Voice Adaptive Role & Intent Orchestratorv1.0-prod

One Voice Assistant Brain. Pluggable Roles for Every Department.

Eliminate repetitive transactional queries across HR, IT Support, and Admissions. VARIO unifies browser-native voice and text with a reusable, role-adaptive orchestration core and modular backend adapters.

Latency
< 180ms
Web Speech STT
Isolation
100%
Rasa per-role NLU
Role Packs
3 Modules
HR · IT · Admissions
Extensibility
0 Redeploy
Declarative adapters
Live Orchestration Simulation
VOICE / TEXT INPUT
Web Speech Active
"What is my remaining paid annual leave balance?"
Role PackHR Self-Service
Intent Classifiedhr_leave_balance (98.6%)
Backend Adapter
HRMSAdapter.get_leave_balance(user_id="EMP-1042")
ASSISTANT RESPONSE~140ms

You currently have 14 days of annual leave and 4 days of casual leave remaining for this cycle.

Google Cloud TTS · Neural2 (en-US-Neural2-F)
Project Overview

A Shared Conversational Brain Without the Silos

Organizations face hundreds of repetitive, transactional queries daily. VARIO solves this by coupling a shared dialogue routing engine with pluggable departmental packs and swappable backend adapters.

Core Framework

What VARIO Is

A Role-Specific Voice Assistant Framework designed for organizations and institutions. VARIO unifies conversational voice and text through a reusable, central orchestration engine, eliminating the need to build and maintain separate, siloed chatbots for each department.

Architecture
Modular Core
Engine Stack
FastAPI + Rasa
Deployment
Docker Ready
TRADITIONAL SILOED MODELHigh Drift & Redundancy
HR Bot · IT Bot · Admission Bot3x Duplicated Engines
VARIO UNIFIED PARADIGMSingle Central Brain
Core RuntimeFastAPI Gateway + Rasa Core
OrchestrationContext & Role Aware
Isolation Policy100% Zero Namespace Drift
Multimodal

Dual Voice & Text Interaction

Built for hands-free and multimodal workflows. Uses browser-native Web Speech API for low-latency Speech-to-Text (STT) and Google Cloud Text-to-Speech (Neural2) for audio responses, with instant, seamless fallback to text chat.

Web Speech STT
Neural2 TTS
Context-Aware

Role-Aware Enterprise Orchestration

Different departments have distinct vocabularies, slots, and validation policies. Role-aware orchestration isolates intent models so HR, IT, and Admissions never cross-contaminate each other while maintaining state across multi-turn workflows.

HR Space|IT Support|Admissions
Config-Driven

Modular & Extensible by Design

Easily extensible for new organizational entities (Finance, Facilities, Student Affairs). New role packs can be registered via configuration data in under one developer-day without touching or redeploying core engine code.

role_pack: "finance_v1"
adapter: "ERPAdapter.get_invoice"
status: "registered_active"
System Workflow

How VARIO Works

From the initial spoken sentence to enterprise fulfillment: a deterministic, role-isolated conversational loop.

01

User

Employee / Student / Applicant

The user begins a session via web browser, expressing a transactional query or workflow intent.

02

Voice / Text

Multimodal Input Layer

Web Speech API transcribes spoken speech into text; typed text passes through with instant latency.

03

Intent + Context

Gateway & Session Manager

FastAPI Gateway validates auth/envelope; Session Manager restores active form, step, and slots from PostgreSQL.

04

Role-aware Orchestration

Core Dialogue Router

The Dialogue Router evaluates conversation role context and routes the utterance to the designated department engine.

05

Role Pack

Isolated Rasa NLU Runtime

Domain-isolated Rasa instance extracts entities, classifies intent, and manages multi-turn slot policies.

06

Enterprise Service

Integration Adapter Layer

Standardized adapter executes the transactional operation against mock or production enterprise backends.

07

Response

Renderer & Neural TTS

Response Renderer selects a paraphrased template variant, Google Cloud TTS synthesizes audio, and response returns.

Core Capabilities

Key Capabilities

Architected specifically for organizational reliability, departmental independence, and rapid customization.

Domain Isolation

Role-Aware Interaction

Prevents intent pollution by isolating training namespaces per department. Vocabulary and actions specific to HR never conflict with IT Support or Admissions intents.

Hands-Free Speech

Voice and Text Interaction

Dual-modality conversational interface. Hands-free voice speech via Web Speech API and Google Cloud Neural2 speech synthesis, with immediate fallback to chat text.

Stateful Forms

Multi-Turn Workflows

Guides users step-by-step through slot collection, partial forms, and explicit confirmation safeguards before firing destructive or record-altering operations.

Out-of-the-Box

HR, IT Support & Admissions Packs

Pre-configured role modules handling high-volume operational queries: leave balances and requests, IT incident ticketing and password resets, and applicant tracking.

Swappable Backends

Enterprise Service Adapters

Decoupled integration adapter layer shielding conversational models from backend implementations. Transition from mock services to production HRMS/ITSM with zero core rewrites.

Zero Redeploy

Extensible Architecture

Add new organizational roles (Finance, Facilities, Student Affairs) purely through declarative configuration data in under 1 developer-day without core redeployments.

Apache-2.0

Open-Source Development

Built openly under the Apache License 2.0 with reproducible Docker Compose setups, comprehensive test suites, and strict architectural documentation.

System Design

Architecture Overview

A modular, multi-tier system engineered with clear boundaries between user presentation, dialogue orchestration, and backend enterprise integrations.

Browser NativeLAYER 01

Frontend Client

Next.js 14 · React · Tailwind CSS

Interactive web client supporting text chat, hands-free talk mode via Web Speech API, and a role-scoped administrative console.

Interface:Web Speech API · SSE
Auth & EnvelopeLAYER 02

API Gateway

FastAPI Single Entrypoint

Validates identity tokens, enforces client rate limits, and standardizes all responses into an auditable {status, data, error} envelope.

Interface:REST / HTTPS · JWT
Multi-Turn CoreLAYER 03

Core Orchestration

Session Manager · Dialogue Router · Renderer

Coordinates state across turns. Restores session form slots from Postgres, routes utterances to the target role, and renders randomized template variants.

Interface:Stateful Routing Machine
Zero DriftLAYER 04

Role Packs

3x Isolated Rasa Open Source Instances

Dedicated departmental NLU classifiers for HR, IT Support, and Admissions, eliminating vocabulary overlap and model drift.

Interface:Isolated Rasa NLU Port
DecoupledLAYER 05

Integration Adapters

AuthAdapter · HRMS · ITSM · Admissions

Standardized translation layer isolating core dialogue logic from enterprise backend schema nuances.

Interface:Python RPC Adapters
High FidelityLAYER 06

Mock Enterprise Services

Isolated FastAPI Microservices

Self-contained mock systems replicating production HRMS leave engines, ITSM ticket workflows, and student information systems.

Interface:Internal REST Endpoints
ACID Audit LogLAYER 07

PostgreSQL Database

Authoritative Single Source of Truth

Durable persistence for conversations, session slots, intent configurations, template variants, and append-only audit logs.

Interface:asyncpg · Strict Schemas

Enterprise Privacy & Decoupling: The architecture preserves user privacy by maintaining strict boundary contracts. Session data is persisted with configurable time-to-live (TTL), administrative actions require scoped credentials, and destructive record changes always require explicit user confirmation.

Domain Applications

Enterprise Use Cases

Three pre-configured role domains handling transactional self-service workflows with complete domain isolation.

HR Role Pack

HR Self-Service

Employee Workflows & Policy FAQs

Eliminates back-and-forth HR emails by resolving employee transactional queries directly through conversational voice and chat.

Sample Voice Query
"What is my remaining paid annual leave balance?"
Leave Balance Inquiries

Fetches sick, casual, and annual leave accruals directly via the HRMS adapter in natural language.

Guided Leave Application

Step-by-step slot collection for leave type, date range, and reason with explicit confirmation and reference ID generation.

Curated Policy FAQs

Answers questions on parental leave, remote work guidelines, healthcare benefits, and company policies.

IT Support Pack

IT Support

Incident Management & Service Desk

Reduces service desk queues by automating routine ticket creation, incident status lookups, and account access procedures.

Sample Voice Query
"I cannot log in to VPN and need my password reset"
Automated Ticket Creation

Gathers issue description, auto-categorizes (Hardware, Software, Network), and returns an ITSM ticket ID.

Ticket Status Tracking

Allows employees to query open ticket status, assigned technician, and latest notes using their ticket reference number.

Guided Password Reset

Safely guides employees through identity verification and password reset while preventing duplicate tickets.

Admissions Pack

Admissions

Student & Applicant Services

Assists prospective students and applicants with high-frequency enrollment status, document requirements, and deadline questions.

Sample Voice Query
"Check application status for ID #ADM-8291"
Application Status Lookup

Prospective students query admission status by application ID with real-time department review notes.

Program Document Checklists

Dynamic document verification checklists tailored to undergraduate, postgraduate, and international programs.

Fee Deadlines & Schedules

Pulls fee schedules and critical cutoff dates from the admissions calendar with graceful guidance on invalid queries.

Apache License 2.0

Open Source & Community Driven

VARIO is an open-source research and engineering framework released under the permissive Apache License 2.0. Designed for transparency, extensibility, and auditability in organizational deployments.

$git clone https://github.com/V-A-R-I-O/vario.git

PES University · Jackfruit Mini-Project · UE24CS341A Software Engineering

Developed by Team PIPELINE (Project ID 42)

Launch Application