Skip to content

Feature/interrupt handler Pranav Khunt#477

Open
pranav6905 wants to merge 4 commits intoDark-Sys-Jenkins:mainfrom
pranav6905:feature/interrupt-handler-pranav
Open

Feature/interrupt handler Pranav Khunt#477
pranav6905 wants to merge 4 commits intoDark-Sys-Jenkins:mainfrom
pranav6905:feature/interrupt-handler-pranav

Conversation

@pranav6905
Copy link

Pranav Khunt
Video Link: Demo

🚀 Intelligent Interruption Gating for LiveKit Voice Agents

Summary

This PR implements an intelligent interruption gating system that prevents LiveKit voice agents from stopping on passive backchanneling (e.g., "yeah", "ok", "hmm") while maintaining immediate responsiveness to meaningful user interruptions.

Key Changes

  • Implemented is_filler_speech() NLP function to distinguish backchannels from real interruptions
  • Added double-hook protection in _interrupt_by_audio_activity and on_end_of_turn to prevent false triggers
  • Environment-based configuration with customizable IGNORE_WORDS list for scalability
  • Real-time transcript analysis with punctuation removal and case normalization
  • Blocked agent pause/stop on filler words while preserving interruption on meaningful speech

Result

  • Smooth, uninterrupted agent responses during user acknowledgements
  • No hiccups or restarts when users say "okay", "yeah", "mhm"
  • Production-ready architecture with locale/language extensibility
  • Natural, human-like conversation flow

This implementation directly addresses the "Hiccup Problem" and delivers a seamless voice AI experience aligned with production standards.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant