← All projects

Call Ms. Beth

Real-Time Voice AI Assistant

Voice AI backend powering two caller-facing apps

About the project

A Django backend for an AI assistant that speaks with callers over the phone. Twilio handles calls while Django Channels streams audio to and from OpenAI Realtime. The assistant handles interruptions and searches the web for current information, with concise spoken answers that identify sources when available.

Highlights

  • Streamed live, bidirectional phone audio between Twilio Media Streams and OpenAI Realtime, with interruption-aware call controls.
  • Added live web search through the OpenAI Responses API for current questions, including news, trends, and exchange rates.
  • Managed subscription-based caller access, NMI billing and plan changes, usage tracking, subscription history, and per-call summaries.
  • Added caller-requested follow-up emails with recipient confirmation; Celery and Redis process summaries and email in the background.

Technology

  • Python
  • Django
  • Django REST Framework
  • Django Channels
  • OpenAI Realtime
  • OpenAI Responses
  • Twilio
  • Celery
  • Redis
  • PostgreSQL/PostGIS
  • NMI
  • Docker Compose

Live projects