↓ Skip to main content

Performance

A Realtime Voice Bot on One Mac, and Why the Third Call Breaks It

A Realtime Voice Bot on One Mac, and Why the Third Call Breaks It

AICC answers calls with anything that speaks the OpenAI Realtime protocol. In the first post in this series that meant a hosted model, or Cascade Realtime Gateway, which runs ASR → LLM → TTS behind the protocol but still calls hosted providers for each stage. The question this post answers: can one Mac run the whole cascade itself, every model local, and still answer inside the deadlines AICC’s client enforces?
What One 4-vCPU FreeSBC Carries

What One 4-vCPU FreeSBC Carries

·11 mins
The first post in this series ended with a promise: FreeSBC’s capacity numbers would get their own post, with the setup next to them. Here they are. On one 4 vCPU cloud VM, FreeSBC v0.5.0 relayed 5000 concurrent G.711 calls with both media legs anchored, set up 3500 calls per second from a carrier without loss, added less than 1 ms to call setup, and ran 8 hours at 3500 concurrent calls with no growth in goroutines, memory, file descriptors or ports.