<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>WebRTC on Rason Yang</title><link>https://rasonyang.dev/tags/webrtc/</link><description>Recent content in WebRTC on Rason Yang</description><generator>Hugo -- gohugo.io</generator><language>en-US</language><copyright>© 2026 Rason Yang</copyright><atom:link href="https://rasonyang.dev/tags/webrtc/index.xml" rel="self" type="application/rss+xml"/><item><title>An AI-Native Call Center in Four Open-Source Projects</title><link>https://rasonyang.dev/posts/ai-native-call-center-in-four-projects/</link><pubDate>Mon, 12 Oct 2026 10:54:49 +0800</pubDate><guid>https://rasonyang.dev/posts/ai-native-call-center-in-four-projects/</guid><description>&lt;p&gt;Call a support line and the call usually goes like this. A recording reads&#10;you a menu. You press 3, then 1, then 0 because nothing fits. You wait in a&#10;queue. An agent picks up and asks for the order number you already keyed&#10;into the menu.&lt;/p&gt;&#10;&lt;p&gt;Behind that call there is more pain, just not the caller&amp;rsquo;s:&lt;/p&gt;&#10;&lt;ul&gt;&#10;&lt;li&gt;The agent&amp;rsquo;s desktop softphone has to be installed, configured and kept&#10;registered. When a laptop sleeps, the agent is silently unreachable.&lt;/li&gt;&#10;&lt;li&gt;The PBX is either on the public internet, where it is scanned all night,&#10;or behind a session border controller that costs real money.&lt;/li&gt;&#10;&lt;li&gt;If a voice bot has been bolted onto the front, it is wired to one vendor&amp;rsquo;s&#10;API, and it hands the caller to a person with none of what was said.&lt;/li&gt;&#10;&lt;/ul&gt;&#10;&lt;p&gt;Each of those pains sits on a different boundary of the call path: the&#10;public edge, the switch, the model, and the agent&amp;rsquo;s browser. I built one&#10;open-source project per boundary. This post is the map; later posts take&#10;one problem at a time.&lt;/p&gt;&#10;&lt;p&gt;&lt;figure&gt;&lt;img&#10; class="my-0 rounded-md"&#10; loading="lazy"&#10; decoding="async"&#10; fetchpriority="low"&#10; alt="Architecture: callers and agent browsers reach FreeSBC; FreeSWITCH and AICC sit on the private network; AICC talks the Realtime protocol to a hosted model or to Cascade Realtime Gateway"&#10; src="https://rasonyang.dev/posts/ai-native-call-center-in-four-projects/stack.svg"&#10; &gt;&lt;/figure&gt;&#10;&lt;/p&gt;&#10;&#10;&lt;h2 class="relative group"&gt;One call, end to end&#10; &lt;div id="one-call-end-to-end" class="anchor"&gt;&lt;/div&gt;&#10; &#10; &lt;span&#10; class="absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none"&gt;&#10; &lt;a class="text-primary-300 dark:text-neutral-700 !no-underline" href="#one-call-end-to-end" aria-label="Anchor"&gt;#&lt;/a&gt;&#10; &lt;/span&gt;&#10; &#10;&lt;/h2&gt;&#10;&lt;ol&gt;&#10;&lt;li&gt;A caller dials in. The carrier&amp;rsquo;s SIP reaches &lt;strong&gt;FreeSBC&lt;/strong&gt;, the only host&#10;with a public address, and FreeSBC relays it to FreeSWITCH on a private&#10;network.&lt;/li&gt;&#10;&lt;li&gt;FreeSWITCH hands the call to &lt;strong&gt;AICC&lt;/strong&gt;, which answers it with a realtime&#10;voice model. AICC speaks the OpenAI Realtime protocol, either to a hosted&#10;model (OpenAI, Qwen, Doubao, Gemini) or to &lt;strong&gt;Cascade Realtime Gateway&lt;/strong&gt;,&#10;which runs ASR → LLM → TTS behind the same protocol.&lt;/li&gt;&#10;&lt;li&gt;The model talks; a flow decides the phase and when a person is needed.&#10;When one is, AICC moves the caller into a &lt;code&gt;mod_callcenter&lt;/code&gt; queue together&#10;with a summary of the conversation so far.&lt;/li&gt;&#10;&lt;li&gt;An agent&amp;rsquo;s phone rings. The phone is &lt;strong&gt;Web SIP Phone&lt;/strong&gt;, a Chrome&#10;extension whose audio reaches FreeSWITCH through FreeSBC over WSS and&#10;DTLS-SRTP. The agent answers in the AICC web app; the extension has no&#10;answer button.&lt;/li&gt;&#10;&lt;li&gt;When the call ends, the bot phase, the queue wait and the agent&amp;rsquo;s part&#10;are one record.&lt;/li&gt;&#10;&lt;/ol&gt;&#10;&#10;&lt;h2 class="relative group"&gt;The edge: FreeSBC&#10; &lt;div id="the-edge-freesbc" class="anchor"&gt;&lt;/div&gt;&#10; &#10; &lt;span&#10; class="absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none"&gt;&#10; &lt;a class="text-primary-300 dark:text-neutral-700 !no-underline" href="#the-edge-freesbc" aria-label="Anchor"&gt;#&lt;/a&gt;&#10; &lt;/span&gt;&#10; &#10;&lt;/h2&gt;&#10;&lt;p&gt;&lt;strong&gt;The pain.&lt;/strong&gt; A SIP server with a public address gets found by scanners&#10;and brute-forced, around the clock. Commercial SBCs fix that for a price. The&#10;open-source route usually means assembling a SIP proxy, a separate media&#10;relay and their configuration, which is a lot to own for one switch.&lt;/p&gt;&#10;&lt;p&gt;&lt;strong&gt;The project.&lt;/strong&gt; FreeSBC&amp;rsquo;s pitch is &amp;ldquo;the Caddy experience:&#10;&lt;a href="https://github.com/rasonyang/freesbc/blob/8bbc4e6ddb9ce752d14c64fa7362145a303ead99/README.md#L3" target="_blank" rel="noreferrer"&gt;one binary, one YAML file, &lt;code&gt;./freesbc run&lt;/code&gt;&lt;/a&gt;&amp;rdquo;. It is the only&#10;element with a public address; FreeSWITCH or Asterisk&#10;&lt;a href="https://github.com/rasonyang/freesbc/blob/8bbc4e6ddb9ce752d14c64fa7362145a303ead99/README.md#L8" target="_blank" rel="noreferrer"&gt;stays on a private LAN and only ever talks to FreeSBC&lt;/a&gt;. It is a&#10;&lt;a href="https://github.com/rasonyang/freesbc/blob/8bbc4e6ddb9ce752d14c64fa7362145a303ead99/docs/design.md#L14-L20" target="_blank" rel="noreferrer"&gt;stateful SIP proxy, not a B2BUA&lt;/a&gt;, and it terminates ICE-Lite,&#10;DTLS-SRTP and RTCP-mux for browsers so the switch&#10;&lt;a href="https://github.com/rasonyang/freesbc/blob/8bbc4e6ddb9ce752d14c64fa7362145a303ead99/README.md#L115" target="_blank" rel="noreferrer"&gt;only sees plain RTP&lt;/a&gt;. The front door has&#10;&lt;a href="https://github.com/rasonyang/freesbc/blob/8bbc4e6ddb9ce752d14c64fa7362145a303ead99/README.md#L106" target="_blank" rel="noreferrer"&gt;per-IP rate limits and scanner fingerprinting&lt;/a&gt;, and an INVITE&#10;is &lt;a href="https://github.com/rasonyang/freesbc/blob/8bbc4e6ddb9ce752d14c64fa7362145a303ead99/docs/edge.md#L47" target="_blank" rel="noreferrer"&gt;admitted only from the exact transport address of a live registration,&#10;or from a carrier&lt;/a&gt;.&lt;/p&gt;&#10;&lt;p&gt;&lt;strong&gt;The boundary.&lt;/strong&gt; A feature belongs in FreeSBC only if&#10;&lt;a href="https://github.com/rasonyang/freesbc/blob/8bbc4e6ddb9ce752d14c64fa7362145a303ead99/README.md#L144-L156" target="_blank" rel="noreferrer"&gt;only the edge can see or do it&lt;/a&gt;. CPS limits, toll-fraud rules&#10;and CDRs stay on the switch, which already does them well. That rule had a&#10;cost: the whole trunk/B2BUA plane was&#10;&lt;a href="https://github.com/rasonyang/freesbc/commit/c363f6e52afb5ca2ececcccac3a4879b792e8875" target="_blank" rel="noreferrer"&gt;deleted on 2026-10-02&lt;/a&gt; because it failed the test. The same&#10;discipline gives topology hiding by construction:&#10;&lt;a href="https://github.com/rasonyang/freesbc/blob/8bbc4e6ddb9ce752d14c64fa7362145a303ead99/README.md#L105" target="_blank" rel="noreferrer"&gt;every SDP body is built by FreeSBC, never copied from the other leg&lt;/a&gt;.&lt;/p&gt;&#10;&lt;p&gt;&lt;strong&gt;Not done yet.&lt;/strong&gt; Client legs are&#10;&lt;a href="https://github.com/rasonyang/freesbc/blob/8bbc4e6ddb9ce752d14c64fa7362145a303ead99/docs/edge.md#L218" target="_blank" rel="noreferrer"&gt;not fully topology-hidden&lt;/a&gt; (issues #166 and #167),&#10;&lt;a href="https://github.com/rasonyang/freesbc/blob/8bbc4e6ddb9ce752d14c64fa7362145a303ead99/docs/edge.md#L230" target="_blank" rel="noreferrer"&gt;IPv6 is untested&lt;/a&gt;, and there is&#10;&lt;a href="https://github.com/rasonyang/freesbc/blob/8bbc4e6ddb9ce752d14c64fa7362145a303ead99/README.md#L173" target="_blank" rel="noreferrer"&gt;no TURN or full ICE&lt;/a&gt;.&lt;/p&gt;&#10;&#10;&lt;h2 class="relative group"&gt;The switch and the call: AICC&#10; &lt;div id="the-switch-and-the-call-aicc" class="anchor"&gt;&lt;/div&gt;&#10; &#10; &lt;span&#10; class="absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none"&gt;&#10; &lt;a class="text-primary-300 dark:text-neutral-700 !no-underline" href="#the-switch-and-the-call-aicc" aria-label="Anchor"&gt;#&lt;/a&gt;&#10; &lt;/span&gt;&#10; &#10;&lt;/h2&gt;&#10;&lt;p&gt;&lt;strong&gt;The pain.&lt;/strong&gt; DTMF menus. Callers repeating themselves after a transfer.&#10;One call split into an IVR log, a queue log and a recording. Dialplans&#10;spread across XML files.&lt;/p&gt;&#10;&lt;p&gt;&lt;strong&gt;The project.&lt;/strong&gt; AICC is&#10;&amp;ldquo;&lt;a href="https://github.com/rasonyang/ai-native-callcenter/blob/86ec6e1d05be5dfdcd06d92a1b675a659a3fd76a/README.md#L3" target="_blank" rel="noreferrer"&gt;an open-source call center where the AI is the default answer, not an add-on&lt;/a&gt;&amp;rdquo;.&#10;There is &lt;a href="https://github.com/rasonyang/ai-native-callcenter/blob/86ec6e1d05be5dfdcd06d92a1b675a659a3fd76a/docs/phase1-decisions.md#L12" target="_blank" rel="noreferrer"&gt;no DTMF IVR&lt;/a&gt;: every external number answers with a bot&#10;flow. &amp;ldquo;&lt;a href="https://github.com/rasonyang/ai-native-callcenter/blob/86ec6e1d05be5dfdcd06d92a1b675a659a3fd76a/README.md#L45-L46" target="_blank" rel="noreferrer"&gt;The model owns the dialogue; the flow owns the phase.&lt;/a&gt;&amp;rdquo;&lt;/p&gt;&#10;&lt;p&gt;The handoff is a tool call. &lt;code&gt;transfer_to_agent&lt;/code&gt;&#10;&lt;a href="https://github.com/rasonyang/ai-native-callcenter/blob/86ec6e1d05be5dfdcd06d92a1b675a659a3fd76a/internal/flow/builtin.go#L213-L222" target="_blank" rel="noreferrer"&gt;requires a queue, a reason and a summary&lt;/a&gt;, plus any slots&#10;collected so far. The agent&amp;rsquo;s screen-pop arrives as a &lt;code&gt;PARTY_RINGING&lt;/code&gt; event&#10;over SSE, and the bot-phase transcript is&#10;&lt;a href="https://github.com/rasonyang/ai-native-callcenter/blob/86ec6e1d05be5dfdcd06d92a1b675a659a3fd76a/README.md#L55-L59" target="_blank" rel="noreferrer"&gt;already there, because the call id is minted before any leg exists&lt;/a&gt;.&#10;The result is &lt;a href="https://github.com/rasonyang/ai-native-callcenter/blob/86ec6e1d05be5dfdcd06d92a1b675a659a3fd76a/README.md#L68-L70" target="_blank" rel="noreferrer"&gt;one CDR with one transcript and one recording&lt;/a&gt;,&#10;not three fragments.&lt;/p&gt;&#10;&lt;p&gt;On the switch side, FreeSWITCH&#10;&lt;a href="https://github.com/rasonyang/ai-native-callcenter/blob/86ec6e1d05be5dfdcd06d92a1b675a659a3fd76a/README.md#L98-L102" target="_blank" rel="noreferrer"&gt;reads its directory and its queues from PostgreSQL through Lua&lt;/a&gt;,&#10;so adding an extension, a queue or a number is a database change. The&#10;whole thing is &lt;a href="https://github.com/rasonyang/ai-native-callcenter/blob/86ec6e1d05be5dfdcd06d92a1b675a659a3fd76a/README.md#L12-L13" target="_blank" rel="noreferrer"&gt;one Go binary plus PostgreSQL and FreeSWITCH&lt;/a&gt;.&lt;/p&gt;&#10;&lt;p&gt;&lt;strong&gt;The boundary.&lt;/strong&gt; A deployment runs&#10;&lt;a href="https://github.com/rasonyang/ai-native-callcenter/blob/86ec6e1d05be5dfdcd06d92a1b675a659a3fd76a/internal/provider/profile.go#L392-L394" target="_blank" rel="noreferrer"&gt;exactly one provider, chosen at startup&lt;/a&gt;, and a cascaded&#10;ASR + LLM + TTS pipeline&#10;&lt;a href="https://github.com/rasonyang/ai-native-callcenter/blob/86ec6e1d05be5dfdcd06d92a1b675a659a3fd76a/README.md#L157-L160" target="_blank" rel="noreferrer"&gt;never enters this repository&lt;/a&gt;. Anything that speaks the Realtime&#10;protocol can be plugged in instead, which is why the next project exists.&lt;/p&gt;&#10;&lt;p&gt;A taste of what this layer has to get right:&#10;&amp;ldquo;&lt;a href="https://github.com/rasonyang/ai-native-callcenter/blob/86ec6e1d05be5dfdcd06d92a1b675a659a3fd76a/CLAUDE.md#L124" target="_blank" rel="noreferrer"&gt;Turn end ≠ playback end.&lt;/a&gt;&amp;rdquo; The model finishing a response is&#10;not the caller having heard it, so a transfer or a hangup&#10;&lt;a href="https://github.com/rasonyang/ai-native-callcenter/blob/86ec6e1d05be5dfdcd06d92a1b675a659a3fd76a/docs/design/02-ai-voice.md#L166" target="_blank" rel="noreferrer"&gt;waits for the audio to drain&lt;/a&gt;. That gets its own post.&lt;/p&gt;&#10;&#10;&lt;h2 class="relative group"&gt;The model: Cascade Realtime Gateway&#10; &lt;div id="the-model-cascade-realtime-gateway" class="anchor"&gt;&lt;/div&gt;&#10; &#10; &lt;span&#10; class="absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none"&gt;&#10; &lt;a class="text-primary-300 dark:text-neutral-700 !no-underline" href="#the-model-cascade-realtime-gateway" aria-label="Anchor"&gt;#&lt;/a&gt;&#10; &lt;/span&gt;&#10; &#10;&lt;/h2&gt;&#10;&lt;p&gt;&lt;strong&gt;The pain.&lt;/strong&gt; Speech-to-speech models are the easy path, but they tie you&#10;to one vendor&amp;rsquo;s voices, languages, regions and prices. Building your own&#10;pipeline looks easy too, and isn&amp;rsquo;t. In Cascade&amp;rsquo;s README:&#10;&amp;ldquo;&lt;a href="https://github.com/rasonyang/cascade-realtime-gateway/blob/74127be2f982b11552d6115b07585815e484d313/README.md#L25-L37" target="_blank" rel="noreferrer"&gt;Wiring ASR → LLM → TTS together takes an afternoon. The rest of a voice agent is what takes months&lt;/a&gt;&amp;rdquo;:&#10;turn detection, barge-in, context after an interrupt, streaming, races, and&#10;a stable client protocol.&lt;/p&gt;&#10;&lt;p&gt;&lt;strong&gt;The project.&lt;/strong&gt; Cascade&#10;&lt;a href="https://github.com/rasonyang/cascade-realtime-gateway/blob/74127be2f982b11552d6115b07585815e484d313/README.md#L3-L4" target="_blank" rel="noreferrer"&gt;speaks the OpenAI Realtime (GA) WebSocket protocol to clients and runs a cascaded ASR → LLM → TTS pipeline behind it&lt;/a&gt;.&#10;The backend is a &lt;a href="https://github.com/rasonyang/cascade-realtime-gateway/blob/74127be2f982b11552d6115b07585815e484d313/README.md#L44-L45" target="_blank" rel="noreferrer"&gt;named profile, changed at runtime through an Admin API&lt;/a&gt;;&#10;new calls pick up the change and calls in progress don&amp;rsquo;t notice. Providers&#10;today are &lt;a href="https://github.com/rasonyang/cascade-realtime-gateway/blob/74127be2f982b11552d6115b07585815e484d313/README.md#L156-L161" target="_blank" rel="noreferrer"&gt;Deepgram, OpenAI and Qwen&lt;/a&gt;. Tools are declared by&#10;the client and executed by the client, and a tool call&#10;&lt;a href="https://github.com/rasonyang/cascade-realtime-gateway/blob/74127be2f982b11552d6115b07585815e484d313/internal/session/pipeline.go#L89-L90" target="_blank" rel="noreferrer"&gt;is never handed to TTS&lt;/a&gt;, so the caller never hears JSON.&lt;/p&gt;&#10;&lt;p&gt;One number shows why &amp;ldquo;context after an interrupt&amp;rdquo; is on that list. In one&#10;measured barge-in,&#10;&lt;a href="https://github.com/rasonyang/cascade-realtime-gateway/blob/74127be2f982b11552d6115b07585815e484d313/docs/decisions.md#L80" target="_blank" rel="noreferrer"&gt;10260 ms of audio had been generated and the caller had heard 2740 ms&lt;/a&gt;.&#10;Without trimming, 117 characters the caller never heard would have entered&#10;the next turn&amp;rsquo;s context.&lt;/p&gt;&#10;&lt;p&gt;On latency, the gateway itself&#10;&lt;a href="https://github.com/rasonyang/cascade-realtime-gateway/blob/74127be2f982b11552d6115b07585815e484d313/docs/qwen-latency.md#L154-L157" target="_blank" rel="noreferrer"&gt;adds 0.6 ms&lt;/a&gt; between the provider&amp;rsquo;s first audio frame and&#10;the client&amp;rsquo;s. End of user speech to first playable audio was&#10;&lt;a href="https://github.com/rasonyang/cascade-realtime-gateway/blob/74127be2f982b11552d6115b07585815e484d313/docs/qwen-latency.md#L28-L36" target="_blank" rel="noreferrer"&gt;p50 1223 ms&lt;/a&gt; on 2026-09-01, measured from a machine in China&#10;against a dedicated Qwen deployment over 20 turns; 391 ms of that is the&#10;500 ms VAD silence window doing its job.&lt;/p&gt;&#10;&lt;p&gt;&lt;strong&gt;The boundary.&lt;/strong&gt; Cascade &lt;a href="https://github.com/rasonyang/cascade-realtime-gateway/blob/74127be2f982b11552d6115b07585815e484d313/README.md#L107-L119" target="_blank" rel="noreferrer"&gt;does not speak SIP or G.711&lt;/a&gt;; audio is&#10;24 kHz PCM in and out. The telephone side is AICC&amp;rsquo;s job, which is why AICC&#10;&lt;a href="https://github.com/rasonyang/ai-native-callcenter/blob/86ec6e1d05be5dfdcd06d92a1b675a659a3fd76a/internal/provider/profile.go#L248-L254" target="_blank" rel="noreferrer"&gt;resamples 8 kHz to 24 kHz and back&lt;/a&gt; when it talks to the&#10;gateway. Cascade is also single-node:&#10;&lt;a href="https://github.com/rasonyang/cascade-realtime-gateway/blob/74127be2f982b11552d6115b07585815e484d313/README.md#L65" target="_blank" rel="noreferrer"&gt;one static API key, no clustering, no persistence&lt;/a&gt;.&lt;/p&gt;&#10;&#10;&lt;h2 class="relative group"&gt;The agent&amp;rsquo;s ear: Web SIP Phone&#10; &lt;div id="the-agents-ear-web-sip-phone" class="anchor"&gt;&lt;/div&gt;&#10; &#10; &lt;span&#10; class="absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none"&gt;&#10; &lt;a class="text-primary-300 dark:text-neutral-700 !no-underline" href="#the-agents-ear-web-sip-phone" aria-label="Anchor"&gt;#&lt;/a&gt;&#10; &lt;/span&gt;&#10; &#10;&lt;/h2&gt;&#10;&lt;p&gt;&lt;strong&gt;The pain.&lt;/strong&gt; A desktop softphone is one more thing to install and support.&#10;A browser softphone tab has its own failures: refresh the page and the call&#10;drops; close the laptop lid and the agent stays &amp;ldquo;available&amp;rdquo; while being&#10;unreachable.&lt;/p&gt;&#10;&lt;p&gt;&lt;strong&gt;The project.&lt;/strong&gt; Web SIP Phone is a Chrome extension, and&#10;&amp;ldquo;&lt;a href="https://github.com/rasonyang/web-sip-phone/blob/fdb1c2c2f856609762fa6894fb1f3bb407f19cd0/README.md#L22-L26" target="_blank" rel="noreferrer"&gt;it is &lt;strong&gt;not&lt;/strong&gt; a softphone&lt;/a&gt;&amp;rdquo;: all call control comes from the SIP&#10;server, and the page&amp;rsquo;s own softphone bar owns every call-facing button. Its&#10;one job is to keep one agent&amp;rsquo;s WebRTC SIP leg registered and healthy:&lt;/p&gt;&#10;&lt;ul&gt;&#10;&lt;li&gt;The SIP runtime lives in an offscreen document, so&#10;&lt;a href="https://github.com/rasonyang/web-sip-phone/blob/fdb1c2c2f856609762fa6894fb1f3bb407f19cd0/README.md#L284-L291" target="_blank" rel="noreferrer"&gt;refreshing the page mid-call does not interrupt audio or change the Call-ID&lt;/a&gt;.&#10;That was &lt;a href="https://github.com/rasonyang/web-sip-phone/blob/fdb1c2c2f856609762fa6894fb1f3bb407f19cd0/docs/FREESWITCH.md#L168" target="_blank" rel="noreferrer"&gt;checked live against FreeSWITCH on 2026-09-02&lt;/a&gt;.&lt;/li&gt;&#10;&lt;li&gt;A &lt;a href="https://github.com/rasonyang/web-sip-phone/blob/fdb1c2c2f856609762fa6894fb1f3bb407f19cd0/src/offscreen/offscreen.ts#L35-L48" target="_blank" rel="noreferrer"&gt;10-second heartbeat&lt;/a&gt; notices a gap of more than 90 seconds,&#10;which means the machine slept, and forces a reconnect.&lt;/li&gt;&#10;&lt;li&gt;With AICC, &lt;a href="https://github.com/rasonyang/ai-native-callcenter/blob/86ec6e1d05be5dfdcd06d92a1b675a659a3fd76a/docs/web-sip-phone-protocol.md#L5-L6" target="_blank" rel="noreferrer"&gt;nobody configures it&lt;/a&gt;. Signing in mints SIP&#10;credentials and the web app hands them to the extension, as&#10;&lt;a href="https://github.com/rasonyang/web-sip-phone/blob/fdb1c2c2f856609762fa6894fb1f3bb407f19cd0/README.md#L184-L186" target="_blank" rel="noreferrer"&gt;a digest hash, never a plaintext password&lt;/a&gt;.&lt;/li&gt;&#10;&lt;/ul&gt;&#10;&#10;&lt;h2 class="relative group"&gt;Where each pain is handled&#10; &lt;div id="where-each-pain-is-handled" class="anchor"&gt;&lt;/div&gt;&#10; &#10; &lt;span&#10; class="absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none"&gt;&#10; &lt;a class="text-primary-300 dark:text-neutral-700 !no-underline" href="#where-each-pain-is-handled" aria-label="Anchor"&gt;#&lt;/a&gt;&#10; &lt;/span&gt;&#10; &#10;&lt;/h2&gt;&#10;&lt;table&gt;&#10;&#9;&lt;thead&gt;&#10;&#9;&#9;&#9;&lt;tr&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;th&gt;Pain&lt;/th&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;th&gt;Handled by&lt;/th&gt;&#10;&#9;&#9;&#9;&lt;/tr&gt;&#10;&#9;&lt;/thead&gt;&#10;&#9;&lt;tbody&gt;&#10;&#9;&#9;&#9;&lt;tr&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;PBX exposed to scanners and toll fraud&lt;/td&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;FreeSBC&lt;/td&gt;&#10;&#9;&#9;&#9;&lt;/tr&gt;&#10;&#9;&#9;&#9;&lt;tr&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;One-way audio and dropped calls behind NAT&lt;/td&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;FreeSBC&lt;/td&gt;&#10;&#9;&#9;&#9;&lt;/tr&gt;&#10;&#9;&#9;&#9;&lt;tr&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;Browsers (WebRTC) talking to a plain-RTP switch&lt;/td&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;FreeSBC&lt;/td&gt;&#10;&#9;&#9;&#9;&lt;/tr&gt;&#10;&#9;&#9;&#9;&lt;tr&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;DTMF menus&lt;/td&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;AICC&lt;/td&gt;&#10;&#9;&#9;&#9;&lt;/tr&gt;&#10;&#9;&#9;&#9;&lt;tr&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;Callers repeating themselves after a transfer&lt;/td&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;AICC&lt;/td&gt;&#10;&#9;&#9;&#9;&lt;/tr&gt;&#10;&#9;&#9;&#9;&lt;tr&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;One call, three fragmented records&lt;/td&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;AICC&lt;/td&gt;&#10;&#9;&#9;&#9;&lt;/tr&gt;&#10;&#9;&#9;&#9;&lt;tr&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;Dialplan and queue config sprawl&lt;/td&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;AICC&lt;/td&gt;&#10;&#9;&#9;&#9;&lt;/tr&gt;&#10;&#9;&#9;&#9;&lt;tr&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;Locked into one speech-to-speech vendor&lt;/td&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;Cascade Realtime Gateway&lt;/td&gt;&#10;&#9;&#9;&#9;&lt;/tr&gt;&#10;&#9;&#9;&#9;&lt;tr&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;Barge-in, turn detection and context after an interrupt&lt;/td&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;Cascade and AICC&lt;/td&gt;&#10;&#9;&#9;&#9;&lt;/tr&gt;&#10;&#9;&#9;&#9;&lt;tr&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;Installing and supporting desktop softphones&lt;/td&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;Web SIP Phone&lt;/td&gt;&#10;&#9;&#9;&#9;&lt;/tr&gt;&#10;&#9;&#9;&#9;&lt;tr&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;Agents dropping off on refresh, sleep or Wi-Fi changes&lt;/td&gt;&#10;&#9;&#9;&#9;&#9;&#9;&lt;td&gt;Web SIP Phone&lt;/td&gt;&#10;&#9;&#9;&#9;&lt;/tr&gt;&#10;&#9;&lt;/tbody&gt;&#10;&lt;/table&gt;&#10;&#10;&lt;h2 class="relative group"&gt;Why four repositories&#10; &lt;div id="why-four-repositories" class="anchor"&gt;&lt;/div&gt;&#10; &#10; &lt;span&#10; class="absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none"&gt;&#10; &lt;a class="text-primary-300 dark:text-neutral-700 !no-underline" href="#why-four-repositories" aria-label="Anchor"&gt;#&lt;/a&gt;&#10; &lt;/span&gt;&#10; &#10;&lt;/h2&gt;&#10;&lt;p&gt;Each project has a written rule about what it refuses to do. FreeSBC&#10;leaves anything the switch can do to the switch. AICC keeps the cascaded&#10;pipeline out. Web SIP Phone&amp;rsquo;s spec says&#10;&amp;ldquo;&lt;a href="https://github.com/rasonyang/web-sip-phone/blob/fdb1c2c2f856609762fa6894fb1f3bb407f19cd0/design.md#L19" target="_blank" rel="noreferrer"&gt;do not add a dial pad, contacts, call history, a CTI API&lt;/a&gt;&amp;rdquo;.&#10;Cascade does not do telephony.&lt;/p&gt;&#10;&lt;p&gt;Those refusals make the pieces usable on their own. FreeSBC can front any&#10;FreeSWITCH or Asterisk. Cascade can serve any Realtime client. AICC runs&#10;fine with a hosted model and no Cascade. The joints between them are&#10;ordinary protocols: SIP and RTP, the OpenAI Realtime protocol, and a small&#10;&lt;code&gt;postMessage&lt;/code&gt; protocol between a web page and an extension.&lt;/p&gt;&#10;&#10;&lt;h2 class="relative group"&gt;What I am not claiming yet&#10; &lt;div id="what-i-am-not-claiming-yet" class="anchor"&gt;&lt;/div&gt;&#10; &#10; &lt;span&#10; class="absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none"&gt;&#10; &lt;a class="text-primary-300 dark:text-neutral-700 !no-underline" href="#what-i-am-not-claiming-yet" aria-label="Anchor"&gt;#&lt;/a&gt;&#10; &lt;/span&gt;&#10; &#10;&lt;/h2&gt;&#10;&lt;p&gt;AICC&#10;&lt;a href="https://github.com/rasonyang/ai-native-callcenter/blob/86ec6e1d05be5dfdcd06d92a1b675a659a3fd76a/docs/load-tests.md#L7-L8" target="_blank" rel="noreferrer"&gt;publishes no performance figures&lt;/a&gt;, because its load tests&#10;have not run. FreeSBC&amp;rsquo;s capacity numbers are&#10;&lt;a href="https://github.com/rasonyang/freesbc/blob/8bbc4e6ddb9ce752d14c64fa7362145a303ead99/docs/performance.md#L3-L5" target="_blank" rel="noreferrer"&gt;explicitly preliminary&lt;/a&gt;, and&#10;&lt;a href="https://github.com/rasonyang/freesbc/blob/8bbc4e6ddb9ce752d14c64fa7362145a303ead99/docs/performance.md#L19" target="_blank" rel="noreferrer"&gt;there has been no run against FreeSWITCH&lt;/a&gt;. Everything here&#10;is single-node. When those numbers exist, they will get their own posts,&#10;with the setup next to them.&lt;/p&gt;&#10;&#10;&lt;h2 class="relative group"&gt;Coming up&#10; &lt;div id="coming-up" class="anchor"&gt;&lt;/div&gt;&#10; &#10; &lt;span&#10; class="absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none"&gt;&#10; &lt;a class="text-primary-300 dark:text-neutral-700 !no-underline" href="#coming-up" aria-label="Anchor"&gt;#&lt;/a&gt;&#10; &lt;/span&gt;&#10; &#10;&lt;/h2&gt;&#10;&lt;ul&gt;&#10;&lt;li&gt;Turn end is not playback end: why a bot cuts off its own goodbye&lt;/li&gt;&#10;&lt;li&gt;Barge-in is a truncation problem&lt;/li&gt;&#10;&lt;li&gt;One whitespace cut Qwen TTS first audio from 1.05 s to 0.25 s&lt;/li&gt;&#10;&lt;li&gt;Keeping a browser phone registered through sleep, Wi-Fi changes and F5&lt;/li&gt;&#10;&lt;li&gt;Why FreeSBC is a proxy and not a B2BUA&lt;/li&gt;&#10;&lt;/ul&gt;&#10;&lt;p&gt;Code: &lt;a href="https://github.com/rasonyang/ai-native-callcenter" target="_blank" rel="noreferrer"&gt;AICC&lt;/a&gt; · &lt;a href="https://github.com/rasonyang/freesbc" target="_blank" rel="noreferrer"&gt;FreeSBC&lt;/a&gt; · &lt;a href="https://github.com/rasonyang/cascade-realtime-gateway" target="_blank" rel="noreferrer"&gt;Cascade Realtime Gateway&lt;/a&gt; · &lt;a href="https://github.com/rasonyang/web-sip-phone" target="_blank" rel="noreferrer"&gt;Web SIP Phone&lt;/a&gt;&lt;/p&gt;&#10;</description><media:content xmlns:media="http://search.yahoo.com/mrss/" url="https://rasonyang.dev/posts/ai-native-call-center-in-four-projects/featured.jpg"/></item></channel></rss>