<?xml version="1.0" encoding="utf-8"?>
<rss version="2.0">
<channel>
<title>Coder Legion - Recent posts tagged voiceai</title>
<link>https://coderlegion.com/tag/voiceai</link>
<description>Powered by Question2Answer</description>
<item>
<title>Presto Reported 95% of Drive-Thru Orders Done Without Intervention. It Only Counted Restaurant Staff</title>
<link>https://coderlegion.com/30237/presto-reported-drive-thru-orders-done-without-intervention-only-counted-restaurant-staff</link>
<description>&lt;blockquote&gt;&lt;p&gt;Originally published at &lt;a rel=&quot;nofollow&quot; href=&quot;https://vibeagentmaking.com/blog/presto-95-percent-without-intervention-counted-restaurant-staff/&quot;&gt;vibeagentmaking.com&lt;/a&gt;.&lt;/p&gt;
&lt;/blockquote&gt;
&lt;p&gt;&lt;em&gt;Two SEC documents, read paragraph by paragraph: a settled order against a drive-thru voice AI company and a pending complaint against a shopping-app founder. Both rates were computed; both left the humans doing the work outside the count.&lt;/em&gt;&lt;/p&gt;
&lt;hr&gt;
&lt;p&gt;There is a sentence on page seven of an SEC order from January 2025 that I have not been able to put down. It concerns Presto Automation, a company that sold voice ordering to drive-thrus, and it describes the number Presto put in front of investors for two years. The order says Presto's reported &quot;automated order completion&quot; and &quot;non-intervention&quot; rates &quot;referred to rates at which drive-thru orders were completed without restaurant staff involvement (but not without any human involvement).&quot;&lt;/p&gt;
&lt;p&gt;Read it twice. The rate was real. Orders really were completed, at the rate stated, without anyone in the restaurant touching them. The people who completed them were sitting in the Philippines and India, on Presto's contract, typing what the customer had said into the order screen. They were not restaurant staff, so they were not counted. The percentage was arithmetically defensible and false at the same time, and the whole difference sat inside the word &quot;intervention&quot;.&lt;/p&gt;
&lt;p&gt;I want to walk through that document and one other, a complaint the SEC filed three months later against the founder of a shopping app called Nate, because the two of them describe the same trick from two directions, and because the numbers they describe (automation rate, non-intervention rate, containment rate, whatever a vendor calls it this quarter) are the numbers anyone buying an AI agent is being quoted right now. The press calls cases like these AI washing; the label is useful for finding them and useless for checking them, which is what the documents are for. I have no 2026 vendor's claim open in front of me and I am not going to imply one. What I have is two regulator documents, each with paragraph numbers, and a question they teach you to ask. (For a third regulator document read the same way, see &lt;a rel=&quot;nofollow&quot; href=&quot;https://vibeagentmaking.com/blog/ftc-18-million-judgment-air-ai-pays-50000/&quot;&gt;the FTC's $18,000,000 judgment against Air AI&lt;/a&gt;, where the order itself explains why the company pays $50,000.)&lt;/p&gt;
&lt;p&gt;One note on register before the details. The Presto document is a settled order. Presto consented to it without admitting or denying the findings, so what follows are the SEC's findings, and I will say &quot;the order states&quot; rather than &quot;Presto admitted&quot;. The Nate document is a complaint in a case that is still open. Its contents are allegations, not proven facts, and I will keep saying so.&lt;/p&gt;
&lt;h3 id=&quot;what-presto-said&quot;&gt;What Presto said&lt;/h3&gt;
&lt;p&gt;The order (Securities Act Release 11352, January 14, 2025) sets out the claims. Investor presentations furnished with four Forms 8-K between January 2022 and January 2023 said Presto Voice achieved &quot;automated order completion&quot; rates of 95% to 99% at its largest customer; the January 2023 deck put the &quot;non-intervention&quot; rate above 95% (paragraph 30). Five registration statements filed between October 2022 and May 2023 said Presto Voice &quot;eliminat[es] human order taking&quot; (paragraph 23). A November 2021 press release described orders taken &quot;via automated speech recognition with over 94% accuracy even in noisy environments&quot; (paragraph 20).&lt;/p&gt;
&lt;p&gt;Those are three different claims and it helps to keep them apart. One is an accuracy figure for speech recognition. One is a completion rate. One is a plain statement that the humans are gone. The order's findings turn on the last two.&lt;/p&gt;
&lt;h3 id=&quot;what-the-rate-measured&quot;&gt;What the rate measured&lt;/h3&gt;
&lt;p&gt;For the original version of Presto's own technology, first deployed in September 2022, the order describes the pipeline: speech became text, and the text was &quot;displayed to human agents that Presto contracted at various off-site locations, including in the Philippines and India&quot;, who entered the order. That version &quot;required human agent intervention, including entering the order, in all instances&quot; and &quot;was not capable of processing orders without it&quot; (paragraph 25). The more advanced version, piloted from June 2023, &quot;required a human agent to enter the orders approximately 70% of the time&quot; from June through at least December 2023 (paragraph 26).&lt;/p&gt;
&lt;p&gt;So at the substantial majority of Presto's own locations, a human entered every order, and at the pilot sites a human entered seven in ten. Meanwhile the number in the decks said 95 and above, and it was not lying about restaurant staff. It was silent about everyone else.&lt;/p&gt;
&lt;p&gt;There is a second layer. From November 2021 to September 2022, every deployed Presto Voice unit ran on a third party's technology, which the order calls Supplier A. The rates Presto reported for that period were Supplier A's rates, which Presto had not independently verified, and the order finds that Presto failed to disclose that the data came from the supplier at all (paragraph 29). During that period, the one place the supplier is named is a January 2022 press release that, in the order's words, &quot;referred to Supplier A only once when it described developing the solution in partnership with Hi Auto&quot; (paragraph 20); Presto's filings called it &quot;our technology&quot;. The order places the disclosure of the supplier's identity in the 10-K of October 11, 2023 (paragraph 36). A reader of the filings at the time could not have known that the 95% was someone else's product measured by someone else.&lt;/p&gt;
&lt;h3 id=&quot;what-presto-s-own-people-wrote&quot;&gt;What Presto's own people wrote&lt;/h3&gt;
&lt;p&gt;The order quotes the company to itself, and the quotes are the part I would put in front of anyone who evaluates vendor metrics for a living.&lt;/p&gt;
&lt;p&gt;On January 20, 2022, one executive wrote to another that &quot;with HITL [humans in the loop], accuracy is not a major concern&quot; and that the product &quot;can even get to 95% or more with humans&quot; (paragraph 27). That is not a confession. It is a product decision, and a reasonable one: keep people in the loop until the model is good enough. The problem is what was said outside.&lt;/p&gt;
&lt;p&gt;In October 2022 a senior executive wrote that the company should not refer to &quot;automation rate with customers because it infers no supervision which isn't true&quot; (paragraph 33). A discussion followed about whether &quot;automated completion rate&quot;, &quot;intervention rate&quot; or some other term was the right one to use with customers. The company understood, in writing, that its own vocabulary implied something the product did not do.&lt;/p&gt;
&lt;p&gt;In January 2023 another executive raised the concern that Presto was &quot;telling investors Presto AI is running 95%+ accuracy without disclosing AI is doing NONE of the work and all orders are processed by humans&quot; (paragraph 33). The capitals are in the order.&lt;/p&gt;
&lt;h3 id=&quot;the-pair-of-numbers-that-settles-it&quot;&gt;The pair of numbers that settles it&lt;/h3&gt;
&lt;p&gt;The cleanest way to see the trick is a single filing. In a Form 8-K of December 14, 2023, as the order describes it, Presto disclosed two things at once: that &quot;human agent intervention was required on 100% of orders at the substantial majority of locations&quot; running the original version, and that its &quot;non-intervention rate across all restaurants powered by Presto's proprietary technology was on average 85%&quot; (paragraph 38).&lt;/p&gt;
&lt;p&gt;Both numbers are about the same restaurants on the same day. One says a human handled everything. The other says a human handled fifteen percent. They do not contradict each other, because they count different humans. The 85% counts the restaurant's staff, who were indeed rarely needed. The 100% counts the people Presto was paying to be the product.&lt;/p&gt;
&lt;p&gt;If you take nothing else from the document, take this: a rate can be exact and still be an answer to a question nobody asked.&lt;/p&gt;
&lt;h3 id=&quot;the-money-and-what-it-cost&quot;&gt;The money, and what it cost&lt;/h3&gt;
&lt;p&gt;Presto raised approximately $55.5 million in a PIPE that closed with its September 2022 business combination, with a net contribution of about $49.8 million (paragraph 15), and approximately $9.5 million in a private placement on May 22, 2023 (paragraph 17). That is $65.0 million raised while the statements were live; the order dates the misstatements from November 2021 to May 2023 (paragraph 1), and both raises fall inside that window. The order does not state a figure for investor losses, so neither will I.&lt;/p&gt;
&lt;p&gt;The corrections came after Presto learned the SEC was looking. The off-site agents were first described in the 10-K of October 11, 2023 (paragraph 37); the &quot;over 70% of orders taken by our Presto Voice solution require human agent intervention&quot; line appeared in a prospectus supplement on November 17, 2023; the 8-K of December 14, 2023 clarified that the 70% referred to the pilot sites and the 100% to everywhere else (paragraph 38).&lt;/p&gt;
&lt;p&gt;Nasdaq suspended trading in Presto's stock on August 8, 2024 and filed a Form 25 to delist it on September 6, 2024 (paragraph 7). The sanction in the order is a cease-and-desist. There is no civil penalty. The order says the Commission &quot;considered Respondent's current financial condition&quot; and &quot;also considered remedial acts undertaken by Respondent and cooperation afforded the Commission staff&quot; (paragraph 48).&lt;/p&gt;
&lt;p&gt;And there is one more finding, which reads like an aside and is not. From September 2022 to December 2024, the order states, &quot;no one at Presto was formally responsible for ensuring that the information disclosed in Presto's Commission filings was accurate&quot; (paragraph 44). The number went out for two years and nobody owned it.&lt;/p&gt;
&lt;h3 id=&quot;nate-the-same-trick-from-the-other-side&quot;&gt;Nate: the same trick, from the other side&lt;/h3&gt;
&lt;p&gt;Nate was a shopping app. Its pitch, quoted in the SEC's complaint against founder Albert Saniger (25 Civ. 2937, S.D.N.Y., filed April 9, 2025), was &quot;the first non-human executive assistant that can buy anything, anywhere&quot; (paragraph 30). Everything below is what the complaint alleges. The case is open, and so is the parallel criminal case filed the same day.&lt;/p&gt;
&lt;p&gt;The complaint's central exchange is worth quoting in full, because the trick happens inside a single answer. In February 2020 an investor's employee asked about Nate's &quot;failure rate today in terms of when a human needs to get involved.&quot; The complaint says Saniger replied, on or about February 28, 2020:&lt;/p&gt;
&lt;blockquote&gt;&lt;p&gt;&quot;If you look at the automation piece only (and forget other things that could make things go wrong like credit card failure or out of stock etc) AND assuming we had a user base that fairly represents the entire world then success ranges from 93% to 97% . . . . However, by looking at our target audiences and the sites that hold the highest concentration, its above 99% success.&quot; (paragraph 37)&lt;/p&gt;
&lt;/blockquote&gt;
&lt;p&gt;The question was when a human is needed. The answer changes the denominator three times before it reaches a number: it restricts the count to &quot;the automation piece&quot;, it excludes the failures that happen in the real world, and it measures over a user base that does not exist. Then it gives 93 to 97. Then, on the sites that matter, 99.&lt;/p&gt;
&lt;p&gt;What the complaint says was true at the time is one sentence: &quot;as of February 2020, virtually all orders placed by Nate's users were manually completed, including by overseas contract workers&quot; (paragraph 39). At the seed round, orders were routed to contractors &quot;primarily located in the Philippines&quot; (paragraph 34). An investor had also been told the average order took &quot;only 10 seconds&quot; (paragraph 32), which the complaint says a manual process could not have met.&lt;/p&gt;
&lt;p&gt;The internal number arrives later and is shorter. According to a June 11, 2021 Slack message from a Nate automation employee to Saniger, the &quot;automation rate&quot; was &quot;essentially zero&quot; (paragraph 57). The Series A, approximately $34 million in shares, closed that same month (paragraph 65).&lt;/p&gt;
&lt;p&gt;Two more allegations belong here because they are what &quot;the rate is real&quot; looks like from inside. The complaint says Saniger &quot;required Nate engineers to be on standby during product demonstrations to potential investors in order to ensure the successful completion of any test purchases&quot; (paragraph 69), and that he gave engineers the email addresses of a &quot;VIP&quot; list of potential investors &quot;so that any orders later placed by those investors could be promptly completed through the manual involvement of Nate workers&quot; (paragraph 70). If those allegations are true, the demo's automation rate was 100% because a person was making it so.&lt;/p&gt;
&lt;p&gt;The complaint also quotes Saniger's own seed deck against the product he later shipped. After the Series A, it alleges, Nate's automation relied on &quot;bots&quot;, a less advanced method than the AI in the pitch (paragraph 58); the seed deck had warned that &quot;[b]ots crash every time the merchant adds a new product to the site, does A/B testing, or makes a permanent change to its design or order flow&quot; (paragraph 60).&lt;/p&gt;
&lt;p&gt;The complaint puts the money at &quot;over $42 million&quot; raised from at least spring 2019 through December 2022 (paragraph 1): two seed wires of $4 million each in March and April 2020 (paragraphs 41 and 42) and the Series A (paragraph 65). It alleges Saniger sold approximately $3 million of his own shares to a Series A investor in June 2021 (paragraph 66). After an article in The Information in June 2022 questioned Nate's use of AI (paragraph 73), the Series B did not close. Nate ceased operations in January 2023 and dissolved through a California Assignment for the Benefit of Creditors, returning nothing to shareholders and &quot;leaving investors with tens of millions of dollars in losses&quot; (paragraphs 75 through 77).&lt;/p&gt;
&lt;p&gt;As of a docket read on September 17, 2026, the civil case and the parallel criminal case both remain open, with a government filing dated January 2026 on the prosecution's docket that I have not read. No plea, trial or outcome is recorded in what I could see, and I am stating none.&lt;/p&gt;
&lt;h3 id=&quot;the-one-question&quot;&gt;The one question&lt;/h3&gt;
&lt;p&gt;Put the two documents side by side and the shape is the same.&lt;/p&gt;
&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;&lt;th&gt;the rate said &lt;/th&gt;&lt;th&gt;what the denominator left out &lt;/th&gt;&lt;th&gt;what the internal record said &lt;/th&gt;&lt;th&gt;&lt;/th&gt;&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;&lt;td&gt;Presto &lt;/td&gt;&lt;td&gt;95 to 99% &quot;automated order completion&quot;; over 95% &quot;non-intervention&quot; &lt;/td&gt;&lt;td&gt;the off-site agents; only restaurant staff counted &lt;/td&gt;&lt;td&gt;&quot;AI is doing NONE of the work&quot;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td&gt;Nate &lt;/td&gt;&lt;td&gt;93 to 97%; &quot;above 99%&quot; on the target sites &lt;/td&gt;&lt;td&gt;everything but &quot;the automation piece&quot;, over a hypothetical user base &lt;/td&gt;&lt;td&gt;&quot;essentially zero&quot;&lt;/td&gt;&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;
&lt;p&gt;Neither number was invented. Each was computed over a definition of &quot;human&quot; that had been quietly narrowed until the humans doing the work fell outside it. Presto narrowed the population. Nate narrowed the event. In both cases the percentage survived contact with the truth because it was never about the thing the reader assumed.&lt;/p&gt;
&lt;p&gt;Which gives you the question, and it is a short one: intervention by whom?&lt;/p&gt;
&lt;p&gt;Every item below is that question in a different coat, and each one is drawn from a paragraph above rather than from general advice.&lt;/p&gt;
&lt;ol&gt;
&lt;li&gt;&lt;p&gt;Ask who counts as a human in this rate. Presto's number was accurate for restaurant staff (paragraph 29).&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Ask what the denominator excludes before you read the percentage. Nate's answer excluded three things before it reached 93 (paragraph 37).&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Ask whether the rate was measured by the vendor or handed to the vendor by its own supplier. Presto passed Supplier A's rates along unverified (paragraph 29).&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Ask whether the demo was staffed. If the complaint is right, Nate's engineers stood by and a VIP list was hand-served (paragraphs 69 and 70).&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Ask who inside the company is responsible for the number being right. At Presto, for two years, the answer was no one (paragraph 44).&lt;/p&gt;
&lt;/li&gt;
&lt;/ol&gt;
&lt;p&gt;Two things this piece is not saying. It is not saying that keeping humans in the loop is deceptive; Presto's own executive treated it as the sensible engineering path (paragraph 27), and it is. It is not saying that any product sold today reports its rate this way; I have no evidence about any of them and I have named none. The violation the SEC found at Presto was the word &quot;eliminates&quot; and a percentage that hid the people who made it true. The allegation against Nate is an answer built to fit a question it did not answer. Those are specific acts, in specific documents, and the reason to read them is that the question they teach costs nothing to ask. The two companies together raised more than $107 million, and at least one investor did ask it, in writing, and was answered with a different denominator (paragraph 37 of the complaint).&lt;/p&gt;
&lt;hr&gt;
&lt;p&gt;&lt;em&gt;Every rate, dollar and time figure in this piece was checked against the two source PDFs by a script published with it, &lt;a rel=&quot;nofollow&quot; href=&quot;https://vibeagentmaking.com/code/figures_c6066.py&quot;&gt;figures_c6066.py&lt;/a&gt;, which extracts each document's text, asserts that each quoted figure is present on the page cited, and prints the derived numbers (the two totals raised, their combined $107.0 million, and the 70% to 30% subtraction). A figure missing from its page fails the run.&lt;/em&gt;&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;Sources:&lt;/strong&gt;&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;&lt;p&gt;SEC Order, In the Matter of Presto Automation Inc., Securities Act Release No. 11352 / Exchange Act Release No. 102177, Admin. Proc. File No. 3-22413, January 14, 2025. Paragraph numbers as cited. &lt;a rel=&quot;nofollow&quot; href=&quot;https://www.sec.gov/files/litigation/admin/2025/33-11352.pdf&quot;&gt;https://www.sec.gov/files/litigation/admin/2025/33-11352.pdf&lt;/a&gt;&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;&lt;p&gt;SEC Complaint, SEC v. Alberto Saniger Mantinan, a/k/a Albert Saniger, 25 Civ. 2937 (S.D.N.Y.), filed April 9, 2025, Document 1. Paragraph numbers as cited. &lt;a rel=&quot;nofollow&quot; href=&quot;https://www.sec.gov/files/litigation/complaints/2025/comp26282.pdf&quot;&gt;https://www.sec.gov/files/litigation/complaints/2025/comp26282.pdf&lt;/a&gt;&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;&lt;p&gt;SEC Litigation Release LR-26282, April 11, 2025 (the Nate complaint's release). &lt;a rel=&quot;nofollow&quot; href=&quot;https://www.sec.gov/enforcement-litigation/litigation-releases/lr-26282&quot;&gt;https://www.sec.gov/enforcement-litigation/litigation-releases/lr-26282&lt;/a&gt;&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;&lt;p&gt;CourtListener RECAP index, S.D.N.Y., dockets 1:25-cv-02937 (SEC v. Mantinan) and 1:25-cr-00157 (United States v. Saniger), read September 17, 2026. &lt;a rel=&quot;nofollow&quot; href=&quot;https://www.courtlistener.com/api/rest/v4/search/?q=%22Saniger%22&amp;amp;type=r&amp;amp;court=nysd&quot;&gt;https://www.courtlistener.com/api/rest/v4/search/?q=%22Saniger%22&amp;amp;type=r&amp;amp;court=nysd&lt;/a&gt;&lt;/p&gt;
&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;&lt;a rel=&quot;nofollow&quot; href=&quot;https://vibeagentmaking.com/blog/&quot;&gt;← Back to blog&lt;/a&gt;&lt;/p&gt;
</description>
<category>Data &amp; AI</category>
<guid isPermaLink="true">https://coderlegion.com/30237/presto-reported-drive-thru-orders-done-without-intervention-only-counted-restaurant-staff</guid>
<pubDate>Thu, 08 Oct 2026 08:08:51 +0000</pubDate>
</item>
<item>
<title>Building Production Voice AI: What 95% Order Containment Actually Takes</title>
<link>https://coderlegion.com/9661/building-production-voice-ai-what-95-order-containment-actually-takes</link>
<description>&lt;p&gt;Most voice AI demos look great. Then you ship to production and discover the system can't handle background noise, interrupts users mid-sentence, or adds latency that kills the experience.&lt;/p&gt;
&lt;p&gt;Deepgram's recent acquisition of OfOne, a platform that achieved 95%+ order containment in actual drive-thru environments, offers insight into what it takes to build voice AI that works in the real world. Not in controlled demos. In production, where people order food with screaming kids in the back seat and truck engines idling.&lt;/p&gt;
&lt;p&gt;Here's what their engineering team learned, and what it means for anyone building with voice AI.&lt;/p&gt;
&lt;h3 id=&quot;the-acoustics-problem-nobody-talks-about&quot;&gt;The Acoustics Problem Nobody Talks About&lt;/h3&gt;
&lt;p&gt;Drive-thru environments are especially hostile to speech recognition. Car engines, wind noise, HVAC systems, multiple voices bleeding into the same microphone, and customers speaking with wildly different accents and speeds. Most legacy speech systems break down because they were never designed for unpredictable, overlapping, multi-source audio.&lt;/p&gt;
&lt;p&gt;The solution isn't better microphones or noise cancellation. It's training models specifically on drive-thru acoustics and continuously adapting them using real operational data. Deepgram's approach couples domain-adapted models with a runtime that hot-swaps them as conditions change.&lt;/p&gt;
&lt;p&gt;The system automatically routes audio to the most appropriate model for current conditions while keeping latency low across thousands of concurrent sessions. Generic ASR models trained on clean audio simply can't handle this level of acoustic chaos.&lt;/p&gt;
&lt;h3 id=&quot;why-interruptions-are-harder-than-you-think&quot;&gt;Why Interruptions Are Harder Than You Think&lt;/h3&gt;
&lt;p&gt;Traditional speech systems treat turn-taking as a separate problem layered on top of recognition. They rely on rules like &quot;if there's silence for X milliseconds, the user is done talking.&quot; This works fine for dictation. It fails completely in conversation.&lt;/p&gt;
&lt;p&gt;People pause mid-sentence. They think out loud. They restart ideas or trail off before finishing. A silence-based system can't tell the difference between &quot;I want a...&quot; (brief pause while thinking) and &quot;I want a hamburger&quot; (done speaking). The result is either premature interruption or awkward delays.&lt;/p&gt;
&lt;p&gt;Flux, Deepgram's conversational speech model, makes turn-taking part of the speech recognition itself. As it transcribes, it evaluates conversational intent using both acoustic signals and language context. Is this a brief pause or the end of a thought? Is the speaker likely to continue or genuinely handing over the turn?&lt;/p&gt;
&lt;p&gt;This lets the system prepare a response early when it detects the speaker might be finished, but immediately resume listening if they continue. Only when Flux is confident the turn has actually ended does it finalize the transcript.&lt;/p&gt;
&lt;p&gt;The technical challenge is that mistakes are costly in both directions. Interrupt too early and you break trust instantly. Wait too long and the interaction feels sluggish and unnatural.&lt;/p&gt;
&lt;h3 id=&quot;the-latency-tax-of-multi-provider-systems&quot;&gt;The Latency Tax of Multi-Provider Systems&lt;/h3&gt;
&lt;p&gt;Deepgram's Voice Agent API targets sub-500 millisecond end-to-end latency, including perception, LLM reasoning, and speech generation. Real-time voice demands perception in under 200 milliseconds and similarly fast time-to-first-audio-byte on generation.&lt;/p&gt;
&lt;p&gt;Building with separate STT, LLM, and TTS providers introduces network hops, buffering delays, and pipeline fragmentation that typically add 1-3 seconds per turn. That's the difference between conversation that feels natural and conversation that makes users interrupt or give up.&lt;/p&gt;
&lt;p&gt;Running the entire pipeline—streaming recognition, turn detection, TTS, and state management—within one runtime optimized for real-time workloads eliminates most of that overhead. This isn't about marginal improvements. It's about whether your voice interface is usable or not.&lt;/p&gt;
&lt;h3 id=&quot;implementation-reality-check&quot;&gt;Implementation Reality Check&lt;/h3&gt;
&lt;p&gt;Most teams can get a proof of concept running within hours using the cloud API. The friction usually appears not in integrating Deepgram, but in surrounding application logic.&lt;/p&gt;
&lt;p&gt;Teams often underestimate what's required to manage conversational state, handle interruptions, or orchestrate backend actions triggered by voice. The ones that struggle are typically trying to adapt existing chatbot or IVR codebases to real-time, turn-based audio. Those architectures assume synchronous, text-only interactions.&lt;/p&gt;
&lt;p&gt;The adjustment isn't about the speech technology. It's about redesigning workflow to account for streaming audio, real-time decision-making, and fallbacks. Once teams make that shift, adoption accelerates quickly.&lt;/p&gt;
&lt;h3 id=&quot;when-self-hosting-makes-sense&quot;&gt;When Self-Hosting Makes Sense&lt;/h3&gt;
&lt;p&gt;Deepgram cloud typically delivers the lowest latency because it runs on optimized GPU clusters. Self-hosted deployments are architecturally identical, but may introduce additional network or hardware constraints.&lt;/p&gt;
&lt;p&gt;Customers choose to self-host for compliance, data sovereignty, or isolation requirements—not for performance. It makes sense when audio must stay on-premises, when strict regional data governance applies, or when private VPC isolation is required at scale.&lt;/p&gt;
&lt;p&gt;Because the Enterprise Runtime automatically distributes and manages models, self-hosting still benefits from the same adaptivity and resource efficiency as the cloud. Just within a controlled customer environment.&lt;/p&gt;
&lt;h3 id=&quot;migration-from-existing-providers&quot;&gt;Migration from Existing Providers&lt;/h3&gt;
&lt;p&gt;Teams using basic STT APIs can typically switch by replacing a single API call and adjusting streaming logic. Deepgram supports open-source models like Whisper in the same runtime, allowing incremental migration—running legacy models during transition while adopting Deepgram models for high-value use cases.&lt;/p&gt;
&lt;p&gt;Significant refactoring only occurs when moving from batch or request-response APIs to fully real-time streaming agents. But that refactor is required regardless of provider. Deepgram tends to reduce complexity because consolidating perception, turn logic, and generation into one platform eliminates large chunks of glue code and multi-provider orchestration.&lt;/p&gt;
&lt;h3 id=&quot;the-domain-adaptation-lesson&quot;&gt;The Domain Adaptation Lesson&lt;/h3&gt;
&lt;p&gt;Generic ASR models don't hold up in noisy, time-compressed environments where accuracy directly affects revenue. Drive-thru performance validated that domain-specific adaptation isn't optional—it's essential.&lt;/p&gt;
&lt;p&gt;This applies equally in healthcare, customer support, and logistics. Models need tuning to specific terminology, acoustic conditions, and conversational patterns for each domain.&lt;/p&gt;
&lt;p&gt;Another key insight: even high-accuracy systems need edge case handling. Deepgram's architecture allows seamless human intervention without collapsing the session. In drive-throughs, back-of-house staff can listen and make real-time corrections, just as they do today. Similar hybrid-supervision models are extending into clinical transcription, appointment scheduling, and contact centers.&lt;/p&gt;
&lt;h3 id=&quot;common-failure-modes&quot;&gt;Common Failure Modes&lt;/h3&gt;
&lt;p&gt;The most common production failures involve overlapping speech, inconsistent turn-taking, unexpected background noise, and user corrections (&quot;actually, change that&quot;). Traditional ASR models are brittle in these scenarios because they assume clear, single-speaker audio.&lt;/p&gt;
&lt;p&gt;Another common failure is latency creep. As teams layer multiple providers, latency quietly inflates until the system feels unresponsive. Running entirely through a single streaming session under one real-time runtime prevents this.&lt;/p&gt;
&lt;p&gt;Scalability failures like traffic spikes, concurrency bursts, inconsistent workloads are handled automatically by model hot-swapping and load distribution algorithms.&lt;/p&gt;
&lt;h3 id=&quot;what-this-means-for-developers&quot;&gt;What This Means for Developers&lt;/h3&gt;
&lt;p&gt;Voice AI is moving from demos to production. The technical challenges aren't about recognition accuracy in clean audio anymore. They're about handling acoustic chaos, managing natural conversation flow, and maintaining sub-500ms latency under real-world conditions.&lt;/p&gt;
&lt;p&gt;The gap between systems that work in demos and systems that work in production is domain-specific adaptation, conversational awareness, and architectural integration. Building with separate providers for each component introduces latency and complexity that breaks the user experience.&lt;/p&gt;
&lt;p&gt;Teams shipping production voice AI need to think about acoustics, turn-taking, and latency from the start. Not as problems to solve later.&lt;/p&gt;
</description>
<category>Articles</category>
<guid isPermaLink="true">https://coderlegion.com/9661/building-production-voice-ai-what-95-order-containment-actually-takes</guid>
<pubDate>Tue, 13 Jan 2026 18:05:32 +0000</pubDate>
</item>
</channel>
</rss>