Close Menu
    Facebook X (Twitter) Instagram
    • Privacy Policy
    • Terms Of Service
    • Social Media Disclaimer
    • DMCA Compliance
    • Anti-Spam Policy
    Facebook X (Twitter) Instagram
    Stack Vision AI
    • Home
    • Crypto News
      • Bitcoin
      • Ethereum
      • Altcoins
      • Blockchain
      • DeFi
    • AI News
    • Stock News
    • Learn
      • AI for Beginners
      • AI Tips
      • Make Money with AI
    • Reviews
    • Tools
      • Best AI Tools
      • Crypto Market Cap List
      • Stock Market Overview
      • Market Heatmap
    • Contact
    Stack Vision AI
    Home»AI News»Mistral AI Releases Voxtral 3: Speech-to-Text, TTS and a Voice Agent SDK
    Mistral AI Releases Voxtral 3: Speech-to-Text, TTS and a Voice Agent SDK
    AI News

    Mistral AI Releases Voxtral 3: Speech-to-Text, TTS and a Voice Agent SDK

    October 21, 20264 Mins Read
    Share
    Facebook Twitter LinkedIn Pinterest Email
    binance


    Mistral AI just released Voxtral 3. Mistral Voxtral 3 is a speech model family paired with a voice agent SDK. It ships 3 transcription models, 1 text-to-speech model and an SDK built on LiveKit. One place for listening, reasoning, tool calls and speaking. All 4 models are in public preview on the Mistral API.

    TL;DR

    • Size: Voxtral Mini Transcribe 3 has 4B parameters. Small Transcribe 3 size: not disclosed. Both batch models list a 32k context.
    • Runs on: Mistral API (EU, US and global endpoints) or your own infrastructure via Mistral sales. GPU and VRAM needs: not disclosed. Mistral says Mini suits resource-constrained environments.
    • Performance: Top 3 on independent speech-to-text rankings, strongest on diarization and multilingual batch transcription.
    • Best: 2.1% AA-WER for Small Transcribe 3, #3 on Artificial Analysis.
    • Worst: Realtime at 240 ms: 7.4% WER on FLEURS 35, vs 4.2% for Gemini 3.5 Realtime.

    What is in the Voxtral 3 family?

    Mistral lists 4 models and 1 SDK:

    All transcription models support diarization and context biasing. Context biasing takes key terms or free text to improve recall. Batch transcription covers 50 languages, including 24 official EU languages.

    How does the Voxtral voice agent SDK work?

    The SDK is built on LiveKit and runs 3 stages as 1 streaming pipeline. Realtime Transcribe 3 listens and detects when the caller stops speaking. A general LLM, such as Mistral Small 4, reasons and calls tools. Voxtral Speech 3 replies in the tone of the conversation so far.

    10web

    Each turn completes in under 1 second. The agent stops talking when the caller cuts in. It handles phone calls over SIP and browser or app sessions over WebRTC. Because each stage is a separate model, teams can swap the LLM, voice or language.

    How accurate is Voxtral Transcribe 3?

    These numbers are self-reported by Mistral:

    • FLEURS 45 (WER, forced / inferred language): Small 4.1% / 4.0%. MAI-Transcribe-2 ties at 4.1% / 4.0%. Mini 4.6% / 4.5%. Whisper large-v3 16.0% / 14.9%.
    • Diarization (cpWER, 5 public sets): Small 18.4% and Mini 18.6%. Pyannote scores 19.0% and MAI-Transcribe-2 20.3%.
    • Keyphrase recall (Earnings 22): Small 94.6% with context, 81.4% without. Scribe v2 posts 94.3% and 84.0%.

    On Artificial Analysis, Small scores 2.1% AA-WER and Mini 2.2%. Only Fun-Realtime-ASR-preview (1.7%) and MAI-Transcribe-2 (2.0%) rank higher. Speed is the gap: Small’s speed factor is 65.8x, against 307.5x for MAI-Transcribe-2.

    How do realtime transcription and TTS compare?

    On FLEURS 35, the realtime model trades latency for accuracy. It scores 5.7% WER at 2,400 ms and 6.4% at 480 ms. At 240 ms, WER rises to 7.4%. Gemini 3.5 Realtime Transcribe scores 4.2% and MAI-Transcribe-2 Streaming 5.8%. GPT Live Transcribe (8.4%) and Scribe v2 Realtime (8.7%) trail every Voxtral setting.

    Voxtral Speech 3 costs $13 per 1M characters. Mistral says that undercuts OpenAI TTS-1, Deepgram, ElevenLabs Flash and Gemini Flash. Explicit controls cover emotion, pacing and emphasis. The model page lists ~90 ms time-to-first-audio and 34 emotion tags. Pro Voice adapts a speaker’s style from 30 minutes of audio. Artificial Analysis places it in the top 12 of both TTS arenas.

    Voxtral 3 vs MAI-Transcribe-2, Scribe v2 and Gemini 3.5 Transcribe

    How much does Voxtral 3 cost, and where can you run it?

    Per Mistral’s price table:

    • Voxtral Mini Transcribe 3 (batch): $0.0035/min
    • Voxtral Small Transcribe 3: $0.004/min
    • Voxtral Mini Transcribe Realtime 3: $0.008/min
    • Voxtral Speech 3 (batch and realtime): $13 per 1M characters
    • Voice agent API: $0.04/min with Mistral Small 4, $0.08/min with any other reasoning model

    The models run on Mistral’s European, US and global endpoints. OpenRouter also lists all 3 new models with EU-hosted, zero-data-retention endpoints.

    Key Takeaways

    • Voxtral 3 bundles 3 ASR models, 1 TTS model and a LiveKit voice agent SDK.
    • Small Transcribe 3 hits 2.1% AA-WER, #3 on Artificial Analysis.
    • Best-in-chart diarization: 18.4% cpWER, ahead of Pyannote and MAI-Transcribe-2.
    • Batch transcription costs $0.0035 to $0.004 per minute; TTS costs $13 per 1M characters.
    • Realtime accuracy trails Gemini 3.5 Realtime, and no open weights were announced.

    Check out the Voxtral 3 announcement, the audio docs and the model pages. All credit goes to the researcher of this project. Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well.

    Asif Razzaq is the CEO of Marktechpost AI Media Inc.. As a visionary entrepreneur and engineer, Asif is committed to harnessing the potential of Artificial Intelligence for social good. His most recent endeavor is the launch of an Artificial Intelligence Media Platform, Marktechpost, which stands out for its in-depth coverage of machine learning and deep learning news that is both technically sound and easily understandable by a wide audience. The platform boasts of over 2 million monthly views, illustrating its popularity among audiences.



    Source link

    bybit
    Share. Facebook Twitter Pinterest LinkedIn Tumblr Email
    CryptoExpert
    • Website

    Related Posts

    Samaya AI Releases Sterling: A 3B-Active Finance Research Agent Model that Beats Claude Fable 5.1 on FrontierFinance at 11x Lower Cost

    October 30, 2026

    OpenAI Urges California to Tighten AI Law After Hugging Face Hack

    October 29, 2026

    Making machines that can listen | MIT News

    October 28, 2026

    vLLM Semantic Router Releases d3-ultra: A 27B Open Multimodal Decision Model

    October 27, 2026
    Add A Comment
    Leave A Reply Cancel Reply

    binance
    Latest Posts

    Ripple Unveils Robinhood, BNY and C2FO Deals at Swell 2026

    October 30, 2026

    Federal Reserve approves Bank of Nova Scotia application

    October 30, 2026

    Stellar Launches Cross-Chain Messaging With Ethereum Through VIA Labs

    October 29, 2026

    Grant Cardone Bets $1 Million on Bitcoin’s Comeback

    October 29, 2026

    OpenAI Urges California to Tighten AI Law After Hugging Face Hack

    October 29, 2026
    aistudios
    LEGAL INFORMATION
    • Privacy Policy
    • Terms Of Service
    • Social Media Disclaimer
    • DMCA Compliance
    • Anti-Spam Policy
    Top Insights

    Samaya AI Releases Sterling: A 3B-Active Finance Research Agent Model that Beats Claude Fable 5.1 on FrontierFinance at 11x Lower Cost

    October 30, 2026

    How I Earned $17,839 From Clipping in 14 Days Using AI

    October 30, 2026
    livechat
    Facebook X (Twitter) Instagram Pinterest
    © 2026 StackVisionAI.com - All rights reserved.

    Type above and press Enter to search. Press Esc to cancel.