Data eXplore : Data Science, ML, Big Data, LLMs and AI Security: “🎧 Fish Audio S2 Pro is a powerful open-source model for speech synthe…”

🎧 Fish Audio S2 Pro is a powerful open-source model for speech synthesis

This is a 4B + 400M parameter TTS model with an unusual Dual-AR architecture, trained on 10+ million hours of audio and supporting 80+ languages.

🟢 What makes it interesting?

🏗 Dual-AR architecture

The model is divided into two parts:

• 4B Slow AR is responsible for the semantics and structure of speech
• 400M Fast AR generates 9 residual codebooks for acoustics

This approach allows to maintain high sound quality without a heavy load on inference.

🎭 Free control of emotions and intonation

You can directly set the style of speech in the text:

[whisper]
[laughing]
[professional broadcast tone]

15,000+ tags are supported, which work at the level of individual words.

🌐 80+ languages

The main high-quality languages:

• English
• Chinese
• Japanese

⚡ Optimization for LLM infrastructure

The model natively works with the SGLang stack, so it supports:

• continuous batching
• paged KV cache
• RadixAttention prefix caching

📊 Performance

• RTF: 0.195 on Nvidia H200
• ~100 ms to the first audio
• more than 3000 acoustic tokens/sec

Developers released: Model weights, code on GitHub for fine-tuning, Engine for streaming inference.

#AI #TTS
••••••••••••••••••••••••••••••••••••••
🤖 Data & ML | @DataXplore