Tag

#cpu-inference

Posts tagged with cpu-inference

2 posts

Steerable text to speech lets an LLM voice agent adjust pitch, rate, and loudness numerically mid-conversation.

Tools • Oct 19, 2026 •12 min read

SteerTTS Review, a Prosody Control Plane for Voice Agents

SteerTTS review: does z-score prosody control work as the control plane for LLM voice agents? Latency math, CPU feasibility, and a steerability harness.

#steertts #text-to-speech +4

Speculative decoding turns idle CPU compute into nearly four times faster token generation for large language model inference.

Engineering • Aug 24, 2026 •11 min read

Why Speculative Decoding Pays Nearly 4x on CPUs

Speculative decoding turns idle CPU cores into 4x faster LLM generation. Learn why it works, when gains collapse, and when CPU beats GPU or API.

#speculative-decoding #cpu-inference +3