IBM AI Releases Granite 4.0 1B Speech as a Compact Multilingual Speech Model for Edge AI and Translation Pipelines

IBM has released

Granite 4.0 1B Speech

, a compact

speech-language model

designed for

multilingual automatic speech recognition (ASR)

and

bidirectional automatic speech translation (AST)

. The release targets enterprise and edge-style speech deployments where memory footprint, latency, and compute efficiency matter as much as raw benchmark quality.

What Changed in Granite 4.0 1B Speech

At the center of the release is a straightforward design goal: reduce model size without dropping the core capabilities expected from a modern multilingual speech system. Granite 4.0 1B Speech has

half the number of parameters of granite-speech-3.3-2b

, while adding

Japanese ASR

,

keyword list biasing

, and improved English transcription accuracy. The model provides faster inference through

better encoder training and speculative decoding

. That makes the release less about pushing model scale upward and more about tightening the efficiency-quality tradeoff for practical deployment.

Training Approach and Modality Alignment

Granite-4.0-1b-speech

is a

compact and efficient speech-language model

trained for multilingual ASR and bidirectional AST. The training mix includes public ASR and AST corpora along with synthetic data used to support

Japanese ASR

,

keyword-biased ASR

, and speech translation. This is an important detail for devs because it shows IBM’s team did not build a separate closed speech stack from scratch; it adapted a Granite 4.0 base language model into a speech-capable model through alignment and multimodal training.

Language Coverage and Intended Use

The supported language set includes

English, French, German, Spanish, Portuguese, and Japanese

. IBM positions the model for

speech-to-text

and

speech translation to and from English

for those languages. It also support for

English-to-Italian

and

English-to-Mandarin

translation scenarios. The model is released under the

Apache 2.0

license, which makes it more straightforward for teams evaluating open deployment options compared with speech systems that carry commercial restrictions or API-only access patterns.

Two-Pass Design and Pipeline Structure

IBM’s Granite Speech Team describes the Granite Speech family as using a

two-pass design

. In that setup, an initial call transcribes audio into text, and any downstream language-model reasoning over the transcript requires a second explicit call to the Granite language model. That differs from integrated architectures that combine speech and language generation into a single pass. For developers, this matters because it affects orchestration. A transcription pipeline built around Granite Speech is modular by design: speech recognition comes first, and language-level post-processing is a separate step.

Benchmark Results and Efficiency Positioning

Granite 4.0 1B Speech recently ranked


#1 on the OpenASR leaderboard


. The Open ASR leaderboard row states with an

Average WER of 5.52

and

RTFx of 280.02

, alongside dataset-specific WER values such as

1.42 on LibriSpeech Clean

,

2.85 on LibriSpeech Other

,

3.89 on SPGISpeech

,

3.1 on Tedlium

, and

5.84 on VoxPopuli

.

Deployment Details

For deployment,

Granite 4.0 1B Speech

is supported natively in


transformers>=4.52.1


and can be served through

vLLM

, giving teams both standard Python inference and API-style serving options. IBM’s reference

transformers

flow uses

AutoModelForSpeechSeq2Seq

and

AutoProcessor

, expects

mono 16 kHz audio

, and formats requests by prepending


<|audio|>


to the user prompt; keyword biasing can be added directly in the prompt as

Keywords: <kw1>, <kw2> ...

. For lower-resource environments, IBM’s vLLM example sets


max_model_len=2048


and


limit_mm_per_prompt={"audio": 1}


, while online serving can be exposed through

vllm serve

with an OpenAI-compatible API interface.

Key Takeaways

1. 
   
   Granite 4.0 1B Speech
   
   is a compact
   
   speech-language model
   
   for multilingual
   
   ASR
   
   and bidirectional
   
   AST
   
   .
   


2. 
   The model has
   
   half the parameters of granite-speech-3.3-2b
   
   while improving deployment efficiency.
   


3. 
   The release adds
   
   Japanese ASR
   
   and
   
   keyword list biasing
   
   for more targeted transcription workflows.
   


4. 
   It supports deployment through
   
   Transformers, vLLM, and mlx-audio
   
   , including Apple Silicon environments.
   


5. 
   The model is positioned for
   
   resource-constrained devices
   
   where latency, memory, and compute cost are critical.
   

Check out


Model Page


,


Repo


and


Technical details

.

Also, feel free to follow us on



Twitter



and don’t forget to join our


120k+ ML SubReddit


and Subscribe to


our Newsletter


. Wait! are you on telegram?


now you can join us on telegram as well.