Models Datasets Spaces Buckets new Docs Enterprise Pricing Website Tasks HuggingChat Collections Languages Organizations Community Blog Posts Daily Papers Hardware Learn Discord Forum GitHub Solutions Team & Enterprise Hugging Face PRO Enterprise Support Inference Providers Inference Endpoints Storage Buckets --[0--> --]--> Back to Articles a]:hidden"> Granite Switch 4.1: Chat, Decisions, and Speech from One Endpoint Enterprise Article Published October 15, 2026 Upvote 63 +57 Kate Soule katesoule Follow ibm-granite Subhajit Chaudhury subhajit1412 Follow ibm-granite Hendrik Strobelt hen Follow ibm-granite Luis A Lastras GrizleeBer Follow ibm-granite :last-child]:mb-0"> Granite Libraries: The OG Decision Models Compose and Extend Your Own Granite Switch Model Accessible from anywhere Resources for Getting Started Introduced last spring, the Granite Switch project enables a modular approach to model development. Now Granite Switch 4.1 models, armed with a Decision adapter and the fastest ASR model on the OpenASR leaderboard, can move efficiently between natural-language responses, general and specialized decisions, and speech-to-text tasks—all from one hosted endpoint.
What happened
Now Granite Switch 4. 1 models, armed with a Decision adapter and the fastest ASR model on the OpenASR leaderboard, can move efficiently between natural-language responses, general and specialized decisions, and speech-to-text tasks—all from one hosted endpoint.
Where the sources line up
And because the Switch adapters were built as cache-efficient Activated LoRAs , the KV cache created from a base model generation can be reused for any subsequent adapter-based decisions. Combined with our team's recent vLLM contributions to speed up low rank adapter inferencing, as well as a co-located ASR encoder, Granite Switch 4. 1 models can switch between a chat request and a decision request and a spoken request, with blazing fast speeds.
Practical impact for readers
Check out our Speech-to-Decisions HF space where granite-switch-4. 1-8b transcribes audio, generates summaries, screens for harmful content, and tests 15 other user-defined flags—all running on a single endpoint in real time.
Who should pay attention now
Granite Libraries: The OG Decision Models Decision models aren’t new. Our previous release of Granite Libraries features a repository of specialized “decision model” adapters and other specialized task adapters that can be composed into custom Granite Switch models. And while Jev and other closed decision models focus on generality, we’ve found that many of our specialized granitelib adapters can outperform generalists on specialized classification tasks.
What is still unclear
Granite Libraries: The OG Decision Models Decision models aren’t new. Our previous release of Granite Libraries features a repository of specialized “decision model” adapters and other specialized task adapters that can be composed into custom Granite Switch models. And while Jev and other closed decision models focus on generality, we’ve found that many of our specialized granitelib adapters can outperform generalists on specialized classification tasks.
Latest comments
0No comments yet. You can start the conversation.