Google Gemma 4 26B A4B Instruct
About this model
Gemma 4 26B A4B Instruct is an open-weight, instruction-tuned model from Google DeepMind, released in April 2026 as part of the Gemma 4 family. Unlike its dense siblings, it uses a Mixture-of-Experts design: of its roughly 26 billion total parameters, only about 4 billion activate per token, so all weights load into memory while inference stays fast. Google describes it as running almost as quickly as a 4B dense model.
Compared to same-family predecessors, this model advances on several fronts. Where the earlier Google Gemma 3 27B Instruct used a dense architecture, Gemma 4 introduces MoE variants alongside dense ones, plus built-in configurable reasoning modes and video input. Its context window reaches 256K tokens, and multilingual coverage spans over 140 languages.
Within Gemma 4 itself, the 26B A4B is positioned as the throughput-optimized counterpart to the dense Google Gemma 4 31B Instruct. Sparse activation reduces compute per token relative to the dense 31B while aiming for comparable quality.
Both target consumer GPUs and workstations. It supports text, image, and video input natively, with audio featured on the smaller family members rather than this size. Its listed capabilities include reasoning, vision, function calling, and web search, offered as an open-weight, multilingual option.
This About section is AI-generated from public sources (Claude Opus 4.8), with no human editing. It may contain inaccuracies — verify critical details against the sources listed above.
Research & Papers
Primary reference paper for this model family, sourced from the HuggingFace model card.
Data sources: Venice API · HuggingFace · Wikipedia · arXiv — enrichment updated 4d ago