Google Gemma 4
Google's open-weight family in five sizes, 2B effective up to 31B dense, text and image in with audio on the smaller ones, 256K context and Apache 2.0 weights since April 2026.
Overview
Gemma 4 landed on 2 April 2026 in five sizes. E2B and E4B are the tiny ones, quoted at 2.3B and 4.5B effective parameters and aimed at phones and embedded hardware. Then a 12B unified model, a 26B A4B sparse mixture-of-experts that activates roughly 3.8B parameters per token and a 31B dense at the top. Everything takes text and images. E2B, E4B and 12B also take audio, covering speech recognition and speech translation. Context runs 128K on the two small models and 256K from the 12B up, with over 140 languages supported.
The licence change is what separates this generation from the last three. Gemma 1 through 3n shipped under the Gemma Terms of Use with a Prohibited Use Policy that Google could revise on its own, an obligation to pass those restrictions down to anyone using your derivative and a widely disputed reading under which models trained on Gemma-generated synthetic data fell inside Gemma's terms. Gemma 4 drops all of it for plain Apache 2.0. Earlier Gemma models and the specialised variants stay on the old terms, so check which generation a checkpoint comes from before you build on it.
For a working engineer the appeal is coverage. One family spans a 2B that runs on a handset and a 31B that runs on a workstation, with the same tokeniser family and prompt conventions, plus purpose-built siblings for embeddings, safety classification, translation and function calling. Deployment is well trodden: llama.cpp, Ollama, vLLM, MLX and LM Studio all took it on release, and thirteen hosted providers serve it if you want an endpoint instead. The gap is transparency. Google publishes weights and a model card, not the corpus or the training pipeline.
Key Features
- ✓ Five sizes: E2B at 2.3B effective and E4B at 4.5B for phones and edge, a 12B unified model, a 26B A4B sparse MoE with 3.8B active and a 31B dense
- ✓ 256K context on the 12B and above, 128K on E2B and E4B
- ✓ Text and image input across the whole family; audio input including speech recognition and translation on E2B, E4B and 12B
- ✓ Apache 2.0 on the weights, so no acceptable use policy, no monthly active user cap and no clause letting Google amend terms later
- ✓ Multilingual coverage past 140 languages
- ✓ Specialised siblings in the same programme: EmbeddingGemma, ShieldGemma 2, MedGemma 1.5, TranslateGemma, FunctionGemma and DiffusionGemma
Where it holds
- • Apache 2.0 removes the specific clauses that made legal review painful on Gemma 2 and 3, including the remote access limitation and the reading that models trained on Gemma synthetic output inherited Gemma terms
- • The 26B A4B activates about 3.8B parameters per token, so quantised it fits a 24GB consumer card and still handles 256K context
- • Day one support across llama.cpp, Ollama, vLLM, MLX and LM Studio, with GGUF and quantised checkpoints published by Google rather than scraped together by the community
- • Over 400 million family downloads and 100,000 community variants means the fine-tuning recipes and quant configs already exist for whatever you are trying
Where it breaks
- • Only the weights are open. Training data and training code stay inside Google, so the corpus cannot be audited or reproduced
- • Gemma 1, 1.1, 2, 3, 3n and every specialised variant remain under the old Gemma Terms of Use and Prohibited Use Policy. Ship two generations in one product and you are managing two licences
- • Audio input stops at the 12B, so the two strongest checkpoints are text and image only
- • On hard reasoning the 31B dense trails larger open-weight releases at comparable memory cost, and it is not a frontier substitute
My Take
The licence is the real story. Moving to Apache 2.0 on 2 April 2026 removed the clauses that stalled legal review, and Apache cannot be amended unilaterally later, which is the part that matters if you are shipping a product on it. Capability-wise the 26B A4B is the practical pick for a single 24GB card, and DeepInfra will serve the 31B at $0.08 in and $0.38 out per million if hosting is not worth the trouble. Where it falls short is provenance: no training data, no training code, so if a client asks what the model saw you have nothing to show them and you want Olmo instead.
Quick Info
- Pricing:
- open-source
- Openness:
- Open weights
- Licence:
- Apache 2.0
- Starting at:
- Weights are free under Apache 2.0 from Hugging Face and Kaggle. Hosted, Gemma 4 31B runs $0.08 in and $0.38 out per million tokens on DeepInfra and $0.10 in, $0.34 out on CoreWeave. Google AI Studio serves it on a free tier at $0.00. Thirteen API providers listed as of 28 August 2026. Self-hosted, the real cost is GPU time: the 26B A4B quantises onto a single 24GB card.
- Added:
- Aug 2026
- Updated:
- Aug 2026
Use Cases
Judge it on your own work
The notes above say where Google Gemma 4 holds and where it breaks. The fastest check is your own workload.
Visit website ↗Alternatives to Google Gemma 4
Mistral AI
open-sourceEuropean lab publishing open weight models you can run on your own hardware. Large 3 is a 675B MoE with 41B active, 256K context and Apache 2.0 weights.
Tongyi Qianwen / 通义千问 (Qwen)
freemiumAlibaba’s open-source large language model family and AI assistant, offering strong multilingual capabilities and deep enterprise integration with Alibaba Cloud.
NVIDIA Nemotron 3
open-sourceNVIDIA's open-weight family, 31.6B Nano up to the 550B Ultra MoE. Hybrid Mamba-Transformer, 1M context, weights plus roughly 3T tokens of training data published.
Ai2 Olmo 3
open-sourceAi2's fully open family at 7B and 32B with Base, Instruct, Think and RL Zero variants. Weights, training data, every intermediate checkpoint, logs and code under Apache 2.0.
MiniCPM
open-sourceOpenBMB's on-device line (面壁小钢炮): MiniCPM5-1B at 1.08B parameters with a 131K context, plus MiniCPM-V 4.6 multimodal at 1.3B. Apache 2.0 on weights and code.