Gemma 4 FAQ
Short, checked answers to the questions people ask most about Gemma 4: what it is, which model to choose, how to get it running, what it can do and what it costs.
Answers drawn from Google's documentation and the guides on this site ·
Jump to a topic
🌱Basics
What Gemma 4 is and who it is for
What is Gemma 4?
Gemma 4 is Google DeepMind's family of open AI models, released on March 31, 2026. It comes in five sizes, from a model that runs on a phone to one for workstations and servers, and you can download and run it yourself. Start on the home page.
Is Gemma 4 free?
Yes. The model weights are free under the Apache 2.0 licence, including for commercial use. You pay only for the hardware or hosting you run them on. See pricing.
What sizes does it come in?
Five: E2B and E4B for phones and small devices, 12B for laptops, and 26B A4B and 31B for a strong GPU or server. Details on the models page.
How is Gemma different from Gemini?
Gemini is Google's larger, closed model family that Google runs for you. Gemma is the open family you download, run privately and can modify. Gemini's top models are more capable. See the model comparison.
Who makes Gemma 4?
Google DeepMind. This website is an independent community reference and is not affiliated with Google.
What is the knowledge cutoff?
January 2025. For anything more recent, paste the information into your prompt or connect the model to a search tool.
Which languages does it support?
More than 140, according to Google's model card, built on a vocabulary of about 262,000 entries.
Is Gemma 4 better than Gemma 3?
Much better. Against Gemma 3 27B, the 31B rises from 20.8 to 89.2 on AIME 2026 maths and from 29.1 to 80.0 on LiveCodeBench v6 coding. It also adds a thinking mode, audio input and a longer context. See the Gemma 3 page.
🧩Choosing a model
Which size fits your device and your job
Which Gemma 4 model should I use?
Pick the largest one your memory allows: E2B or E4B on a phone, 12B on a 16 GB laptop, 26B A4B for speed on a 24 GB GPU, and 31B for the best quality. The runtime selector can help.
Which model is the best?
The 31B scores highest on almost every test. The 26B A4B is close behind and faster. See benchmarks.
Is the 31B worth it over the 26B A4B?
Sometimes. The gap is two to three points on knowledge, maths and coding, but wider on agent tasks (76.9 vs 68.2) and long-context retrieval at 128K (96.4 vs 89.8).
What do the names E2B, E4B and A4B mean?
The E stands for "effective": the edge models run with the footprint of a 2B or 4B model while holding more parameters in total. A4B means about 4 billion parameters are active per token in the 26B Mixture-of-Experts model.
Why is the 26B faster than the 31B?
It is a Mixture-of-Experts model. Each token uses about 3.8B of its parameters, so there is far less to compute. The whole model still has to fit in memory.
What is special about the 12B?
It is the largest model that accepts audio, it has the full 256K context, and it fits a 16 GB laptop at 4-bit. See the 12B guide.
Is there a model smaller than E2B?
Not in Gemma 4. If you need something tiny, Gemma 3 has a 270M model.
Should I use the base model or the -it model?
The -it (instruction-tuned) model. Base models continue text instead of answering questions and exist for people doing their own training.
⬇️Download and install
Getting the files and running them
Where can I download Gemma 4?
From Hugging Face, Kaggle, Ollama or LM Studio. The download hub has links for every size, and how to download walks through it.
What is the easiest way to install it?
Ollama: install it, then run ollama run gemma4. If you prefer no terminal, use LM Studio. See the install guide.
Which file should I download?
For running locally, the official QAT 4-bit build of the largest size your memory allows - in Ollama, the -it-qat tag. For serving or fine-tuning, the plain -it repository. See QAT builds.
How big are the downloads?
Through Ollama's QAT tags, from about 4.3 GB for E2B to about 19 GB for the 31B. Full-precision files are several times larger.
What is the -it-assistant download?
A small draft model that works alongside the main model to speed up generation. It is not a chat model and does nothing useful by itself.
Why do Ollama names differ from Hugging Face names?
They are separate naming schemes. Ollama uses gemma4:12b; Hugging Face uses google/gemma-4-12B-it, with a capital B.
Can I run it offline?
Yes. Once a model is downloaded, it needs no internet connection.
Do I need to download anything to try it?
No. You can try it in Google AI Studio, or see the playground and chat pages.
Does it work on a Mac?
Yes. Apple silicon Macs run it well through Ollama, LM Studio or MLX. See Mac setup.
💾Hardware and speed
Memory, GPUs and how fast it runs
How much memory does each model need?
At 4-bit, Google lists about 2.9 GB for E2B, 4.5 GB for E4B, 6.7 GB for 12B, 14.4 GB for 26B A4B and 17.5 GB for 31B, for the weights alone. Long conversations need more. See the VRAM guide.
Can it run on a 16 GB laptop?
Yes. The 12B at 4-bit needs about 6.7 GB for the weights, which leaves room for everything else.
Can I run it without a GPU?
The two edge models are usable on a CPU. Larger models will run but slowly.
How much quality is lost at 4-bit?
Little with Google's QAT builds, which are trained to tolerate 4-bit. Ordinary 4-bit conversions lose more, and below 4-bit quality falls quickly.
How fast is it on a phone or laptop?
In Google's tests, E2B writes about 52 tokens a second on a Galaxy S26 Ultra, 56 on an iPhone 17 Pro and 160 on a MacBook Pro M4 Max, all on GPU.
What is the MTP drafter and should I use it?
Multi-Token Prediction pairs the model with a small drafter that proposes several tokens at once for the main model to check. Google describes it as faster with no quality loss. See capabilities.
Does thinking mode slow it down?
Yes. The reasoning is generated text, so it costs time and tokens. Turn it off for quick tasks.
🎛️Capabilities
What it can and cannot do
What can Gemma 4 take as input?
Text and images on every size, video as a series of frames on every size, and audio on E2B, E4B and 12B. Output is always text. See features.
Can it generate images or audio?
No. It reads images and audio but only writes text.
How long is the context window?
256K tokens on the 12B, 26B A4B and 31B, and 128K on E2B and E4B. Google's phone builds list a 32K maximum.
What is thinking mode?
A setting where the model writes out its reasoning before the final answer. It improves accuracy on maths, code and planning. Published benchmark scores assume it is on.
Does it support function calling?
Yes, with built-in tokens for declaring and calling tools. The model only writes the request; your program runs the tool and should validate it first.
Can it read documents and screenshots?
Yes. For small text or dense pages, raise the image detail setting to 560 or 1,120 tokens per image; the default is 280.
Can it transcribe audio?
Yes on E2B, E4B and 12B. Google's model card limits clips to 30 seconds, so split longer recordings.
Can I fine-tune it?
Yes. The weights are open and the licence lets you keep and redistribute what you build.
Does it remember previous conversations?
No. It only sees the current conversation. Any memory between chats comes from the app you use.
☁️API and pricing
Hosted access, keys and cost
Is there a Gemma 4 API?
Yes. Google serves Gemma 4 through the Gemini API, and other providers host it too. See the API page.
Is there a separate Gemma 4 API key?
No. On Google's API you use a Gemini API key from Google AI Studio. Other providers issue their own keys, and a local server needs none.
Which models can I call through Google's API?
Google's documentation lists the 31B and 26B A4B. For the smaller sizes, use another provider or run them yourself.
Is the API free?
Google's pricing page lists no per-token price for Gemma models, and access is rate-limited. Other providers charge per token.
How much does hosted Gemma 4 cost?
On OpenRouter on October 7, 2026, the 31B was listed at $0.09 per million input tokens and $0.34 per million output tokens. Prices change; check pricing.
Can I use the OpenAI SDK?
Yes with local servers such as Ollama and LM Studio and with most third-party providers, which accept the OpenAI format. Google's own examples use the Google GenAI SDK.
Should I use an API or host it myself?
Use an API to start quickly or for light use. Host it yourself for privacy, offline use, the smaller models or steady high volume. See self-hosting.
📱Phones
iPhone and Android
Can Gemma 4 run on a phone?
Yes. E2B and E4B are built for it and work fully offline. See mobile downloads.
Is there an official app?
The official route is Google AI Edge Gallery, a free app from Google on the App Store and Google Play. Gemma 4 is downloaded inside it.
What does my phone need?
iOS 17 or later, or Android 12 or later, and storage for the model: 2.58 GB for E2B or 3.66 GB for E4B. See the Android page.
Should I use CPU or GPU on a phone?
GPU. On Google's test phone it cut the wait for the first word from 1.8 seconds to 0.3.
Can the bigger models run on a phone?
No. There are no mobile builds beyond E4B. The 12B and larger need a computer.
Will it drain my battery?
While it is generating, yes. When idle it uses nothing.
💻Coding and agents
Using it to write code
Is Gemma 4 good for coding?
The larger sizes are. The 31B solves 80.0% of LiveCodeBench v6 problems and the 12B 72.0%. The edge models score much lower. See Gemma 4 coding.
Which model is best for coding?
The 31B for quality, the 26B A4B for speed, and the 12B on a 16 GB laptop.
Can I use it in my code editor?
Yes. Run it with Ollama or LM Studio and point any extension that accepts an OpenAI-compatible endpoint at the local address.
Can Claude Code use Gemma 4?
Yes, through Ollama, as an unofficial setup that Anthropic does not support. See Gemma 4 vs Claude Code.
How good is it at agent tasks?
It is the family's weakest area. On the Tau2 agent test the 31B scores 76.9 but E2B only 24.5. Use a 12B or larger and keep task chains short.
Is there a Gemma model for search and retrieval?
Yes. EmbeddingGemma 2, released October 6, 2026, turns text, images, audio and video into vectors for search. See the EmbeddingGemma 2 guide.
⚖️Licence, privacy and safety
What you may do and what to watch for
What licence does Gemma 4 use?
Apache 2.0, a standard permissive open-source licence.
Can I use it commercially?
Yes. Apache 2.0 allows commercial use, modification and redistribution, including in closed-source products. Keep the licence and copyright notices when you redistribute.
Are older Gemma models Apache 2.0 too?
No. Gemma 3 and earlier remain under the Gemma Terms of Use.
Is my data private?
When you run the model on your own device, your prompts are not sent to a model provider. Hosted services do receive them, so read their terms.
Does it make mistakes?
Yes. Like every language model it can state wrong or outdated things confidently. Check anything important. See limitations.
Does the downloaded model have a content filter?
There is no server-side filter on a model you run yourself. Safety behaviour is trained in, and adding safeguards to a public product is up to you. See safety.
Can I rely on it for medical or legal work?
Only with a qualified person checking the output. Fluent answers can sound authoritative when they are wrong.
🔧Troubleshooting
Common problems and quick fixes
Tool calling or formatting is broken. What should I do?
Update your app and download the model again. A July 2026 refresh of the weights fixed the chat template and tool calling without changing the model name.
Why does the model forget the start of the conversation?
Local apps often start with a context window far smaller than the model supports. Raise the context length in your app's settings.
I get "not found" when downloading from Hugging Face. Why?
Check the name. Gemma 4 repositories use a capital B, for example google/gemma-4-12B-it.
Why is it so slow?
Most often the model does not fit in memory, or it is running on the CPU instead of the GPU. Try a smaller size or a QAT build, and switch thinking off for simple tasks.
Why do I see the model's reasoning in the answer?
Your app is not separating the thinking from the reply. Update the app, or turn thinking off.
My results are worse than the published benchmarks. Why?
Published scores use thinking mode and, for vision, the highest image detail. Defaults are lower. Quantised builds can also score slightly lower.
Is gemma4:latest safe to rely on?
For experimenting, yes. For anything that must stay the same, name the size and build explicitly, because a general tag can be repointed.
Where can I get more help?
Try the prompting guide and technical specs, or use the contact page.
Figures come from Google's Gemma 4 model card and the sources cited on each linked guide. Prices, rankings and app details change; each answer links to the page where they are kept current.
Still have a question?
Tell us what is missing and we will add it.