Gemma 3 4B is the compact end of Google’s open Gemma 3 family: multimodal text and image
\ninput, a 128K context, and roughly 3 GB of VRAM at 4-bit \u2014 small enough for almost any modern
\nGPU, and for a good deal of hardware that is not a GPU at all.<\/p>\n
What is unusual here is the context window. A 4B model with 128K context is not the normal
\ntrade-off; small models historically shipped with small windows, which limited them to short
\nprompts and made them useless for document work. Gemma 3 4B can hold a substantial document
\nin memory on a 6 GB card, which opens up edge and on-device use cases \u2014 local document
\nsearch, offline assistants, in-browser or in-app inference \u2014 that previously required sending
\ndata to a server. Do not expect it to reason like a frontier model; expect it to be the
\nmodel that makes a privacy-preserving feature feasible at all. At $0.05 in \/ $0.10 out per
\nmillion tokens the hosted option is close to free, so self-hosting here is about data
\nresidency and latency, not cost.<\/p>","protected":false},"excerpt":{"rendered":"
What is Gemma 3 4B? Gemma 3 4B is the compact end of Google’s open Gemma 3 family: multimodal text […]<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"cm_developer":"Google","cm_model_type":"LLM (multimodal)","cm_modality":"Text, Image \u2192 Text","cm_parameters":"4B","cm_context_window":"128K","cm_max_output":"","cm_license":"Gemma (open)","cm_open_weights":"yes","cm_release_date":"2025","cm_input_price":"0.05","cm_output_price":"0.1","cm_api_providers":"Google AI Studio, Ollama","cm_vram_fp16":"","cm_vram_q4":"~3 GB","cm_min_gpu":"Any 6GB+ GPU","cm_benchmarks":"","cm_official_url":"https:\/\/huggingface.co\/google"},"class_list":["post-1240","ai_model","type-ai_model","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/convly.ai\/de\/wp-json\/wp\/v2\/ai_model\/1240","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/convly.ai\/de\/wp-json\/wp\/v2\/ai_model"}],"about":[{"href":"https:\/\/convly.ai\/de\/wp-json\/wp\/v2\/types\/ai_model"}],"wp:attachment":[{"href":"https:\/\/convly.ai\/de\/wp-json\/wp\/v2\/media?parent=1240"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}