Allen AI
OLMoE Q3_K_M 7B-A1B
An English chat and writing MoE from Allen AI. Experimental 3-bit download; stores all 7B weights and activates about 1B per token.
About OLMoE Q3_K_M 7B-A1B
An English chat and writing MoE from Allen AI. Experimental 3-bit download; stores all 7B weights and activates about 1B per token.
Every model in this catalog runs locally in the Offline AI Chat app. After the download finishes, OLMoE Q3_K_M answers on your phone with no connection, and your prompts and replies are never uploaded.
- Download size
- 3.3 GB (Q3_K_M GGUF)
- Memory needed
- 6 GB minimum · 8 GB recommended
- Context in app
- 2,048 tokens
- Runs on
- Android 8+, 64-bit · iOS in private testing
- Access
- Offline Plus subscription
- License
- Apache-2.0 and Gemma terms
- Model source
- Allen AI on Hugging Face