LLM Hub

Open-source Android app bringing the power of Large Language Models directly to your mobile device. Experience AI conversations with state-of-the-art models - all running locally for maximum privacy.

Key Features

Everything you need for private, powerful AI conversations on your Android device

Multiple LLM Models
Support for Gemma-3, Llama-3.2, Phi-4, and Gemma-3n models
Privacy First
Complete privacy - no internet required for inference
Vision Support
Multimodal models that understand both text and images
GPU Acceleration
Optimized performance on supported devices (8GB+ RAM)
On-Device Processing
Your conversations never leave your device
Direct Downloads
Download models directly from HuggingFace

Supported Models

Choose from a variety of state-of-the-art LLM models optimized for mobile devices

Gemma-3 1B Series
Google
Optimized for mobile devices with GPU acceleration support
529MB (INT4), 1005MB (INT8)
Up to 4k tokens
Llama-3.2 Series
Meta
Meta's powerful models optimized for on-device inference
1.20GB (1B), 3.08GB (3B)
1.2k tokens
Phi-4 Mini
Microsoft
Microsoft's efficient model for advanced reasoning
3.67GB (INT8)
1.2k tokens
Gemma-3n Series
Google
Vision Support
Multimodal models with vision and text capabilities
2.92GB (E2B), 4.10GB (E4B)
4k tokens

Technology Stack

Built with modern Android development tools and cutting-edge AI technology

Kotlin
Modern Android development language
Jetpack Compose
Modern UI toolkit for Android
MediaPipe & LiteRT
AI runtime for on-device inference
INT4/INT8 Quantization
Optimized model compression

Requirements

Android 7.0+
API level 24 or higher
2GB+ RAM
4GB+ recommended, 8GB+ for GPU acceleration
1GB - 5GB Storage
Depending on selected models
Internet
Required only for model downloads

How It Works

LLM Hub uses Google's MediaPipe framework with LiteRT to run quantized AI models directly on your Android device

1
Download
Pre-optimized .task files from HuggingFace
2
Load
Models into MediaPipe's LLM Inference API
3
Process
Your input locally using CPU or GPU
4
Generate
Responses without sending data to external servers

Ready to Experience Private AI?

Download LLM Hub today and start having AI conversations that stay completely private on your device.