Running an on-device LLM on your phone with ChatterUI
A quick test of Phi-3-mini-4k-instruct running locally on a Google Pixel 9 through ChatterUI: clone the repo, or just install the APK and download a GGUF model.
If you’ve ever wanted to run an on-device LLM on your smartphone, this repo (ChatterUI) is a great resource! You can either clone and customize the project for your own apps, or simply use the provided APK to install it on your Android device and download the GGUF of model of your choice to self-host locally.
Here’s a short clip of me testing Phi-3-mini-4k-instruct on a Google Pixel 9, pretty fast and definitely good enough!