[Show / Question] Building an on-device, fully local Agent on a 4B model (Gemma 4 / Ministral) across Mobile & Desktop. Facing the reality of on-device limits—where should on-device agents go from here?

Like many here, I’m obsessed with true privacy sovereignty and local-first AI. Over the past few months, I've been building Agro — an open-source, 100% on-device cross-platform LLM and autonomous agent client running on Android, iOS, macOS, Windows, and Linux. The project is built on Kotlin Multipla