Topic

#on-device-ai

2 articles exploring on-device-ai. Expert insights and analysis from our editorial team.

Showing 1–2 of 2 articles
Related topics:
mobile-inference hexagon-htp llama-cpp open-source snapdragon-npu apple-intelligence

Articles

Newest first
Open Source

Off Grid v0.0.88 Ships Hexagon HTP Acceleration: Auditability Is the Real Edge Over Apple Intelligence

Off Grid v0.0.88 ships Hexagon HTP/NPU text acceleration with a self-reported 3× speed gain. Auditability of the MIT source is its genuine advantage over Apple Intelligence.
Developer Tools

LiteRT-LM v0.10.1 Ships Gemma 4 MTP Heads That llama.cpp Can't Access

LiteRT-LM v0.10.1 ships Gemma 4 with Qualcomm NPU acceleration, but Google stripped MTP heads from public weights, locking peak Gemma 4 throughput to its own runtime.
Browse All Topics