The NPU Liberation Framework
Forcing ONNX runtime execution onto bare-metal Qualcomm Hexagon hardware under strict 8GB RAM constraints. To bypass closed-source cloud telemetry, I deployed an offline-first edge architecture utilizing Tauri v2 and PocketBase. The entry documents how we eliminated model hallucinations via audio activity detection gates and achieved significant memory footprints reductions.