How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

LoRA HEF (Qwen2-1.5B) runs on Hailo-10H but scores below the base model (100% on GPU, 39% on device)

calendar_today September 27, 2026 person @Boris_Pavelka domain hailo

Hi, I’ve been trying to get a small LoRA adapter running on a Raspberry Pi 5 with the AI HAT+ 2, following DFC_7_LoRA_Tutorial pretty much to the letter. The good part is the whole thing works end to end: the HEF compiles, loads, and generates text. The bad part is that on the device the adapter makes the model worse than no adapter at all, and I’ve run out of things to check on my side.

open_in_new Read original post