Running LLM on NPU [ERROR at line 244: Failed to create the dialog.

[Harsha0056]

Hi, I used to run an LLM on the NPU using a command through the Command Prompt, and it used to return responses successfully and i was able to run this a couple of weeks back as well. However, it suddenly started throwing an error. Do you have any idea what might be causing this?

System Specs : Snapdragon(R) X Elite - X1E78100 - Qualcomm(R) Oryon(TM) CPU 3.42 GHz

[shreyajn]

Hi, 5000 usually means incompatible context binaries. Were you running the same model on the same device a couple of weeks back?

[Harsha0056]

Hi, 5000 usually means incompatible context binaries. Were you running the same model on the same device a couple of weeks back?

Hi @shreyajn , thanks for getting back to me! Yes, everything was working smoothly without any issues a couple of weeks ago. All of a sudden i am facing this issue.

[shreyajn]

Just so we can verify, what is the version with which QNN context binaries were made? And which version is being run with on-device?

[Harsha0056]

Just so we can verify, what is the version with which QNN context binaries were made? And which version is being run with on-device?
@shreyajn
I don't have the exact version number , but this what it looks when it runs.

Edit : Found the QNN version: 2.25.0.240728. It's an older one—I created it back in October 2024