Skip to content

Issues: airockchip/rknn-llm

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

143 Open 94 Closed
143 Open 94 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

gemma3-4b 不能正常转换/运行
#240 opened Apr 14, 2025 by kuku20009
2
Pls add setup script for easier on boarding
#237 opened Apr 10, 2025 by hajajmaor
Qwen2.5-VL-3B-Instruct示例需求
#236 opened Apr 9, 2025 by Kernel-Zhang
1
Failed to init rkllm
#235 opened Apr 9, 2025 by hguitar
1
MiniCPM-V-2_6 - terminate called after throwing an instance of ‘std::out_of_range’
#234 opened Apr 7, 2025 by vlncent1
Correct way to pass image embedding for multi-modal mode in Python
#233 opened Apr 5, 2025 by AIWintermuteAI
failed to run chatglm3
#232 opened Mar 31, 2025 by Adolfhill
2
Support for more types of VLMs, including SmolVLM
#231 opened Mar 30, 2025 by AIWintermuteAI
rk3588 Deepseek 14B模型运行内存要求？
#229 opened Mar 27, 2025 by lzjie-tchip
whisper这种speech to text的模型能否在rknn3588上实现量化部署
#227 opened Mar 24, 2025 by XuechenCao
2
llm_demo和rkllm_server_demo同样模型生成的质量和长短差距甚远
#226 opened Mar 19, 2025 by huyin92
1
rknn-llm 是否可以为算子指定使用的后端
#225 opened Mar 18, 2025 by wohaiaini
6
Has anyone integrated .rkllm files with a RAG model or agent using LangChain?
#224 opened Mar 14, 2025 by khw11044
请问是否会支持 flashmla
#223 opened Mar 14, 2025 by lijianxing123
什么时候支援Python 3.11及更新的版本？
#222 opened Mar 13, 2025 by woodrex83
4
请问如何升级NPU驱动？
#221 opened Mar 13, 2025 by yanlei08
[librkllm_api]: Please open source API user space bindings
#219 opened Mar 12, 2025 by nekrondev
请问，转换模型前的用于量化的校准样本作用
#218 opened Mar 11, 2025 by ldptest
1
你好能否提供一下librkllmrt.so动态库的源码或者提供一下OpenHarmony平台的librkllmrt.so
#217 opened Mar 7, 2025 by yun-lai-yun-qu
1
rkllm_server_demo何时支持多模态模型
#216 opened Mar 7, 2025 by fungizhang
2
请问下，rknn-llm可以指定某个npu核进行推理么？
#215 opened Mar 7, 2025 by pxrgod
7
rkllm1.1.4支持模型受限，新版本rkllm何时发版？
#214 opened Mar 6, 2025 by bestlee666
4
咨询下主页上的测试数据使用的芯片算力是多少T的？
#213 opened Mar 6, 2025 by pxrgod
9
deepseek微调模型无法转换为rkllm
#212 opened Mar 6, 2025 by jianfeng-xiyue
3
Get device properties failed 怎么解决
#211 opened Mar 6, 2025 by wqw-qqa
2
ProTip! What’s not been updated in a month: updated:<2025-03-14.