Cannot find library: run mlc_chat_cli --local-id rwkv-raven-1b5-q8f16_0

#1

I follwed the latest MLC-LLM manualMLC LLM | Home try to run prebuilt rwkv-raven-1b5–q8f16_0, but got the following error:

root@68ae28ac2b13:/home/repo# ./run_mlc_llm.sh Use MLC config: “/home/repo/mlc-llm/dist/prebuilt/mlc-chat-rwkv-raven-1b5-q8f16_0/mlc-chat-config.json” Use model weights: “/home/repo/mlc-llm/dist/prebuilt/mlc-chat-rwkv-raven-1b5-q8f16_0/ndarray-cache.json” Cannot find library “rwkv-raven-1b5-q8f16_0-cuda.so” in “/home/repo/mlc-llm/dist”/prebuilt/lib or other search paths

in run_mlc_llm.sh is: ./mlc-llm/build/mlc_chat_cli --local-id rwkv-raven-1b5-q8f16_0 --artifact-path /home/repo/mlc-llm/dist

#2

before run mlc_chat_cli，I have pulled model binary file and configure file using: cd mlc-llm/dist/prebuilt/ git clone mlc-ai/mlc-chat-rwkv-raven-1b5-q8f16_0 · Hugging Face

#3

There is no prebuilt cuda lib. Please try to build it by yourself or use vulkan lib instead

#4

Okay, Copyed, I’ll try out later, 3q