Hello community,
We are excited to share with folks about the project we released recently: Web-LLM, running large language model completely on the browser. We have a runnable demo that you can try out on the website. And you are welcome to check out our GitHub repo for more details.
This project is only possible thanks to the shoulders open-source ecosystems that we stand on. We want to thank the Apache TVM community and developers of the TVM Unity effort.