Question about the status of Relax

Development unity
#1

I have seen the release of MLC-LLM project, and it’s based on the tvm unity branch.

I have some questions:

  1. What is the status of the Relax?
  • frontend support: seems the relax only support torch.fx and dynamo? can I convert an onnx model to relax?
  • dynamic auto tuning support? does tvm support auto tuning for dynamic shape now?
  1. Also I have question about the MLC-LLM project, seems it builds model using relax? I didn’t find the import process from onnx or pytorch.
#2

Thank you for asking! Relax is under active development and is being used as backbone as tvm unity. It is at a state where it is ready to support novel use-cases such as stable diffusion and LM.

Right now the unity branch support torch fx, we love to see more importers, @jwfromm had some work on onnx on the side. The MLC LLM atm is indeed building relax directly atm, but we can also support importing when possible.

We love to hear about community’s feedbacks about tvm unity, feel free to ask more questions under Unity category

2 Likes