Hi @fnakhaee, did you run the model with dynamic inputs in Relay or Relax?
Currently in Relax, we are working on matching Relay performance for static workloads by adding passes like FuseOps, after that we will shift our focus to improving performance for dynamic workloads, which involves works around dynamic shape tuning as masahi mentioned before and Relax passes such as dynamic memory planning.
Feel free to check out Relax pre-RFC for more details and the discussion we had in the TVM community meeting yesterday: https://youtu.be/2aYWGOYmDFY.