Hi : I am trying to use the following methods to re-load built tensorrt engine from my saved cache directory. However, it looks like it has some bugs using this method:
Also, Here is my error message:
Also, I found that when it is trying to get batch size after loading trt cache, it looks like it fails: tvm/src/runtime/contrib/tensorrt/tensorrt_runtime.cc at main · apache/tvm · GitHub. Someone knows why? Thank you very much! Probably @trevor-m can help?