Hi, i am using tvmc.TVMCPackage(package_path=str(model_path)) to load the package
and then use result = tvmc.run(package, inputs={"x": img}, device=device)
From the log, i can see a lot of load_module from the temp file (unzipping and load)
Is there any overhead for this? Is it possible to load from an unzipped mod.so and mod.json etc directly?
2023-05-19 08:12:08.941 INFO load_module /tmp/tmpd9l6449x/mod.so 2023-05-19 08:12:09.002 INFO load_module /tmp/tmpmyqvofag/mod.so 2023-05-19 08:12:09.056 INFO load_module /tmp/tmp_gcptegx/mod.so 2023-05-19 08:12:09.115 INFO load_module /tmp/tmp_hzng5xw/mod.so 2023-05-19 08:12:09.172 INFO load_module /tmp/tmpx9azafu0/mod.so 2023-05-19 08:12:09.229 INFO load_module /tmp/tmpxaifsu_p/mod.so 2023-05-19 08:12:09.285 INFO load_module /tmp/tmp2avpw0oo/mod.so 2023-05-19 08:12:09.340 INFO load_module /tmp/tmpq8vtsu1r/mod.so 2023-05-19 08:12:09.396 INFO load_module /tmp/tmpal4d2rdp/mod.so 2023-05-19 08:12:09.459 INFO load_module /tmp/tmpaboro44l/mod.so