Thanks @adb for providing this, worked for me! My misunderstanding was that expectation, that the .so already contains the “ready to go” runtime module, which is obviously not the case.
@heliqi run the script “run.sh” in the the apps/how_to_deploy folder. This will give you the runtime.o, link this against your executable and provide as well the header files. The Makefile in the how_to_deploy folder does exactly this. If you want to use OpenCL, you will also need to link this. You may have also a look here: https://docs.tvm.ai/deploy/nnvm.html