I wanted to build an automated benchmark tool, which tests the entire model zoo per RPC on different devices. But, for some reason I am only able to run a single network at once and have to restart the program on the developer machine afterwards, as the RPC server seems to be blocked.
Is there a way to terminate the RPCSession? I looked into tvm docs - tvm.rpc
Currently I am building a new session for each network as tvm crashed when I build it beforehand and tried to reuse the same session across all networks.