Terminating RPC Session


I wanted to build an automated benchmark tool, which tests the entire model zoo per RPC on different devices. But, for some reason I am only able to run a single network at once and have to restart the program on the developer machine afterwards, as the RPC server seems to be blocked.

Is there a way to terminate the RPCSession? I looked into tvm docs - tvm.rpc

Currently I am building a new session for each network as tvm crashed when I build it beforehand and tried to reuse the same session across all networks.

The RPC session will be terminated once it goes out of scope. e.g. you can create the session in a python function and not retain reference to it. You can also make use of the rpc tracker to multiplex across servers. The autotvm runners might be a good place to look

1 Like