Terminating RPC Session

Questions
#1

Hi,

I wanted to build an automated benchmark tool, which tests the entire model zoo per RPC on different devices. But, for some reason I am only able to run a single network at once and have to restart the program on the developer machine afterwards, as the RPC server seems to be blocked.

Is there a way to terminate the RPCSession? I looked into tvm docs - tvm.rpc

Currently I am building a new session for each network as tvm crashed when I build it beforehand and tried to reuse the same session across all networks.

#2

The RPC session will be terminated once it goes out of scope. e.g. you can create the session in a python function and not retain reference to it. You can also make use of the rpc tracker to multiplex across servers. The autotvm runners might be a good place to look

1 Like