The hardware related information is specified in “target”. In your case, the target should be cuda -model=1080ti. The builder will build the model based on the target, and runner is only in charge of running the built model, so it doesn’t have to take the hardware information. Accordingly, the device key in RPC runner is just a label and can be arbitrarily specified.