Can we deploy different ops in a graph on different backends?

for example, a graph include conv + bn + relu, can we run conv + bn on gpu and relu on cpu?

Maybe you can take a look at https://github.com/cmu-catalyst/collage, but I’m not sure if it supports GPU+CPU in the same graph.