Hi, is there a simple list of all relay operators for BYOC?
I can find relay operators in the Python API section of the doc but they are spread amongst different sections and mixed with other functions.
There’s no specific list of Relay ops for BYOC. You could decide what ops you want to implement for each BYOC backend, and the rest unimplemented ops will remain on the host (e.g., CPU and GPU). This is one of the most important features BYOC brings that allows you to run any model with your codegen without implementing all ops.
That is really great, thank you for clarifying.
I was still interested in having a list of actual operators however:
The list of relay functions in tvm.relay — tvm 0.9.dev182+ge718f5a8a documentation contains things like setrecursionlimit or build which I don’t think are meaningful for BYOC (correct me if I am wrong).
Not everything under tvm.relay is an op. The page you referred is just the APIs under this namespace. I would suggest looking at the model IR directly to get the sense about which ops should be supported, or referring to other BYOC integrations for their supported ops (e.g., Relay TensorRT Integration — tvm 0.9.dev182+ge718f5a8a documentation)
Great I will look into that. In the future it could be helpful to have an extensive list of the relay operators that are generated for BYOC.
Thank you!