Run TVMC package with VTA

Hi, I am a new user of Apache TVM and VTA. I am currently having some confusion regarding TVMC package and VTA. I have compiled my ANN model and got output of a tar file consist of I am trying to do inference on PYNQ using VTA. I guess it’s not possible using as there is not option to chose vta as device.

Can someone please give me some direction how after having the TVMCPackage I can run it in FPGA using VTA? I am using RPC servers. Thank you.

Hi @ShadAhammed, thanks for posting. You’re correct that vta is not a target device supported by tvmc run at the moment.

I don’t think there is a big limiting factor in TVM that prevents that to be supported, I guess the reason on why this is not in place it mostly because nobody implemented/tested that specific use case yet.

Regarding your questions, I think @areusch can perhaps give some pointers on where to look for help on that.

hi @ShadAhammed , you’re right we don’t support this in tvmc at the moment. I think what I can point you to now is the VTA tutorial, in particular see tune_and_evaluate here.

1 Like

Hi @areusch, firstly thanks a lot for referring this tutorial. I actually have gone through all those tutorials on how to synchronise my specific classification based neural network with the examples. My neural network is based of data, not image. I have created the TVMC package and run inteference with test data on host computer with My compiled module is created with ‘tar’ extension and it has, mod.params and files. The next job was to probably use the function as in your referred tutorial.

my_vadd = … )

But I don’t have the parameters to use in this function. Compiled module from the tvmc.compile is a tvmc package which I don’t know how to use for the next steps. If you have any further idea/suggestion/direction, kindly share.

Hey @ShadAhammed , we have recently ported VTA to Sabana

I would be interested on knowing more about your use case. Happy to chat, let me know!

Hi @vegaluis , thank you for responding. Will be happy to share our knowledge. I am trying to work now on the graph execution procedure for vta. Cannot do it with my normal classification network. Unfortunately have no use cases in the community forum too to verify.

@ShadAhammed Maybe it will be great to chat and see what you are building? I can help you out with VTA related stuff…Feel free to message me on our discord and we can do a zoom call.