[VTA,uTVM] VTA on a microcontroller?

Hi,

I’ve posted several seemingly disjoint threads on this forum, that actually all lead up to this purpose: I’m trying to run TVM on a custom RISC-V microcontroller that features custom accelerators. To make this possible i’ve been looking into uTVM and the VTA accelerator stack.

I was wondering whether it is possible to deploy the TVM runtime and JIT compiler that is used in VTA on a microcontroller environment. (Because if I get it correctly, VTA needs a (let’s say a linux) workstation with a (let’s say a) desktop CPU. Right?)
Given the difficult deployment on microcontrollers by itself (as i’ve seen in studying uTVM) I think it will be quite difficult to run such a runtime on a device with very limited memory and no OS. Is it even possible to compile the TVM runtime to RISC-V ? I guess it should be with the LLVM backend for RISC-V maybe? But does this produce code that i can run on a microntroller? What are current challenges/constraints in deploying this runtime on a microcontroller?

Is running this RISC-V compiled runtime (if it is possible) through an emulator like QEMU maybe an interesting way to develop this kind of runtime? Has anyone got any experience with this or comments on this idea? Any help is much appreciated! Thanks!

1 Like