Several questions about micro TVM

[areusch]

@sho

So the Graph Runtime works on top of C Runtime? Could you please tell me where the C Runtime actually is? I found the link below but it seems that graph_executor is written in C++.

There are actually two GraphExecutor implementations in TVM: one for the C++ Runtime and one for the C Runtime. Sorry for this confusion.

@sho

I understood that the key difference is micro TVM uses C runtime and micro TVM uses C++ runtime, and the latter may not work on MCUs for the moment.

could you clarify this sentence? I think you meant to say something different in the second “micro TVM.”

@sho

AOT Executor is the C code that can be downloaded onto MCUs?

Yes.

@sho

I’d like to know what capabilities you are adding to AOT.

We’ll be releasing some roadmaps for microTVM and TVM as a whole ~next month.

@sho

Also, I’m curious about how you can execute GraphExecutor + GraphJSON on MCUs for the moment. I know it’s difficult for MCUs due to memory constraints, but I’d like to see how you deploy standalone GraphExecutor + GraphJSON to run inference on MCUs without communicating with the host PC. Should I be able to see it in the tutorial below?

Yes, the microtvm-blogpost-eval does explain the approach, but unfortunately it’s a bit out of date. We should have a new tutorial at some point soon that uses Project API. I’d also suggest you look for the Arduino tutorial coming up at TVMCon. Apologies for lacking documentation here.