I enjoy the reading of https://arxiv.org/abs/2006.03031 which supports dyn model support in the TVM using relay vm.
However, i want to ask some quick questions:
-
Do we have uploaded completely of Nimble code on the mainstream? Especially about the memory performance issue like this : [VM] The performance degradation of VM runtime and Dynamic Shape support compared to Graph Runtime. In paper we have described we have memory planning and heterogeneous device placement to solve this.
-
The evaluated platforms contain arm, however it is on cloud. How about embedded platforms? Does VM could be one part of
libtvm_runtime.so
which could be cross compiled using cross compiler?
Thanks for the great work! I like this design solving this problem. @haichen @jroesch @zhiics