Pytorch with microTVM

Awizhey · September 14, 2023, 9:56am

Hi,

I’ve been exploring the challenges of deploying PyTorch models on resource-constrained microcontrollers, and it’s apparent that PyTorch lacks native support for such environments. This has led me to explore external tools like TVM.

While I see most tutorials with TFlite integration, I’m eager to understand if there are plans or ongoing efforts to expand support for PyTorch on microcontrollers using TVM. I’ve noticed there’s only one (limited) tutorial available.

Any insights or resources you can share regarding PyTorch and TVM integration for edge deployment would be greatly appreciated. I’d love to hear what you guys recommend as the best approach for integrating PyTorch with TVM micro.

mshr-h · September 19, 2023, 12:42pm

Hi,

I’ve written an example script to integrate TVM and Hummingbird before. It may be helpful for you.

github.com

mshr-h/sandbox/blob/main/tvm_/lightgbm_microtvm/lightgbm_microtvm.py

import pathlib
import json

import tvm
from tvm import relay
import numpy as np
import pandas as pd
from matplotlib import pyplot as plt
import lightgbm as lgb
from hummingbird.ml import convert

x = np.arange(0, 100)
y = (np.sin(x * 0.25) + 1) * 2 + np.ones(100)*5 + np.random.rand(100) * 0.1

# Prepare dataset
points = 12
names = []
for i in range(points):
    names.append("a" + str(i))
ds = []

This file has been truncated. show original