HMX support on HTP using tvm runtime

#1

TVM has support for hvx on htp. I want to know if tvm supports hmx on htp? or tvm plans to support hmx in future? @sanirudh @srkreddy1238 @tqchen

2 Likes
#2

@Hzfengsy Do you know any relevant information about this issue?

#3

Unfortunately, Qualcomm does not provide public HMX API and documentation, so we are not able to support them shortly

1 Like
#4

What about the stuff published by Qualcomm a long-time ago?

  1. Is it for GPU/CPU-only? Perhaps leveraging TVM & OpenCL
  2. Is it relevant for (old) HTP archs? I mean useless for S23 (>= v73) onwards.

Are any Qualcomm engineers or researchers in this Forum?

#5

Hi @escorciav, I am a Qualcomm engineer. You’re right. The link you’ve shared only talks about targeting Adreno GPU using TVM/OpenCL and this doesn’t apply to Hexagon DSP (or HTP). My team has been working on TVM for Hexagon DSP, but we don’t plan to support APIs and features that are not public.

1 Like
#6

Thanks. Looking forward to use it as part of QNN (or SNPE)!

May I know if you guys are using Halide for newer DSP:HTP archs? The docs seems old.

#7

hi @jverma , Can we integrate QNN/SNPE to tvm by byoc?

#8

So far, hexagon sdk version 5.5 has examples for htp, but only for fp16 and not int8.