Autotvm compilation Error with Adreno 630 (Galaxy S9)

thkim · March 15, 2021, 10:12pm

I’m trying to do auto-tuning with Adreno 630. Although there was a similar question (Autotune error with Qualcomm Adreno), my error is different and the given solution doesn’t work. The following is one debug message of multiple trials.

I’ve followed https://tvm.apache.org/docs/tutorials/frontend/deploy_model_on_android.html and https://tvm.apache.org/docs/tutorials/autotvm/tune_relay_mobile_gpu.html. Currently, I’ve run a TVM-built model and an autotuned TVM-built model on Galaxy S9 CPU, and a TVM-built model on Galaxy S9 Adreno GPU.

My target and host setting are: target = tvm.target.Target(“opencl”) target_host = “llvm -mtriple=arm64-linux-android”

Thanks!

csullivan · March 18, 2021, 6:59pm

Hi @thkim, can you try with the “opencl --device=mali” target and see if you are able to autotune? The issue might be related to using the cuda winograd schedule.

thkim · March 19, 2021, 7:45am

Thank you for your reply @csullivan. Unfortunately, I was not able to autotune with the “opencl --device=mali” I didn’t include -device option because I’m using Adreno gpu. For reference, I’ve tried the following conditions:

target = ‘opencl’ target = ‘opencl -device=mali’ target = ‘opencl --device=mali’ target = tvm.target.Target(“opencl”) target = tvm.target.Target(“opencl -device=mali”) target = tvm.target.Target(“opencl --device=mali”)

csullivan · March 20, 2021, 12:05am

Hi @thkim, I’ve used

target = "opencl --device=mali"
target_host = "llvm -mtriple=arm64-linux-android"

for autotuning on Adreno 650 successfully. When you use this configuration what errors do you see?

Related: We will soon upstream support for an Adreno target specifically. Please checkout [RFC] Texture memory support if you are interested.

thkim · March 21, 2021, 5:13am

Hi @csullivan, I’ve used the same target and target_host. It shows multiple 0.00/ 0.00 GFLOPS.

I’ve used my desktop that doesn’t have GPU. I think it makes some problem with the autotuning process. Is it correct? Currently, I’m trying to use my laptop including GEFORCE RTX 2060. There is an issue with using my GPU driver in the TVM docker. If you’ve made the environment to use GPU driver in the TVM docker, could you give me some tips?

Thank you so much for your reply!

thkim · March 23, 2021, 12:29am

You don’t need to reply to my additional questions. I’ve made the environment to use GPU driver in the TVM docker. However, I’m facing the same issue.

thkim · June 16, 2021, 8:35pm

Hi @csullivan, I came back here. From the log file, the compilation error messages look as follows:

It seems that the android toolchain file has problems. I’ve just followed this link (tvm/apps/android_rpc at main · apache/tvm · GitHub) to generate a standalone toolchain, but it’s targetting the CPU, not GPU. I think the problem is from the standalone toolchain file considering the error messages. What standalone toolchain file did you use?

Thanks!

Taeho