Hi, I am trying to autotune the tflite model mobilenet_v1_1.0_224.tflite using. I used the code for tuning mxnet model and made some changes for the above mentioned model. Looks like tuning is happening but at last when we are try to deploy it to at arm target it throws some error. (Currently I was using 10 number of trials for every task, just for the test purpose) Following are the logs:
Extract tasks… File mobilenet_v1_1.0_224.tgz existed, skip. Tuning… [Task 1/20] Current/Best: 0.63/ 5.92 GFLOPS | Progress: (10/10) | 15.94 s Done. [Task 2/20] Current/Best: 0.85/ 3.99 GFLOPS | Progress: (10/10) | 6.54 s Done. [Task 3/20] Current/Best: 4.62/ 6.91 GFLOPS | Progress: (10/10) | 7.15 s Done. [Task 4/20] Current/Best: 1.01/ 1.94 GFLOPS | Progress: (10/10) | 5.10 s Done. [Task 5/20] Current/Best: 3.18/ 3.49 GFLOPS | Progress: (10/10) | 10.17 s Done. [Task 6/20] Current/Best: 1.36/ 1.36 GFLOPS | Progress: (10/10) | 3.33 s Done. [Task 7/20] Current/Best: 1.69/ 8.85 GFLOPS | Progress: (10/10) | 4.15 s Done. [Task 8/20] Current/Best: 0.53/ 3.08 GFLOPS | Progress: (10/10) | 14.34 s Done. [Task 9/20] Current/Best: 3.67/ 9.57 GFLOPS | Progress: (10/10) | 6.57 s Done. [Task 10/20] Current/Best: 2.01/ 2.01 GFLOPS | Progress: (10/10) | 7.32 s Done. [Task 11/20] Current/Best: 3.95/ 10.97 GFLOPS | Progress: (10/10) | 16.84 s Done. [Task 12/20] Current/Best: 1.41/ 2.62 GFLOPS | Progress: (10/10) | 5.87 s Done. [Task 13/20] Current/Best: 9.62/ 10.89 GFLOPS | Progress: (10/10) | 5.09 s Done. [Task 14/20] Current/Best: 0.00/ 2.52 GFLOPS | Progress: (10/10) | 12.28 s Done. [Task 15/20] Current/Best: 4.06/ 14.68 GFLOPS | Progress: (10/10) | 7.10 s Done. [Task 16/20] Current/Best: 0.45/ 2.15 GFLOPS | Progress: (10/10) | 12.44 s Done. [Task 17/20] Current/Best: 4.41/ 6.61 GFLOPS | Progress: (10/10) | 4.77 s Done. [Task 18/20] Current/Best: 0.00/ 1.96 GFLOPS | Progress: (10/10) | 29.38 s Done. [Task 19/20] Current/Best: 6.53/ 8.62 GFLOPS | Progress: (10/10) | 6.84 s Done. [Task 20/20] Current/Best: 3.63/ 5.71 GFLOPS | Progress: (10/10) | 2.83 s Done. Compile… Upload… Traceback (most recent call last): File “tune_relay_arm.py”, line 443, in tune_and_evaluate(tuning_option) File “tune_relay_arm.py”, line 416, in tune_and_evaluate module.set_input(‘data’, data_tvm) File “/home/yovan/tvm_all/tvm/python/tvm/contrib/graph_runtime.py”, line 132, in set_input self._get_input(key).copyfrom(value) File “tvm/_ffi/_cython/./function.pxi”, line 286, in tvm._ffi._cy2.core.FunctionBase.call File “tvm/_ffi/_cython/./function.pxi”, line 221, in tvm._ffi._cy2.core.FuncCall File “tvm/_ffi/_cython/./function.pxi”, line 210, in tvm._ffi._cy2.core.FuncCall3 File “tvm/_ffi/_cython/./base.pxi”, line 143, in tvm._ffi._cy2.core.CALL tvm._ffi.base.TVMError: Except caught from RPC call: [15:41:12] /home/yovan/tvm_all/tvm/apps/android_rpc/app/src/main/jni/../../../../../../include/../src/runtime/graph/graph_runtime.cc:339: Check failed: in_idx >= 0 (-1 vs. 0)