After re-building the entire TVM, and trying it again, I got the normal result now This time I use the new TVM builds and this is what I got
note: affinity_mode: kBig = 1, kLittle = -1. kDefault = 0. pass 1 or -1 to control the cores
H=512 L=12 BERT
affinity mode is: -1 , core number is: 2
Mean inference time (std dev): 530.63 ms (12.87 ms)
affinity mode is: -1 , core number is: 4
Mean inference time (std dev): 298.80 ms (2.79 ms)
affinity mode is: 1 , core number is: 2
Mean inference time (std dev): 227.32 ms (1.17 ms)
affinity mode is: 1 , core number is: 4
Mean inference time (std dev): 143.89 ms (4.97 ms)
affinity mode is: 0 , core number is: 5
Mean inference time (std dev): 165.22 ms (3.75 ms)
affinity mode is: 0 , core number is: 6
Mean inference time (std dev): 224.16 ms (3.47 ms)
affinity mode is: 0 , core number is: 8
Mean inference time (std dev): 181.72 ms (15.10 ms)
Mobilenet
affinity mode is: -1 , core number is: 2
Mean inference time (std dev): 294.93 ms (2.86 ms)
affinity mode is: -1 , core number is: 4
Mean inference time (std dev): 146.83 ms (1.45 ms)
affinity mode is: 1 , core number is: 2
Mean inference time (std dev): 97.59 ms (0.91 ms)
affinity mode is: 1 , core number is: 4
Mean inference time (std dev): 55.96 ms (1.05 ms)
affinity mode is: 0 , core number is: 5
Mean inference time (std dev): 112.20 ms (2.04 ms)
affinity mode is: 0 , core number is: 6
Mean inference time (std dev): 95.35 ms (1.53 ms)
affinity mode is: 0 , core number is: 8
Mean inference time (std dev): 76.14 ms (4.59 ms)