Hello @FrozenGene, Yes, I knew there is “MaxConcurrency()” function in the backend.cc to control the max number of cores we could use.
What I did: export TVM_NUM_THREADS =8 in Hikey 970 since it has 8 cores. Afterwards, I run with following code: config_threadpool(0, 8) ftimer = module.module.time_evaluator(“run”, dev, repeat=50, min_repeat_ms=500)
I use htop and indeed the benchmark is using all of 8 cores (CPU utilization ~=800%)
I have run several times and the result I got is consistent.
- running with 4 small even outperform running with 4 big cores.
- running with 4 big and 4 small outperform running only with 4 big cores.
Both are weird to me…
