Hi, I am new to tvm and I’m working with ansor.
I’ve followed some tutorials and they worked well.
Now I wonder If the measurements will remain correct if I launch multiple auto-tuning tasks simultaneously?
I have referred to How does AutoTVM distribute resources for tuning and runtime measurements on one single CPU?. It seems like it’s OK when CPU/GPU resources are relatively abundant. But what if I run 1,000 tasks on a CPU with only 32 threads? Or what if the total memory requirement of these task are somehow too large, lead to OS swap issue?
Any help would be appreciated! 
if you tune GPU tasks this is likely fine since it measures GPU time. if you tune CPU tasks, running tuner and worker on the same machine can be inaccurate
1 Like
Hi, not sure what the ‘multiple tasks’ you were refer to specifically, if the ‘tasks’ is what Ansor extrated from IrModule, which has nothing to do with hardware resource. For Ansor there are intermittent measuring periods when single task schedule is built and measured on target hardware. The measuring is done task by task sequentially not parallel.