OpenCL jit slowed down on ARM

Development
1

Hi

A while ago as a test, I’ve deployed simple resnet18 on Mali T830 (built with mali target) and Mali G71 (built with opencl target) and the first run where jit happens, took ~6 seconds. But just back to that app, jit now takes ~ 25 seconds which is very strange. I checked everything, (removing the app and installing again) even compared nightly with the prev version tvnm/nnvm that I was using and couldn’t find any reason why jit got quadruple all of a sudden.

Would appreciate any comment or insight!

2

JIT timing is likely has things to do with opencl driver, which we cannot do too much about it. Maybe way to reduce jit timing is to use domain specific opencl compiler to build the binary first. I haven’t tried that route but in theory we could update runtime to support that