Benchmarking Quantization on Intel CPU

Application
25

You should try tuning your model with the highest level of AVX extensions that your CPU supports (avx2 or avx512). Tuning tutorial: https://docs.tvm.ai/tutorials/autotvm/tune_nnvm_x86.html