Question about Target option

[gnup84]

Thanks you so much…

I tested many options.

then i catch the weird situations.

target = “llvm -mcpu=cascadelake -libs=mkl”

if i set a option to use mkl like above, the inference time is slower than not use mkl.

not use mkl = 12ms use mkl = 87ms

TVM and BLAS libraries

It depends. What’s your workload? Is that just a dense op or an entire network? Dense may not be the performance bottleneck if you profile an entire network so that the impact of using CBLAS would be moderated. I did an experiment months ago using 512x512 matrix to perform dense with and without CBLAS. The one with CBLAS is ~1.25x faster. If no external library specified (e.g., llvm), TVM will generate LLVM IR and then lowers to the machine code directly. In this case, it’s suggested to specify…

This post says set(USE_OPENMP intel or gnu) can improve the inference time.

In this case, inference time is 16ms. // use_openmp and mkl But still slow…

I think that using mkl is more fast than not use.

Why this happen??

1. Why using MKL is more slow than base.
2. What is the relationship between the openmp, mkl? *** model = resnet50, bacth_size = 1, model in relay.testing