How to find out layout transformation time?

Questions
#1

Hi. I am working with AutoTVM. On running the tune_relay_x86 script in tutorials/autotvm, I get the console output showing the mean inference time with the optimal schedule. How can I determine what proportion of this inference time that was spent on data layout transformations?

Can I determine it from just the log files (a.k.a without making changes to the code)? If changes in code are needed, please provide hints on how to proceed with this task. Thanks.

#2

You can use a built-in profiler to measure per-op times. See an example in https://github.com/apache/tvm/blob/main/tests/python/unittest/test_runtime_profiling.py#L72-L75. The report would include the time it took for all layout transforms.

1 Like