How to add a custom tunable parameter to Ansor?

wanwanwan · April 14, 2021, 6:58am

Hi, I have a question about the usage of Ansor.

I found that the cudnn TOPI has a tunable knob ‘algo’ to pick the best of the cudnn algorithm types using AutoTVM.

apache/tvm/blob/main/python/tvm/topi/cuda/conv2d.py#L120-L122


cfg.define_knob("algo", range(8))
if cfg.is_fallback:  # Let CUDNN choose the best algo
    cfg["algo"] = OtherOptionEntity(-1)

Could you tell me how to add a tunable parameter like ‘algo’, and do the same kind of auto-tuning with AutoScheduling ( a.k.a Ansor ) ?

Thank you.

comaniac · April 14, 2021, 4:25pm

Ansor doesn’t support custom tunable knob for now. On the other hand, if you are clear about the knobs you want to tune, AutoTVM is still a good option as for today.