Running LegalizeOps in C++

Troubleshooting
#1

I am having trouble running legalizeOps in C++. I have an IRModule in C++ and I try to run a few passes.

auto optMod    = tvm::transform::Sequential({
          tvm::relax::transform::Normalize(),
          tvm::relax::transform::FoldConstant(),
          tvm::relax::transform::EliminateCommonSubexpr(),
          tvm::relax::transform::LegalizeOps(tvm::runtime::NullOptType{}, true),
          tvm::relax::transform::DeadCodeElimination(),
          tvm::tir::transform::LowerInitBlock(),
          tvm::tir::transform::RemoveNoOp(),
          tvm::tir::transform::Simplify(),
        })(tvmMod);

When I try to run this in C++ instead of python I get a bunch of warnings (for every relax op basically):

<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.power is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.sum is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.reshape is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.multiply is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.add is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.rsqrt is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.multiply is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.multiply is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.permute_dims is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.reshape is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.matmul is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.permute_dims is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.reshape is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.matmul is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.permute_dims is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.reshape is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.matmul is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.reshape is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.reshape is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.reshape is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.strided_slice is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.strided_slice is found.
<...>/tvm/0.19.0/Release/src/relax/transform/legalize_ops.cc:323: Warning: No legalization func for relax.reshape is found

My understanding is that when we import tvm in python it automatically registers legalization functions for all the relax operator. Is this not possible in C++? Is there a way to run LegalizeOps in C++?

Thanks

#2

You are right. All legalization functions for operators are registered in Python. So there is no way to run it in pure C++.

I wonder what’s the use case of running the compilation stage without python env

1 Like
#3

in general we are moving towards a stage where we focus on python-first compiler development, while enabling deployment without any python dependencies.

1 Like