@haichen, I’m trying this, but the alter_op_layout is never called because the layouts appear to be invalid. Specifically, this line https://github.com/apache/incubator-tvm/blob/master/src/relay/transforms/transform_layout.h#L285-L286 always returns success=false. I tried adding the ElemwiseArbitraryLayout to sparse dense, but that did not fix the problem. Is there a way to add the correct layout (which I assume is just the identity?) or a way to skip this layout business altogether?