I was trying to convert my pytorch model to relay. The model is from performer_torch. However, I got "NotImplementedError: The following operators are not implemented: [‘aten::einsum’].
I also tried to work around by first converting pytorch model to onnx and then parse the onnx to get relay. However, the same issue happens: “tvm.error.OpNotImplemented: The following operators are not supported for fronend ONNX: Einsum”.
Einsum has become an important operator in the transformer family, as it is convenient for various kind of attention mechanisms. Is there any way to work around this? Or is there any plan to support it in the frontend?