The freeze_params and relay.transform.DynamicToStatic() help to transfer the dynamic shape to static. mod, params = relay.frontend.from_onnx(onnx_model, shape_dict, freeze_params=True) mod = relay.transform.DynamicToStatic()(mod)
This solves my issue.