We are trying to use test script https://github.com/apache/tvm/blob/v0.8/tests/python/frontend/onnx/test_forward.py. Please note for tvm v0.8, latest ONNX opset version is 13. However, we see above test script explicitly verifies older opset version of an OP. e.g. test_squeeze() verifies opset=11, test_upsample_nearest() verifies opset=7
Given above, how does CI ensure that the latest opset version for an ONNX OP is not broken ?
Please note, above issue is with both release and main branch.
At the moment there is no written policy on officially supported versions of input frameworks. They are mostly based on best effort from community members to support operators in various frameworks and write tests to them.
Current CI offers no guarantees of that kind, as it is another of the cases of best effort non-structured community support.
I’d encourage you to file issues on the GitHub project for issues you find. In case it is possible for you, patches fixing those issues are also always welcome.