Sorry for late participation, ARM China as a commercial user of TVM have done lots of work to meet the customer’s requirements, just like what tianqi have pointed.
1. The centric build approach can’t work for us
in the early time we try our best to add the customized pass or logic in Relay’s centric build flow, then we found we need pay lots of time to fix official failed cases and actually all these fixes are very specific for our business scenario, they aren’t general solutions, so they shouldn’t be contributed to community. Finally, as the business requirement grow, we choose to use our own build flow, this way can control the passes flexibly.
2. TVM Script (TensorIR) is the key to our next step DSL work
Besides the Relay/Relax graph level work, our next step work will be focus on DSL, in other words, we need a higher level and more abstract programming method than the traditional OpenCL C way, the key to archive this work is TVM script, because it resolves the expressive power issue of TE. So we need and look forward to the newest update of TVM script and relevant work.
Many TVM users may know TVM script and Relax are the two key point of Unity branch, some community contributors like @Hzfengsy @junrushao pay lots of extra time to keep the TVM script work synced between branch main and Unity, the same changes need to send two different PR to two branch will consume lots of precious energy and time of TVM contributors. So we agree use Unity as the main branch.
3. The work of Unity is the key of everyone’s next step success.
Everyone know the work of Unity is focus on LLM/AIGC, if a company can’t keep up with this technical revolution, then we can see it can’t be success in the future. Use Unity as the main branch will make the downstream organization of TVM community like us easier to use the newest work like dynamic shape, Relax and so on.
4. The transition will be smooth for Relay users.
As previous discuss pointed out, the Unity will still keep all work of Relay, so the downstream like us can transition smoothly, this is very important for our customers, so very thanks to community contributors for keep this point.