TVMC - UMA Integration

@PhilippvK Are you referring to this PR? https://github.com/apache/tvm/pull/11382 As far as I can tell, it does not define a textual representation for multi targets. But yes, the canon_multi_target_and_host helper originates from there.

@MJKlaiber Thanks for the feedback. I did not find any use of environment variables in TVMC besides the $TVM_CONFIGS_JSON_DIR, so I’d appreciate some feedback from TVMC veterans on adding $UMA_BACKENDS. @leandron @gromero

Good idea about just always using the multi target, to avoid the multi target challenge on the CLI entirely. This should not have any downside as far as I can tell.

I was referring to this regarding extra_targets: https://github.com/apache/tvm/blob/main/python/tvm/driver/tvmc/target.py#L371 and https://github.com/apache/tvm/blob/main/python/tvm/driver/tvmc/compiler.py#L300 . I dug a bit deeper and found this related PR: https://github.com/apache/tvm/pull/7304 and this discussion post: BYOC Partitioning Support on TVMC by @leandron . So this seems related to BYOC partitioning. Maybe there is some room for unification here.

1 Like