How to read out the intermediate value in Relay IR?

AndrewZhaoLuo · February 15, 2022, 8:39pm

https://github.com/AndrewZhaoLuo/TVM-Sandbox/blob/main/relay/graph_debugger_example.py Here is an example of using graph debugger. My apologies as it isn’t very complete and the tensor dumps you’ll have to manually associate.

If you use graph debugger there is also an interesting function get_node_output which might also be promising:

github.com

apache/tvm/blob/main/src/runtime/graph_executor/debug/graph_executor_debug.cc#L351


  return PackedFunc([sptr_to_self, this](TVMArgs args, TVMRetValue* rv) {
    if (String::CanConvertFrom(args[0])) {
      this->DebugGetNodeOutput(this->GetNodeIndex(args[0]), args[1]);
    } else {
      this->DebugGetNodeOutput(args[0], args[1]);
    }
  });
} else if (name == "execute_node") {
  return PackedFunc(
      [sptr_to_self, this](TVMArgs args, TVMRetValue* rv) { this->ExecuteNode(args[0]); });
} else if (name == "get_node_output") {
  return PackedFunc([sptr_to_self, this](TVMArgs args, TVMRetValue* rv) {
    *rv = this->GetNodeOutput(args[0], args[1]);
  });
} else if (name == "run_individual") {
  return PackedFunc([sptr_to_self, this](TVMArgs args, TVMRetValue* rv) {
    int number = args[0];
    int repeat = args[1];
    int min_repeat_ms = args[2];
    ICHECK_GT(number, 0);
    ICHECK_GT(repeat, 0);

Finally debug_get_output is also a function you can call with the above example with rt_mod: https://github.com/apache/tvm/blob/main/python/tvm/contrib/debugger/debug_executor.py#L234