Problem with FuseOps (and embedded constants in TIR)

kparzysz · February 25, 2022, 2:57pm

We were hitting this assertion:

apache/tvm/blob/main/src/relay/backend/te_compiler_cache.cc#L242


          return make_const(dtype, static_cast<const int32_t*>(data)[0]);
        } else if (dtype == DataType::Int(64)) {
          return make_const(dtype, static_cast<const int64_t*>(data)[0]);
        } else if (dtype == DataType::Float(32)) {
          return make_const(dtype, static_cast<const float*>(data)[0]);
        } else if (dtype == DataType::Float(64)) {
          return make_const(dtype, static_cast<const double*>(data)[0]);
        } else if (dtype == DataType::Bool()) {
          return make_const(dtype, static_cast<const uint8_t*>(data)[0]);
        } else {
          LOG(FATAL) << dtype << " not handled";
          return tvm::PrimExpr();
        }
      },
      "compile_engine_const", topi::kBroadcast);
  scalars_.push_back(value->op);
  return {value};
} else {
  const auto* ttype = op->checked_type().as<TensorTypeNode>();
  std::stringstream ss;
  ss << "constant_" << const_index++;

We do have a unit testcase that checks the LLVM IR to see if the _linked_param function was generated, but I’m not sure if it runs in CI right now, since it requires Hexagon target to be enabled. This is actually work in progress, so these tests should start running soon.