[BYOC, CUTLASS] Dealing with Constants in C source-gen based BYOC

ashutosh-arm · November 25, 2021, 4:57pm

Hi @masahi, We are using constant extraction in CMSIS-NN flow what @manupa-arm has suggested above. Please take a look here:

github.com

apache/tvm/blob/ee230138cb89c0e57946f0237e27fbe161149838/src/relay/backend/contrib/cmsisnn/extract_constants.cc#L162


  return mod;
}


transform::Pass ExtractConstantsFromPartitionedFunction() {
  runtime::TypedPackedFunc<IRModule(IRModule, transform::PassContext)> pass_func =
      [=](IRModule m, transform::PassContext pc) { return ExtractConstants(m); };
  return tvm::transform::CreateModulePass(pass_func, 0, "ExtractConstantsFromPartitionedFunction",
                                          {});
}


TVM_REGISTER_GLOBAL("relay.ext.cmsisnn.transform.ExtractConstantsFromPartitionedFunction")
    .set_body_typed(ExtractConstantsFromPartitionedFunction);


}  // namespace cmsisnn
}  // namespace contrib
}  // namespace relay
}  // namespace tvm