Question about Codegen (tvmgen_default_fused)

Questions
#1

Hi Sirs,

I have a question about the codegen when using CMSIS-NN Pass.

Below picture is part of the model.

image
image432×517 18.1 KB

And we got the generated function as below picture.

image
image858×199 21 KB

There are 4 default fused functions before concatenate, and the function is just only copy input to output.

image
image702×239 11.5 KB

These 4 fused functions look like unnecessary, could they be not generated ?

Thanks!

#2

This looks similar to the issue with reshape that was recently fixed https://github.com/apache/tvm/pull/12215

cc @ashutosh-arm

#3

It looks like they correspond to reshape op of Relay. Could you please share the *.relay file produced from compilation?

#4

Do you mean this (relay file)?

Or please tell me how to save relay file.

Thanks!

#5

Hi @markii apologies for the delay, I just tried your link but it looks like it has expired now. Would you mind resending?

Out of interest did you try cherry-picking the patch that I attached above (https://github.com/apache/tvm/pull/12215) into your tree? Did this make any different to the generated code?

#6

Hi lhutton1,

yes, but it makes no different. please refer to the below link~

Thanks~