Hi @FrozenGene,
I think I see why we don’t want to change the layout for no workload (no workload means we don’t even know the strategy, I think). What I am missing is why we don’t want to change the layout when cfg.is_fallback
. In that case, the strategy is defined, so we know how the weights should be reshaped (likewise, we know what data type we need during legalization).