[Discussion] About the weight layout of Dense/BatchMatmul

I think @altanh and @tkonolige has similar findings too recently.