[opencl] support image memory object in opencl backend

#1

Hello,

since image memory and buffer memory are two types of storage in Opencl. and sometimes Image will outperform Buffer in some case, But seems TVM can’t generate kernel code with Image.

Could anyone give some hints or guideline about how to enable TVM could create Image memory as storage?

to be more specific

  • use clcreateimage to create a memory object and read_image to read from it.
#2

I wonder if there are supports for opencl image in TVM now? Thx

#4

Yes. I think so. There is a PR in TVM and we demonstrated that TVM can surpass most of human-written code in mobile -GPU with texture memory support.

#5

That’s impressive. So can you show some docs or keywords about the feature? BTW, I really care about that can I use ansor to generate code spporting opencl images? Thank you !

#6

Here is the related RFC [[RFC] Texture memory support] by the other authors. But I think there is no out-of-the-box ansor supporting right now. You can create a topic to discuss that.

#7

What formats are used to pack NHWC into RGBA which is inherently HW4. Only one I can think of is to split the channels into groups of four, then you have N * (C/4) HW4 images.

Any idea what is used by topi when the target is opencl?