Problem with relay.qnn.op.conv2d's channels value limit

Questions
#1

Hi I’m currently working on compiling I-ViT using TVM from https://github.com/zkkli/I-ViT. On this project, This error appears.

Check failed: value < 1LL << (dtype.bits() - 1) (192 vs. 128) : ValueError: Literal value 192 exceeds maximum of int8

I think this error appears on this code section

conv2d = relay.qnn.op.conv2d(data, weight, input_zero_point, kernel_zero_point, input_scale, 
kernel_scale, kernel_size=kernel_size, channels=output_channels, data_layout=data_layout, 
kernel_layout=kernel_layout, strides=strides, padding=padding, **kwargs)

conv2d’s channels has data type int8 and value 192 exceeds the limit of int8. Is there any way to solve this problem?? should I create another conv2d and use those 2 layer as one??

#2

I have same issue. Did you solve?

#3

The Error was caused by quantized layer norm from layers.py

def quantized_layernorm(data, 
                    bias_int):
    data = relay.cast(data, 'int32')
    mean = relay.mean(data, axis=2, keepdims=True)
    data = data - mean
    data_sq = data * data

This should fix it

1 Like