RPi4 Unit test fail: test_fp16_conversion

Troubleshooting
#1

I am testing out the new RC on some of my machines.

I am running the unit tests, and have build for a Raspberry Pi 4 (Raspbian 10, python3.7.3, numpy==1.21.4).

I have the unit test tests/python/all-platform-minimal-test/test_runtime_ndarray.py::test_fp16_conversion FAILED.

E       AssertionError: 
E       Not equal to tolerance rtol=1e-07, atol=1e-07
E       
E       Mismatched elements: 100 / 100 (100%)
E       Max absolute difference: 263.8
E       Max relative difference: inf
E        x: array([ -87.8 ,   28.55,  -17.6 ,  -94.06, -110.44,  -67.6 ,  -60.47,
E                85.  , -125.3 ,  148.6 , -130.  ,  -59.4 , -192.4 ,  -15.72,
E               -72.56, -158.  , -110.25, -134.4 ,   86.8 ,  119.44,  133.1 ,...
E        y: array([0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,
E              0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,
E              0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,...

Is this test expected to fail on this platform, e.g. due to it not being supported in the ISA? Or is there some other issue at play?

#2

I’m not sure. Is it reprorucible on x86? Is LLVM properly linked on raspi?

#3

I’ve built on x86, and had complete test coverage.

I’m using what is currently the default LLVM on Raspbian’s http://raspbian.raspberrypi.org/raspbian buster/main armhf

I can compile and run models with TVM on the RPi4, it’s just this test that’s failing (and possibly others after it).

I’ll try tomorrow running in a Docker container on the RPi4