Why do we need to build TVM runtime on remote device for Auto TVM?

Can you double check that your device has /lib/arm-linux-gnueabi folder without hf?

As for glibc version - you can use Ubuntu 14.04 or Debian 8 (Jessie) OS to cross-compile TVM runtime for your device - both has glibc 2.19