howave
October 21, 2018, 7:18am
1
I convert the model and params to float16 format,
and set some parameters for float16 calculation.
int dtype_code = kDLFloat;
then uses float2half and half2float for data conversion,
TVMArrayCopyFromBytes(x, data_x, total_inputsizeof(uint16_t)); sizeof(uint16_t));
float32 results are verified according to the example but the float16 results by above settings are wrong.
Could you have some guides？Thanks!
The correctness of fp16 in python is verified here https://github.com/merrymercy/tvm-mali/issues/3#issuecomment-371849500 .
@qhou also verified fp16 on mali (in C++ API?). Maybe he can share some thoughts.
howave
October 21, 2018, 7:51am
3
Yes, I also verified the correctness of our fp16 models in python.
howave
October 22, 2018, 8:06am
4
It works now, there is something wrong with my float/half conversion functions.
Nice, you can also use these functions for float/half conversion.
/*!
* Copyright (c) 2018 by Contributors
* \file builtin_fp16.cc
* \brief Functions for conversion between fp32 and fp16
*/
#include <builtin_fp16.h>
#include <tvm/runtime/c_runtime_api.h>
extern "C" {
// disable under msvc
#ifndef _MSC_VER
TVM_WEAK uint16_t __gnu_f2h_ieee(float a) {
return __truncXfYf2__<float, uint32_t, 23, uint16_t, uint16_t, 10>(a);
}
TVM_WEAK float __gnu_h2f_ieee(uint16_t a) {
return __extendXfYf2__<uint16_t, uint16_t, 10, float, uint32_t, 23>(a);
}
show original
qhou
October 26, 2018, 3:57am
6
We implemented float32 to float16 in assembly for aarch64. It works well.
@merrymercy Hi, can you elaborate how to call this function in C++?
I have a float* a, and I assigned values to it. How should I copy these float32 data to a float16 DLTensor?
many thanks if there any help
you can use the function like:
out[indexOut] = (int)(__gnu_h2f_ieee(*(outputData + indexOutputData)));