Hello,
This thread may be useful. TLDR unless you use Tensor Core FP16 will not give you the performance improvements seen in TRT.
Hello,
This thread may be useful. TLDR unless you use Tensor Core FP16 will not give you the performance improvements seen in TRT.