Hi @jacobpostman, thank you for the clarification. I tried to tune the model on iOS target, with the above changes whichever you noted, I’m able to tune the model on the iOS target but while tuning the model every time I see "Current/Best: 0.00/ 0.00 GFLOPS" in the logs. I’ve used the same script whichever you shared ([Auto-TVM] How to Auto tune the model on iOS device).i ran the tuning model for more than an hour, for more info attaching the tuning logs.
Test Suite 'All tests' started at 2020-09-15 18:28:32.249
Test Suite 'tvmrpcLauncher.xctest' started at 2020-09-15 18:28:32.249
Test Suite 'tvmrpcLauncher' started at 2020-09-15 18:28:32.249
Test Case '-[tvmrpcLauncher testRPC]' started.
2020-09-15 18:28:32.344791+0530 tvmrpc[3515:190115] [18:28:32] /Users/Dileep/LatestTVM/22_08/tvm/apps/ios_rpc/tvmrpc/TVMRuntime.mm:146: Load module from /private/var/containers/Bundle/Application/B8353EEF-9E61-40CC-BF6E-80EBDDF824F3/tvmrpc.app/Frameworks/tvm/tmp_func_17cd287b713d0fed.dylib ...
Test Case '-[tvmrpcLauncher testRPC]' passed (0.126 seconds).
Test Suite 'tvmrpcLauncher' passed at 2020-09-15 18:28:32.376.
Executed 1 test, with 0 failures (0 unexpected) in 0.126 (0.126) seconds
Test Suite 'tvmrpcLauncher.xctest' passed at 2020-09-15 18:28:32.376.
Executed 1 test, with 0 failures (0 unexpected) in 0.126 (0.127) seconds
Test Suite 'All tests' passed at 2020-09-15 18:28:32.376.
Executed 1 test, with 0 failures (0 unexpected) in 0.126 (0.127) seconds
[Task 10/12] Current/Best: 0.00/ 0.00 GFLOPS | Progress: (42/100) | 456.39 s
Test session results and logs:
/Users/Library/Developer/Xcode/DerivedData/tvmrpc-crkmdkqlzonxjwdcvrxtvofnlaup/Logs/Test/Test-tvmrpc-2020.09.15_18-28-23-+0530.xcresult
2020-09-15 18:28:32.398 xcodebuild[35740:545190] [MT] IDETestOperationsObserverDebug: 7.995 elapsed -- Testing started completed.
2020-09-15 18:28:32.398 xcodebuild[35740:545190] [MT] IDETestOperationsObserverDebug: 0.000 sec, +0.000 sec -- start
2020-09-15 18:28:32.398 xcodebuild[35740:545190] [MT] IDETestOperationsObserverDebug: 7.995 sec, +7.995 sec -- end
** TEST SUCCEEDED **
Every time I can see the test got succeded, but there is no change in the GFLOPS. Whether the model is tuning properly or any step I’m missing while tuning the model?
the same way I tried to tune the model on iPhone Metal target, changing the below target configurations
target = 'metal'
proxy_port = 9090
key = "iphone"
arch = "arm64"
sdk = "iphoneos"
target_host = "llvm -mtriple=%s-apple-darwin" % arch
tasks = autotvm.task.extract_from_program(mod["main"], target=target,
target_host= target_host,params=params,
ops=(relay.op.get("nn.conv2d"),))
After changing the above target configuration, tuning is not happening for the iPhone Metal target. any idea what step might be missing here? Have you tried to tune the model on the iPhone Metal target?
Thanks,