Using target flag --link-params

aakah18151 · February 24, 2021, 1:30pm

I am trying to use -link-params target flag to store the weights/parameters of a custom MNIST model in the flash memory. I am using STM32F746-Nucleo board and getting an error while running this using microTVM.

..
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 23 B]:
0000  ff fd 2b 00 00 00 e1 66 10 20 00 00 00 00 00 00  ..+....f........
0010  00 04 00 00 00 02 00                             .......
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 32 B]:
0000  00 00 00 00 00 00 03 00 00 00 0a 00 00 00 00 00  ................
0010  00 00 06 80 00 80 ff ff ff ff ff ff ff ff e4 8f  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: ff fd                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  4 B]: 5e 00 00 00                                      ^...
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  3 B]: e1 66 10                                         .f.
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [ 95 B]:
0000  53 00 00 00 00 00 00 00 03 00 00 00 01 80 02 80  S...............
0010  ff ff ff ff ff ff ff ff 03 00 00 00 09 00 00 00  ................
0020  0b 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00  ................
0030  1f 00 00 00 00 00 00 00 66 75 73 65 64 5f 6e 6e  ........fused_nn
0040  5f 63 6f 6e 74 72 69 62 5f 64 65 6e 73 65 5f 70  _contrib_dense_p
0050  61 63 6b 5f 61 64 64 00 00 00 00 00 00 00 00     ack_add........
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: 8d a6                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 25 B]:
0000  ff fd 2b 00 00 00 e1 66 10 20 00 00 00 00 00 00  ..+....f........
0010  00 04 00 00 00 02 00 00 00                       .........
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 30 B]:
0000  00 00 00 00 03 00 00 00 0a 00 00 00 00 00 00 00  ................
0010  01 80 00 80 ff ff ff ff ff ff ff ff af 87        ..............
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: ff fd                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  4 B]: 4f 00 00 00                                      O...
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  3 B]: e1 66 10                                         .f.
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [ 80 B]:
0000  44 00 00 00 00 00 00 00 03 00 00 00 01 80 02 80  D...............
0010  ff ff ff ff ff ff ff ff 03 00 00 00 09 00 00 00  ................
0020  0b 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00  ................
0030  10 00 00 00 00 00 00 00 66 75 73 65 64 5f 6e 6e  ........fused_nn
0040  5f 73 6f 66 74 6d 61 78 00 00 00 00 00 00 00 00  _softmax........
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: 97 c4                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 18 B]:
0000  ff fd 2b 00 00 00 e1 66 10 20 00 00 00 00 00 00  ..+....f........
0010  00 04                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 34 B]:
0000  00 00 00 02 00 00 00 00 00 00 00 03 00 00 00 0a  ................
0010  00 00 00 00 00 00 00 02 80 00 80 ff ff ff ff ff  ................
0020  ff ff                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: read {29.99s}  128 B -> [  3 B]: ff 30 82                                         .0.
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}       <- [  2 B]: [err: AttributeError]
Traceback (most recent call last):
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/base.py", line 266, in write
    bytes_written = self.child.write(data, timeout_sec)
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/serial.py", line 123, in write
    self._port.write_timeout = timeout_sec
AttributeError: 'NoneType' object has no attribute 'write_timeout'
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}       <- [  2 B]: [err: AttributeError]
Traceback (most recent call last):
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/base.py", line 266, in write
    bytes_written = self.child.write(data, timeout_sec)
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/serial.py", line 123, in write
    self._port.write_timeout = timeout_sec
AttributeError: 'NoneType' object has no attribute 'write_timeout'
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}       <- [  2 B]: [err: AttributeError]
Traceback (most recent call last):
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/base.py", line 266, in write
    bytes_written = self.child.write(data, timeout_sec)
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/serial.py", line 123, in write
    self._port.write_timeout = timeout_sec
AttributeError: 'NoneType' object has no attribute 'write_timeout'
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}       <- [  2 B]: [err: AttributeError]
Traceback (most recent call last):
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/base.py", line 266, in write
    bytes_written = self.child.write(data, timeout_sec)
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/serial.py", line 123, in write
    self._port.write_timeout = timeout_sec
AttributeError: 'NoneType' object has no attribute 'write_timeout'
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}       <- [  2 B]: [err: AttributeError]
Traceback (most recent call last):
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/base.py", line 266, in write
    bytes_written = self.child.write(data, timeout_sec)
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/serial.py", line 123, in write
    self._port.write_timeout = timeout_sec
AttributeError: 'NoneType' object has no attribute 'write_timeout'
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}       <- [  2 B]: [err: AttributeError]
Traceback (most recent call last):
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/base.py", line 266, in write
    bytes_written = self.child.write(data, timeout_sec)
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/serial.py", line 123, in write
    self._port.write_timeout = timeout_sec
AttributeError: 'NoneType' object has no attribute 'write_timeout'
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}       <- [  2 B]: [err: AttributeError]
Traceback (most recent call last):
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/base.py", line 266, in write
    bytes_written = self.child.write(data, timeout_sec)
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/serial.py", line 123, in write
    self._port.write_timeout = timeout_sec
AttributeError: 'NoneType' object has no attribute 'write_timeout'
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}       <- [  2 B]: [err: AttributeError]
Traceback (most recent call last):
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/base.py", line 266, in write
    bytes_written = self.child.write(data, timeout_sec)
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/serial.py", line 123, in write
    self._port.write_timeout = timeout_sec
AttributeError: 'NoneType' object has no attribute 'write_timeout'

DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}       <- [  2 B]: [err: AttributeError]
Traceback (most recent call last):
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/base.py", line 266, in write
    bytes_written = self.child.write(data, timeout_sec)
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/serial.py", line 123, in write
    self._port.write_timeout = timeout_sec
AttributeError: 'NoneType' object has no attribute 'write_timeout'
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}       <- [  2 B]: [err: AttributeError]
Traceback (most recent call last):
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/base.py", line 266, in write
    bytes_written = self.child.write(data, timeout_sec)
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/serial.py", line 123, in write
    self._port.write_timeout = timeout_sec
AttributeError: 'NoneType' object has no attribute 'write_timeout'
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}       <- [  2 B]: [err: AttributeError]
Traceback (most recent call last):
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/base.py", line 266, in write
    bytes_written = self.child.write(data, timeout_sec)
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/serial.py", line 123, in write
    self._port.write_timeout = timeout_sec
AttributeError: 'NoneType' object has no attribute 'write_timeout'
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}       <- [  2 B]: [err: AttributeError]
Traceback (most recent call last):
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/base.py", line 266, in write
    bytes_written = self.child.write(data, timeout_sec)
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/serial.py", line 123, in write
    self._port.write_timeout = timeout_sec
AttributeError: 'NoneType' object has no attribute 'write_timeout'
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}       <- [  2 B]: [err: AttributeError]
Traceback (most recent call last):
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/base.py", line 266, in write
    bytes_written = self.child.write(data, timeout_sec)
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/serial.py", line 123, in write
    self._port.write_timeout = timeout_sec
AttributeError: 'NoneType' object has no attribute 'write_timeout'
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}       <- [  2 B]: [err: AttributeError]
Traceback (most recent call last):
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/base.py", line 266, in write
    bytes_written = self.child.write(data, timeout_sec)
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/serial.py", line 123, in write
    self._port.write_timeout = timeout_sec
AttributeError: 'NoneType' object has no attribute 'write_timeout'
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}       <- [  2 B]: [err: AttributeError]
Traceback (most recent call last):
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/base.py", line 266, in write
    bytes_written = self.child.write(data, timeout_sec)
  File "/home/hw1580381/ai@edge/tvm_feb24/python/tvm/micro/transport/serial.py", line 123, in write
    self._port.write_timeout = timeout_sec
AttributeError: 'NoneType' object has no attribute 'write_timeout'
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: ff fd                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  4 B]: 73 0c 00 00                                      s...
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  3 B]: e1 66 10                                         .f.
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  68 0c 00 00 00 00 00 00 07 00 00 00 94 2e 01 20  h...............
0010  00 00 00 00 00 00 00 00 00 00 00 00 40 0c 00 00  ............@...
0020  00 00 00 00 01 00 00 00 00 00 00 00 02 20 01 00  ................
0030  d1 8d 14 3f 6c ea 80 3d 78 21 4e 3f ce b7 08 3f  ...?l..=x!N?...?
0040  5e cc 62 3f 3c c6 c9 3e e1 f1 9f 3e 9e ef 51 3e  ^.b?<..>...>..Q>
0050  de 3f 73 3f 63 42 4f 3f db 54 1a 3f 86 08 cb 3e  .?s?cBO?.T.?...>
0060  a7 b3 7a 3e 98 18 8f 3e 54 20 4f 3f 74 cd 0b 3f  ..z>...>T.O?t..?
0070  4a d0 47 3f 1f a0 be 3e 45 7d 1a 3f b0 0d e8 3d  J.G?...>E}.?...=
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  2f ee 46 3e 23 12 82 3c 6e 0a 02 3f 9b b4 77 3f  /.F>#..<n..?..w?
0010  8f 84 a1 3d fb 86 56 3f 2a 6e 78 3e 80 7b e4 3e  ...=..V?*nx>.{.>
0020  6f 0f db 3e f9 5c 24 3f 5d 8f dc 3e 2b 0a 76 3f  o..>.\$?]..>+.v?
0030  27 73 23 3e db f4 31 3f 44 cd e8 3e 22 51 73 3f  's#>..1?D..>"Qs?
0040  7a fb 74 3f a2 f1 31 3f c3 5b 50 3f 1f b2 bb 3c  z.t?..1?.[P?...<
0050  ed f4 94 3e 7f 0c 30 3f 57 db be 3e a3 05 0a 3f  ...>..0?W..>...?
0060  be 29 0d 3e 7c 11 5f 3f 78 34 cc 3e c4 d6 83 3d  .).>|._?x4.>...=
0070  86 b0 62 3f 99 55 27 3f 61 ff ff 19 3f 3d b6 1c  ..b?.U'?a...?=..
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  3f df 2d 4c 3f 54 3a df 3e 2f b2 04 3f e9 a2 15  ?.-L?T:.>/..?...
0010  3f f6 f8 17 3f 6f 96 8b 3e 74 cf 43 3f 3b 0d 3e  ?...?o..>t.C?;.>
0020  3f 8c 73 af 3e a7 f3 c5 3d 06 97 5f 3f 54 d5 4b  ?.s.>...=.._?T.K
0030  3f c7 f9 70 3f 27 81 1a 3f a3 ea 1c 3d db 61 0a  ?..p?'..?...=.a.
0040  3f 8f c0 97 3d a5 9b ed 3e 84 aa 66 3e f7 81 15  ?...=...>..f>...
0050  3e de e9 41 3e 5d d7 47 3f af ed 93 3e 04 ed 70  >..A>].G?...>..p
0060  3f d7 2d 53 3f a9 25 2b 3f c4 cc fb 3e a4 b9 0d  ?.-S?.%+?...>...
0070  3f 41 02 9a 3e dc 60 54 3f 0c 0b 43 3e 96 5c 31  ?A..>.`T?..C>.\1
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  3f 31 1b d0 3e 85 c3 bf 3e 90 ec 68 3d b6 b2 1a  ?1..>...>..h=...
0010  3f f5 01 3c 3f 37 29 0f 3e f0 71 b0 3e 07 a7 53  ?..<?7).>.q.>..S
0020  3f 42 b2 74 3e 2b 30 4b 3d 56 a9 cf 3d f5 0c 67  ?B.t>+0K=V..=..g
0030  3f c1 e9 d9 3e 55 47 d3 3c 78 99 03 3f 4b fa 8d  ?...>UG.<x..?K..
0040  3e 32 27 43 3f 6b d4 24 3e 67 7b 0c 3f 25 d4 59  >2'C?k.$>g{.?%.Y
0050  3f ab 91 1b 3f 90 43 e3 3e 4d a6 77 3f d3 bc 33  ?...?.C.>M.w?..3
0060  3f db 08 5f 3f a3 b7 85 3e bb b0 61 3f 07 f5 10  ?.._?...>..a?...
0070  3e 0e 7e 31 3f 30 e1 32 3f d1 35 71 3f 9c df 32  >.~1?0.2?.5q?..2
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  3e 33 30 05 3f ab 4f 17 3f ed 93 a3 3e 17 68 a7  >30.?.O.?...>.h.
0010  3e d0 c2 9d 3d f8 fa f9 3e 6b bb d3 3e 91 78 70  >...=...>k..>.xp
0020  3f 30 a5 92 3e cb 7f af 3e 72 9e 24 3f 77 7f 33  ?0..>...>r.$?w.3
0030  3e b2 af 25 3f 95 3a 29 3f 41 f0 59 3e b2 94 41  >..%?.:)?A.Y>..A
0040  3f f1 5e bd 3e 77 d2 a2 3e fb 8d 38 3f 71 2e d5  ?.^.>w..>..8?q..
0050  3c fe 47 cc 3e 1e c2 32 3f 61 c6 16 3f ef 43 a6  <.G.>..2?a..?.C.
0060  3e 9e dc fc 3e f6 3a d1 3c bd 16 62 3f bb 10 20  >...>.:.<..b?...
0070  3f 8c 95 1b 3f bb 03 4d 3e 4a 82 c6 3e 22 50 16  ?...?..M>J..>"P.
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  3f 7c 53 4a 3f 41 cb 44 3e 3c 55 51 3f 22 96 15  ?|SJ?A.D><UQ?"..
0010  3f fb 8e 38 3f 2b 29 7f 3f ce 1b 7e 3d d6 ab fc  ?..8?+).?..~=...
0020  3e d3 59 27 3f ae d4 d4 3e 53 ae 2c 3f 98 e1 c3  >.Y'?...>S.,?...
0030  3e bb 4a 00 3f 19 af 5b 3f 7d 53 6b 3f 58 ab 51  >.J.?..[?}Sk?X.Q
0040  3f 3d 45 f4 3d 3c 89 12 3e 04 3c 23 3f ad 63 ce  ?=E.=<..>.<#?.c.
0050  3e a1 df 09 3f e7 ee 06 3c 0a 29 6e 3f 0c da 12  >...?...<.)n?...
0060  3f 35 9d 28 3f 77 e8 07 3f 79 c7 41 3f 7d 7f 14  ?5.(?w..?y.A?}..
0070  3e ec ce 23 3f db 56 da 3e 38 66 08 3f c2 b9 47  >..#?.V.>8f.?..G
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  3f 2a 7a f6 3d 7c 16 7e 3f dc c7 27 3f b5 db 41  ?*z.=|.~?..'?..A
0010  3f 84 0c 34 3f 8b 76 a3 3e bc d3 fd 3e cb 21 2c  ?..4?.v.>...>.!,
0020  3e 0f d5 7d 3f a9 8c 4c 3f 55 cb 1e 3e 4d 9f 1c  >..}?..L?U..>M..
0030  3e 45 bf 09 3f fd 81 fb 3e 7e 07 c4 3e 7c 83 da  >E..?...>~..>|..
0040  3d 44 f2 79 3f 85 d7 24 3e 67 b6 23 3e af 56 1f  =D.y?..$>g.#>.V.
0050  3f 07 d9 4c 3f 86 43 bf 3e c9 c6 97 3e e8 04 27  ?..L?.C.>...>..'
0060  3f a2 3e fd 3e a2 f4 43 3e ce 34 c4 3d 92 56 14  ?.>.>..C>.4.=.V.
0070  3f f9 da 33 3f 87 7d da 3c 8d 22 5c 3f e2 5f 8f  ?..3?.}.<."\?._.

DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  3c ef 4d fc 3e 94 92 37 3f 3d b4 ed 3e b8 b6 ce  <.M.>..7?=..>...
0010  3e 93 18 1a 3d da fa 42 3f ec 4f 41 3e 0d aa 75  >...=..B?.OA>..u
0020  3f d5 dd 95 3e 67 99 7c 3e 62 63 7b 3d c5 95 e8  ?...>g.|>bc{=...
0030  3e aa bc 18 3f dd 03 96 3d 2d c9 fb 3e 1b b0 2e  >...?...=-..>...
0040  3f 7d 06 05 3f 70 fa 0d 3e e8 8b b8 3d 91 34 0c  ?}..?p..>...=.4.
0050  3e a3 6e 04 3f e0 4e 33 3f b7 e2 23 3f 46 b3 18  >.n.?.N3?..#?F..
0060  3e d9 2b 84 3e 99 f2 48 3f 8e 95 db 3e 20 41 c7  >.+.>..H?...>.A.
0070  3e 5c b9 64 3e 3d 1c f0 3e 7d 34 e8 3c 06 06 52  >\.d>=..>}4.<..R
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  3f 62 4c 23 3e df 2a 2f 3f cb 04 6b 3f e0 1c 24  ?bL#>.*/?..k?..$
0010  3f f9 d1 01 3f 15 50 83 3d 0f 59 18 3d 57 08 ed  ?...?.P.=.Y.=W..
0020  3e 35 b7 2a 3f 57 90 2e 3f 00 bf 19 3e 30 f7 74  >5.*?W..?...>0.t
0030  3f ac ba 0a 3f ea c0 3d 3f e1 0b 77 3f 1b 00 4e  ?...?..=?..w?..N
0040  3e f8 f5 06 3f 5b a5 2c 3e 7d 80 10 3f 53 bb 47  >...?[.,>}..?S.G
0050  3f df fa 3b 3f 37 65 22 3e d6 4e 9e 3e 09 b6 2e  ?..;?7e">.N.>...
0060  3f f0 9c a4 3e 15 d1 42 3f e0 d9 5d 3e c9 8a 39  ?...>..B?..]>..9
0070  3e 1e 7e ce 3e 8c 89 bb 3e 54 7b 1e 3f ce 5b 39  >.~.>...>T{.?.[9
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  3f 3a 39 72 3f 4e 12 68 3f 50 73 11 3f 10 8b 6f  ?:9r?N.h?Ps.?..o
0010  3f 60 12 dd 3e ed ae 1d 3f 41 e4 ad 3e 3a 3f 17  ?`..>...?A..>:?.
0020  3f df 25 6a 3f af b8 50 3f f4 fd 48 3f 67 c0 d2  ?.%j?..P?..H?g..
0030  3c cc 91 47 3f 14 41 cb 3e 68 5d 35 3f cd db 02  <..G?.A.>h]5?...
0040  3f 76 66 69 3e 91 5c 2c 3f d3 92 b7 3d aa c1 7d  ?vfi>.\,?...=..}
0050  3f 11 ef 6f 3f 3a 4e ca 3c a5 e6 84 3e cc f9 3d  ?..o?:N.<...>..=
0060  3f d0 15 27 3e e3 2e 07 3c 0f 27 3d 3f c3 0b 51  ?..'>...<.'=?..Q
0070  3f 30 47 3e 3f 59 cc 6d 3f b4 5e 7d 3f f9 29 5c  ?0G>?Y.m?.^}?.)\
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  3f 83 d6 0d 3f 4e 49 71 3f 32 df e4 3c c1 8d 6b  ?...?NIq?2..<..k
0010  3f 7a 4e 97 3e a2 af 81 3e c5 99 73 3f bf ed 6d  ?zN.>...>..s?..m
0020  3f 79 d5 93 3e e4 b1 2b 3f 40 1b b5 3e bd df 84  ?y..>..+?@..>...
0030  3e fd a2 3a 3f 9a 31 79 3f 68 ba d1 3e c3 a5 39  >..:?.1y?h..>..9
0040  3e 7f d6 6f 3f 75 72 91 3e 21 d3 12 3f 89 35 94  >..o?ur.>!..?.5.
0050  3d 00 a5 1b 3e 01 7e ce 3e 1c f4 a2 3e dd 41 e3  =...>.~.>...>.A.
0060  3e 7a 9f 9d 3e b0 d3 28 3f b4 eb 83 3e 75 b8 62  >z..>..(?...>u.b
0070  3f 21 05 1f 3f 99 f1 2d 3f 6f 17 43 3f e4 85 37  ?!..?..-?o.C?..7
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  3f 9e 54 f8 3d 3d b0 f8 3e 21 d0 6d 3f ef ed 04  ?.T.==..>!.m?...
0010  3e 34 e6 a5 3e 54 00 9e 3e fc a7 37 3f 44 e9 06  >4..>T..>..7?D..
0020  3f 4b 5b 09 3f 6c 3b 46 3f 81 46 59 3f a4 b3 22  ?K[.?l;F?.FY?.."
0030  3d 31 e5 01 3f d5 8d 22 3f 1d d1 4f 3f 9f 26 38  =1..?.."?..O?.&8
0040  3f 3d 54 18 3e 80 67 49 3f c0 98 21 3e dc 6b df  ?=T.>.gI?..!>.k.
0050  3e 1d ef 13 3f f7 29 d0 3e 5c 9d 67 3f e2 99 1d  >...?.).>\.g?...
0060  3f 96 b8 9a 3e 05 82 bd 3e 49 0d 1a 3f 25 9d 8d  ?...>...>I..?%..
0070  3e 36 e1 26 3f fb 13 8c 3d 5a d5 13 3f 69 10 57  >6.&?...=Z..?i.W
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  3f 49 3b 97 3e 23 36 cf 3e ff ff a3 42 3f 43 f0  ?I;.>#6.>...B?C.
0010  ea 3e ac d4 24 3e 85 3a cf 3e 52 c1 79 3e 92 d5  .>..$>.:.>R.y>..
0020  ab 3d 95 ee 55 3f f3 f7 91 3e 19 06 48 3f bb 92  .=..U?...>..H?..
0030  3b 3f b1 23 52 3f 9a 64 f3 3d c4 7b 59 3f b1 db  ;?.#R?.d.=.{Y?..
0040  2c 3c 68 dd be 3e a8 7e fb 3e 30 08 ca 3d 8d 4b  ,<h..>.~.>0..=.K
0050  18 3f 27 9a 1f 3f ce 50 f9 3e ae 96 fb 3d 70 ba  .?'..?.P.>...=p.
0060  97 3e da d6 09 3f 2f 03 1b 3f 56 1b 61 3e 05 dd  .>...?/..?V.a>..
0070  bd 3c 15 f2 68 3f 5f 3d a8 3e b6 6f 3a 3f f4 01  .<..h?_=.>.o:?..
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  12 3f 85 fa c0 3e d0 6b 9a 3d 78 2a 03 3e 71 06  .?...>.k.=x*.>q.
0010  c7 3d aa 89 b2 3e 29 61 51 3f 7b f0 96 3d b0 e4  .=...>)aQ?{..=..
0020  58 3e b2 5f 1b 3f e1 24 ac 3e 8d a4 43 3f 52 d2  X>._.?.$.>..C?R.
0030  49 3f 72 34 0b 3f 71 10 07 3f 45 8e 31 3f f2 81  I?r4.?q..?E.1?..
0040  60 3f 8b c3 69 3f ca f7 14 3f e7 6e 77 3e e8 b0  `?..i?...?.nw>..
0050  6f 3f b4 33 db 3e 03 24 67 3e 4d 4a 10 3f 46 90  o?.3.>.$g>MJ.?F.
0060  f5 3e 8e b5 4f 3f c5 99 38 3e 59 7f 1f 3f 3f 75  .>..O?..8>Y..??u
0070  e4 3e 64 0f 6f 3f 3c 0a 17 3e bc aa 89 3e 86 e8  .>d.o?<..>...>..
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  74 3f 28 ee 58 3e 60 35 b0 3e fd 4f 4a 3f b2 0e  t?(.X>`5.>.OJ?..
0010  30 3e 1f 99 6c 3f 94 3e 3e 3f d5 9d f6 3e 3b ef  0>..l?.>>?...>;.
0020  f1 3e 2b 26 73 3f d1 88 a1 3b ad d0 71 3f 16 03  .>+&s?...;..q?..
0030  29 3f ce 22 68 3e 66 f4 4a 3d d9 66 37 3f 64 a9  )?."h>f.J=.f7?d.
0040  c9 3e 53 27 35 3f f0 76 17 3f 88 76 2e 3f d1 ac  .>S'5?.v.?.v.?..
0050  7b 3f a8 2e 66 3f d0 0f 06 3d ff ff fa 5d 3f e4  {?..f?...=...]?.
0060  aa 04 3f da 06 3c 3e dd 8c 48 3f ca 66 16 3f a6  ..?..<>..H?.f.?.
0070  e9 96 3e e7 5b 3e 3d 14 3f 99 3e 84 8f 23 3e 07  ..>.[>=.?.>..#>.
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  8f 5c 3d d7 ae 8e 3e a3 67 d2 3e 7d a2 43 3e 7a  .\=...>.g.>}.C>z
0010  00 33 3f 6f ae 52 3e 7d d3 b3 3e 10 77 a5 3e 5b  .3?o.R>}..>.w.>[
0020  65 2b 3f b5 d3 9c 3e ae 55 60 3e bb 57 32 3e da  e+?...>.U`>.W2>.
0030  be 3f 3d 7b a9 4e 3f dc 34 89 3e b5 d9 56 3f 93  .?={.N?.4.>..V?.
0040  2c 37 3f 48 db 6f 3f 92 20 1f 3f de ba 8e 3e c1  ,7?H.o?...?...>.
0050  38 72 3f ad dd 73 3f 01 e5 49 3f 08 3f 50 3f 09  8r?..s?..I?.?P?.
0060  e1 69 3f 00 6b fb 3e fb 8b a9 3e 3d 80 6e 3e c6  .i?.k.>...>=.n>.
0070  91 63 3d 44 a5 13 3f 66 8d 29 3e a1 27 c8 3e 0e  .c=D..?f.)>.'.>.
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  fd 9d 3d a4 57 3d 3f 4c 6d 6f 3f eb 8c f9 3e ed  ..=.W=?Lmo?...>.
0010  fe 35 3f 7a c7 37 3f 58 04 99 3d 78 6b b5 3e 25  .5?z.7?X..=xk.>%
0020  f1 8d 3e d1 bb d0 3e f2 a3 1d 3f 4b 5e 68 3f 8a  ..>...>...?K^h?.
0030  4b 43 3e c1 da 20 3f 5d 5f 81 3e 0f ea f8 3c e6  KC>...?]_.>...<.
0040  9f df 3d e0 06 00 3f ae c9 1d 3f 94 02 01 3f 71  ..=...?...?...?q
0050  43 78 3f 55 07 4d 3f 11 7a 12 3d 61 27 cb 3e 91  Cx?U.M?.z.=a'.>.
0060  da 66 3f 30 44 40 3e 55 95 7f 3f 77 80 71 3f f3  .f?0D@>U..?w.q?.
0070  88 3e 3e d5 fe e0 3e 33 4f d8 3e b8 41 12 3f 73  .>>...>3O.>.A.?s
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  f8 18 3e e6 e1 39 3e 3f a5 3f 3f 0c 07 ac 3e b9  ..>..9>?.??...>.
0010  f4 83 3e 2a e3 6a 3e 96 d8 7e 3e a4 0e 60 3f c5  ..>*.j>..~>..`?.
0020  4e 1d 3f db 4c 03 3f 55 45 26 3f 12 43 f8 3e 3a  N.?.L.?UE&?.C.>:
0030  9b 4a 3d 4e 44 42 3f 85 d5 d2 3d 23 a6 0a 3f 09  .J=NDB?...=#..?.
0040  5d 88 3e 31 ca 73 3f 03 aa da 3e ab a5 6f 3f 1a  ].>1.s?...>..o?.
0050  63 2e 3f 6d 5e 0c 3f ea 67 f2 3e 9c 1c 52 3f 2c  c.?m^.?.g.>..R?,
0060  b0 6e 3f e1 65 28 3e 91 ce b8 3e e0 bc aa 3e 1b  .n?.e(>...>...>.
0070  15 22 3f 49 23 ea 3e 50 01 5e 3d aa 76 71 3e ae  ."?I#.>P.^=.vq>.
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  57 7c 3e 90 6d 44 3f c9 9c 42 3f fd 0c 75 3f 5d  W|>.mD?..B?..u?]
0010  2f f8 3e 80 98 e8 3d de c2 28 3f 84 92 5e 3f e4  /.>...=..(?..^?.
0020  e8 be 3e 32 f7 52 3f b4 27 74 3b 08 7c 5b 3f 12  ..>2.R?.'t;.|[?.
0030  28 45 3f dd cc 34 3e 6e bc 01 3e f9 29 1b 3f a7  (E?..4>n..>.).?.
0040  c2 1a 3f bb 25 f9 3e 29 34 73 3d 6b 04 f1 3e 0e  ..?.%.>)4s=k..>.
0050  c4 3f 3f 75 f9 49 3f 5f 53 15 3e 4b ba 4d 3f eb  .??u.I?_S.>K.M?.
0060  8c e6 3e 38 00 05 3e ed 6f 98 3e c6 f4 de 3e 14  ..>8..>.o.>...>.
0070  85 36 3f cc 38 14 3f b2 37 5a 3f d1 74 c6 3d fc  .6?.8.?.7Z?.t.=.
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  96 08 3f bc c1 68 3f 82 3f 62 3f 9a 11 ea 3d f0  ..?..h?.?b?...=.
0010  84 78 3f 24 77 09 3e d5 3c c6 3e 70 a7 cf 3d 86  .x?$w.>.<.>p..=.
0020  10 73 3f 8d 21 65 3f b9 7f ef 3e 21 b0 af 3e db  .s?.!e?...>!..>.
0030  2d f4 3e 9a f7 ab 3d 6a ac cb 3e 91 36 0b 3f 22  -.>...=j..>.6.?"
0040  80 1f 3d 04 85 47 3f 10 5e 53 3f d2 73 e9 3e e9  ..=..G?.^S?.s.>.
0050  de 0a 3e 0b 88 9d 3e b3 fc 53 3f e9 c5 34 3e b0  ..>...>..S?..4>.
0060  f3 6d 3e c4 7a 5c 3f cd ed 06 3f cc 71 c0 3d 67  .m>.z\?...?.q.=g
0070  18 0c 3f a8 0f 1f 3f 1d 90 8e 3d bb 11 1e 3f e2  ..?...?...=...?.

DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  f9 8f 3e 5b 91 3a 3f a0 95 17 3f 45 60 2c 3f 07  ..>[.:?...?E`,?.
0010  96 7b 3f 5c 2c 21 3f 90 db 19 3f 43 25 51 3e 5e  .{?\,!?...?C%Q>^
0020  74 49 3f 04 bd 9a 3e 3b c9 7e 3f ae 46 1d 3e 44  tI?...>;.~?.F.>D
0030  33 4b 3e 09 72 42 3f c5 ba 6a 3f 7c fd 3c 3e ef  3K>.rB?..j?|.<>.
0040  bf 87 3e 91 73 3e 3d f3 8b 0a 3e 5c 20 ac 3e 70  ..>.s>=...>\..>p
0050  65 5e 3e 32 c6 9e 3e 7a 5d 66 3f 1c eb 08 3f 8f  e^>2..>z]f?...?.
0060  26 28 3f 75 0c a1 3e 00 ee 59 3f 11 52 2a 3f 3a  &(?u..>..Y?.R*?:
0070  fa 53 3f 24 4d 05 3f 22 3d 74 3f e9 3a 6b 3f 9e  .S?$M.?"=t?.:k?.
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  d1 c9 3e 8d 46 78 3f d8 3d c6 3d da b7 01 3c b9  ..>.Fx?.=.=...<.
0010  ff ff a3 3e f1 a8 83 3e c2 06 68 3f a1 d6 21 3f  ...>...>..h?..!?
0020  34 eb 6c 3d fa 57 a8 3d b7 b5 f5 3d 16 f4 5d 3f  4.l=.W.=...=..]?
0030  9e 9d 23 3f 05 37 06 3f 9e f5 c4 3e 7c 5d 56 3c  ..#?.7.?...>|]V<
0040  24 b7 cd 3e a8 c6 c9 3e 42 fd e2 3d e0 64 3b 3f  $..>...>B..=.d;?
0050  f4 6e 45 3f a9 ad 5f 3f ca 1f b4 3d 84 79 7b 3f  .nE?.._?...=.y{?
0060  94 8c 40 3e 2e cf 8a 3d b3 bc 5c 3f 68 98 59 3f  ..@>...=..\?h.Y?
0070  6a 72 29 3f 13 b5 44 3f e9 3a 5d 3f d7 02 a3 3e  jr)?..D?.:]?...>
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  c2 0d bd 3e a0 20 7a 3e 37 6d 53 3f cd 01 01 3f  ...>..z>7mS?...?
0010  97 52 69 3d 29 64 30 3f fe 73 fb 3e 57 68 48 3e  .Ri=)d0?.s.>WhH>
0020  c7 a6 d7 3e 21 68 47 3f b8 48 04 3f a9 a6 80 3e  ...>!hG?.H.?...>
0030  af d2 12 3f b4 3e 7f 3f f9 62 dc 3d 42 2a d5 3d  ...?.>.?.b.=B*.=
0040  91 9e 3b 3f 35 95 f2 3e 96 61 19 3f 34 98 18 3f  ..;?5..>.a.?4..?
0050  a6 39 31 3f c9 f2 3e 3f 65 e9 12 3e d7 56 73 3f  .91?..>?e..>.Vs?
0060  98 67 81 3d 01 06 1a 3f 57 fa 04 3f 3b 6d 33 3f  .g.=...?W..?;m3?
0070  30 32 35 3f be 16 4f 3d b4 22 79 3f 50 73 6a 3e  025?..O=."y?Psj>
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  9f 6c 55 3f ec d9 6a 3f a4 8c 93 3e 05 49 48 3f  .lU?..j?...>.IH?
0010  01 85 f6 3d 6d 29 41 3e d0 c2 61 3f ef 1b 87 3e  ...=m)A>..a?...>
0020  00 28 03 3e 8b 98 5c 3f 2f 6a e9 3e 37 b2 fe 3e  .(.>..\?/j.>7..>
0030  1a 1a 50 3f 19 cc ff ff 3d 1b 64 5a 3e 62 e8 62  ..P?....=.dZ>b.b
0040  3f f3 f4 1d 3e 30 0d 35 3f 7e f4 da 3e 8e 35 48  ?...>0.5?~..>.5H
0050  3f a8 74 7a 3f b3 2b 57 3f 3f 2c ca 3e 44 9b 4c  ?.tz?.+W??,.>D.L
0060  3f b1 80 3d 3f 62 71 20 3f da af 13 3f 3f 82 a9  ?..=?bq.?...??..
0070  3e cb ca ea 3e 41 44 5d 3e 13 81 2c 3e 12 74 8c  >...>AD]>..,>.t.
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [117 B]:
0000  3e 1c 56 43 3f f8 1e 72 3f 14 97 18 3d 99 41 99  >.VC?..r?...=.A.
0010  3e a6 cc 08 3f 6f b8 c2 3d 20 e6 02 3f 55 d3 fb  >...?o..=...?U..
0020  3e f4 41 3b 3f 29 3a 5a 3f 0a 44 4f 3f 1b 78 9e  >.A;?):Z?.DO?.x.
0030  3e 2b 90 e7 3e 64 38 73 3f a0 cb a2 3e 8b 6f 3d  >+..>d8s?...>.o=
0040  3f 46 87 74 3f 22 05 5b 3f 2f 25 a9 3e 30 fa e3  ?F.t?".[?/%.>0..
0050  3d 48 1e 95 3e 64 f7 20 3f 92 89 6f 3f 26 ea 43  =H..>d..?..o?&.C
0060  3f 4b 85 6f 3f 5f 37 a4 3e 5c fa d3 3e 97 14 7c  ?K.o?_7.>\..>..|
0070  3e aa db 7b 3f                                   >..{?
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: 0c ad                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 19 B]:
0000  ff fd 17 00 00 00 e1 66 10 0c 00 00 00 00 00 00  .......f........
0010  00 04 00                                         ...
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 12 B]: 00 00 01 00 00 00 04 00 00 00 bd 94              ............
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: ff fd                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  4 B]: 2b 00 00 00                                      +...
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  3 B]: e1 66 10                                         .f.
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [ 40 B]:
0000  20 00 00 00 00 00 00 00 0f 00 00 00 02 00 00 00  ................
0010  06 00 00 00 03 00 00 00 01 00 00 00 00 00 00 00  ................
0020  00 00 00 00 00 00 00 00                          ........
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: 66 57                                            fW
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 13 B]: ff fd 17 00 00 00 e1 66 10 0c 00 00 00           .......f.....
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 18 B]:
0000  00 00 00 00 04 00 00 00 01 00 00 00 04 00 00 00  ................
0010  bd 94                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: ff fd                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  4 B]: 0b 01 00 00                                      ....
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  3 B]: e1 66 10                                         .f.
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 01 00 00 00 00 00 00 03 00 00 00 00 80 00 80  ................
0010  ff ff ff ff ff ff ff ff 04 00 00 00 07 00 00 00  ................
0020  07 00 00 00 07 00 00 00 07 00 00 00 94 2e 01 20  ................
0030  00 00 00 00 01 00 00 00 00 00 00 00 04 00 00 00  ................
0040  02 20 01 00 01 00 00 00 00 00 00 00 1c 00 00 00  ................
0050  00 00 00 00 1c 00 00 00 00 00 00 00 01 00 00 00  ................
0060  00 00 00 00 3c 97 00 08 00 00 00 00 01 00 00 00  ....<...........
0070  00 00 00 00 04 00 00 00 02 20 01 00 03 00 00 00  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 00 00 00 03 00 00 00 00 00 00 00 01 00 00 00  ................
0010  00 00 00 00 10 00 00 00 00 00 00 00 7c 99 00 08  ............|...
0020  00 00 00 00 01 00 00 00 00 00 00 00 04 00 00 00  ................
0030  02 20 01 00 01 00 00 00 00 00 00 00 01 00 00 00  ................
0040  00 00 00 00 01 00 00 00 00 00 00 00 10 00 00 00  ................
0050  00 00 00 00 24 3b 01 20 00 00 00 00 01 00 00 00  ....$;..........
0060  00 00 00 00 04 00 00 00 02 20 01 00 01 00 00 00  ................
0070  00 00 00 00 1a 00 00 00 00 00 00 00 1a 00 00 00  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [ 12 B]: 00 00 00 00 10 00 00 00 00 00 00 00              ............
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: 4e d7                                            N.
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [IoTimeoutError 30.00s]
DEBUG:tvm.micro.transport.base:micro-rpc: closing transport

---------------------------------------------------------------------------
TVMError                                  Traceback (most recent call last)
<ipython-input-25-fc5c48623d10> in <module>
     12     # this model values of 0 to 2Pi are acceptable.
     13     graph_mod.set_input(input_tensor, data)
---> 14     graph_mod.run()
     15     tvm_output = graph_mod.get_output(0).asnumpy()
     16     print("result is: " + str(tvm_output))

~/tvm_feb24/python/tvm/contrib/graph_runtime.py in run(self, **input_dict)
    204         if input_dict:
    205             self.set_input(**input_dict)
--> 206         self._run()
    207 
    208     def get_num_outputs(self):

~/tvm_feb24/python/tvm/_ffi/_ctypes/packed_func.py in __call__(self, *args)
    235             != 0
    236         ):
--> 237             raise get_last_ffi_error()
    238         _ = temp_args
    239         _ = args

TVMError: MicroSessionTimeoutError: failed to read reply message after timeout 30s

I am using the target string “TARGET = tvm.target.target.create(‘c -keys=arm_cpu -mcpu=cortex-m7 -link-params -model=stm32f746xx -runtime=c -system-lib’)” when getting this error. Also note that I am able to run the model with “TARGET= tvm.target.target.micro(“stm32f746xx”)” . How do I use -link-params flag on this board? Am I missing something here?

areusch · February 24, 2021, 4:03pm

hi @aakah18151 ,

It seems like it’s failing while trying to set input tensors to the device. Does it fail in the same place each time, or is it flaky?

Could you double-check you’re instantiating GraphRuntime with tvm.micro.create_local_graph_runtime()? I don’t see it calling _lookup_linked_param, but it might be doing that in an earlier chunk of the logs.

Andrew

aakah18151 · February 25, 2021, 4:07am

Hi @areusch. Yes it fails in the same place, after last layer(fused_nn_softmax_2). Yes, I am instantiating GraphRuntime with tvm.micro.create_local_runtime() . I am posting the earlier chunks of log where calling for _lookup_linked_params is done.

DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [ 84 B]:
0000  48 00 00 00 00 00 00 00 03 00 00 00 01 80 02 80  H...............
0010  ff ff ff ff ff ff ff ff 03 00 00 00 09 00 00 00  ................
0020  0b 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00  ................
0030  14 00 00 00 00 00 00 00 5f 6c 6f 6f 6b 75 70 5f  ........_lookup_
0040  6c 69 6e 6b 65 64 5f 70 61 72 61 6d 00 00 00 00  linked_param....
0050  00 00 00 00                                      ....
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: a7 92                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 15 B]: ff fd 2b 00 00 00 e1 e7 10 20 00 00 00 00 00     ..+............
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 35 B]:
0000  00 00 04 00 00 00 02 00 00 00 00 00 00 00 03 00  ................
0010  00 00 0a 00 00 00 00 00 00 00 07 80 00 80 ff ff  ................
0020  ff ff ff                                         ...
DEBUG:tvm.micro.transport.base:micro-rpc: read {29.99s}  128 B -> [  5 B]: ff ff ff 99 42                                   ....B
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: ff fd                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  4 B]: 27 00 00 00                                      '...
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  3 B]: e1 e7 10                                         ...
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [ 40 B]:
0000  1c 00 00 00 00 00 00 00 03 00 00 00 07 80 00 80  ................
0010  ff ff ff ff ff ff ff ff 01 00 00 00 00 00 00 00  ................
0020  03 00 00 00 00 00 00 00                          ........
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: 09 3d                                            .=
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 25 B]:
0000  ff fd 23 00 00 00 e1 e7 10 18 00 00 00 00 00 00  ..#.............
0010  00 04 00 00 00 02 00 00 00                       .........
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 18 B]:
0000  00 00 00 00 04 00 00 00 04 00 00 00 00 00 00 00  ................
0010  2b c2                                            +.
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: ff fd                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  4 B]: 2b 00 00 00                                      +...
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  3 B]: e1 e7 10                                         ...
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [ 44 B]:
0000  20 00 00 00 00 00 00 00 0a 00 00 00 02 00 00 00  ................
0010  03 00 00 00 00 00 00 00 07 80 00 80 ff ff ff ff  ................
0020  ff ff ff ff 0a 00 00 00 00 00 00 00              ............
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: e6 48                                            .H
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 27 B]:
0000  ff fd 17 00 00 00 e1 e7 10 0c 00 00 00 00 00 00  ................
0010  00 04 00 00 00 01 00 00 00 04 00                 ...........
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [  4 B]: 00 00 f0 43                                      ...C
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: ff fd                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  4 B]: 53 00 00 00                                      S...
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  3 B]: e1 e7 10                                         ...
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [ 84 B]:
0000  48 00 00 00 00 00 00 00 03 00 00 00 01 80 02 80  H...............
0010  ff ff ff ff ff ff ff ff 03 00 00 00 09 00 00 00  ................
0020  0b 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00  ................
0030  14 00 00 00 00 00 00 00 5f 6c 6f 6f 6b 75 70 5f  ........_lookup_
0040  6c 69 6e 6b 65 64 5f 70 61 72 61 6d 00 00 00 00  linked_param....
0050  00 00 00 00                                      ....
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: a7 92                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [  5 B]: ff fd 2b 00 00                                   ..+..
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 23 B]:
0000  00 e1 e7 10 20 00 00 00 00 00 00 00 04 00 00 00  ................
0010  02 00 00 00 00 00 00                             .......
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 23 B]:
0000  00 03 00 00 00 0a 00 00 00 00 00 00 00 07 80 00  ................
0010  80 ff ff ff ff ff ff                             .......
DEBUG:tvm.micro.transport.base:micro-rpc: read {29.99s}  128 B -> [  4 B]: ff ff 99 42                                      ...B
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: ff fd                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  4 B]: 27 00 00 00                                      '...
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  3 B]: e1 e7 10                                         ...
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [ 40 B]:
0000  1c 00 00 00 00 00 00 00 03 00 00 00 07 80 00 80  ................
0010  ff ff ff ff ff ff ff ff 01 00 00 00 00 00 00 00  ................
0020  04 00 00 00 00 00 00 00                          ........
.

.


.

.

DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 13 B]: 80 00 80 ff ff ff ff ff ff ff ff d2 4a           ............J
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: ff fd                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  4 B]: 51 00 00 00                                      Q...
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  3 B]: e1 e7 10                                         ...
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [ 82 B]:
0000  46 00 00 00 00 00 00 00 03 00 00 00 01 80 02 80  F...............
0010  ff ff ff ff ff ff ff ff 03 00 00 00 09 00 00 00  ................
0020  0b 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00  ................
0030  12 00 00 00 00 00 00 00 66 75 73 65 64 5f 6e 6e  ........fused_nn
0040  5f 73 6f 66 74 6d 61 78 5f 32 00 00 00 00 00 00  _softmax_2......
0050  00 00                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: bb c7                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 18 B]:
0000  ff fd 2b 00 00 00 e1 e7 10 20 00 00 00 00 00 00  ..+.............
0010  00 04                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 34 B]:
0000  00 00 00 02 00 00 00 00 00 00 00 03 00 00 00 0a  ................
0010  00 00 00 00 00 00 00 04 80 00 80 ff ff ff ff ff  ................
0020  ff ff                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: read {29.99s}  128 B -> [  3 B]: ff 06 47                                         ..G
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: ff fd                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  4 B]: 73 0c 00 00                                      s...
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  3 B]: e1 e7 10                                         ...
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  68 0c 00 00 00 00 00 00 07 00 00 00 94 2e 01 20  h...............
0010  00 00 00 00 00 00 00 00 00 00 00 00 40 0c 00 00  ............@...
0020  00 00 00 00 01 00 00 00 00 00 00 00 02 20 01 00  ................
0030  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0040  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0050  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0060  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0070  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0010  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0020  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0030  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0040  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0050  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0060  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0070  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................

DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0010  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0020  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0030  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0040  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0050  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0060  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0070  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0010  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0020  00 00 00 00 00 00 00 00 e9 e8 e8 3e fb fa fa 3e  ...........>...>
0030  ac ab 2b 3f 00 00 80 3f 00 00 80 3f 97 96 16 3f  ..+?...?...?...?
0040  bb ba ba 3e 00 00 00 00 00 00 00 00 00 00 00 00  ...>............
0050  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0060  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0070  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0010  00 00 00 00 aa a9 29 3f fe fd 7d 3f fe fd 7d 3f  ......)?..}?..}?
0020  fe fd 7d 3f fe fd 7d 3f fe fd 7d 3f fe fd 7d 3f  ..}?..}?..}?..}?
0030  db da 5a 3f f1 f0 f0 3d 00 00 00 00 00 00 00 00  ..Z?...=........
0040  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0050  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0060  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0070  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  aa a9 29 3f fe fd 7d 3f fe fd 7d 3f fe fd 7d 3f  ..)?..}?..}?..}?
0010  d6 d5 55 3f 8f 8e 0e 3f b1 b0 30 3f fe fd 7d 3f  ..U?...?..0?..}?
0020  fe fd 7d 3f f5 f4 f4 3e 00 00 00 00 00 00 00 00  ..}?...>........
0030  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0040  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0050  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0060  00 00 00 00 00 00 00 00 00 00 00 00 d1 d0 50 3e  ..............P>
0070  fb fa 7a 3f fe fd 7d 3f d3 d2 52 3f 81 80 00 3e  ..z?..}?..R?...>
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  c1 c0 40 3d 00 00 00 00 c1 c0 c0 3c cf ce 4e 3f  ..@=.......<..N?
0010  fe fd 7d 3f 8d 8c 0c 3f 00 00 00 00 00 00 00 00  ..}?...?........
0020  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0030  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0040  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0050  00 00 00 00 00 00 00 00 00 00 00 00 9b 9a 9a 3e  ...............>
0060  fc fb 7b 3f d3 d2 52 3f c9 c8 c8 3d 00 00 00 00  ..{?..R?...=....
0070  00 00 00 00 00 00 00 00 f5 f4 f4 3e f9 f8 78 3f  ...........>..x?
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  fe fd 7d 3f 83 82 82 3e 00 00 00 00 00 00 00 00  ..}?...>........
0010  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0020  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0030  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0040  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0050  f9 f8 f8 3d 91 90 90 3d 00 00 00 00 00 00 00 00  ...=...=........
0060  00 00 00 00 00 00 00 00 d2 d1 51 3f fe fd 7d 3f  ..........Q?..}?
0070  fe fd 7d 3f 83 82 82 3e 00 00 00 00 00 00 00 00  ..}?...>........
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0010  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0020  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0030  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0040  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0050  00 00 00 00 eb ea ea 3e f8 f7 77 3f fe fd 7d 3f  .......>..w?..}?
0060  c7 c6 46 3f a1 a0 20 3d 00 00 00 00 00 00 00 00  ..F?...=........
0070  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0010  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0020  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0030  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0040  99 98 98 3e f8 f7 77 3f fe fd 7d 3f e8 e7 67 3f  ...>..w?..}?..g?
0050  fd fc 7c 3e 00 00 00 00 00 00 00 00 00 00 00 00  ..|>............
0060  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0070  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0010  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0020  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0030  81 80 00 3f fe fd 7d 3f fe fd 7d 3f 91 90 10 3f  ...?..}?..}?...?
0040  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0050  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0060  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0070  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0010  00 00 00 00 00 00 00 00 00 00 00 00 b1 b0 30 3f  ..............0?
0020  f7 f6 76 3f fe fd 7d 3f a0 9f 1f 3f c1 c0 40 3d  ..v?..}?...?..@=
0030  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0040  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0050  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0060  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0070  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 00 00 00 00 00 00 00 c9 c8 c8 3d eb ea 6a 3f  ...........=..j?
0010  fe fd 7d 3f ea e9 69 3f 8d 8c 0c 3e 00 00 00 00  ..}?..i?...>....
0020  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0030  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0040  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0050  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0060  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0070  00 00 00 00 00 00 00 00 c7 c6 46 3f fe fd 7d 3f  ..........F?..}?
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  fe fd 7d 3f 8e 8d 0d 3f 00 00 00 00 00 00 00 00  ..}?...?........
0010  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0020  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0030  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0040  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0050  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0060  00 00 00 00 9d 9c 9c 3e f9 f8 78 3f fe fd 7d 3f  .......>..x?..}?
0070  be bd 3d 3f c1 c0 40 3d 00 00 00 00 00 00 00 00  ..=?..@=........
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0010  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0020  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0030  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0040  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0050  99 98 98 3d c9 c8 48 3f fe fd 7d 3f fe fd 7d 3f  ...=..H?..}?..}?
0060  8e 8d 0d 3f 00 00 00 00 00 00 00 00 00 00 00 00  ...?............
0070  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................

DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0010  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0020  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0030  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0040  87 86 06 3f fe fd 7d 3f fe fd 7d 3f ae ad 2d 3f  ...?..}?..}?..-?
0050  c1 c0 40 3d 00 00 00 00 00 00 00 00 00 00 00 00  ..@=............
0060  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0070  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0010  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0020  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0030  f9 f8 78 3f fe fd 7d 3f fe fd 7d 3f c9 c8 c8 3d  ..x?..}?..}?...=
0040  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0050  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0060  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0070  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0010  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0020  f9 f8 78 3f fe fd 7d 3f fe fd 7d 3f ad ac 2c 3e  ..x?..}?..}?..,>
0030  a1 a0 a0 3d a1 a0 a0 3d a1 a0 a0 3d a1 a0 a0 3d  ...=...=...=...=
0040  a1 a0 a0 3c 00 00 00 00 a1 a0 a0 3c a1 a0 a0 3d  ...<.......<...=
0050  a1 a0 a0 3d 95 94 14 3e 97 96 16 3f 97 96 16 3f  ...=...>...?...?
0060  97 96 16 3f 94 93 13 3f a1 a0 20 3d 00 00 00 00  ...?...?...=....
0070  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0010  f9 f8 78 3f fe fd 7d 3f fe fd 7d 3f fe fd 7d 3f  ..x?..}?..}?..}?
0020  fe fd 7d 3f fe fd 7d 3f fe fd 7d 3f fe fd 7d 3f  ..}?..}?..}?..}?
0030  a9 a8 28 3f 90 8f 0f 3f a7 a6 26 3f fe fd 7d 3f  ..(?...?..&?..}?
0040  fe fd 7d 3f fe fd 7d 3f fe fd 7d 3f fe fd 7d 3f  ..}?..}?..}?..}?
0050  fe fd 7d 3f fe fd 7d 3f f7 f6 f6 3e 00 00 00 00  ..}?..}?...>....
0060  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0070  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  af ae 2e 3f fe fd 7d 3f fe fd 7d 3f fe fd 7d 3f  ...?..}?..}?..}?
0010  fe fd 7d 3f fe fd 7d 3f fe fd 7d 3f fe fd 7d 3f  ..}?..}?..}?..}?
0020  fe fd 7d 3f fe fd 7d 3f fe fd 7d 3f fe fd 7d 3f  ..}?..}?..}?..}?
0030  fa f9 79 3f f8 f7 77 3f f8 f7 77 3f aa a9 29 3f  ..y?..w?..w?..)?
0040  eb ea ea 3e eb ea ea 3e e5 e4 64 3e 00 00 00 00  ...>...>..d>....
0050  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0060  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0070  00 00 00 00 ed ec ec 3e f7 f6 f6 3e f7 f6 f6 3e  .......>...>...>
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  f7 f6 f6 3e a7 a6 26 3f fe fd 7d 3f fe fd 7d 3f  ...>..&?..}?..}?
0010  fe fd 7d 3f 9c 9b 1b 3f f7 f6 f6 3e f7 f6 f6 3e  ..}?...?...>...>
0020  a5 a4 24 3e 00 00 00 00 00 00 00 00 00 00 00 00  ..$>............
0030  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0040  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0050  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0060  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0070  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0010  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0020  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0030  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0040  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0050  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0060  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0070  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0010  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0020  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0030  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0040  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0050  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0060  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0070  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0010  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0020  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0030  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0040  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0050  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0060  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0070  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [112 B]:
0000  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0010  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0020  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0030  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0040  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0050  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
0060  00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: 86 61                                            .a
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 15 B]: ff fd 17 00 00 00 e1 e7 10 0c 00 00 00 00 00     ...............
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [ 16 B]: 00 00 04 00 00 00 01 00 00 00 04 00 00 00 f0 43  ...............C
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: ff fd                                            ..
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  4 B]: 0b 01 00 00                                      ....
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  3 B]: e1 e7 10                                         ...
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 01 00 00 00 00 00 00 03 00 00 00 06 80 00 80  ................
0010  ff ff ff ff ff ff ff ff 04 00 00 00 07 00 00 00  ................
0020  07 00 00 00 07 00 00 00 07 00 00 00 94 2e 01 20  ................
0030  00 00 00 00 01 00 00 00 00 00 00 00 04 00 00 00  ................
0040  02 20 01 00 01 00 00 00 00 00 00 00 1c 00 00 00  ................
0050  00 00 00 00 1c 00 00 00 00 00 00 00 01 00 00 00  ................
0060  00 00 00 00 48 97 00 08 00 00 00 00 01 00 00 00  ....H...........
0070  00 00 00 00 04 00 00 00 02 20 01 00 03 00 00 00  ................
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [128 B]:
0000  00 00 00 00 03 00 00 00 00 00 00 00 01 00 00 00  ................
0010  00 00 00 00 10 00 00 00 00 00 00 00 88 99 00 08  ................
0020  00 00 00 00 01 00 00 00 00 00 00 00 04 00 00 00  ................
0030  02 20 01 00 01 00 00 00 00 00 00 00 01 00 00 00  ................
0040  00 00 00 00 01 00 00 00 00 00 00 00 10 00 00 00  ................
0050  00 00 00 00 24 3b 01 20 00 00 00 00 01 00 00 00  ....$;..........
0060  00 00 00 00 04 00 00 00 02 20 01 00 01 00 00 00  ................
0070  00 00 00 00 1a 00 00 00 00 00 00 00 1a 00 00 00  ................

DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [ 12 B]: 00 00 00 00 10 00 00 00 00 00 00 00              ............
DEBUG:tvm.micro.transport.base:micro-rpc: write {30.00s}        <- [  2 B]: 04 63                                            .c
DEBUG:tvm.micro.transport.base:micro-rpc: read {30.00s}  128 B -> [IoTimeoutError 30.00s]
DEBUG:tvm.micro.transport.base:micro-rpc: closing transport

---------------------------------------------------------------------------
TVMError                                  Traceback (most recent call last)
<ipython-input-37-0b70168db202> in <module>
     12     # this model values of 0 to 2Pi are acceptable.
     13     graph_mod.set_input(input_tensor, tvm.nd.array(x_test[1]))
---> 14     graph_mod.run()
     15     tvm_output = graph_mod.get_output(0).asnumpy()
     16     print("result is: " + str(tvm_output))

~/tvm_feb24/python/tvm/contrib/graph_runtime.py in run(self, **input_dict)
    204         if input_dict:
    205             self.set_input(**input_dict)
--> 206         self._run()
    207 
    208     def get_num_outputs(self):

~/tvm_feb24/python/tvm/_ffi/_ctypes/packed_func.py in __call__(self, *args)
    235             != 0
    236         ):
--> 237             raise get_last_ffi_error()
    238         _ = temp_args
    239         _ = args

TVMError: MicroSessionTimeoutError: failed to read reply message after timeout 30s

areusch · February 25, 2021, 7:00am

@aakah18151 I think the --link-params is working but either you’re seeing problems with the serial port or one of the implemented operators is crashing. Can you tell me more about your hardware setup (OS, cable, etc)?

aakah18151 · February 25, 2021, 7:20am

@areusch I think operator crashing is not a problem because the same model works with the following target string TARGET= tvm.target.target.micro(“stm32f746xx”) but fails when using TARGET = tvm.target.target.create(‘c -keys=arm_cpu -mcpu=cortex-m7 -link-params -model=stm32f746xx -runtime=c -system-lib’)

This might also mean that serial port/cable might not be the issue.

I am using Ubuntu 18.04

This cable and

STM32F746ZG Nucleo Board.

areusch · February 25, 2021, 4:43pm

@aakah18151 I wonder if this may be an alignment issue with the generated DLTensor data?

aakah18151 · February 25, 2021, 4:54pm

@areusch Should the DLTensor data alignment be different in both cases i.e. when using -link-params and when not using -link-params ?

areusch · February 25, 2021, 5:48pm

in the -link-params case it’s handled by the linker; I think it should be correct since we declare with the correct data type, but just wondering. in the other case, it’s handled by the memory allocator and maybe the linker too.

mdw-octoml · March 7, 2021, 1:32am

Sorry for the delayed reply here. I hit a similar issue a few days ago which affects both nRF5340DK and the QEMU emulation:

In this case, the workaround is to use -link-params in the target, and to not call set_input() on the graph module with any of the model params – that is, if you use -link-params you only need to call set_input() with the first-layer inputs.

My belief is that this bug is caused by the size of the params tensor being larger than some threshold, since smaller params tensors are fine. @aakah18151 - Are you calling set_input() with the model params as well as using -link-params?