Model graph size doubling after partitioning for arm compute library

[Leo-arm]

@dmitriy-arm might know.