For power efficiency, move memory as little as possible. So, for flexible power efficient hardware, use UMA. But UMA (Mac M, Strix Halo/Ryzen AI) seems not comparatively cheap at this stage. Or, for less flexibility use a GPU with enough VRAM. For smaller solutions in the ARM realm: general SoC are neither fast nor efficient, whereas edge mobile devices are promising but not cheap.
It becomes a matter of numeric comparison really - there are compromises and no clear winners.
For power efficiency, move memory as little as possible. So, for flexible power efficient hardware, use UMA. But UMA (Mac M, Strix Halo/Ryzen AI) seems not comparatively cheap at this stage. Or, for less flexibility use a GPU with enough VRAM. For smaller solutions in the ARM realm: general SoC are neither fast nor efficient, whereas edge mobile devices are promising but not cheap.
It becomes a matter of numeric comparison really - there are compromises and no clear winners.