Yes, Wezterm has this. https://wezfurlong.org/wezterm/multiplexing.html

I haven’t used it yet, and it requires you install Wezterm on the remote. Ideally Wezterm could push a mux server executable to the remote host if needed.