What about a transport/shell-emulation via something like mosh? Just a quick idea, need to think it through. Mosh is super responsive due to local completion and such though.