I run Kstars on PC in observatory and then connect through VNC with x11vnc. Even if connection gives up nothing happens because everything is running on observatory PC. Also I am connected through PowerLine adapter that gives me 100Mbit speed over 50m distance. So transfer of ASI1600 frame takes 3 seconds.
40Gbit?? You mean Mbit because there is no way to get that speed over wifi. Most likely you have unreliable connection which drops packets that can gives you slow transfers.