Latency is the biggest issue that I can see, even with reduced bitrates and games that have lower processing overhead (to keep rendering power manageable) I just can not see the latency being acceptable versus even your typical ~100ms-150ms gameplay.