According to Richard Seroter, the introduction of load-aware and context-aware routing in the GKE Inference Gateway has enabled Google Cloud's Vertex AI, which operates on GKE, to achieve a 35% reduction in latency. This improvement significantly enhances performance compared to standard load balancing, offering users faster and more efficient AI inference capabilities.