According to Richard Seroter, the new Google AI Gemini Embedding 2 model introduces the ability to process interleaved modalities in a single request, allowing users to obtain embeddings for both images and their corresponding text captions simultaneously. This advancement could significantly enhance AI model efficiency and multimodal application development.