Google has integrated its general-purpose world model, Project Genie, with Street View. This means users can explore real-world streets in an interactive way, adjusting weather conditions or viewing locations in different seasons.

The technology is not just for humans to play around with; it’s also designed to help robots and autonomous vehicles better understand their environments. For instance, a robot might experience the rare London sunshine for the first time through Genie's simulations.

Google has been collecting Street View data since 2001 using cars with cameras and individuals with backpacks containing camera equipment. The tech giant holds more than 280 billion images from over 110 countries, making it a valuable resource for combining real-world information with simulated worlds.

The aim is to use Genie for educational experiences, gaming, and robotics training. It’s already being used by Waymo to train self-driving cars on rare events like tornadoes or casual encounters with elephants, which can be surprisingly challenging in simulations.

While the current version of Genie isn’t yet photorealistic, it is improving fast. The technology has a lot of potential for both human and robotic interaction, but accuracy and physics awareness are areas that still need work. For now, users can expect a video game quality simulation rather than a perfect real-world recreation.