Waymo's Secret Co-Pilot: Leaked Code Reveals Gemini AI Assistant in Robotaxis
Leaked code from Waymo's app reveals the company is testing Google's Gemini AI as an in-car assistant for its robotaxis. The 1,200-line prompt details its role, limitations, and how it differs from Tesla's approach.
What if your next self-driving car could talk back? It appears Waymo, Alphabet's autonomous vehicle company, is testing the integration of Google's GeminiAI chatbot into its robotaxis. The development came to light after researcher Jane Manchun Wong discovered a detailed system prompt within Waymo's mobile app code.
“While digging through Waymo’s mobile app code, I discovered the complete system prompt for its unreleased Gemini integration,” Wong wrote in a blog post. The document, a 1,200+ line specification titled ‘Waymo Ride Assistant Meta-Prompt,’ defines exactly how the AI assistant is expected to behave. While the feature hasn't shipped, Wong says the prompt makes it clear this is “more than a simple chatbot.”
The AI's Role and Its Limits
According to the leaked prompts, the AI assistant is instructed to be a “friendly and helpful AI companion” whose goal is to enhance the rider's experience. It’s directed to use simple language, avoid jargon, and keep responses succinct—just one to three sentences.
The assistant can reportedly manage in-cabin functions like climate control, lighting, and music. Notably absent, however, are controls for volume, route changes, seats, or windows. Crucially, the AI is programmed to maintain a clear distinction between its identity as Gemini and the autonomous driving technology, the 'Waymo Driver.' When asked, “How do you see the road?” it's supposed to reply, “The Waymo Driver uses a combination of sensors…,” not “I use sensors.”
Building Trust and Fending Off Competition
One of the most interesting aspects is the set of guardrails built into the assistant. It’s explicitly forbidden from speculating on or commenting on real-time driving actions or specific incidents. If a passenger asks about a video of a Waymo crash, it’s instructed to deflect. “Your role is not to be a spokesperson for the driving system’s performance,” the prompt reads, likely a measure to avoid liability and manage public relations.
In a statement to TechCrunch, Waymo spokesperson Julia Ilina was non-committal, saying, “While we have no details to share today, our team is always tinkering with features... Some of these may or may not come to our rider experience.”
Waymo isn't the only player integrating AI assistants. Tesla is doing something similar with xAI's Grok. However, the approaches seem different: Gemini appears programmed to be pragmatic and ride-focused, while Grok is pitched more as an in-car conversational buddy that can remember context.
This content is AI-generated based on source articles. While we strive for accuracy, errors may occur. We recommend verifying with the original source.
Related Articles
Google's Gemini AI on Pixel phones can now order food, book rides, and complete tasks on your behalf across select apps like Uber and Grubhub. Is this the dawn of true AI agents?
Apple reportedly asked Google to set up servers for Gemini-powered Siri that meets Apple's privacy standards. A deeper look at what this partnership really means.
Swedish startup Einride raises $113M ahead of NYSE debut, deploying 200 autonomous trucks for major brands. The logistics revolution accelerates.
Dubai signs deals with three unproven US transport companies after previous $450M Hyperloop failure and GM Cruise debacle. Will underground tunnels, flying pods, and air taxis work?
Thoughts
Share your thoughts on this article
Sign in to join the conversation