Vantage in Google Labs - Practice & assess future-ready skills with AI-simulated team
byโข
Vantage is a Google Research experiment that uses GenAI to assess future-ready skills like collaboration, critical thinking, and creativity. AI avatars simulate real scenarios, score your performance, and deliver a personal Skill Map. Now on Google Labs.


Replies
Google Research just made the hardest skills to measure, actually measurable.
Vantage is a Google Research experiment that uses GenAI to assess future-ready skills like collaboration, critical thinking, and creativity. AI avatars simulate real scenarios, score your performance, and deliver a personal Skill Map.
The problem: Critical thinking, collaboration, and creativity matter most but are nearly impossible to assess at scale.
The solution: Vantage uses an Executive LLM to simulate real team scenarios, surface skill evidence, and score performance at human-expert level.
What stands out:
๐ง AI simulated team: Work through missions like debates, pitches, and experiments with AI avatars.
๐ฏ Executive LLM: Introduces dynamic challenges like conflict and constraints mid-conversation.
๐ AI Evaluator: Scores using expert-level rubrics with human-like agreement.
๐บ๏ธ Personal Skill Map: Visual scores with precise qualitative feedback.
๐ฌ Validated by New York University: AI scoring matches human experts across 188 testers.
๐ Aligned with OECD and World Economic Forum frameworks.
๐ Built for classrooms: Designed as a skills layer alongside existing curricula.
Skills assessed:
- Collaboration: Conflict resolution and project management.
- Creative Thinking: Generating, building, and evaluating ideas.
- Critical Thinking: Interpreting, analyzing, and judging information.
Different because itโs not a test, but an adaptive conversation that reveals real capability.
P.S. I hunt the latest and greatest launches in tech, SaaS and AI, follow to be notified โ @rohanrecommends
@rohanrecommendsย For B2B/tech roles like product launches or client pitches, how does Vantage simulate those high-stakes moments; like defending a pivot to skeptical stakeholders or resolving cross-timezone conflicts? Does the AI throw curveballs based on your actual responses?
Stella AI
This would be a great brainstorming partner!
Interesting idea! How do you ensure the AI-simulated scenarios stay relevant as tech stacks and best practices evolve? I remember one painful incident where outdated training led to a junior engineer deploying a container with root privileges to production.
OpenPlugin
Cool! Built something like this before under the guise of an interview and its interesting how a reframing from interview to assessment enables you to discover a whole value add of education.
critical thinking and collaboration are the skills I need most but never know how to actually benchmark. curious how the skill map tracks improvement over time. do repeated sessions show progression?
Very interesting. Measuring soft skills in a realistic way is always hard because people modify their behavior when they know they are being observed (i.e., the Hawthorne Effect). I wonder if the fact that they are being audited by an AI would defuse that behavior.