AI Evals Certification
Define what good looks like for your AI. Catch failures before your users do, so even its non-deterministic outputs earn your trust.
Product Lead at Meta
Learn live online
Taught by top AI product leaders
Small class sizes
20 students per class, on average
4.8
Based on 1,284 ratings
20,901+
students graduated
Our instructors work at
The new standard for AI product reliability
As AI adoption accelerates, PMs face a new challenge: proving not just what AI can do, but whether it can be trusted. Customers, regulators, and leadership are demanding AI systems that are accurate, safe, and aligned with company values—but most teams lack the tools to measure and enforce trust at scale.
The AI Evals Certification equips Product Managers with the frameworks and playbooks to lead in this new era. You’ll learn how to define “good” beyond accuracy, design evals that surface hidden risks, and integrate gating mechanisms into CI/CD pipelines. By the end of the program, you’ll be able to scale evals across products, embed responsible AI practices into team culture, and confidently ship AI features that earn user trust.
This isn’t theory. You’ll build systematic eval suites, run failure mode analyses, and leave with the practical skills and portfolio-ready artifacts to prove you can safeguard AI products from launch to scale.
What you’ll learn
Modern Eval Frameworks
Define “good” for AI outputs with trust-driven metrics that go beyond accuracy, aligning with adoption, compliance, and growth.
Failure Mode Taxonomies
Apply structured methods to discover and prioritize hidden risks before they erode adoption or damage user trust.
Systematic Eval Suites
Translate failures into repeatable evaluators validated against gold-standard datasets for consistent, trustworthy outputs.
Eval Gating Systems
Turn evaluators into scalable gates within deployment pipelines, with clear escalation paths when thresholds are breached.
Cross-Product Eval Playbooks
Design scalable practices to monitor drift, bias, and fairness continuously across multiple product lines.
Responsible AI Culture Plan
Create a portfolio-ready playbook to embed responsible AI practices into your org and align stakeholders around long-term trust.
Who this course is for
Product Managers
who want to operationalize trust in AI products and lead with eval-driven execution.
Senior PMs/Leads
embedding safety, fairness, and reliability into team workflows at scale.
AI Advocates
who need systematic eval suites, deployment pipeline gating, and cross-product playbooks to safeguard launches.
Prerequisites
This course is not for everyone
PMs need to have a solid understanding of AI in a product context
This is not an entry level course
Completion of AI Product Management Certification is strongly advised. Prior experience with AI Prototyping is recommended for success.
It is FOR YOU if you ...
want to master Evals, scaling from prototypes to trustworthy, production-ready AI systems.
Not sure if this certification is right for you?
Schedule a callWhat's included
Live sessions
Live build labs with your AI Product Leader.
Course materials
Full access to materials and recordings, anytime.
AI tools access
$50k+ worth of AI tools, included with Unlimited Membership.
Instructor feedback
Direct, live feedback from your Silicon Valley instructor.
Workflows & templates
The most popular AI tool workflows, templates, and prompt packs.
Certification
Industry-recognized credential on completion.
Reimbursement kit
Support and resources to get your employer to cover the cost.
Alumni community
Exclusive access to a network of 10k+ alumni.
Unlimited membership
$416
$462/mo, billed annually
- Access to all 10 live instructor-led courses
- Weekly live AI workshops
- Free access to $50k+ worth of AI tools
Buy individual course
$2,999
AI Evals Certification Curriculum
01Build trusted AI products on modern eval metrics1 live session2 labs1 artifactDay 1 Hook: "What does 'good' mean — the answer, or the path to it?"Show Details
Pre-read
Output vs. trajectory eval split
AI Evaluation Strategy Canvas
First Eval Lab Walkthrough
Eval strategy canvas — "good" defined, output vs. trajectory split
Session recording
02Master failure-mode discovery1 live session2 labs1 artifactDay 2 Hook: "What can go wrong, for chatbots and for agents?"Show Details
Pre-read
Build a Failure Taxonomy, prioritize by impact
Eval Audit Walkthrough
Failure Taxonomy Canvas
Failure Taxonomy — agent + output failure modes, prioritized
Session recording
03Translate failures into calibrated eval suites1 live session3 labs1 artifactDay 3 Hook: "How do I measure quality, and trust the judge?"Show Details
Pre-read
5-part Eval Spec, judge calibration (κ ≥ 0.6)
Trajectory Eval Lab
Judge Calibration Tool
Eval Spec Builder
Calibrated eval suite — gold set + 5-part Eval Spec
Session recording
04Ship safely with a CI eval gate1 live session3 labs1 artifactDay 4 Hook: "How do I block bad releases automatically, for real?"Show Details
Pre-read
GitHub Actions eval gate, regression golden set
CI Gate Demo
Eval Gate Mapping Tool
Launch Strategy Builder
CI eval gate — thresholds and blocking dimensions defined
Session recording
05Scale evals, online & closed-loop1 live session2 labs1 artifactDay 5 Hook: "How do evals scale, and how does production feed back in?"Show Details
Pre-read
Production traces → Error Feed → offline set → gate
Coverage Matrix Tool
Budget Crisis Tool
Closed-loop coverage & scale plan
Session recording
06Champion a culture of responsible AI1 live session2 labs1 artifactDay 6 Hook: "How do I make the closed loop how my org ships, and prove compliance?"Show Details
Pre-read
Eval ROI, pyramid memo, AI-native capstone
Ship/Hold Memo Builder
Final Pitch Prompt Generator
Ship/Hold memo — data-backed recommendation on Ascend IQ
Session recording
07Final project: ship your Ascend IQ recommendation6 artifacts1 repoCertificationShow Details
Your forked repo: all six artifacts assembled into one submission
AI Evals certification review, graded by your instructor
Certificate issued on pass
Upcoming start dates
Choose the time that best fits your schedule
Course
Dates
Schedule
Instructor
AI Evals
4 spots left
Oct 12 – Oct 28
3 Weeks · Part-time
Mondays and Wednesdays
10:00 AM – 12:00 PM
(America / Los Angeles)
AI Evals
Nov 7 – Nov 21
3 Weeks · Part-time
Saturdays
7:30 AM – 12:00 PM
(America / Los Angeles)
30mins break
Nothing that works? Join the waitlist or request a private cohort
Explore our flexible plans
Single Certification
Ideal for: Focused learners who want to master a specific skill
$2,999
- 1 live, instructor-led certification course
Pro Membership
Ideal for: Product managers ready to build broad expertise across multiple disciplines
$333
/mo, billed annually
- 2 live, instructor-led certification courses
- Weekly live AI Workshops
- Access to on-demand content
- Access to our alumni community
Unlimited Membership
Ideal for: Product professionals seeking full career transformation
$416
/mo, billed annually
- 10 live, instructor-led certification courses
- Weekly live AI Workshops
- Free access to $50k+ worth of AI tools
- Ticket to one ProductCon conference
- Access to on-demand content
- Access to our alumni community
- Access to all newly released courses
Hear it from our alumni
"The biggest shift was getting comfortable turning rough ideas into working prototypes — actually shipping things, not just planning them."
Vikrant Shukla
Sr Product Manager at Salesforce
Thank you Product School for helping bring genAI concepts down to earth. We covered technical basics such as RAG and embedding and tokenization and Product-focused ideals such as defensive and offensive AI strategies.
Deepak Ravi
Product Manager, AI & Data at New York Life
"Through the certification, I learned a lot about AI, myself, and how to keep current with the rapid changes in the industry. No doubt that I will be a better product leader, and I look forward to building our AI PM community."
Josh Gray
Global Monetization Product at Tiktok
"This program strengthened my understanding of how successful AI products are built — not just with strong models, but with the right balance of workflow integration, trust, evaluation, and operational impact."
Debolina Das
Sr Product Manager at Amazon
"It was the right time to pick up this course when AI tools like Claude Code are changing how PMs work — and this program gave me a practical, hands-on foundation from vision to launch."
Clinton Gonsalves
Product Manager at JPMC
"Product School helped me develop critical product skills to master my job and get a product promotion. The case studies and real examples shared by my instructor helped me put into practice the frameworks that I learned and drive impact in my work."
Paulina Mwangi
Sr Director of Product at Salesforce
"Claude Code gave me a better overview of the entire process — system, roadmap, strategy — and freed up mental space to focus on the quality of the work."
Jenny Kan
Product Strategy Lead at ServiceNow
"Product School helped me learn the skills that I needed to break into product, and now I work on Product Strategy for Google Play."
Shilpi Verma
Product Lead at Google
"This certification covers everything you need to know about Product Management to jumpstart and land your first PM job. It isn’t all theory, you get to apply everything you learn to your own project and the instructors provide feedback to help you improve."
Medha Ghatikesh
Product Manager at Meta
Train the whole product org
Private cohorts on your schedule, group pricing from three seats, and everything you need to get it expensed.
Group discounts starting at 3 seats
Private cohorts, your dates and your case studies
Reimbursement letter and invoicing handled
Team progress reporting for managers
Frequently asked questions
What does a Certification from Product School mean?
Product School certifications are the gold standard in Product Management and AI Training and are recognized across the industry. Since 2014, Product School has been at the cutting edge of Product Management education. We’ve certified over 20,000 Product Managers from around the world, so we know exactly what it takes to succeed in this highly competitive and ever changing industry. Hiring managers recognize that our alumni have been trained by the very best.
What’s the schedule and duration of the course?
We know you’re busy, so making this fit in with your schedule is key! That’s why we have multiple course options that focus on making this as convenient as possible.
Who are Product School instructors?
Our instructors are accomplished AI Product Leaders who work at some of the most prominent Silicon Valley companies, such as Google, Facebook, Netflix, Airbnb, PayPal, Uber, and Amazon. As experienced professionals who build digital products for millions of people and work with AI every day, they know exactly what it takes to get upskilled as a Product Manager and succeed in the role as an AI native PM.
How many students are in each class?
At Product School, we believe in fostering a collaborative and personalized learning environment. That’s why we keep our class sizes small, with a limited number of students per class. Unlike other Product Management courses, where you may be competing for the instructor's attention among dozens or even hundreds of students, we ensure that you'll receive individual attention and forge meaningful relationships with your instructor and peers. They’re also just big enough that you benefit from learning and networking alongside students with a broad range of professional backgrounds.
What are the classes like?
Our AI certifications are hands-on, immersive, and practical from the very first day. You’ll be using state-of-the-art PM and AI tools, taking part in group exercises, discussing case studies, creating content to add directly to your portfolio, strengthening your resume, and practicing mock interviews. By the end of the sessions, you’ll have built deeper knowledge and skills in AI Product Management supported by a tool-kit of frameworks aligned to real-world examples to help you succeed in your career.
Are the certifications taught in-person or online?
All of Product School's courses are delivered live online. You'll be able to stream lectures in real-time, interact with your instructor, and collaborate with your peers from anywhere in the world, all from the comfort of your own home. We offer cohorts at various times to accommodate students from different time zones and locations around the world.
How much does Product School cost?
Product School offers three plans to fit different goals and levels of commitment.
Single Certification — One live, instructor-led certification to deepen expertise in a specific area.
Pro Membership — Two live certifications per year, on-demand content and alumni community access. Flexible payment plans available.
Unlimited Membership — Ten live certifications per year, free access to $50,000+ worth of AI tools, a ticket to ProductCon, on-demand content and alumni community access. Flexible payment plans available.
Discover how our programs can unlock new opportunities—without worrying about upfront costs. Schedule a call with our Admissions Team to discuss which plan aligns with your goals and explore flexible payment options tailored to you.
Which Product School plan is right for me?
It depends on your goals and how quickly you want to grow.
If you’re targeting one specific skill gap, a Single Certification is the most direct path. If you want structured annual development across two focus areas, Pro Membership gives you that without overcommitting. If you’re serious about staying ahead of AI in product management and want maximum access — certifications, events, tools, and community — Unlimited Membership is built for you.
Not sure? Schedule a call and we’ll help you choose.
What’s included in the Pro and Unlimited Memberships?
Both memberships include live, instructor-led certifications, on-demand content, alumni community access, and a LinkedIn badge.
Pro Membership — Two certifications per year — a focused way to keep developing without a large time or financial commitment. Flexible payment plans available.
Unlimited Membership — Ten certifications per year, plus free access to $50,000+ worth of AI tools and a ticket to ProductCon (SF, NY, or London). Built for professionals who want to go all-in on their product career. Flexible payment plans available.
Schedule a call to find out which is right for you.
How do I get started?
Ready to get started? Explore our plans to find the right fit, or enroll now if you already know which certification you want. If you have questions, schedule a free call and we’ll help you choose.
Can Product School provide custom training for my company?
Absolutely! We frequently customize training for companies looking to onboard new talent, upskill and align existing teams, and outpace the competition. In-person or online, we’ll work with you to design a unique experience that fits your company’s needs and schedule, no matter where you are in the world. Speak to our Enterprise team to learn more today.