🎓 Free introductory course "LLM evaluations for AI product teams". Save your seat

email course

LLM evaluations for AI product teams

Free 7-day email course on LLM evaluations for AI product teams and AI leaders. A gentle introduction to evaluating LLM-powered products, no coding knowledge required.

The course starts on December 9, 2024.

Sing up for free

Evidently AI Open-source ML observability course

about the course

What you will learn

The fundamentals of LLM evals: from evaluation methods and benchmarks to LLM guardrails and creating custom LLM judges.This course is designed for AI product managers and AI leaders interested in grasping the core concepts in AI quality and observability.

Save my seat

Evaluations at different stages of LLM app lifecycle: from experiments to production monitoring.

How to design evaluation datasets and use synthetic data to generate varied test cases.

What can go wrong with LLM apps: hallucinations, prompt injection, jailbreaks.

How to build LLM observability in production: tracing, evals, guardrails.

LLM evaluation methods: LLM judge, regular expressions, predictive metrics.

Practical examples: how to evaluate RAGs, QA systems, and agents.

perks

Why take the course?

Join the course to learn how to evaluate LLM-powered products.

Free

10+ byte-sized videos

LLM evals explained in plain English

Certificate upon completion

team

Meet course instructor

Elena Samuylova

Co-founder and CEO

Evidently AI

Elena Samuylova is a CEO and Co-founder at Evidently AI, a Y Combinator-backed startup developing open-source tools to evaluate, test, and monitor the performance of machine learning models.

‍

She has been active in the applied machine learning space since 2014. Previously, she co-founded and served as a CPO of an industrial AI startup. She worked with global metal and chemical companies to implement machine learning for production optimization. Prior to that, she led business development at Yandex Data Factory, an enterprise AI division of Yandex. She focused on delivering ML-based solutions to retail, banking, telecom, and other industries. In 2018, Elena was named 50 Women in Product Europe by Product Management Festival.

Faq

Have a question or need help?

Is the course free?

Yes, the course is 100% free.

What is the course format?

The course is organized into a series of 7 daily emails. Each day you will receive an email that consists of a byte-sized video covering a particular topic, a video summary, and recommendations for further reading.

Sign up to save your seat and be notified when the .

How long does it take to complete the course?

The course lasts seven work days, and one extra week to complete the final quiz.

Will I get a course certificate?

You will receive a certificate if you successfully complete the final quiz.

Note that to take the quiz you need to register on the quiz platform. No worries, we will provide all the instructions.

Are there any course prerequisites?

The course is designed for everyone interested in grasping the fundamentals of LLM evaluations. No previous knowledge of the subject or coding skills required.

What if I need help?

Have a question or just want to say “Hi”? Jump to our Discord to chat with fellow learners and get support from the course team.

When does the course start?

The course starts on December 9, 2024. Sign up to save your seat.

How can I enroll?

Will course materials still be available after the course?

Yes! All course videos will be available during and after the course.