OpenAI Evals migration checklist: save this before Oct 31 🔖 On Oct 31, existing evals on OpenAI's Evals platform become read-only. On Nov 30, the Evals dashboard and API shut down, along with Agent Builder and reusable prompts. OpenAI's migration guide points to Promptfoo, an open-source eval tool that runs on your own machine (Promptfoo joined OpenAI in March). You rebuild each eval by hand: prompts, provider, test cases and assertions, in one config file. ⚠️ Graders: rebuilt as assertions. OpenAI notes similarity scores may not match. ⚠️ Dataset review and prompt iteration don't come with you. Move-out checklist: 1️⃣ List every eval you run: names, datasets, graders 2️⃣ Rebuild each one as a config file 3️⃣ Rerun, then compare scores before you trust them Send this to whoever owns your evals 📦 Sources: OpenAI deprecations page (developers.openai.com/api/docs/deprecations), OpenAI Cookbook "Moving from OpenAI Evals to Promptfoo" #OpenAI #LLMevals #promptfoo #AIengineering #LLMOps - @dgm.america