HACKATHON - Agent Eval Harness (by the Friendly Data Meetup)

SIGN UP HERE TO ATTEND 👉 https://luma.com/h8zer2ek ______________________________________________ Hi new friends and old! The Friendly Data Meetup Hackathon is back by popular demand! 🎉 After the brilliant turnout (and the even more brilliant demos) at our first hackathon in January, we simply had to do it again. 👩‍💻 This evening is all about learning, building, and having fun with friendly faces. No pressure, no pitch decks, just inquisitive minds making cool things with data. With perhaps a slight competitive edge for those seeking glory 😉 📍 We're very grateful to Quantspark for kindly hosting us at their venue for the evening! 💡 The challenge: Judge the Agent ⚖️ *Dawdle Deliveries'* shiny new AI customer support bot goes live next week. Is it actually ready? Your job is to find out, with evidence instead of vibes! AI agents are moving into production, and everyone is asking the same question: how do you know it works? Together, we'll find out by building an evaluation harness from scratch: * 🧪 Write the tests: a set of realistic (and sneaky) customer questions * ✅ Build the checks: automatic pass/fail checks, plus an AI judge that marks every answer * 🔧 Fix it and prove it: improve the bot, then show a before/after scorecard proving your fix worked (without breaking anything else!)