Tue, Aug 11, 202613:20EvalsGraphsAgents
Event-Request Agents and a Game-Like Review Desk
Stefano Casafranca shows agents that triage event requests, and a game-like interface to review them.
Takeaways
- The center rents its venue to internal and external partners, and requests arrive in many forms, including long email forms that touch departments such as catering, police coverage, furniture and moving crews.
- A dashboard shows what each event needs, and feedback from a review session pushed him toward gamifying it so new interns can pick up the workflow faster.
- In the concept, called The Center, a red button would run the agent ("the fellow") and a green stamp would approve or send an email, with escalation as a separate option; the goal is for the agent to learn and grow more reliable over time.
- He treats tags in code as the most important part of the agent graph: department tags, plus proposed tags for whether a request came from a form or an email reply, so LangSmith traces can be segmented and evaluated.
- He names Papers, Please, Undertale, Ace Attorney and Duolingo as inspirations, and says KPIs should be defined before tagging.
Transcript
Transcript coming.
Same night
Premieres Thu, Nov 518:45ATune: Heart Rate and Game Sounds in Your TerminalColin McNamara · Coding agents
Premieres Thu, Nov 2619:38Local-First AI Infrastructure with llama.cppBert · Routing

