View organization page for MLflow

71,582 followers

Missed last week’s #MLflow Community Meetup? Check out this clip with Benjamin Wilson on 𝗮𝗴𝗲𝗻𝘁𝗶𝗰 𝗷𝘂𝗱𝗴𝗲𝘀! 🙌 “The judge no longer works as an LLM as a judge—it actually works as an agent as a judge.” In this mode, the trace metadata (the trace info object in MLflow) is passed in: the input to the call, the output, and basically the root span ID for that trace. With that metadata—and MLflow’s MCP features recently released—the judge can make tool calls to MLflow to do things like searching spans and querying different aspects of the trace. 🎥 Watch the full video to go deeper: https://lnkd.in/eDzZmd_E Have questions? Bring them to MLflow Office Hours next Wed, Oct 22 🔗 https://lnkd.in/ezg-R8tc #opensource #oss #mlflow #agenticjudges #llm #genai

To view or add a comment, sign in

Explore content categories