1 Release published by 1 person

• v0.2.0

  published Jul 24, 2025

5 Pull requests merged by 3 people

• Example and Dataset Changes

  #475 merged Jul 26, 2025

• fix imports

  #476 merged Jul 25, 2025

• Add otel dependencies

  #473 merged Jul 25, 2025

• Groq Client support

  #470 merged Jul 24, 2025

• JUD-1550: Trace Eval Fixes

  #467 merged Jul 23, 2025

3 Pull requests opened by 3 people

• MyPy fix (JUD-1537)

  #466 opened Jul 22, 2025

• Set score 0 if error

  #472 opened Jul 24, 2025

• Fix: Example class now validates field names

  #474 opened Jul 25, 2025

11 Issues closed by 1 person

• [BUG]: Intermittent dashboard trace synchronization failures

  #448 closed Jul 22, 2025

• [BUG]: Improve API authentication error handling and debugging guidance

  #447 closed Jul 22, 2025

• [BUG]: Missing links in documentation

  #444 closed Jul 19, 2025

• [BUG] Silent acceptance of threshold in ExampleScorer subclasses may lead to misleading behavior

  #440 closed Jul 19, 2025

• [FEATURE] Auto-Instrumentation for Custom Runner Functions

  #433 closed Jul 19, 2025

• Code lacks support for structured evaluation with scoring

  #414 closed Jul 19, 2025

• Missing fine-grained JudgeVal tracing for sub-agent actions

  #413 closed Jul 19, 2025

• Lack of centralized error monitoring across agents

  #412 closed Jul 19, 2025

• [Optional] Docs: Add Gemini wrap() Example (non-OpenAI LLM)

  #410 closed Jul 19, 2025

• Documentation: Missing Performance and Scaling Guidelines

  #404 closed Jul 19, 2025

• Documentation: Missing Error Handling and Troubleshooting Guide

  #403 closed Jul 19, 2025

7 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Update Needed: execute_api_eval() blocks async servers, it needs async version

  #378 commented on Jul 19, 2025 • 0 new comments

• Feature Request: Make the trace link clickable on Spyder IDE

  #381 commented on Jul 19, 2025 • 0 new comments

• Fix: Uncaught JudgmentAPIError exposes internal stack trace to end-user

  #382 commented on Jul 19, 2025 • 0 new comments

• Missing Session-Based Tracing API

  #398 commented on Jul 19, 2025 • 0 new comments

• Missing Async Evaluation API for Non-Blocking Operations

  #400 commented on Jul 19, 2025 • 0 new comments

• Native Chainlit integration utilities for Judgeval Tracing and Evaluation

  #395 commented on Jul 19, 2025 • 0 new comments

• Add EchoAgent and Evaluation Pipeline with Custom Relevancy Scorer

  #375 commented on Jul 19, 2025 • 0 new comments