Search results

Support parallel scenario execution

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#30 In aviralgarg05/agentunit;

· aviralgarg05 opened on Dec 6, 2025

Add dataset sampling strategies

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#28 In aviralgarg05/agentunit;

· aviralgarg05 opened on Dec 6, 2025

Add scenario tagging and filtering

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#17 In aviralgarg05/agentunit;

· aviralgarg05 opened on Dec 6, 2025

Create VS Code extension for AgentUnit configs

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#16 In aviralgarg05/agentunit;

· aviralgarg05 opened on Dec 6, 2025

Add baseline comparison with regression detection

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#20 In aviralgarg05/agentunit;

· aviralgarg05 opened on Dec 6, 2025

Add retry decorator with exponential backoff

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#27 In aviralgarg05/agentunit;

· aviralgarg05 opened on Dec 6, 2025

Add streaming output for live evaluation progress

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#18 In aviralgarg05/agentunit;

· aviralgarg05 opened on Dec 6, 2025

Support custom metrics via YAML configuration

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#19 In aviralgarg05/agentunit;

· aviralgarg05 opened on Dec 6, 2025

Add LLM cost tracking and budgeting

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#23 In aviralgarg05/agentunit;

· aviralgarg05 opened on Dec 6, 2025

Support async adapters

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#25 In aviralgarg05/agentunit;

· aviralgarg05 opened on Dec 6, 2025

Add --watch mode for continuous evaluation

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#21 In aviralgarg05/agentunit;

· aviralgarg05 opened on Dec 6, 2025

Add test for markdown report emoji encoding

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

tests

Status: Open.

#15 In aviralgarg05/agentunit;

· aviralgarg05 opened on Dec 6, 2025