-
Notifications
You must be signed in to change notification settings - Fork 22
Leaderboard: jeremyeder/reference (55.8/100 - Bronze) #254
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Leaderboard: jeremyeder/reference (55.8/100 - Bronze) #254
Conversation
# [2.10.0](v2.9.0...v2.10.0) (2025-12-16) ### Bug Fixes * add bounded retry logic for LLM rate limit handling ([ambient-code#205](https://github.com/jeremyeder/agentready/issues/205)) ([6ecb786](6ecb786)), closes [ambient-code#104](https://github.com/jeremyeder/agentready/issues/104) * disable attestations for Test PyPI to avoid conflict ([ambient-code#155](https://github.com/jeremyeder/agentready/issues/155)) ([a33e3cd](a33e3cd)), closes [pypa/#action-pypi-publish](https://github.com/jeremyeder/agentready/issues/action-pypi-publish) * downgrade docker/metadata-action to v5 and fix shellcheck warnings ([12f5509](12f5509)) * enable Harbor task filtering for smoketest support ([ambient-code#222](https://github.com/jeremyeder/agentready/issues/222)) ([f780188](f780188)) * leaderboard workflow and SSH URL support ([ambient-code#147](https://github.com/jeremyeder/agentready/issues/147)) ([de28cd0](de28cd0)) * make E2E test timeouts configurable and add sensitive directory test ([ambient-code#206](https://github.com/jeremyeder/agentready/issues/206)) ([27e87e5](27e87e5)), closes [ambient-code#104](https://github.com/jeremyeder/agentready/issues/104) [ambient-code#192](https://github.com/jeremyeder/agentready/issues/192) * rename research report in data directory ([b8ddfdc](b8ddfdc)) * resolve all test suite failures - achieve zero failures ([ambient-code#180](https://github.com/jeremyeder/agentready/issues/180)) ([990fa2d](990fa2d)), closes [ambient-code#148](https://github.com/jeremyeder/agentready/issues/148) [ambient-code#147](https://github.com/jeremyeder/agentready/issues/147) [ambient-code#145](https://github.com/jeremyeder/agentready/issues/145) * resolve broken links and workflow failures ([ambient-code#160](https://github.com/jeremyeder/agentready/issues/160)) ([fbf5cf7](fbf5cf7)) * resolve YAML syntax error in continuous-learning workflow ([ambient-code#172](https://github.com/jeremyeder/agentready/issues/172)) ([3d40fcc](3d40fcc)) * resolve YAML syntax error in update-docs workflow and add actionlint ([ambient-code#173](https://github.com/jeremyeder/agentready/issues/173)) ([97b06af](97b06af)) * skip PR comments for external forks to prevent permission errors ([ambient-code#163](https://github.com/jeremyeder/agentready/issues/163)) ([2a29fb8](2a29fb8)) * update --version flag to show correct version and research report date ([ambient-code#221](https://github.com/jeremyeder/agentready/issues/221)) ([5a85abb](5a85abb)) * **workflows:** ensure post-comment step runs after Claude Code Action ([b087e5c](b087e5c)) * **workflows:** handle all event types in agentready-dev workflow ([9b942bf](9b942bf)) * **workflows:** improve error handling and logging for comment posting ([9ea1e6b](9ea1e6b)) * **workflows:** improve issue number extraction and add debug step ([ecd896b](ecd896b)) * **workflows:** remove if:always() to test step execution ([ff0bb12](ff0bb12)) * **workflows:** simplify post-comment step condition ([1bbf40a](1bbf40a)) ### Features * add ambient-code/agentready to leaderboard ([ambient-code#148](https://github.com/jeremyeder/agentready/issues/148)) ([621152e](621152e)) * add Harbor Terminal-Bench comparison for agent effectiveness ([ambient-code#199](https://github.com/jeremyeder/agentready/issues/199)) ([a56e318](a56e318)) * add Memory MCP server allow list to repository settings ([ambient-code#203](https://github.com/jeremyeder/agentready/issues/203)) ([41d87bb](41d87bb)) * add quay/quay to leaderboard ([ambient-code#162](https://github.com/jeremyeder/agentready/issues/162)) ([d6e8df0](d6e8df0)) * Add weekly research update skill and automation ([ambient-code#145](https://github.com/jeremyeder/agentready/issues/145)) ([7ba17a6](7ba17a6)) * automate PyPI publishing with trusted publishing (OIDC) ([ambient-code#154](https://github.com/jeremyeder/agentready/issues/154)) ([71f4632](71f4632)), closes [pypa/#action-pypi-publish](https://github.com/jeremyeder/agentready/issues/action-pypi-publish) * consolidate GitHub Actions workflows by purpose ([ambient-code#217](https://github.com/jeremyeder/agentready/issues/217)) ([717ca6b](717ca6b)), closes [ambient-code#221](https://github.com/jeremyeder/agentready/issues/221) * container support ([ambient-code#171](https://github.com/jeremyeder/agentready/issues/171)) ([c6874ea](c6874ea)) * convert AgentReady assessment to on-demand workflow ([ambient-code#213](https://github.com/jeremyeder/agentready/issues/213)) ([b5a1ce0](b5a1ce0)), closes [ambient-code#191](https://github.com/jeremyeder/agentready/issues/191) * enhance assessors with multi-language support and security ([ambient-code#200](https://github.com/jeremyeder/agentready/issues/200)) ([85712f2](85712f2)), closes [#10](#10) * Harbor framework integration for Terminal-Bench evaluations ([ambient-code#202](https://github.com/jeremyeder/agentready/issues/202)) ([d73a8c8](d73a8c8)), closes [#4](#4) [ambient-code#178](https://github.com/jeremyeder/agentready/issues/178) [ambient-code#178](https://github.com/jeremyeder/agentready/issues/178) * Redesign homepage features with two-column layout and research links ([ambient-code#189](https://github.com/jeremyeder/agentready/issues/189)) ([570087d](570087d)), closes [ambient-code#187](https://github.com/jeremyeder/agentready/issues/187) * replace markdown-link-check with lychee for link validation ([ambient-code#177](https://github.com/jeremyeder/agentready/issues/177)) ([f1a4545](f1a4545)) * Terminal-Bench eval harness (MVP Phase 1) ([ambient-code#178](https://github.com/jeremyeder/agentready/issues/178)) ([d06bab4](d06bab4)), closes [ambient-code#171](https://github.com/jeremyeder/agentready/issues/171) * **workflows:** add comment posting for [@agentready-dev](https://github.com/agentready-dev) agent ([5dff614](5dff614)) ### Performance Improvements * implement lazy loading for heavy CLI commands ([ambient-code#151](https://github.com/jeremyeder/agentready/issues/151)) ([6a7cd4e](6a7cd4e))
Score: 55.8/100 (Bronze) Repository: https://github.com/jeremyeder/reference
CI Workflow FixThe validation workflow is failing because it cannot access the Root CauseThe checkout action fetches the PR branch but doesn't have the base Fix AppliedI've updated the workflow in this PR branch to:
See commits:
NoteSince GitHub Actions uses the workflow file from the base branch (not the PR branch), these fixes won't take effect for this PR's validation. The workflow needs to be fixed in the main repo first. The submission itself is valid - the assessment JSON file has been successfully added to this PR. The validation will complete once the workflow is fixed in main. |
|
Hi @jeremyeder! Thanks for your interest in AgentReady. The To assess your own repository: pip install agentready
agentready assess .See AgentReady documentation for more information. |
|
🎉 This PR is included in version 2.22.1 🎉 The release is available on GitHub release Your semantic-release bot 📦🚀 |
🥇 AgentReady Assessment (Current Repository)Score: 78.3/100 | Level: Gold 🎯 Next Steps (by impact)
📦 Download Full Reports • 🔗 View Workflow 📄 Full Assessment Report (click to expand)🤖 AgentReady Assessment ReportRepository: agentready 📊 Summary
Languages Detected
Repository Stats
🎯 Priority ImprovementsFocus on these high-impact fixes first:
📋 Detailed FindingsFindings sorted by priority (Tier 1 failures first, then Tier 2, etc.) 📝 Remediation StepsMeasured: 33.6% (Threshold: ≥80%) Evidence:
Add type annotations to function signatures
Commands: # Python
pip install mypy
mypy --strict src/
# TypeScript
npm install --save-dev typescript
echo '{"compilerOptions": {"strict": true}}' > tsconfig.jsonExamples:
📝 Remediation StepsMeasured: not configured (Threshold: configured) Evidence:
Configure conventional commits with commitlint
Commands: npm install --save-dev @commitlint/cli @commitlint/config-conventional husky📝 Remediation StepsMeasured: 3 huge, 11 large out of 186 (Threshold: <5% files >500 lines, 0 files >1000 lines) Evidence:
Refactor large files into smaller, focused modules
Examples:
📝 Remediation StepsMeasured: 330 lines, 53 headings, 33 bullets (Threshold: <500 lines, structured format) Evidence:
Make documentation more concise and structured
Commands: # Check README length
wc -l README.md
# Count headings
grep -c '^#' README.mdExamples: Features
DocumentationSee docs/ for detailed guides. Bad: Verbose proseThis project is a tool that helps you assess your repository [Many more paragraphs of prose...] Examples: Examples:
📝 Remediation StepsMeasured: basic config (Threshold: CI with best practices) Evidence:
Add or improve CI/CD pipeline configuration
Commands: # Create GitHub Actions workflow
mkdir -p .github/workflows
touch .github/workflows/ci.yml
# Validate workflow
gh workflow view ci.ymlExamples:
📝 Assessment Metadata
🤖 Generated with Claude Code |
* chore(release): 2.10.0 [skip ci] # [2.10.0](jeremyeder/agentready@v2.9.0...v2.10.0) (2025-12-16) ### Bug Fixes * add bounded retry logic for LLM rate limit handling ([ambient-code#205](https://github.com/jeremyeder/agentready/issues/205)) ([6ecb786](jeremyeder@6ecb786)), closes [ambient-code#104](https://github.com/jeremyeder/agentready/issues/104) * disable attestations for Test PyPI to avoid conflict ([ambient-code#155](https://github.com/jeremyeder/agentready/issues/155)) ([a33e3cd](jeremyeder@a33e3cd)), closes [pypa/#action-pypi-publish](https://github.com/jeremyeder/agentready/issues/action-pypi-publish) * downgrade docker/metadata-action to v5 and fix shellcheck warnings ([12f5509](jeremyeder@12f5509)) * enable Harbor task filtering for smoketest support ([ambient-code#222](https://github.com/jeremyeder/agentready/issues/222)) ([f780188](jeremyeder@f780188)) * leaderboard workflow and SSH URL support ([ambient-code#147](https://github.com/jeremyeder/agentready/issues/147)) ([de28cd0](jeremyeder@de28cd0)) * make E2E test timeouts configurable and add sensitive directory test ([ambient-code#206](https://github.com/jeremyeder/agentready/issues/206)) ([27e87e5](jeremyeder@27e87e5)), closes [ambient-code#104](https://github.com/jeremyeder/agentready/issues/104) [ambient-code#192](https://github.com/jeremyeder/agentready/issues/192) * rename research report in data directory ([b8ddfdc](jeremyeder@b8ddfdc)) * resolve all test suite failures - achieve zero failures ([ambient-code#180](https://github.com/jeremyeder/agentready/issues/180)) ([990fa2d](jeremyeder@990fa2d)), closes [ambient-code#148](https://github.com/jeremyeder/agentready/issues/148) [ambient-code#147](https://github.com/jeremyeder/agentready/issues/147) [ambient-code#145](https://github.com/jeremyeder/agentready/issues/145) * resolve broken links and workflow failures ([ambient-code#160](https://github.com/jeremyeder/agentready/issues/160)) ([fbf5cf7](jeremyeder@fbf5cf7)) * resolve YAML syntax error in continuous-learning workflow ([ambient-code#172](https://github.com/jeremyeder/agentready/issues/172)) ([3d40fcc](jeremyeder@3d40fcc)) * resolve YAML syntax error in update-docs workflow and add actionlint ([ambient-code#173](https://github.com/jeremyeder/agentready/issues/173)) ([97b06af](jeremyeder@97b06af)) * skip PR comments for external forks to prevent permission errors ([ambient-code#163](https://github.com/jeremyeder/agentready/issues/163)) ([2a29fb8](jeremyeder@2a29fb8)) * update --version flag to show correct version and research report date ([ambient-code#221](https://github.com/jeremyeder/agentready/issues/221)) ([5a85abb](jeremyeder@5a85abb)) * **workflows:** ensure post-comment step runs after Claude Code Action ([b087e5c](jeremyeder@b087e5c)) * **workflows:** handle all event types in agentready-dev workflow ([9b942bf](jeremyeder@9b942bf)) * **workflows:** improve error handling and logging for comment posting ([9ea1e6b](jeremyeder@9ea1e6b)) * **workflows:** improve issue number extraction and add debug step ([ecd896b](jeremyeder@ecd896b)) * **workflows:** remove if:always() to test step execution ([ff0bb12](jeremyeder@ff0bb12)) * **workflows:** simplify post-comment step condition ([1bbf40a](jeremyeder@1bbf40a)) ### Features * add ambient-code/agentready to leaderboard ([ambient-code#148](https://github.com/jeremyeder/agentready/issues/148)) ([621152e](jeremyeder@621152e)) * add Harbor Terminal-Bench comparison for agent effectiveness ([ambient-code#199](https://github.com/jeremyeder/agentready/issues/199)) ([a56e318](jeremyeder@a56e318)) * add Memory MCP server allow list to repository settings ([ambient-code#203](https://github.com/jeremyeder/agentready/issues/203)) ([41d87bb](jeremyeder@41d87bb)) * add quay/quay to leaderboard ([ambient-code#162](https://github.com/jeremyeder/agentready/issues/162)) ([d6e8df0](jeremyeder@d6e8df0)) * Add weekly research update skill and automation ([ambient-code#145](https://github.com/jeremyeder/agentready/issues/145)) ([7ba17a6](jeremyeder@7ba17a6)) * automate PyPI publishing with trusted publishing (OIDC) ([ambient-code#154](https://github.com/jeremyeder/agentready/issues/154)) ([71f4632](jeremyeder@71f4632)), closes [pypa/#action-pypi-publish](https://github.com/jeremyeder/agentready/issues/action-pypi-publish) * consolidate GitHub Actions workflows by purpose ([ambient-code#217](https://github.com/jeremyeder/agentready/issues/217)) ([717ca6b](jeremyeder@717ca6b)), closes [ambient-code#221](https://github.com/jeremyeder/agentready/issues/221) * container support ([ambient-code#171](https://github.com/jeremyeder/agentready/issues/171)) ([c6874ea](jeremyeder@c6874ea)) * convert AgentReady assessment to on-demand workflow ([ambient-code#213](https://github.com/jeremyeder/agentready/issues/213)) ([b5a1ce0](jeremyeder@b5a1ce0)), closes [ambient-code#191](https://github.com/jeremyeder/agentready/issues/191) * enhance assessors with multi-language support and security ([ambient-code#200](https://github.com/jeremyeder/agentready/issues/200)) ([85712f2](jeremyeder@85712f2)), closes [ambient-code#10](jeremyeder#10) * Harbor framework integration for Terminal-Bench evaluations ([ambient-code#202](https://github.com/jeremyeder/agentready/issues/202)) ([d73a8c8](jeremyeder@d73a8c8)), closes [#4](jeremyeder#4) [ambient-code#178](https://github.com/jeremyeder/agentready/issues/178) [ambient-code#178](https://github.com/jeremyeder/agentready/issues/178) * Redesign homepage features with two-column layout and research links ([ambient-code#189](https://github.com/jeremyeder/agentready/issues/189)) ([570087d](jeremyeder@570087d)), closes [ambient-code#187](https://github.com/jeremyeder/agentready/issues/187) * replace markdown-link-check with lychee for link validation ([ambient-code#177](https://github.com/jeremyeder/agentready/issues/177)) ([f1a4545](jeremyeder@f1a4545)) * Terminal-Bench eval harness (MVP Phase 1) ([ambient-code#178](https://github.com/jeremyeder/agentready/issues/178)) ([d06bab4](jeremyeder@d06bab4)), closes [ambient-code#171](https://github.com/jeremyeder/agentready/issues/171) * **workflows:** add comment posting for [@agentready-dev](https://github.com/agentready-dev) agent ([5dff614](jeremyeder@5dff614)) ### Performance Improvements * implement lazy loading for heavy CLI commands ([ambient-code#151](https://github.com/jeremyeder/agentready/issues/151)) ([6a7cd4e](jeremyeder@6a7cd4e)) * feat: add jeremyeder/reference to leaderboard Score: 55.8/100 (Bronze) Repository: https://github.com/jeremyeder/reference --------- Co-authored-by: semantic-release-bot <semantic-release-bot@martynus.net>
Leaderboard Submission
Repository: jeremyeder/reference
Score: 55.8/100
Tier: Bronze
Submitted by: @jeremyeder
Validation Checklist
Automated validation will run on this PR.
Submitted via
agentready submitcommand.