refactor(scripts): refactor dev-tools and lib scripts to use CIHelpers module #482

chaosdinosaur · 2026-02-12T00:06:17Z

Pull Request

Description

Add CIHelpers module import, mocking, and cleanup to test files for Generate-PrReference.ps1 and Get-VerifiedDownload.ps1. Add error propagation tests verifying CI annotation handling paths.
Replace remaining inline $env:GITHUB_ACTIONS check and raw ::error:: output in Test-ActionVersionConsistency.ps1 catch block with Write-CIAnnotation.

Related Issue(s)

Fixes #352

Type of Change

Select all that apply:

Code & Documentation:

Bug fix (non-breaking change fixing an issue)
New feature (non-breaking change adding functionality)
Breaking change (fix or feature causing existing functionality to change)
Documentation update

Infrastructure & Configuration:

AI Artifacts:

Reviewed contribution with prompt-builder agent and addressed all feedback
Copilot instructions (.github/instructions/*.instructions.md)
Copilot prompt (.github/prompts/*.prompt.md)
Copilot agent (.github/agents/*.agent.md)
Copilot skill (.github/skills/*/SKILL.md)

Note for AI Artifact Contributors:

Agents: Research, indexing/referencing other project (using standard VS Code GitHub Copilot/MCP tools), planning, and general implementation agents likely already exist. Review .github/agents/ before creating new ones.

Skills: Must include both bash and PowerShell scripts. See Skills.

Model Versions: Only contributions targeting the latest Anthropic and OpenAI models will be accepted. Older model versions (e.g., GPT-3.5, Claude 3) will be rejected.

See Agents Not Accepted and Model Version Requirements.

Other:

Script/automation (.ps1, .sh, .py)
Other (please describe):

Sample Prompts (for AI Artifact Contributions)

User Request:

Execution Flow:

Output Artifacts:

Success Indicators:

For detailed contribution requirements, see:

Common Standards: docs/contributing/ai-artifacts-common.md - Shared standards for XML blocks, markdown quality, RFC 2119, validation, and testing
Agents: docs/contributing/custom-agents.md - Agent configurations with tools and behavior patterns
Prompts: docs/contributing/prompts.md - Workflow-specific guidance with template variables
Instructions: docs/contributing/instructions.md - Technology-specific standards with glob patterns
Skills: docs/contributing/skills.md - Task execution utilities with cross-platform scripts

Testing

Checklist

Required Checks

Documentation is updated (if applicable)
Files follow existing naming conventions
Changes are backwards compatible (if applicable)
Tests added for new functionality (if applicable)

AI Artifact Contributions

Used /prompt-analyze to review contribution
Addressed all feedback from prompt-builder review
Verified contribution follows common standards and type-specific requirements

Required Automated Checks

The following validation commands must pass before merging:

Markdown linting: npm run lint:md
Spell checking: npm run spell-check
Frontmatter validation: npm run lint:frontmatter
Link validation: npm run lint:md-links
PowerShell analysis: npm run lint:ps

Security Considerations

This PR does not contain any sensitive or NDA information
Any new dependencies have been reviewed for security issues
Security-related scripts follow the principle of least privilege

Additional Notes

codecov-commenter · 2026-02-12T00:08:38Z

Codecov Report

❌ Patch coverage is 0% with 8 lines in your changes missing coverage. Please review.
✅ Project coverage is 83.41%. Comparing base (67585f5) to head (8217d2a).

Files with missing lines	Patch %	Lines
scripts/security/Test-ActionVersionConsistency.ps1	0.00%	8 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #482      +/-   ##
==========================================
- Coverage   83.41%   83.41%   -0.01%     
==========================================
  Files          20       20              
  Lines        3510     3509       -1     
==========================================
- Hits         2928     2927       -1     
  Misses        582      582

Flag	Coverage Δ
pester	`83.41% <0.00%> (-0.01%)`	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines	Coverage Δ
scripts/security/Test-ActionVersionConsistency.ps1	`84.06% <0.00%> (+0.45%)`	⬆️

... and 1 file with indirect coverage changes

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Copilot

Pull request overview

This PR refactors three utility scripts to use the shared CIHelpers module, replacing inline CI annotation patterns with standardized CIHelpers function calls. The changes include updating Test-ActionVersionConsistency.ps1 to use Write-CIAnnotation instead of raw ::error:: output, and adding test coverage for error propagation in Generate-PrReference.ps1 and Get-VerifiedDownload.ps1.

Changes:

Replaced inline $env:GITHUB_ACTIONS checks and ::error:: output with Write-CIAnnotation calls in Test-ActionVersionConsistency.ps1
Added CIHelpers module imports and cleanup to test files for Generate-PrReference.ps1 and Get-VerifiedDownload.ps1
Added error propagation tests to verify error handling paths

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 6 comments.

File	Description
scripts/tests/lib/Get-VerifiedDownload.Tests.ps1	Adds CIHelpers import/cleanup and error propagation test, plus CIHelpers function mocks
scripts/tests/dev-tools/Generate-PrReference.Tests.ps1	Adds CIHelpers import/cleanup and error propagation test, plus CIHelpers function mocks
scripts/security/Test-ActionVersionConsistency.ps1	Replaces inline CI pattern with Write-CIAnnotation in catch block

scripts/tests/dev-tools/Generate-PrReference.Tests.ps1

scripts/tests/lib/Get-VerifiedDownload.Tests.ps1

scripts/tests/dev-tools/Generate-PrReference.Tests.ps1

scripts/tests/lib/Get-VerifiedDownload.Tests.ps1

scripts/tests/dev-tools/Generate-PrReference.Tests.ps1

scripts/tests/lib/Get-VerifiedDownload.Tests.ps1

Copilot

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated no new comments.

Copilot

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 2 comments.

scripts/tests/lib/Get-VerifiedDownload.Tests.ps1

scripts/tests/dev-tools/Generate-PrReference.Tests.ps1

chaosdinosaur · 2026-02-12T17:10:15Z

@copilot open a new pull request to apply changes based on the comments in this thread

…est cleanup - Replace inline $env:GITHUB_ACTIONS check and ::error:: output with Write-CIAnnotation in Test-ActionVersionConsistency.ps1 - Standardize entry point guard to $script:SkipMain pattern - Add CIHelpers module cleanup in AfterAll for Generate-PrReference and Get-VerifiedDownload test files 🔧 - Generated by Copilot

WilliamBerryiii

Nice!

WilliamBerryiii · 2026-02-13T01:27:46Z

Thank you for this contribution, @chaosdinosaur! 🎉 Your refactoring of the dev-tools and lib scripts to use the CIHelpers module — along with the added test coverage for error propagation and CI annotation handling — cleans up the codebase and makes it more consistent. We appreciate the effort you put into this.

Copilot

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 3 comments.

scripts/security/Test-ActionVersionConsistency.ps1

scripts/tests/lib/Get-VerifiedDownload.Tests.ps1

…ttern - extract Invoke-ActionVersionConsistency function with full param block - replace HVE_SKIP_MAIN env var with MyInvocation.InvocationName guard - add Remove-Module CIHelpers cleanup to test AfterAll block 🔧 - Generated by Copilot

- pipe Export-ConsistencyReport to Out-Host inside Invoke-ActionVersionConsistency - prevents Write-Output json from contaminating function return value 🐛 - Generated by Copilot

Copilot

Pull request overview

Copilot reviewed 4 out of 4 changed files in this pull request and generated 2 comments.

scripts/security/Test-ActionVersionConsistency.ps1

…ency 🔧 - Generated by Copilot

WilliamBerryiii · 2026-02-13T02:49:45Z

@agreaves-ms or @katriendg ... can you do a quick review of this because I made some small changes on the cleanup for the tests.

Copilot AI review requested due to automatic review settings February 12, 2026 00:06

Copilot started reviewing on behalf of chaosdinosaur February 12, 2026 00:06 View session

Copilot AI reviewed Feb 12, 2026

View reviewed changes

Copilot AI review requested due to automatic review settings February 12, 2026 00:29

Copilot started reviewing on behalf of chaosdinosaur February 12, 2026 00:30 View session

Copilot AI reviewed Feb 12, 2026

View reviewed changes

WilliamBerryiii mentioned this pull request Feb 12, 2026

refactor(scripts): standardize PowerShell entry point guard pattern #477

Merged

28 tasks

chaosdinosaur marked this pull request as ready for review February 12, 2026 16:53

chaosdinosaur requested a review from a team as a code owner February 12, 2026 16:53

Copilot AI review requested due to automatic review settings February 12, 2026 16:53

Copilot started reviewing on behalf of chaosdinosaur February 12, 2026 16:54 View session

Copilot AI reviewed Feb 12, 2026

View reviewed changes

scripts/tests/lib/Get-VerifiedDownload.Tests.ps1 Show resolved Hide resolved

scripts/tests/dev-tools/Generate-PrReference.Tests.ps1 Show resolved Hide resolved

chaosdinosaur force-pushed the refactor/scripts-cihelpers-devtools-lib-352 branch from e3c2e5d to e8642ba Compare February 12, 2026 23:54

chaosdinosaur and others added 2 commits February 12, 2026 23:56

Merge branch 'main' into refactor/scripts-cihelpers-devtools-lib-352

4e485e6

Merge branch 'main' into refactor/scripts-cihelpers-devtools-lib-352

5b15736

Copilot AI review requested due to automatic review settings February 13, 2026 01:23

Copilot started reviewing on behalf of WilliamBerryiii February 13, 2026 01:24 View session

WilliamBerryiii approved these changes Feb 13, 2026

View reviewed changes

Copilot AI reviewed Feb 13, 2026

View reviewed changes

scripts/security/Test-ActionVersionConsistency.ps1 Outdated Show resolved Hide resolved

scripts/security/Test-ActionVersionConsistency.ps1 Outdated Show resolved Hide resolved

scripts/tests/lib/Get-VerifiedDownload.Tests.ps1 Show resolved Hide resolved

WilliamBerryiii added 2 commits February 12, 2026 18:13

fix(scripts): prevent pipeline pollution from Export-ConsistencyReport

895d9fb

- pipe Export-ConsistencyReport to Out-Host inside Invoke-ActionVersionConsistency - prevents Write-Output json from contaminating function return value 🐛 - Generated by Copilot

Copilot AI review requested due to automatic review settings February 13, 2026 02:32

Copilot AI reviewed Feb 13, 2026

View reviewed changes

scripts/security/Test-ActionVersionConsistency.ps1 Show resolved Hide resolved

scripts/security/Test-ActionVersionConsistency.ps1 Show resolved Hide resolved

fix(scripts): add OutputType attribute to Invoke-ActionVersionConsist…

8217d2a

…ency 🔧 - Generated by Copilot

refactor(scripts): refactor dev-tools and lib scripts to use CIHelpers module #482

Are you sure you want to change the base?

refactor(scripts): refactor dev-tools and lib scripts to use CIHelpers module #482

Conversation

chaosdinosaur commented Feb 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Pull Request

Description

Related Issue(s)

Type of Change

Sample Prompts (for AI Artifact Contributions)

Testing

Checklist

Required Checks

AI Artifact Contributions

Required Automated Checks

Security Considerations

Additional Notes

Uh oh!

codecov-commenter commented Feb 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

chaosdinosaur commented Feb 12, 2026

Uh oh!

WilliamBerryiii left a comment

Choose a reason for hiding this comment

Uh oh!

WilliamBerryiii commented Feb 13, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

WilliamBerryiii commented Feb 13, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

chaosdinosaur commented Feb 12, 2026 •

edited

Loading

codecov-commenter commented Feb 12, 2026 •

edited

Loading