Skip to content
Merged

Develop #1082

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
450a471
docs: enhance PR template with comprehensive squash merge workflow
GrammaTonic Nov 16, 2025
3e9d894
chore: sync develop with main after squash merge
GrammaTonic Nov 16, 2025
bad8357
feat(prometheus): Phase 1 - Standard Runner Metrics Endpoint (#1066)
GrammaTonic Nov 17, 2025
b7161fd
chore(deps): chore(deps)(deps): bump aquasecurity/trivy-action from 0…
dependabot[bot] Nov 17, 2025
492ce7b
chore(deps): chore(deps)(deps): bump actions/upload-artifact from 4 to 5
dependabot[bot] Nov 17, 2025
6580102
chore(deps): chore(deps)(deps): bump actions/checkout from 5 to 6
dependabot[bot] Nov 24, 2025
7aec39f
fix(security): upgrade Go to 1.25.5 to fix CVE-2025-61729
Dec 5, 2025
2e611e7
chore: sync develop with main after squash merge
Dec 5, 2025
3fb387a
fix(security): upgrade npm to 11.6.4 to fix CVE-2025-64756
Dec 5, 2025
a540fd9
fix(ci): optimize Super-Linter to reduce image size overhead
Dec 5, 2025
d65be88
fix(ci): replace Super-Linter with lightweight GitHub Actions
Dec 5, 2025
a6c2954
fix(ci): add Trivy scan resilience settings for large images
Dec 5, 2025
ced4ecb
refactor: remove experimental Go metrics exporter
Dec 5, 2025
6c3f3e5
chore: sync develop with main after glob patching fix
Dec 5, 2025
74c640f
feat: upgrade GitHub Actions runner to 2.330.0 (#1075)
GrammaTonic Dec 6, 2025
cb28e27
chore(deps): chore(deps)(deps): bump hadolint/hadolint-action from 3.…
dependabot[bot] Dec 8, 2025
604dce1
fix: resolve disk space exhaustion in security scan workflow (#1077)
GrammaTonic Dec 14, 2025
00f387c
chore(deps): chore(deps)(deps): bump actions/upload-artifact from 5 to 6
dependabot[bot] Dec 15, 2025
f0dcc4d
fix: replace broken free-disk-space action with manual cleanup (#1079)
Copilot Dec 18, 2025
3e92e8e
chore: update runner version to 2.330.0 in docs and build scripts
GrammaTonic Dec 18, 2025
d4dee72
refactor: replace Go Prometheus implementation with netcat method
GrammaTonic Dec 18, 2025
794cf1a
fix(security): patch CVE-2025-64756 glob vulnerability in standard ru…
GrammaTonic Dec 18, 2025
039aaec
Merge branch 'main' into develop
GrammaTonic Dec 18, 2025
145cbfd
chore: remove unused monitoring workflow
GrammaTonic Dec 18, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
47 changes: 21 additions & 26 deletions .github/copilot-tracking/prometheus-implementation-progress.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,9 +16,8 @@
- [x] 2-phase implementation plan defined
- [x] Metrics strategy documented
- [x] Dashboard panel specifications designed
- [x] Go module created with Prometheus dependencies
- [x] Metrics exporter implementation completed
- [x] Metrics tested and validated
- [x] Implementation approach switched to netcat method
- [x] Removed Go dependencies and implementation

### 🚧 In Progress (0%)
- [ ] Docker integration
Expand All @@ -40,19 +39,19 @@
**Tasks:**
- [x] Create feature branch
- [x] Create feature specification document
- [x] Create Go metrics exporter using Prometheus client library
- [x] Implement Prometheus metrics (gauges, counters, histograms)
- [ ] Add metrics exporter binary to Docker images
- [ ] Update `docker/entrypoint.sh` to start metrics exporter
- [ ] Update `docker/entrypoint-chrome.sh` to start metrics exporter
- [ ] Create bash metrics server script using netcat
- [ ] Create bash metrics collector script
- [ ] Initialize job log file in entrypoint scripts
- [ ] Update `docker/entrypoint.sh` to start metrics server and collector
- [ ] Update `docker/entrypoint-chrome.sh` to start metrics server and collector
- [ ] Expose port 9091 in Dockerfiles
- [ ] Update Docker Compose files to map port 9091
- [ ] Test metrics endpoint on all runner types

**Next Steps:**
1. Create multi-stage Dockerfile for building Go binary
2. Update entrypoint.sh to start metrics exporter
3. Update entrypoint-chrome.sh to start metrics exporter
1. Create /tmp/metrics-server.sh using netcat for HTTP server
2. Create /tmp/metrics-collector.sh to generate Prometheus metrics
3. Update entrypoint scripts to launch background processes

---

Expand Down Expand Up @@ -92,17 +91,13 @@
## 📂 Files to Create/Modify

### Phase 1: Metrics Endpoint
- [x] Create `go.mod` (Go module with Prometheus dependencies)
- [x] Create `go.sum` (dependency checksums)
- [x] Create `cmd/metrics-exporter/main.go` (main metrics exporter)
- [x] Update `.gitignore` (add bin/, keep go.sum)
- [ ] Create `internal/metrics/collector.go` (optional: metrics collection logic)
- [ ] Create `internal/metrics/registry.go` (optional: Prometheus registry)
- [ ] Update `docker/entrypoint.sh` (start metrics exporter)
- [ ] Update `docker/entrypoint-chrome.sh` (start metrics exporter)
- [ ] Update `docker/Dockerfile` (multi-stage build for Go binary, add `EXPOSE 9091`)
- [ ] Update `docker/Dockerfile.chrome` (multi-stage build, add `EXPOSE 9091`)
- [ ] Update `docker/Dockerfile.chrome-go` (multi-stage build, add `EXPOSE 9091`)
- [ ] Create `docker/metrics-server.sh` (netcat-based HTTP server for port 9091)
- [ ] Create `docker/metrics-collector.sh` (bash script to generate Prometheus metrics)
- [ ] Update `docker/entrypoint.sh` (start metrics server and collector)
- [ ] Update `docker/entrypoint-chrome.sh` (start metrics server and collector)
- [ ] Update `docker/Dockerfile` (add `EXPOSE 9091`)
- [ ] Update `docker/Dockerfile.chrome` (add `EXPOSE 9091`)
- [ ] Update `docker/Dockerfile.chrome-go` (add `EXPOSE 9091`)
- [ ] Update `docker/docker-compose.production.yml` (add port mapping)
- [ ] Update `docker/docker-compose.chrome.yml` (add port mapping)
- [ ] Update `docker/docker-compose.chrome-go.yml` (add port mapping)
Expand Down Expand Up @@ -205,13 +200,13 @@ curl http://localhost:9091/metrics

## 📝 Design Decisions

- **Go Prometheus Client**: Using official `github.com/prometheus/client_golang` library
- **Real-time Updates**: Metrics updated on events, not polling intervals
- **Netcat HTTP Server**: Using netcat (nc) for lightweight HTTP server on port 9091
- **Bash Metrics Collector**: Pure bash script to generate Prometheus text format
- **Periodic Updates**: Metrics updated every 30 seconds via background process
- **Port 9091**: Standard Prometheus exporter port, avoids conflicts
- **Prometheus Text Format**: Standard exposition format with proper metric types
- **Dashboard JSON**: Users import into their own Grafana instance
- **Multi-stage Build**: Separate Go build stage for smaller final images
- **Static Binary**: CGO_ENABLED=0 for portability and smaller size
- **Job Log Tracking**: Parse /tmp/jobs.log for job metrics
- **Health Endpoint**: `/health` endpoint for container health checks

---
Expand Down
Loading
Loading