Major Infrastructure and Services Restructuring #17
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…s for the `System`
️✅ There are no secrets present in this pull request anymore.If these secrets were true positive and are still valid, we highly recommend you to revoke them. 🦉 GitGuardian detects secrets in your source code to help developers and security teams secure the modern development process. You are seeing this because you or someone else with access to this repository has authorized GitGuardian to scan your pull request. |
…ions and add Grafana dashboards
… Redis and MongoDB initialization in main.go. Introduce provider management structure for cloud services.
…cements to the flow and cloud design.
…ures, capabilities, and services, and improve local development instructions for Persys Cloud.
…h-flow.drawio, including adjustments to element positions and styles for improved clarity.
…ay module for accurate version tracking.
miladhzzzz
commented
Jul 8, 2025
Contributor
Author
miladhzzzz
left a comment
miladhzzzz
left a comment
There was a problem hiding this comment.
It seems fine...
…t runner, and comprehensive test scenarios for Persys Cloud components, including service health checks, workload management, and monitoring.
…d testing strategy and system flow visualization, detailing testing objectives, scenarios, architecture, and data flow for improved clarity and guidance.
…yml to improve service definitions, add new Grafana dashboards for API Gateway, Prow Scheduler, and CoreDNS, and remove outdated dashboard configurations. Introduce Prometheus as a data source for monitoring and adjust scrape configurations for better service visibility.
…eus metrics support, and streamline etcd settings for improved performance and monitoring.
…ult signing settings for enhanced certificate flexibility.
… for MongoDB storage, add TLS settings, and update HTTP addresses. Upgrade Go version to 1.23.0 and update various dependencies in go.mod. Introduce Makefile for build automation and add sample environment variables for configuration.
…ructure with a more modular approach, introducing separate types for application, database, TLS, and other settings. Update config loading method to utilize viper's unmarshal functionality for improved configuration management. Adjust GitHub controller to utilize new configuration structure for webhook settings and authentication credentials.
…ler for handling requests to the prow-scheduler, including authentication and proxying logic. Implement ProwService for managing scheduler discovery and request proxying. Add routes for workload and node management, along with health check and metrics endpoints. Include middleware for service identity headers and ensure certificate management for secure communication.
…, ensuring alignment with the current project state.
….go to support mutual TLS for secure communication, configure separate routers for mTLS and non-mTLS traffic, and integrate Prometheus for monitoring. Introduce graceful shutdown handling and MongoDB connection setup, ensuring robust application initialization and error management.
…thod to AuthService interface and its implementation in AuthServiceImpl for validating user authentication via OAuth2 tokens. Refactor logging utility in audit.go to enhance logging capabilities with context support and optional Loki integration.
… observability and instrumentation improvements, including OpenTelemetry tracing, Prometheus metrics, and bugfixes for reconciliation and monitoring.
…agent API calls and workload scheduling, refactor key management to improve key loading and generation, and implement asynchronous command sending to nodes. Add monitoring and reconciliation capabilities with new Monitor and Reconciler components, and update workload handling to include logging and status updates.
…Prometheus metrics support, configure mTLS and non-mTLS servers, and improve certificate management. Introduce graceful shutdown for both server types and ensure CoreDNS registration with dynamic IP resolution.
…cluding gin, uuid, and OpenTelemetry components. Add new indirect dependencies for enhanced functionality and performance. Introduce sample environment variables for Prow scheduler configuration.
…ate mTLS and non-mTLS route handlers, implement workload reconciliation logic, and enhance node and workload management endpoints. Add support for logging and metrics in reconciliation processes, and improve error handling across API interactions.
…-end tests using Docker. The workflow includes steps for checking out the code, setting up Docker, running tests, and uploading test results.
… in e2e-docker.yml and refactor build command in go.yml to target the scheduler directory. Comment out Cloud Mgmt build step for clarity.
…, streamline help output, and enhance cleanup process. This simplifies the test environment management and focuses on essential testing commands.
…e Makefile commands to use 'docker compose' syntax. This enhances the testing environment setup and ensures compatibility with the latest Docker CLI standards.
…le support and refine trigger conditions for main branch and pull requests. This improves repository handling and ensures compatibility with submodules.
…file and simplify go.mod by removing unnecessary require block. This enhances compatibility and streamlines dependency management.
…s by adding MongoDB and CFSSL components, update environment variables for API Gateway and Prow Scheduler, and streamline volume management. This improves the overall architecture and facilitates better service interactions.
… CoreDNS and adjust health check endpoints for API Gateway, Prow Scheduler, and Persys Agent. This enhances service connectivity and ensures accurate health monitoring.
…ice to Persys Prow, add environment variable for CENTRAL_URL, and adjust service dependencies. This improves clarity and enhances service communication within the testing environment.
…pping and add a new mapping for port 8084. This adjustment improves service configuration clarity and ensures proper port allocation for testing.
…oud-test' network for all services to enhance connectivity and ensure proper service communication during testing.
… point to 'persys-prow' service, ensuring correct service communication in the testing environment. Update submodule reference for 'persys-agent'.
…RL environment variable for consistency and clarity in service definitions.
…ring the latest changes are included in the project.
…rporating the latest changes into the project.
…rporating the latest changes into the project.
…e container name from Docker Compose for MongoDB service to streamline service definitions.
…er URLs for correct service communication, and change health check endpoints to metrics for improved monitoring. Comment out unused workload tests to streamline the test suite.
…Scheduler URLs from HTTPS to HTTP for consistency in service communication.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Pull Request: Major Infrastructure and Services Restructuring
Description
This pull request implements a comprehensive restructuring of the Persys Cloud platform, focusing on service architecture, infrastructure organization, and security enhancements. The changes include implementing mTLS, reorganizing service directories, updating configurations, and improving the overall infrastructure setup.
Major Changes
Infrastructure Reorganization
Moved infrastructure files to new structure:
manifests/toinfra/manifests/IaC/**toinfra/**Added new infrastructure components:
Service Architecture Updates
API Gateway:
Prow Scheduler:
Cloud Management:
Security Enhancements
Certificate Management:
Authentication:
Monitoring and Observability
Added Prometheus configuration:
Added Grafana dashboards and data sources
Implemented distributed tracing with Jaeger
Removed Components
Configuration Updates
Updated Docker Compose:
Updated CoreDNS:
Updated service configurations:
Testing
Dependencies
Related Issues
Checklist
Additional Notes
This restructuring significantly improves the platform's security, observability, and maintainability. The changes align with modern cloud-native practices and provide a more robust foundation for future development.