Pre MDL #2992
Open
Pre MDL #2992
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add two new cronjob templates that enable cauldrons and other deployments to sync production data: - sync-mongo-production-data.yaml: Downloads latest MongoDB private dump from GCS and restores to environment - sync-postgres-production-data.yaml: Downloads latest PostgreSQL backup from GCS and restores to environment Features: - Runs weekly on Sundays at 2 AM - Uses init containers for backup download - Requires restore.enabled: true as safety check - Configurable via cronJobs.syncMongoProductionData.enabled and cronJobs.syncPostgresProductionData.enabled - Supports custom postgres database names via postgres.db setting This enables environments like sefariastaging to keep their data in sync with production automatically.
Add postgres configuration block that allows cauldrons and deployments to specify: - Custom database name (defaults to 'sefaria_auth') - PostgreSQL host (defaults to DATABASES_HOST from secret) - Restore and sync flags This configuration is required for the sync-postgres-production-data cronjob to work properly.
…onjobs' into pre-mdl
🧪 CI InsightsHere's what we observed from your CI run for 232e61d. 🟢 All jobs passed!But CI Insights is watching 👀 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Pre MDL PR for pre-mdl cauldron