Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
102 commits
Select commit Hold shift + click to select a range
ffa1d88
add deploy-sandbox.yml
jtherrmann Dec 2, 2025
49a3eab
rename hyp3-sandbox to hyp3-edc-sandbox
jtherrmann Dec 2, 2025
dff2aa6
deploy-edc-sandbox perms
jtherrmann Dec 2, 2025
3d29a01
Update OPERA_DIST_S1.yml
cmarshak Dec 11, 2025
4bd5059
Update CHANGELOG.md
cmarshak Dec 11, 2025
3e31034
Update CHANGELOG.md
cmarshak Dec 11, 2025
674d9c1
Update OPERA_DIST_S1.yml
cmarshak Dec 11, 2025
2a01337
Update CHANGELOG.md
cmarshak Dec 11, 2025
0c0ef2c
Update CHANGELOG.md
jhkennedy Dec 11, 2025
feeeb7a
Merge pull request #2991 from ACCESS-Cloud-Based-InSAR/Expose-context…
jhkennedy Dec 11, 2025
420693c
Fix OPERA_DIST_S1
jhkennedy Dec 11, 2025
695c818
Merge pull request #2992 from ASFHyP3/jhkennedy-patch-1
jhkennedy Dec 11, 2025
0c2ff1f
distribution_url
jtherrmann Dec 16, 2025
0599eef
delete jth-sandbox
jtherrmann Dec 16, 2025
4f6e5d7
edc-sandbox cost profile
jtherrmann Dec 16, 2025
131669d
start updating deployment docs
jtherrmann Dec 19, 2025
94f3f8f
update ssl cert docs for edc and jpl
jtherrmann Dec 19, 2025
d715f9f
clarify region
jtherrmann Dec 19, 2025
e5ad0ad
update gh secrets in deploy docs
jtherrmann Dec 19, 2025
6d26374
wording
jtherrmann Dec 19, 2025
a801e85
finish updating ssl cert docs
jtherrmann Dec 19, 2025
ac5adaf
wording
jtherrmann Dec 19, 2025
88f1fd6
revise
jtherrmann Dec 19, 2025
c2c06b6
Merge branch 'develop' into hyp3-edc-sandbox
jtherrmann Dec 19, 2025
5608e7d
Merge pull request #2985 from ASFHyP3/hyp3-edc-sandbox
jtherrmann Dec 19, 2025
2c6638f
fix: Run the checks workflow on a push to any PR to main or develop
kalebvonburris Jan 12, 2026
6c2dde5
adding hyp3-slimsar-test to deploy yml to deploy test hyp3 for slimsa…
ZachHoppinen Jan 12, 2026
f0a022c
add changelog entry for new deployment
ZachHoppinen Jan 12, 2026
d975076
combine changelog added entries
ZachHoppinen Jan 12, 2026
7699876
Merge pull request #2998 from ASFHyP3/hyp3-slimsar-test
ZachHoppinen Jan 12, 2026
8656537
create new job_spec yaml for tdbp processing slimsar data. Adding to …
ZachHoppinen Jan 14, 2026
89b29c5
generalize bucket names and ecr address for now
ZachHoppinen Jan 14, 2026
4c67ed3
adding defaults to all api_schema parameters
ZachHoppinen Jan 14, 2026
844f55b
add slimsar compute environment and fix job_spec for slimsar to it
ZachHoppinen Jan 14, 2026
d1c5fcf
remove unused parameters from job_spec
ZachHoppinen Jan 14, 2026
e4d4b3e
removing unneccesary defaults from api_specs
ZachHoppinen Jan 14, 2026
09c78c7
fix command to accept necessary arguments
ZachHoppinen Jan 15, 2026
1c99a20
add in polarization selection paramater and remove publish bucket for…
ZachHoppinen Jan 15, 2026
affbf55
add in large g4 gpus instances and volume and gpu commands to docker
ZachHoppinen Jan 15, 2026
b9def7d
remove unnessary docker commands from job spec
ZachHoppinen Jan 15, 2026
028d883
change data_fps to singular fp, add in pattern for pols, and change i…
ZachHoppinen Jan 20, 2026
6b2500b
fixing required param list from data_fps to data_fp
ZachHoppinen Jan 20, 2026
c85bb5c
Merge branch 'develop' into kb/fix/1476-checks-from-forks-dont-run
kalebvonburris Jan 21, 2026
954004f
whitespace
jhkennedy Jan 22, 2026
ac22307
Keep push event trigger for tests workflow
jhkennedy Jan 22, 2026
33fde8d
Update static analysis workflow to include pull requests
jhkennedy Jan 22, 2026
f5239b4
Merge pull request #2997 from ASFHyP3/kb/fix/1476-checks-from-forks-d…
jhkennedy Jan 22, 2026
bc67b2d
Bump the github-actions-deps group with 3 updates
dependabot[bot] Jan 22, 2026
79a526d
Merge pull request #2982 from ASFHyP3/dependabot/github_actions/githu…
jhkennedy Jan 22, 2026
51b41fa
Merge branch 'develop' into hoppinen-slimsar-test-job-spec
ZachHoppinen Jan 22, 2026
15d43d9
Update job_spec/SLIMSAR_TDBP.yml
ZachHoppinen Jan 22, 2026
1e92cfd
Update job_spec/SLIMSAR_TDBP.yml
ZachHoppinen Jan 22, 2026
0471a5e
Update job_spec/SLIMSAR_TDBP.yml
ZachHoppinen Jan 22, 2026
1385378
Update job_spec/SLIMSAR_TDBP.yml
ZachHoppinen Jan 22, 2026
65894a9
add in ami_id for compute id from current ec2
ZachHoppinen Jan 22, 2026
5b870dd
fixing double quote to single quote to match new regex style
ZachHoppinen Jan 22, 2026
34a0c7a
extra 1 at end of ami_id for some reason
ZachHoppinen Jan 22, 2026
6072b78
Update ARIA_AUTORIFT.yml to support custom chip-size and search-range
cmspeed Jan 23, 2026
17909c0
Update CHANGELOG.md
cmspeed Jan 23, 2026
7567928
Update CHANGELOG with new job_spec and changes
jhkennedy Jan 23, 2026
3f0b2a9
fix missing newline at end of file
jhkennedy Jan 23, 2026
8dbf7ea
Merge pull request #3001 from cmspeed/update-autorift-yml
jhkennedy Jan 23, 2026
2fe2883
Add condition to run Snyk action only for non-forked PRs
jhkennedy Jan 23, 2026
904b8dc
Apply suggestion from @jhkennedy
jhkennedy Jan 23, 2026
f8f368f
Remove premature version entry in CHANGELOG
jhkennedy Jan 23, 2026
9248eb8
Merge pull request #3002 from ASFHyP3/jhkennedy-patch-1
jhkennedy Jan 23, 2026
4866b1d
ITS_LIVE monitoring needs to be able to do cloudformation operations …
jhkennedy Oct 16, 2025
6f11ac5
readme and changelog
jhkennedy Oct 16, 2025
e6f8f80
Add ECR
jhkennedy Oct 23, 2025
c14550b
Update CHANGELOG.md
jhkennedy Jan 23, 2026
f9fa669
Merge pull request #3000 from ASFHyP3/hoppinen-slimsar-test-job-spec
ZachHoppinen Jan 26, 2026
d1e4822
Bump actions/checkout in the github-actions-deps group
dependabot[bot] Jan 26, 2026
0205482
Merge pull request #2936 from ASFHyP3/jpl-deploy-policy
jhkennedy Jan 26, 2026
f5e1b02
drop publish-stac-prefix as not necessary anymore
jhkennedy Jan 8, 2026
b2d1131
Add a bulk metadata gen job for ITS_LIVE
jhkennedy Jan 10, 2026
572b0ea
add removed prarmeter to changelog
jhkennedy Jan 10, 2026
8023907
add tags for test builds of containers
jhkennedy Jan 10, 2026
b8754d6
use on demand instances and set timout for 6 hours for its-live bulk …
jhkennedy Jan 11, 2026
d5bc76b
fix meta bulk job name
jhkennedy Jan 12, 2026
c28d6b2
parquet files hsould end in parquet
jhkennedy Jan 12, 2026
25dde11
update autorift image tag
jhkennedy Jan 12, 2026
400f0d9
increase job memory
jhkennedy Jan 12, 2026
e50e742
fix itslive meatadata image tag
jhkennedy Jan 12, 2026
a1d4950
add ITS_LIVE_STAC_BULK and update itslive-metadata to handle missing …
jhkennedy Jan 15, 2026
af9847a
Clean up ITS_LIVE job specs
jhkennedy Jan 22, 2026
b16f99a
Apply suggestions from code review
jhkennedy Jan 24, 2026
d5fda41
bump to a minor release due to the number of additions and changes in…
jhkennedy Jan 26, 2026
df1b3d2
Merge pull request #2996 from ASFHyP3/its-live-updates
jhkennedy Jan 26, 2026
a794197
Merge pull request #3006 from ASFHyP3/dependabot/github_actions/githu…
jhkennedy Jan 26, 2026
d950c6a
Update ARIA_AUTORIFT.yml to support processing of S1C/D and S2C/D gra…
cmspeed Jan 26, 2026
341f2d4
Update CHANGELOG.md
cmspeed Jan 26, 2026
8d2f63d
add S1 D and S2 C+D to autorift and its-live-autorift job specs
jhkennedy Jan 27, 2026
c7455d3
Merge pull request #3004 from cmspeed/update-autorift-yml
jhkennedy Jan 27, 2026
14f35f1
add in allocation strategy for slimsarCompute environment and changelog
ZachHoppinen Jan 27, 2026
95035c0
Merge pull request #3007 from ASFHyP3/hoppinen-slimsar-test-compute-e…
ZachHoppinen Jan 28, 2026
2bd0271
Update SlimSAR instance types in compute_environments.yml
ZachHoppinen Jan 28, 2026
764b846
changelog
ZachHoppinen Jan 28, 2026
644af0b
Update job_spec/config/compute_environments.yml
ZachHoppinen Jan 28, 2026
6e86e8e
Merge pull request #3008 from ASFHyP3/ZachHoppinen-patch-1
ZachHoppinen Jan 29, 2026
ef5ff01
Update ITS_LIVE autorift and crop jobs to allow automatically publish…
jhkennedy Jan 29, 2026
ae95e29
make stac endpoint nullable
jhkennedy Jan 30, 2026
b34ba6e
Merge pull request #3009 from ASFHyP3/its-live-autorift
jhkennedy Jan 30, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 4 additions & 2 deletions .github/workflows/deploy-custom-prod.yml
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,9 @@ jobs:
cost_profile: DEFAULT
job_files: >-
job_spec/ITS_LIVE_AUTORIFT.yml
job_spec/ITS_LIVE_META.yml
job_spec/ITS_LIVE_CROP.yml
job_spec/ITS_LIVE_CROP_BULK.yml
job_spec/ITS_LIVE_META_BULK.yml
instance_types: r7gd.2xlarge,r7gd.4xlarge,r7gd.8xlarge
default_max_vcpus: 2000 # Max: 10,406
expanded_max_vcpus: 2000 # Max: 10,406
Expand Down Expand Up @@ -310,7 +312,7 @@ jobs:
url: https://${{ matrix.domain }}

steps:
- uses: actions/checkout@v6.0.0
- uses: actions/checkout@v6.0.2
with:
fetch-depth: 0

Expand Down
24 changes: 22 additions & 2 deletions .github/workflows/deploy-custom-test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -65,7 +65,9 @@ jobs:
cost_profile: DEFAULT
job_files: >-
job_spec/ITS_LIVE_AUTORIFT.yml
job_spec/ITS_LIVE_META.yml
job_spec/ITS_LIVE_CROP.yml
job_spec/ITS_LIVE_CROP_BULK.yml
job_spec/ITS_LIVE_META_BULK.yml
instance_types: r7gd.2xlarge,r7gd.4xlarge,r7gd.8xlarge
default_max_vcpus: 640 # Max: 10,406
expanded_max_vcpus: 640 # Max: 10,406
Expand Down Expand Up @@ -127,13 +129,31 @@ jobs:
required_surplus: 0
security_environment: ASF
ami_id: /aws/service/ecs/optimized-ami/amazon-linux-2023/recommended/image_id

- environment: hyp3-slimsar-test
domain: hyp3-slimsar-test.asf.alaska.edu
template_bucket: cf-templates-1ce4dbsaugtx1-us-west-2
image_tag: test
product_lifetime_in_days: 14
default_credits_per_user: 0
default_application_status: APPROVED
cost_profile: DEFAULT
job_files: >-
job_spec/INSAR_ISCE_BURST.yml
job_spec/SLIMSAR_TDBP.yml
instance_types: r6id.xlarge,r6id.2xlarge,r6id.4xlarge,r6id.8xlarge,r6idn.xlarge,r6idn.2xlarge,r6idn.4xlarge,r6idn.8xlarge
default_max_vcpus: 640
expanded_max_vcpus: 640
required_surplus: 0
security_environment: ASF
ami_id: /aws/service/ecs/optimized-ami/amazon-linux-2023/recommended/image_id

environment:
name: ${{ matrix.environment }}
url: https://${{ matrix.domain }}

steps:
- uses: actions/checkout@v6.0.0
- uses: actions/checkout@v6.0.2
with:
fetch-depth: 0

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/deploy-daac-prod.yml
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ jobs:
name: ${{ matrix.environment }}

steps:
- uses: actions/checkout@v6.0.0
- uses: actions/checkout@v6.0.2
with:
fetch-depth: 0

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/deploy-daac-test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -44,7 +44,7 @@ jobs:
name: ${{ matrix.environment }}

steps:
- uses: actions/checkout@v6.0.0
- uses: actions/checkout@v6.0.2
with:
fetch-depth: 0

Expand Down
Original file line number Diff line number Diff line change
@@ -1,9 +1,12 @@
name: Deploy jth sandbox to AWS
name: Deploy HyP3 EDC Sandbox to AWS

permissions:
contents: read

on:
push:
branches:
- hyp3-jth-sandbox
- hyp3-edc-sandbox

concurrency: ${{ github.workflow }}-${{ github.ref }}

Expand All @@ -14,13 +17,13 @@ jobs:
fail-fast: false
matrix:
include:
- environment: hyp3-jth-sandbox
- environment: hyp3-edc-sandbox
template_bucket: cf-templates-bywc0durdnqy-us-west-2
image_tag: test
product_lifetime_in_days: 14
default_credits_per_user: 0
default_application_status: APPROVED
cost_profile: DEFAULT
cost_profile: EDC
opera_rtc_s1_end_date: Default
job_files: >-
job_spec/AUTORIFT.yml
Expand All @@ -36,24 +39,24 @@ jobs:
required_surplus: 0
security_environment: EDC
ami_id: /ngap/amis/image_id_ecs_al2023_x86
distribution_url: ''
distribution_url: 'https://d3bvvghf83wjqc.cloudfront.net'

environment:
name: ${{ matrix.environment }}

steps:
- uses: actions/checkout@v4.2.2
- uses: actions/checkout@v6.0.2
with:
fetch-depth: 0

- uses: aws-actions/configure-aws-credentials@v4
- uses: aws-actions/configure-aws-credentials@v5
with:
aws-access-key-id: ${{ secrets.V2_AWS_ACCESS_KEY_ID }}
aws-secret-access-key: ${{ secrets.V2_AWS_SECRET_ACCESS_KEY }}
aws-session-token: ${{ secrets.V2_AWS_SESSION_TOKEN }}
aws-region: ${{ secrets.AWS_REGION }}

- uses: actions/setup-python@v5
- uses: actions/setup-python@v6
with:
python-version: 3.13

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/deploy-plus-prod.yml
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ jobs:
url: https://${{ matrix.domain }}

steps:
- uses: actions/checkout@v6.0.0
- uses: actions/checkout@v6.0.2
with:
fetch-depth: 0

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/deploy-plus-test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ jobs:
url: https://${{ matrix.domain }}

steps:
- uses: actions/checkout@v6.0.0
- uses: actions/checkout@v6.0.2
with:
fetch-depth: 0

Expand Down
17 changes: 12 additions & 5 deletions .github/workflows/static-analysis.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,13 @@ name: Static code analysis
permissions:
contents: read

on: push
on:
push:
pull_request:
branches:
- main
- develop


env:
SETUPTOOLS_SCM_PRETEND_VERSION_FOR_HYP3: v0.0.0
Expand All @@ -23,7 +29,7 @@ jobs:
matrix:
security_environment: [ASF, EDC, JPL, JPL-public]
steps:
- uses: actions/checkout@v6.0.0
- uses: actions/checkout@v6.0.2
- uses: actions/setup-python@v6
with:
python-version: 3.13
Expand All @@ -37,7 +43,7 @@ jobs:
openapi-spec-validator:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v6.0.0
- uses: actions/checkout@v6.0.2
- uses: actions/setup-python@v6
with:
python-version: 3.13
Expand All @@ -50,7 +56,7 @@ jobs:
statelint:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v6.0.0
- uses: actions/checkout@v6.0.2
- uses: ruby/setup-ruby@v1
with:
ruby-version: 2.7
Expand All @@ -69,8 +75,9 @@ jobs:
snyk:
runs-on: ubuntu-latest
if: ${{ ! github.event.pull_request.head.repo.fork }}
steps:
- uses: actions/checkout@v6.0.0
- uses: actions/checkout@v6.0.2
- uses: snyk/actions/setup@v1.0.0
- uses: actions/setup-python@v6
with:
Expand Down
9 changes: 7 additions & 2 deletions .github/workflows/tests.yml
Original file line number Diff line number Diff line change
@@ -1,6 +1,11 @@
name: Run tests

on: push
on:
push:
pull_request:
branches:
- main
- develop

env:
SETUPTOOLS_SCM_PRETEND_VERSION_FOR_HYP3: v0.0.0
Expand All @@ -10,7 +15,7 @@ jobs:
runs-on: ubuntu-latest

steps:
- uses: actions/checkout@v6.0.0
- uses: actions/checkout@v6.0.2

- uses: actions/setup-python@v6
with:
Expand Down
25 changes: 25 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,31 @@ All notable changes to this project will be documented in this file.
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).

## [10.13.0]

### Added
- Added optional `chip_size` and `search_range` parameters to the `ARIA_AUTORIFT.yml` job specification to enable user-defined `chip-size` and `search-range`.
- Updated `AUTORIFT.yml`, `ARIA_AUTORIFT.yml`, and `ITS_LIVE_AUTORIFT.yml` validation schema to support processing of Sentinel-1D and Sentinel-2C/D granules.
- Added a `model_context_length` parameter to the `OPERA_DIST_S1` job specification.
- Added a new custom hyp3-slimsar-test deployment.
- Added a new `SLIMSAR_TDBP` job_spec for slimsar time-domain backprojection processing.
- Added a new `SlimSAR` compute environment for slimsar processing with correct EC2 instances.
- Added a new `ITS_LIVE_CROP_BULK` job spec which re-crops existing ITS_LIVE products which are specified in a parquet file to ensure they are chunk-aligned and have a time dimension, and then it generates STAC JSON and other metadata files.
- Added a new `ITS_LIVE_META_BULK` job spec which generates STAC JSON and other metadata files for existing ITS_LIVE products which are specified in a parquet file.
- Added the `ITS_LIVE_CROP_BULK` and `ITS_LIVE_META_BULK` job spec to the ITS_LIVE deployments.
- Added the `stac_items_endpoint` and `stac_exists_okay` job parameters to the `ITS_LIVE_AUTORIFT` and `ITS_LIVE_CROP` job specs to allow directly publishing STAC items to the ITS_LIVE STAC catalog.

### Changed
- Increased the maximum `stride_for_norm_param_estimation` to 32 from 16 for the `OPERA_DIST_S1` job specification to handle models with a larger input size.
- The `ITS_LIVE_META` job spec has been renamed `ITS_LIVE_CROP` as it re-crops an existing ITS_LIVE product to ensure it is chunk-aligned and has a time dimension, and then it generates STAC JSON and other metadata files.
- The hyp3-ci stack permission for JPL deployments were expanded to support deploying HyP3-based monitoring stacks:
- Listing CloudFormation stacks is now allowed.
- CloudFormation permissions were expanded to any region from just us-west-2.
- ECR actions are now allowed.

### Removed
- Removed the `publish_stac_prefix` job parameter from the `ITS_LIVE_AUTORIFT` and `ITS_LIVE_CROP` (previously `ITS_LIVE_META`) job specs as it's no longer used by the ITS_LIVE plugins.

## [10.12.1]

### Fixed
Expand Down
Loading