Skip to content

ALCF Reconstruction and Segmentation for bl832 #114

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
davramov wants to merge 13 commits into
base: main
Choose a base branch
from
Draft

ALCF Reconstruction and Segmentation for bl832 #114

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
2308319
Updating ALCF endpoints to include the synaps-i allocation (to be set…
davramov Jan 23, 2026
dc33044
Updating bl832 config.py to distinguish IRI and SYNAPS-I ALCF endpoints
davramov Jan 23, 2026
99e8741
Adding the config.yaml file for setting up the globus compute endpoin…
davramov Jan 23, 2026
523fc19
Adding the config.yaml file for setting up the globus compute endpoin…
davramov Jan 23, 2026
951b9d9
Adding segmentation Prefect task, and segmentation globus compute cod…
davramov Jan 23, 2026
dd155f7
ensuring self.config for scicat and ghcr images
davramov Jan 23, 2026
719d4c6
linting
davramov Jan 23, 2026
05341fc
Making separate ALCF SYNAPS-I endpoint configs for raw, reconstructed…
davramov Jan 23, 2026
d74137a
Refactoring ALCF reconstruction flow to use the prune_controller class
davramov Jan 26, 2026
18d470c
Removing old commented out prune code
davramov Jan 26, 2026
c1d7e2d
linting and docstrings
davramov Jan 26, 2026
8e0947f
Docstrings, linting, and type hints
davramov Jan 26, 2026
72f49f0
Updating globus compute config for segmentation
davramov Jan 26, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
27 changes: 23 additions & 4 deletions config.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -46,6 +46,7 @@ globus:
uri: beegfs.als.lbl.gov
uuid: d33b5d6e-1603-414e-93cb-bcb732b7914a
name: bl733-beegfs-data

# 8.3.2 ENDPOINTS

spot832:
Expand All @@ -72,17 +73,35 @@ globus:
uuid: 75b478b2-37af-46df-bfbd-71ed692c6506
name: data832_scratch

alcf832_raw:
alcf832_synaps_raw:
root_path: /data/bl832/raw
uri: alcf.anl.gov
uuid: TBD
name: alcf832_synaps_raw

alcf832_synaps_recon:
root_path: /data/bl832/scratch/reconstruction/
uri: alcf.anl.gov
uuid: TBD
name: alcf832_synaps_recon

alcf832_synaps_segment:
root_path: /data/bl832/scratch/segmentation/
uri: alcf.anl.gov
uuid: TBD
name: alcf832_synaps_segment

alcf832_iri_raw:
root_path: /data/raw
uri: alcf.anl.gov
uuid: 55c3adf6-31f1-4647-9a38-52591642f7e7
name: alcf_raw
name: alcf_iri_raw

alcf832_scratch:
alcf832_iri_scratch:
root_path: /data/scratch
uri: alcf.anl.gov
uuid: 55c3adf6-31f1-4647-9a38-52591642f7e7
name: alcf_scratch
name: alcf_iri_scratch

alcf_eagle832:
root_path: /IRIBeta/als/example
Expand Down
Loading
Loading