Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ICESat-2 ML tutorial - photon classification on ATL07 sea ice data #17

Merged
merged 21 commits into from
Aug 18, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
c8b1690
Initial jupytext notebook with outline and ATL07 to geopandas script
weiji14 Aug 6, 2024
0c892ed
Save ATL07 photon data to GeoParquet file with ZSTD compression
weiji14 Aug 7, 2024
18336b9
Writeup sub-section on moving data from CPU to GPU
weiji14 Aug 7, 2024
5db2d77
Add ICESat-2 photon classification tutorial to index table
weiji14 Aug 7, 2024
561529c
Merge branch 'main' into photon_classifier
weiji14 Aug 7, 2024
6836bcd
Add pytorch (cpu build) to conda environment
weiji14 Aug 7, 2024
d616d77
Refactor to get ATL07 using earthaccess instead of icepyx
weiji14 Aug 8, 2024
1858273
Search for Sentinel-2 imagery captured at same time as ATL07 track
weiji14 Aug 10, 2024
f445e25
Second exact spatial intersection search using ATL07 line track
weiji14 Aug 12, 2024
fce139d
Add more columns to GeoDataFrame and filter out cloudy points
weiji14 Aug 12, 2024
770bb83
Plot ATL07 tracks on top of Sentinel-2 image
weiji14 Aug 12, 2024
1a11529
Label surface type of ATL07 points using Sentinel-2 Red band pixel value
weiji14 Aug 12, 2024
87cf493
Rename Part 2 to DataLoader and Model architecture
weiji14 Aug 13, 2024
1a42bcc
Architect PhotonClassificationModel and writeup ML model choices
weiji14 Aug 13, 2024
d599a37
Construct main training loop for ML model
weiji14 Aug 13, 2024
bdccda1
Merge branch 'main' into photon_classifier
weiji14 Aug 14, 2024
395982e
Add instructions to install pytorch in first code cell
weiji14 Aug 16, 2024
2a0ae41
Save geoparquet schema version 1.1.0 and reword note on zstd compression
weiji14 Aug 16, 2024
c3cace6
Merge branch 'main' into photon_classifier
weiji14 Aug 16, 2024
db55b60
Add overview flowchart to top of notebook and minor edits
weiji14 Aug 18, 2024
aac4747
Pre-render Jupyter notebook and move files to machine-learning folder
weiji14 Aug 18, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions book/_config.yml
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,7 @@ execute:
- "**/geospatial-advanced.ipynb"
- "cloud-computing/04-cloud-optimized-icesat2.ipynb"
- "cloud-computing/atl08_parquet_files/atl08_parquet.ipynb"
- "machine-learning/photon_classifier.ipynb"
allow_errors: false
# Per-cell notebook execution limit (seconds)
timeout: 300
Expand Down
2 changes: 1 addition & 1 deletion book/_toc.yml
Original file line number Diff line number Diff line change
Expand Up @@ -38,6 +38,7 @@ parts:
- file: tutorials/cloud-computing/atl08_parquet_files/atl08_parquet
options:
- titlesonly: true
- file: tutorials/machine-learning/photon_classifier.ipynb
- caption: Projects
chapters:
- file: projects/index
Expand All @@ -47,4 +48,3 @@ parts:
- file: reference/bibliography
- file: reference/IS2-resources
- file: reference/questions

1 change: 1 addition & 0 deletions book/tutorials/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,3 +10,4 @@ Below you'll find a table keeping track of all tutorials presented at this event
| [ICESat-2 Mission](./mission-overview/icesat-2-mission-overview.ipynb) | ICESat-2 Mission and Products | n/a | Not recorded |
| [Cloud Computing](./cloud-computing/00-goals-and-outline.ipynb) | Cloud Computing Tutorial | n/a | Not recorded |
| [Notebooks to Packages](./nb-to-package/index.md) | All about Python classes to packages | n/a | Not recorded |
| [ICESat-2 photon classification](./machine-learning/photon_classifier.ipynb) | Machine Learning, PyTorch | ATL07 | Not recorded |
14,286 changes: 14,286 additions & 0 deletions book/tutorials/machine-learning/photon_classifier.ipynb

Large diffs are not rendered by default.

Loading
Loading