Skip to content

Commit

Permalink
Reduce the data size by cutting surveys
Browse files Browse the repository at this point in the history
Remove the surveys with systematic errors, large surveys, and cut the
region even more. Got it down to ~300k points which is more manageable
to plot on CI.
  • Loading branch information
leouieda committed Feb 7, 2024
1 parent c4607cd commit d417b18
Show file tree
Hide file tree
Showing 4 changed files with 422 additions and 241 deletions.
22 changes: 15 additions & 7 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
# Caribbean - Single-beam bathymetry

This dataset is a compilation of several single-beam bathymetry surveys of the
Caribbean ocean displaying a wide range of tectonic activity, uneven
distribution, and even clear systematic errors in some of the survey lines.
Caribbean ocean displaying a wide range of tectonic activity and uneven
distribution.

The original data file was compressed with LZMA to save space and make it
possible to upload it to this GitHub repository (see `raw/`) since there is not
Expand All @@ -13,12 +13,12 @@ direct download link we could use.
| | Summary |
|--:|:--|
| File | `caribbean-bathymetry.csv.xz` |
| Size | 7.8 Mb |
| Version | [v1](https://github.com/fatiando-data/caribbean-bathymetry/releases/latest) |
| DOI | https://doi.org/10.5281/zenodo.5882211 |
| Size | 1.3 Mb |
| Version | [v2](https://github.com/fatiando-data/caribbean-bathymetry/releases/latest) |
| DOI | https://doi.org/10.5281/zenodo.10631903 |
| License | [CC-BY](https://creativecommons.org/licenses/by/4.0/) |
| MD5 | `md5:a7332aa6e69c77d49d7fb54b764caa82` |
| SHA256 | `sha256:9adaa2ead1cd354206235105489b511c4c46833b2e137a3eadc917243d16f09e` |
| MD5 | `md5:79698c447daba7c15011a5528c8fe212` |
| SHA256 | `sha256:f90d5d34309df866321676efdea5ef4817fe71534c7190d3b495a33efd2dd20e` |
| Source | [NOAA NCEI](https://ngdc.noaa.gov/mgg/geodas/trackline.html) |
| Original license | [public domain](https://ngdc.noaa.gov/ngdcinfo/privacy.html) |
| Processing code | [`prepare.ipynb`](https://nbviewer.org/github/fatiando-data/caribbean-bathymetry/blob/main/prepare.ipynb) |
Expand All @@ -27,10 +27,18 @@ direct download link we could use.

> These are the changes made to the original dataset.
Version 1:

* Convert from MGD77 to a simpler compressed CSV format.
* Retain only the survey ID, coordinates, and depth.
* Cut the data to a slightly smaller region.

Version 2:

* Reduce the region even more to reduce the data size.
* Remove problematic surveys that had systematic errors.
* Remove very dense surveys to reduce data size.

## About this repository

This is a place to format and prepare the original dataset for use in our
Expand Down
9 changes: 5 additions & 4 deletions environment.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,15 +3,16 @@ channels:
- conda-forge
- defaults
dependencies:
- python==3.9
- python==3.10
- pip
- numpy
- jupyterlab
- ipykernel
- matplotlib
- pyproj
# PyGMT for plotting
- pygmt==0.4.1
- gmt==6.2.0
- pygmt==0.11.0
- gmt==6.5.0
# Fatiando
- pooch>=1.0
- verde==1.6.1
- verde==1.8.0
Loading

0 comments on commit d417b18

Please sign in to comment.