Skip to content

Latest commit

 

History

History
40 lines (29 loc) · 3.26 KB

data_subscriber_downloader.md

File metadata and controls

40 lines (29 loc) · 3.26 KB

Bulk Data Subscriber and Download Service

This tutorial will demonstrate the utilization of a commandline-based tool known as the podaac-data-subscriber[downloader] which allows users to either subscribe to datasets (for periodic, continuous updating featuring the latest available data) or one-time "bulk" downloading of one or more data files with a single request.

While originally developed by the PO.DAAC, the podaac-data-subscriber[downloader] has recently been upgraded to enable access to data from other NASA Distributed Active Archive Centers (DAACs). For the purposes of this tutorial, we will simply demonstrate data access and extraction of TROPESS data from the NASA GES DISC using the one-time downloader feature.

More specific details regarding the podaac-data-subscriber[downloader] can be found here: https://github.com/podaac/data-subscriber

You may also click the following links for more detailed documentation regarding the following options:

  1. Subscriber
  2. Downloader

In the following tutorial example, we demonstrate access and file extraction of the TROPESS CrIS-JPSS1 L2 Carbon Monoxide for Forward Stream, Summary Product V1 dataset (DOI: 10.5067/JL1HT3NGEAW3).

Tutorial steps:

  1. Create an Earthdata Login Account (clear here for details)
  2. Approve access to the NASA GES DISC Archive in your Earthdata Login Profile (click here for details)
  3. Create/modify a .netrc file in your home directory containing your Earthdata Login credentials as shown below:
    machine urs.earthdata.nasa.gov login <your username> password <your password>

Note: There's a dedicated TROPESS data access tutorial (click here for more info) that explains more details on setting up your .netrc file.

  1. Install podaac-data-subscriber[downloader] by executing the following 'pip' command from your terminal/commandline:
    pip install podaac-data-subscriber
  2. Once installed, run the following command from your commandline:
    podaac-data-downloader -c TRPSYL2COCRS1FS -d myData -p GES_DISC -sd 2023-06-01T00:00:00Z -ed 2023-06-28T00:00:00Z

Explanation of arguments:
-c Collection name of the queried dataset, specified by the shortname managed by the DAAC.
-d Directory name of the desired location of the data, starting from the current directory of execution.
-p Provider name indicated by the name of the DAAC
-sd Start date/time, in ISO-8601 format
-ed End date/time, in ISO-8601 format

For a more complete explanation of available arguments, you may type the following at your commandline:
podaac-data-downloader --help

Expected result: A list of 27 files in your specified directory, such as:
TROPESS_CrIS-JPSS1_L2_Summary_CO_20230601_MUSES_R1p20_FS_F0p6.nc, TROPESS_CrIS-JPSS1_L2_Summary_CO_20230602_MUSES_R1p20_FS_F0p6.nc, etc...