Updated based on review

Add remote database url. Modify attribute naming convention. Remove chunking scripts.
worldbank · Sep 4, 2024 · 4ea7fae · 4ea7fae
1 parent d3050b5
commit 4ea7fae
Show file tree

Hide file tree

Showing 4 changed files with 3 additions and 74 deletions.
diff --git a/docs/acceptance/db.md b/docs/acceptance/db.md
@@ -10,7 +10,7 @@ The acceptance test below provides steps to verify that the deliverable meets ou
 
 The input data is stored in Parquet format on AWS S3 (object storage), specifically in the file `space2stats_updated.parquet`. Any additional fields must be appended to this file. The Parquet file is tabular with the following columns:
 - `hex_id`
-- `{aggregation_method[sum, mean, etc.]}_{variable_name}_{year}`
+- `{variable_name}_{aggregation_method[sum, mean, etc.]}_{year}`
 
 ### Database Setup
 
@@ -20,7 +20,7 @@ You can use a local database for this acceptance test by running the following c
 docker-compose up
 ```
 
-Alternatively, you can connect to a remote database, such as the Tembo database used for production.
+Alternatively, you can connect to a remote database, such as the [Tembo database](reluctantly-simple-spoonbill.data-1.use1.tembo.io) used for production.
 
 ### Data Ingestion
 

diff --git a/postgres/chunk_parquet.py b/postgres/chunk_parquet.py
diff --git a/postgres/load_parquet_chunks.sh b/postgres/load_parquet_chunks.sh
diff --git a/postgres/load_to_prod.sh b/postgres/load_to_prod.sh
@@ -17,7 +17,7 @@ CHUNKS_DIR="parquet_chunks"
 
 # Name of the target table
 TABLE_NAME="space2stats"
-PARQUET_FILE=space2stats_updated.parquet
+PARQUET_FILE=space2stats.parquet
 
 echo "Starting"