-
Notifications
You must be signed in to change notification settings - Fork 14
Merging data
To use OEPS data for mapping or spatial analysis, you need to enable it as spatial data. An easy way to do this is by merging the non-spatial csv data with a spatial data format called a shapefile. A shapefile is a spatial data format file for storing the geometric location and attributes of geographic features, such as points, lines, and polygons. In the case of the OEPS, think of the shapes or geometries of all US states, counties, Census tracts, and zip codes. It is easy to merge the non-spatial with the spatial based on their matching geographic identifiers, sometimes called GEOIDs or FIPS codes. Read on for more information about how to do this.
Note: Some geographic identifiers or FIPS codes start with the numeric 0, such as in the case of 01 (state), 01211 (county), 01211445377 (Census tract), or 07436 (zip code). This is sometimes referred to as a ‘leading zero’ (or ‘leading 0’). To maintain the leading zero for all identifiers, make sure your merge variables are both formatted as strings. See more details in the notes below.
- Head to the OEPS Data Download page.
- Scroll down to Filter Data and Download.
- Under Filter by Theme, select Geographic Boundaries, and any or all of the other data themes of interest.
- Under Filter by Scale, select at least one of the spatial scales: State, County, Tract, Zip Code.
- Click Download Selected Data.
- The downloader will build your data archive. Depending on its size and the speed of your computer, this may take a minute. You should soon see a zip file downloaded to your local device, called
OEPS_DOWNLOAD_YEAR_MO_DY.zip
. - Open the zip file. You should see three folders:
data
,docs
, andgeometry
.
- The
data
folder includes your selected downloaded datasets. - The
docs
folder includes the metadata documentation files for all datasets, in markdown (.md) format. - The
geometry
folder contains the shapefiles for all spatial scales selected.
- Follow the instructions for merging OEPS data with your state, county, tract, or zip geometry shapefiles (or altneratively, merge with your own spatial file):
- Load the US state geometry shapefile.
- Merge data: Load the state data file (i.e. DS01_S.csv).
- Merge on STATEFP (current table key) and STATEFP (import table key). IMPORTANT: You may need to change the import table key to a string, from an integer, to maintain the leading zeros.
- Include all variables, or select only the ones you want, in your merge.
- Visualize, map and inspect.
- Load the US county geometry shapefile.
- Merge data: Load the county data file (i.e. DS01_C.csv).
- Merge on GEOID (current table key) and COUNTYFP (import table key). IMPORTANT: You may need to change the import table key to a string, from an integer, to maintain the leading zeros.
- Include all variables, or select only the ones you want, in your merge.
- Visualize, map and inspect.
- Load US Census tracts geometry shapefile.
- Merge data: Load the tract data file (i.e. DS01_T.csv).
- Merge on GEOID (current table key) and GEOID (import table key). IMPORTANT: You may need to change the import table key to a string, from an integer, to maintain the leading zeros.
- Include all variables, or select only the ones you want, in your merge.
- Visualize, map and inspect.
- Load US ZCTAs geometry shapefile.
- Merge data: Load the zip code data file (i.e. DS01_Z.csv).
- Merge on ZCTA5CE10 (current table key) and ZCTA (import table key). IMPORTANT: You may need to change the import table key to a string, from an integer, to maintain the leading zeros.
- Include all variables, or select only the ones you want, in your merge.
- Visualize, map and inspect.