Skip to content

Commit

Permalink
Add WSF exp data
Browse files Browse the repository at this point in the history
  • Loading branch information
matamadio committed Aug 9, 2024
1 parent 2d00520 commit daacefe
Show file tree
Hide file tree
Showing 4 changed files with 361 additions and 0 deletions.
105 changes: 105 additions & 0 deletions _datasets/json/WSF_19.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,105 @@
{
"datasets": [
{
"id": "WSF_19",
"title": "World Settlement Footprint 2019",
"description": "The World Settlement Footprint (WSF®) 2019 is a 10m resolution binary mask outlining the extent of human settlements globally derived by means of 2019 multitemporal Sentinel-1 (S1) and Sentinel-2 (S2) imagery.",
"risk_data_type": [
"exposure"
],
"publisher": {
"name": "DLR",
"url": "https://geoservice.dlr.de/"
},
"version": "R2019",
"project": "World Settlement Footprint (WSF®)",
"details": "Based on the hypothesis that settlements generally show a more stable behavior with respect to most land-cover classes, temporal statistics are calculated for both S1- and S2-based indices. In particular, a comprehensive analysis has been performed by exploiting a number of reference building outlines to identify the most suitable set of temporal features (ultimately including 6 from S1 and 25 from S2). Training points for the settlement and non-settlement class are then generated by thresholding specific features, which varies depending on the 30 climate types of the well-established Köppen Geiger scheme. Next, binary classification based on Random Forest is applied and, finally, a dedicated post-processing is performed where ancillary datasets are employed to further reduce omission and commission errors. Here, the whole classification process has been entirely carried out within the Google Earth Engine platform. To assess the high accuracy and reliability of the WSF2019, two independent crowd-sourcing-based validation exercises have been carried out with the support of Google and Mapswipe, respectively, where overall 1M reference labels have been collected based photointerpretation of very high-resolution optical imagery.",
"spatial": {
"scale": "global"
},
"license": "CC-BY-4.0",
"contact_point": {
"name": "WSF team",
"email": "[email protected]",
"url": "https://geoservice.dlr.de/web/datasets/wsf_2019"
},
"creator": {
"name": "Mattia Marconcini"
},
"exposure": {
"category": "buildings",
"metrics": [
{
"id": "1",
"dimension": "structure",
"quantity_kind": "area"
}
]
},
"attributions": [
{
"id": "0",
"entity": {
"name": "Mattia Marconcini",
"email": "[email protected]"
},
"role": "author"
},
{
"id": "1",
"entity": {
"name": "EOC Geoservice",
"email": "[email protected]",
"url": "https://geoservice.dlr.de/web/contact"
},
"role": "resource_provider"
},
{
"id": "2",
"entity": {
"name": "WSF team",
"email": "[email protected]"
},
"role": "processor"
}
],
"referenced_by": [
{
"id": "0",
"name": "Understanding Current Trends in Global Urbanisation - The World Settlement Footprint Suite",
"author_names": [
"Mattia Marconcini",
"Annekatrin Metz-Marconcini",
"Thomas Esch",
"Noel Gorelick"
],
"date_published": "2021-01-01",
"url": "https://austriaca.at/0xc1aa5576%200x003c9b4c.pdf",
"doi": "10.1553/giscience2021_01_s33"
}
],
"resources": [
{
"id": "0",
"title": "World Settlement Footprint (WSF) 2019 - Sentinel-1/2 - Global",
"description": "Binary mask at 10m resolution outlining the extent of human settlements globally derived by means of 2019 multitemporal Sentinel-1 (S1) and Sentinel-2 (S2) imagery. ",
"format": "geotiff",
"spatial_resolution": 10,
"coordinate_system": "EPSG:4326",
"access_url": "https://geoservice.dlr.de/web/maps/eoc:wsf2019",
"download_url": "https://download.geoservice.dlr.de/WSF2019/",
"temporal": {
"start": "2019",
"end": "2019"
}
}
],
"links": [
{
"href": "https://docs.riskdatalibrary.org/en/0__2__0/rdls_schema.json",
"rel": "describedby"
}
]
}
]
}
107 changes: 107 additions & 0 deletions _datasets/json/WSF_EVO.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,107 @@
{
"datasets": [
{
"id": "WSF_evo",
"title": "World Settlement Footprint Evolution",
"description": "The World Settlement Footprint (WSF®) Evolution is a 30m resolution dataset outlining the global settlement extent on a yearly basis from 1985 to 2015.",
"risk_data_type": [
"exposure"
],
"publisher": {
"name": "DLR",
"url": "https://geoservice.dlr.de/"
},
"version": "R2019",
"project": "World Settlement Footprint (WSF®)",
"details": "Based on the assumption that settlement growth occurred over time, all pixels categorized as non-settlement in the WSF2015 (Marconcini et al., 2020) are excluded a priori from the analysis. Next, for each target year in the past, all available Landsat-5/7 scenes acquired over the given area of interest are gathered and key temporal statistics (i.e., temporal mean, minimum, maximum, etc.) are then extracted for different spectral indices. Among others, these include: the normalized difference built-up index (NDBI), normalized difference vegetation index (NDVI) and modified normalized difference water index (MNDWI). Temporal features proved generally robust if computed over at least 7 clear cloud-/cloud-shadow-free observations; accordingly, if for a given pixel in the target year this constraint is not satisfied, the time frame is enlarged backwards (at 1-year steps) as long as the condition is met.\nStarting backwards from the year 2015 - for which the WSF2015 is used as a reference - settlement and non-settlement training samples for the given target year t are iteratively extracted by applying morphological filtering to the settlement mask derived for the year t+1, as well as excluding potentially mislabeled samples by adaptively thresholding the temporal mean NDBI, MNDWI and NDVI. Finally, binary Random Forest classification in performed.\nTo quantitatively assess the high accuracy and reliability of the dataset, an extensive campaign based on crowdsourcing photointerpretation of very high-resolution airborne and satellite historical imagery has been performed with the support of Google. In particular, for the years 1990, 1995, 2000, 2005, 2010 and 2015, ~200K reference cells of 30x30m size distributed over 100 sites around the world have been labelled, hence summing up to overall ~1.2M validation samples.\nIt is worth noting that past Landsat-5/7 availability considerably varies across the world and over time. Independently from the implemented approach, this might then result in a lower quality of the final product where few/no scenes have been collected. Accordingly, to provide the users with a suitable and intuitive measure that accounts for the goodness of the Landsat imagery, we conceived the Input Data Consistency (IDC) score, which ranges from 6 to 1 with: 6) very good; 5) good; 4) fair; 3) moderate; 2) low; 1) very low. The IDC score is available on a yearly basis between 1985 and 2015 and supports a proper interpretation of the WSF evolution product.\n\nThe WSF evolution and IDC score datasets are organized in 5138 GeoTIFF files (EPSG4326 projection) each one referring to a portion of 2 x 2 degree size (~222 x 222 km) on the ground. WSF evolution values range between 1985 and 2015 corresponding to the estimated year of settlement detection, whereas 0 is no data. A comprehensive publication with all technical details and accuracy figures is currently being finalized. For the time being, please refer to Marconcini et al,. 2021.",
"spatial": {
"scale": "global"
},
"license": "CC-BY-4.0",
"contact_point": {
"name": "WSF team",
"email": "[email protected]",
"url": "https://geoservice.dlr.de/web/datasets/wsf_2019"
},
"creator": {
"name": "Mattia Marconcini"
},
"exposure": {
"category": "buildings",
"metrics": [
{
"id": "1",
"dimension": "structure",
"quantity_kind": "area"
}
]
},
"attributions": [
{
"id": "0",
"entity": {
"name": "Mattia Marconcini",
"email": "[email protected]"
},
"role": "author"
},
{
"id": "1",
"entity": {
"name": "EOC Geoservice",
"email": "[email protected]",
"url": "https://geoservice.dlr.de/web/contact"
},
"role": "resource_provider"
},
{
"id": "2",
"entity": {
"name": "WSF team",
"email": "[email protected]"
},
"role": "processor"
}
],
"referenced_by": [
{
"id": "0",
"name": "Understanding Current Trends in Global Urbanisation - The World Settlement Footprint Suite",
"author_names": [
"Mattia Marconcini",
"Annekatrin Metz-Marconcini",
"Thomas Esch",
"Noel Gorelick"
],
"date_published": "2021-01-01",
"url": "https://austriaca.at/0xc1aa5576%200x003c9b4c.pdf",
"doi": "10.1553/giscience2021_01_s33"
}
],
"resources": [
{
"id": "0",
"title": "World Settlement Footprint (WSF) 2019 - Sentinel-1/2 - Global",
"description": "Binary mask at 10m resolution outlining the extent of human settlements globally derived by means of 2019 multitemporal Sentinel-1 (S1) and Sentinel-2 (S2) imagery. ",
"format": "geotiff",
"spatial_resolution": 30,
"coordinate_system": "EPSG:4326",
"access_url": "https://geoservice.dlr.de/web/maps/eoc:wsfevolution",
"download_url": "https://download.geoservice.dlr.de/WSF_EVO/",
"temporal": {
"start": "1985",
"end": "2015",
"duration": "P30Y"
},
"temporal_resolution": "P1Y"
}
],
"links": [
{
"href": "https://docs.riskdatalibrary.org/en/0__2__0/rdls_schema.json",
"rel": "describedby"
}
]
}
]
}
61 changes: 61 additions & 0 deletions _datasets/world-settlement-footprint-2019.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,61 @@
---
contact_point:
email: [email protected]
name: WSF team
url: https://geoservice.dlr.de/web/datasets/wsf_2019
creator:
name: Mattia Marconcini
dataset_id: WSF_19
description: "The World Settlement Footprint (WSF\xAE) 2019 is a 10m resolution binary\
\ mask outlining the extent of human settlements globally derived by means of 2019\
\ multitemporal Sentinel-1 (S1) and Sentinel-2 (S2) imagery."
details: "Based on the hypothesis that settlements generally show a more stable behavior\
\ with respect to most land-cover classes, temporal statistics are calculated for\
\ both S1- and S2-based indices. In particular, a comprehensive analysis has been\
\ performed by exploiting a number of reference building outlines to identify the\
\ most suitable set of temporal features (ultimately including 6 from S1 and 25\
\ from S2). Training points for the settlement and non-settlement class are then\
\ generated by thresholding specific features, which varies depending on the 30\
\ climate types of the well-established K\xF6ppen Geiger scheme. Next, binary classification\
\ based on Random Forest is applied and, finally, a dedicated post-processing is\
\ performed where ancillary datasets are employed to further reduce omission and\
\ commission errors. Here, the whole classification process has been entirely carried\
\ out within the Google Earth Engine platform. To assess the high accuracy and reliability\
\ of the WSF2019, two independent crowd-sourcing-based validation exercises have\
\ been carried out with the support of Google and Mapswipe, respectively, where\
\ overall 1M reference labels have been collected based photointerpretation of very\
\ high-resolution optical imagery."
exposure:
category: buildings
dimension: structure
quantity_kind: area
taxonomy: null
hazard: null
license: CC-BY-4.0
loss: null
project: "World Settlement Footprint (WSF\xAE)"
publisher:
name: DLR
url: https://geoservice.dlr.de/
purpose: null
resources:
- coordinate_system: EPSG:4326
description: 'Binary mask at 10m resolution outlining the extent of human settlements
globally derived by means of 2019 multitemporal Sentinel-1 (S1) and Sentinel-2
(S2) imagery. '
download_url: https://download.geoservice.dlr.de/WSF2019/
format: geotiff
id: '0'
spatial_resolution: 10
title: World Settlement Footprint (WSF) 2019 - Sentinel-1/2 - Global
risk_data_type:
- exposure
schema: rdl-02
spatial:
countries:
- GLO
scale: global
title: World Settlement Footprint 2019
version: R2019
vulnerability: null
---
88 changes: 88 additions & 0 deletions _datasets/world-settlement-footprint-evolution.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,88 @@
---
contact_point:
email: [email protected]
name: WSF team
url: https://geoservice.dlr.de/web/datasets/wsf_2019
creator:
name: Mattia Marconcini
dataset_id: WSF_evo
description: "The World Settlement Footprint (WSF\xAE) Evolution is a 30m resolution\
\ dataset outlining the global settlement extent on a yearly basis from 1985 to\
\ 2015."
details: 'Based on the assumption that settlement growth occurred over time, all pixels
categorized as non-settlement in the WSF2015 (Marconcini et al., 2020) are excluded
a priori from the analysis. Next, for each target year in the past, all available
Landsat-5/7 scenes acquired over the given area of interest are gathered and key
temporal statistics (i.e., temporal mean, minimum, maximum, etc.) are then extracted
for different spectral indices. Among others, these include: the normalized difference
built-up index (NDBI), normalized difference vegetation index (NDVI) and modified
normalized difference water index (MNDWI). Temporal features proved generally robust
if computed over at least 7 clear cloud-/cloud-shadow-free observations; accordingly,
if for a given pixel in the target year this constraint is not satisfied, the time
frame is enlarged backwards (at 1-year steps) as long as the condition is met.
Starting backwards from the year 2015 - for which the WSF2015 is used as a reference
- settlement and non-settlement training samples for the given target year t are
iteratively extracted by applying morphological filtering to the settlement mask
derived for the year t+1, as well as excluding potentially mislabeled samples by
adaptively thresholding the temporal mean NDBI, MNDWI and NDVI. Finally, binary
Random Forest classification in performed.
To quantitatively assess the high accuracy and reliability of the dataset, an extensive
campaign based on crowdsourcing photointerpretation of very high-resolution airborne
and satellite historical imagery has been performed with the support of Google.
In particular, for the years 1990, 1995, 2000, 2005, 2010 and 2015, ~200K reference
cells of 30x30m size distributed over 100 sites around the world have been labelled,
hence summing up to overall ~1.2M validation samples.
It is worth noting that past Landsat-5/7 availability considerably varies across
the world and over time. Independently from the implemented approach, this might
then result in a lower quality of the final product where few/no scenes have been
collected. Accordingly, to provide the users with a suitable and intuitive measure
that accounts for the goodness of the Landsat imagery, we conceived the Input Data
Consistency (IDC) score, which ranges from 6 to 1 with: 6) very good; 5) good; 4)
fair; 3) moderate; 2) low; 1) very low. The IDC score is available on a yearly basis
between 1985 and 2015 and supports a proper interpretation of the WSF evolution
product.
The WSF evolution and IDC score datasets are organized in 5138 GeoTIFF files (EPSG4326
projection) each one referring to a portion of 2 x 2 degree size (~222 x 222 km)
on the ground. WSF evolution values range between 1985 and 2015 corresponding to
the estimated year of settlement detection, whereas 0 is no data. A comprehensive
publication with all technical details and accuracy figures is currently being finalized.
For the time being, please refer to Marconcini et al,. 2021.'
exposure:
category: buildings
dimension: structure
quantity_kind: area
taxonomy: null
hazard: null
license: CC-BY-4.0
loss: null
project: "World Settlement Footprint (WSF\xAE)"
publisher:
name: DLR
url: https://geoservice.dlr.de/
purpose: null
resources:
- coordinate_system: EPSG:4326
description: 'Binary mask at 10m resolution outlining the extent of human settlements
globally derived by means of 2019 multitemporal Sentinel-1 (S1) and Sentinel-2
(S2) imagery. '
download_url: https://download.geoservice.dlr.de/WSF_EVO/
format: geotiff
id: '0'
spatial_resolution: 30
title: World Settlement Footprint (WSF) 2019 - Sentinel-1/2 - Global
risk_data_type:
- exposure
schema: rdl-02
spatial:
countries:
- GLO
scale: global
title: World Settlement Footprint Evolution
version: R2019
vulnerability: null
---

0 comments on commit daacefe

Please sign in to comment.