Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RES region update to 2019 #581

Draft
wants to merge 4 commits into
base: production
Choose a base branch
from
Draft

Conversation

kaskranenburgQ
Copy link
Contributor

@kaskranenburgQ kaskranenburgQ commented Mar 7, 2025

This PR updates the remaining RES-regions to the base year 2019.

The RES-regions have been updated using the dataset amalgamator (also called combiner), it's code can be found in the folder: etlocal/app/amalgamator.

The RES regions that are geographically equal to a province are created by taking the dataset of the respective province, these RES regions are:

  • Drenthe
  • Flevoland
  • Groningen
  • Friesland
  • Zeeland

The other RES region dataset are created using the municipalities that are in the RES-region.
The RES-region site is used for matching municipalities to their RES-regions.

To reproduce the amalgamations, please run the lines in the attached text file in your pry environment on etlocal.
To acces the pry environment enter "rails c" in the terminal while in the etlocal repository.
In this file, you can also see which datasets have been used as input for the RES-region datasets.

While updating this the following issues were encountered:

  1. The Eemsdelta dataset had incorrect share values for useful demand per housing and period.
  2. The combination method weighted_average doesn't work as desired when calculating with shares (example: all keys of parent group share_useful_demand_houses, since the resulting shares add up to >1.0.
  3. Excel rounding issue where summed value of group shares are for instance 1.0000000001 (this is for instance the case for parent group transport_road_electricity_distribution).

The first issue was fixed by updating the household shares in the Eemsdelta municipality and migrating this change on etlocal.

The second issue was fixed by altering the variable on which the combination method was called. For the combination method weighted_average to function correctly for shares, we need to specify one variable for the whole share group. We changed it to the sum of al households in the dataset for the households_heat share_in_useful_demand group.

The third issue was caused due to the rounding of the keys to 8 digits. We changed the round method to a floor method. With the floor method, when the total sum of the share group will become lower than 1.0, instead of higher. The difference will be attributed to the flexible share in the share group. This way, rounding to 8 digits will no longer lead to errors.

In addition I made an alteration on how the interconnector capacity is calculated, for the European datasets it makes sense to use the sum method, since we use the actual interconnector data for this capacity.
For Municipal datasets this value is set to 60 GW per municipality, to ensure the connection to the rest of the Dutch grid.
If we use the sum method for local datasets, the RES regions would end up with 100+ GW connections, which have a huge influence on the cost of the scenario.
For now, we have set the combination method for this data point to average. This should be reviewed per dataset amalgamation.

Goes together with:
quintel/etsource#3226

@kaskranenburgQ kaskranenburgQ requested review from louispt1 and removed request for louispt1 March 7, 2025 14:22
@kaskranenburgQ
Copy link
Contributor Author

It seems that the Provincial datasets have been updated in 2023 with this PR.
The Municipal datasets have been updated after this update in 2024 with this PR.

Therefore updating the RES-regions based on the provincial datasets would mean a discrepancy between the data quality in the RES-regions.
The following RES-regions would be based on the Provincial dataset update from 2023 :

  • Drenthe
  • Flevoland
  • Groningen
  • Friesland
  • Zeeland

While the rest of the RES-regions would be based on the municipal dataset update from 2024.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants