Skip to content
This repository has been archived by the owner on Mar 26, 2024. It is now read-only.
/ Radar-STATS Public archive

Open-source project to monitor and report hourly statistics about Spain’s “Radar COVID” Exposure Notification app.

License

Notifications You must be signed in to change notification settings

pvieito/Radar-STATS

Repository files navigation

Radar STATS

Radar STATS (née RadarCOVID-STATS) is an open-source project developed to monitor and report hourly statistics about Spain’s “Radar COVID” Exposure Notification app – Created by @pvieito


NOTE: The Radar STATS project has been archived. All the data collected from August 2020 to January 2022 remains available for public research in the Data directory.


Links

Last Results

Daily Summary Plots

RadarCOVID-Report-Summary-Plot

Daily Summary Table

COVID-19 Cases (Source Countries) Shared TEKs by Generation Date (Source Countries) Shared TEKs by Upload Date (Source Countries) Shared TEKs Uploaded on Generation Date (Source Countries) Shared Diagnoses (Source Countries – Estimation) TEKs Uploaded per Shared Diagnosis (Source Countries) Usage Ratio (Source Countries) COVID-19 Cases (Spain) App Downloads (Spain – Official) Shared Diagnoses (Spain – Official) Usage Ratio (Spain)
Sample Date (UTC) Source Countries
2022-01-22 ES 141095 238 777 238 238 3.26 0.17% 141095
2022-01-21 ES 126060 592 1281 432 432 2.97 0.34% 126060
2022-01-20 ES 129119 633 892 304 304 2.93 0.24% 129119
2022-01-19 ES 129364 1053 1892 601 601 3.15 0.46% 129364
2022-01-18 ES 132390 1210 1829 528 528 3.46 0.40% 132390
2022-01-17 ES 138172 1544 2159 596 596 3.62 0.43% 138172
2022-01-16 ES 132590 1391 1269 377 377 3.37 0.28% 132590 4256 836 0.63%
2022-01-15 ES 132590 1586 1813 566 566 3.20 0.43% 132590 4256 836 0.63%
2022-01-14 ES 132590 1677 2084 549 654 3.19 0.49% 132590 4256 836 0.63%
2022-01-13 ES 144009 2242 3091 803 803 3.85 0.56% 144009 4256 836 0.58%
2022-01-12 ES 121272 1268 2557 712 712 3.59 0.59% 121272 4256 836 0.69%
2022-01-11 ES 115279 1020 2652 814 814 3.26 0.71% 115279 4256 836 0.73%
2022-01-10 ES 112827 1102 1941 627 627 3.10 0.56% 112827 4256 836 0.74%
2022-01-09 ES 124309 1179 1548 495 495 3.13 0.40% 124309 4955 849 0.68%
2022-01-08 ES 124309 1180 1726 481 481 3.59 0.39% 124309 4955 849 0.68%
2022-01-07 ES 124309 1023 1922 605 605 3.18 0.49% 124309 4955 849 0.68%
2022-01-06 ES 89674 933 1611 418 530 3.04 0.59% 89674 4955 849 0.95%
2022-01-05 ES 112773 962 2741 775 775 3.54 0.69% 112773 4955 849 0.75%
2022-01-04 ES 107570 904 3746 1216 1216 3.08 1.13% 107570 4955 849 0.79%
2022-01-03 ES 104984 1012 1781 538 538 3.31 0.51% 104984 4955 849 0.81%
2022-01-02 ES 82391 1146 1238 417 417 2.97 0.51% 82391 6029 951 1.15%
2022-01-01 ES 82391 1110 1279 379 379 3.37 0.46% 82391 6029 951 1.15%
2021-12-31 ES 82391 944 1898 459 682 2.78 0.83% 82391 6029 951 1.15%
2021-12-30 ES 82391 842 3295 909 909 3.62 1.10% 82391 6029 951 1.15%
2021-12-29 ES 69709 845 2624 708 720 3.64 1.03% 69709 6029 951 1.36%
2021-12-28 ES 63892 1087 3789 1244 1244 3.05 1.95% 63892 6029 951 1.49%
2021-12-27 ES 56771 1175 2484 819 819 3.03 1.44% 56771 6029 951 1.68%
2021-12-26 ES 37497 918 1644 579 579 2.84 1.54% 37497 9995 946 2.52%

Daily Generation to Upload Period Table

RadarCOVID-Report-Generation-Upload-Period-Table

Multi-Backend Results

NOTE: These tables include data extracted from different Exposure Notification backends (eg. the CH backend data is extracted from the SwissCovid server). You can find the exact backend definitions in the exposure_notification_io module.

Multi-Backend Summary Table

Shared TEKs by Generation Date (Source Countries)
Backend CH DE DE@ES EE ES EU@ES IT@ES MT
Sample Date (UTC)
2022-01-22 821 0 0 73 238 0 0 6131
2022-01-21 1933 32496 0 141 592 0 299 6366
2022-01-20 2875 63209 0 163 633 0 544 6504
2022-01-19 3662 87618 0 207 1053 0 704 6493
2022-01-18 4177 107767 0 236 1210 0 1004 6478
2022-01-17 4314 111658 0 235 1544 0 1189 6894
2022-01-16 3942 109642 0 214 1391 0 1359 6882
2022-01-15 3639 121198 242 217 1586 3 1364 6860
2022-01-14 3670 130641 21259 200 1677 13869 1524 6836
2022-01-13 3696 128271 36428 203 2242 39465 1824 6828
2022-01-12 2806 126786 39367 192 1268 45785 2319 6842
2022-01-11 2168 125532 31135 146 1020 37834 2323 6833
2022-01-10 1562 113422 0 118 0 0 0 6821
2022-01-09 1012 102100 0 93 0 0 0 6816

Multi-Backend Cross-Sharing Summary Table

Fraction of TEKs in Backend (A) Available in Backend (B)
Backend (A) CH DE DE@ES EE ES EU@ES IT@ES MT
Backend (B)
CH - 2.6%
DE 89.1% - 95.9% 58.4% 80.4% 0.4% 1.3%
DE@ES 9.1% - 74.5%
EE - 0.1%
ES 0.6% - 2.5%
EU@ES 8.1% 79.4% 6.4% 23.8% - 16.1%
IT@ES 1.7% - 1.2%
MT 0.1% 8.0% -

Documentation

Definitions

  • TEK (Temporary Exposure Key): A random identifier generated on-device each day used by Exposure Notification apps like Radar COVID to detect exposures and share positive diagnoses. When a user has a confirmed case of COVID-19, he can share the TEKs generated on-device from the last 14 days through an Exposure Notification app which will be published on a server like the Radar COVID server. Other devices then download the infected TEKs from the server and check if they have detected them nearby via Bluetooth on the previous 14 days.
  • Source Countries: Countries with an Exposure Notification app that can share TEKs with the Radar COVID server directly or through the EFGS (see the notes below for more information). Currently the following countries are considered source countries: ES.

Metrics

  • COVID-19 Cases in Source Countries (covid_cases): Confirmed new COVID-19 cases in applicable source countries estimated with a 7-day rolling average (see the notes below for more information).
  • Shared TEKs by Generation Date (shared_teks_by_generation_date): TEKs published on the Radar COVID server by the date they were generated on-device.
  • Shared TEKs by Upload Date (shared_teks_by_upload_date): TEKs published on the Radar COVID server by the date they were added to the server. Typically this is the date when the user shares the positive diagnosis using the app with the one-time code sent by the Health Authorities or when TEKs from other countries backends are loaded from the EFGS.
  • Shared TEKs Uploaded on Generation Date (shared_teks_uploaded_on_generation_date): TEKs uploaded to the Radar COVID server on the same date they were generated on-device. This metric measures the number of diagnoses shared by devices which already support the new Exposure Notification API version with early TEK release (ie. the current date TEK is released along previous days TEKs), see the notes below for more information.
  • Shared Diagnoses (shared_diagnoses): Estimation of the number of diagnoses shared via Exposure Notification apps published on the Radar COVID server. The estimation is inferred from the maximum number of TEKs uploaded each date that were generated on-device on a unique date, as each device can only upload 1 TEK per generation date.
  • TEKs Uploaded per Shared Diagnosis (teks_per_shared_diagnosis): Estimation of the average number of TEKs uploaded with each shared diagnosis. This number should ideally be around 14 TEKs uploaded per shared diagnosis.
  • Usage Ratio (shared_diagnoses_per_covid_case): Estimation of the fraction of COVID-19 cases in applicable source countries which shared their diagnosis via an Exposure Notification app (see the notes below for more information). Ideally it should be 100% (ie. all confirmed cases sharing their TEKs with an Exposure Notification app).

Important Notes

  • As Radar COVID is integrated with the EU Federation Gateway Service (EFGS) project, the server may publish TEKs from multiple source countries. Those EU-wide TEKs are published merged with TEKs shared directly from the Radar COVID app and they cannot be distinguished. To compute a valid usage ratio, we take in account COVID-19 cases from all applicable source countries integrated with the EFGS, currently the following countries are considered source countries: ES.
  • TEKs on the Radar COVID server may also be padded with artificial random TEKs to increase anonymization. Currently there is no known technique to detect such alterations, so metrics dependent on the number of uploaded TEKs (eg. shared diagnoses or usage ratio) may be lower than the estimated.
  • Some devices use the Exposure Notification API version 1, which shares the last TEK (ie. the TEK generated the day the diagnosis is shared) a day after it was generated, so two uploads (one with the previous TEKs and another with the last TEK) will take place on different days. This will lead to a duplication on the shared diagnoses metric. This duplication effect will disappear once all devices are using the new Exposure Notification API version which shares all 14 TEKs at once.

Data Sources

Contributions

Contributions to the Radar STATS project are welcome, both as Pull Requests or Issues.

Only files on the following directories should be modified as other files are generated automatically by the Report Update GitHub Action:

  • Data/Templates/
  • Modules/
  • Notebooks/*/Source/

The project entry point is a Python notebook located at Notebooks/RadarCOVID-Report/Source/RadarCOVID-Report.ipynb.

Press References

The Radar STATS project has been referenced and featured on multiple news articles:

Related Links

About

Open-source project to monitor and report hourly statistics about Spain’s “Radar COVID” Exposure Notification app.

Topics

Resources

License

Stars

Watchers

Forks