Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Broken links to IPEA gpkg files #24

Closed
ropinho opened this issue Jun 1, 2021 · 6 comments
Closed

Broken links to IPEA gpkg files #24

ropinho opened this issue Jun 1, 2021 · 6 comments
Assignees

Comments

@ropinho
Copy link
Contributor

ropinho commented Jun 1, 2021

All links to download geographic data from IPEA is broken returning 404 (Not Found).

Hence, the generation pipeline described in instance generation README.md finish unsuccessfully. The generate.py script fails to find the *.gpkg files in the data_raw directory, raising following error:

fiona._err.CPLE_OpenFailedError: ./loggibud/loggibud/v1/instance_generation/../../../data_raw/33.gpkg: No such 
file or directory

The (broken) links used in download.sh script are:

@gabisurita
Copy link
Contributor

Thanks for the report. I believe IPEA changed the path internally. I'll investigate this further.

@gabisurita gabisurita self-assigned this Jun 17, 2021
@minterciso
Copy link

I'm also experiencing this issue, will this be updated soon?

@gabisurita
Copy link
Contributor

gabisurita commented Jun 25, 2021

By checking the metadata from IPEA (available at this CSV), I believe that the new paths are:

https://www.ipea.gov.br/geobr/data_gpkg/census_tract/2010/33census_tract_2010.gpkg
https://www.ipea.gov.br/geobr/data_gpkg/census_tract/2010/53census_tract_2010.gpkg
https://www.ipea.gov.br/geobr/data_gpkg/census_tract/2010/15census_tract_2010.gpkg

But I couldn't validate if anything else changed, and the rest of the pipeline still works. @Pinho @minterciso Maybe you can check if just changing the paths and renaming the files work. I shall check this in a couple of days.

@ropinho
Copy link
Contributor Author

ropinho commented Jun 25, 2021

@gabisurita I used these links to manually download the files (using curl) and placed them into the data_raw directory. The instances were generated successfully.

Therefore, I believe that replace the links in "download.sh" fix this issue. I can test this and open a PR if all OK.

@gabisurita
Copy link
Contributor

Solved by #28 .

@gabisurita
Copy link
Contributor

We should also fix the README links, but I'll keep this closed since the script is already working.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants