Document footprint links

[ian-r-rose]

Fixes #222.

I used the following Python snippet to help generate the doc table:

import s3fs
import pandas

fs = s3fs.S3FileSystem(anon=True)

fips = pandas.read_csv("https://github.com/kjhealy/fips-codes/raw/master/state_and_county_fips_master.csv")
fips = fips[fips.state == "CA"].assign(fips=fips.fips.astype(str).str.slice(-3))

global_ml_parquet = sorted(
    fs.glob(
        "s3://dof-demographics-dev-us-west-2-public/"
        "global_ml_building_footprints/parquet/**.parquet"
    )
)
global_ml_parquet = ["s3://" + p for p in global_ml_parquet]

global_ml_zip = sorted(
    fs.glob(
        "s3://dof-demographics-dev-us-west-2-public/"
        "global_ml_building_footprints/shp/**.zip"
    )
)
global_ml_zip = ["s3://" + p for p in global_ml_zip]

lines = []
lines.append("| County | GeoParquet (HTTPS) | Shapefile (HTTPS) | GeoParquet (S3) | Shapefile (S3) |")
lines.append("| -------| ------------------ | ----------------- | --------------- | ---------------|")

domain = "https://dof-demographics-dev-us-west-2-public.s3.us-west-2.amazonaws.com/"

for p, s in zip(global_ml_parquet, global_ml_zip):
    county = fips[fips.fips == p.split(".")[-2].split("_")[-1]].iloc[0]["name"]
    hp = domain + "/".join(p.split("/")[-3:])
    hs = domain + "/".join(s.split("/")[-3:])
    lines.append(f"| {county} | [URL]({hp}) | [URL]({hs}) | [URL]({p}) | [URL]({s}) |")

Built docs here

[ian-r-rose]

cc @fennisreed for feedback

[britt-allen]

This all looks efficient and great. Thanks for creating this so quickly, @ian-r-rose !

[ian-r-rose]

I believe the most recent commit broke the code snippets

…

On Thu, Oct 26, 2023 at 3:48 PM britt ***@***.***> wrote: ***@***.**** approved this pull request. This all looks efficient and great. Thanks for creating this so quickly, @ian-r-rose <https://github.com/ian-r-rose> ! — Reply to this email directly, view it on GitHub <#229 (review)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABLWQNYZ77ZZRBLQGAG3CUTYBLSCTAVCNFSM6AAAAAA6R3OCT6VHI2DSMVQWIX3LMV43YUDVNRWFEZLROVSXG5CSMV3GSZLXHMYTOMBQG42TANBUG4> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[britt-allen]

We both ran into the same failure on our commits, I am not sure how mine introduced anything new? @ian-r-rose

[ian-r-rose]

We both ran into the same failure on our commits, I am not sure how mine introduced anything new? @ian-r-rose

This was the python issue in #231, it should work now

[britt-allen]

Yes I saw that right after I commented, I misunderstood.

[britt-allen]

Nice catch, ty!