Skip to content

2024‐06‐07 Meeting Minutes

Paul Philion edited this page Jun 7, 2024 · 7 revisions

Before the meeting

allconnect url discoveries

Found work around on allconnect website, going to: allconnect.com/local and selecting Washington state. This allows us to search without a home address. Use incognito mode to avoid cookie usage, sometimes allconnect saves previously input addresses and skews results.

  1. https://www.allconnect.com/local/wa/seattle?zip_code=98195
  • possible to need as little as: state, city, and zip_5
  • doesn't always search for the inputted zip though
  • somewhat similar to the first allconnect url in api
  1. https://www.allconnect.com/results/providers?zip=98195
  • possible to need as little as little as: zip_5
  • appears to be more accurate than url 1
  • somewhat similar to the second allconnect url in api

Further steps/ questions:

  • I'm not sure how allconnect url is constructed in webscraper too well, not sure how to redesign using the above 2 urls
  • will also need to edit parameters in api
  • Have not tested using api yet, but just using testing on allconnect and changing the url seems to work

After Meeting

  • After discussion and experimentation, Refactored AllConnect query to use option (2) above, while keeping the full address API. This was committed to branch New Layout: https://github.com/Aaron8727/Internet-Webscraper-API/tree/New-Layout
  • Discussed variability of data based on different addresses and query methods. FCC site has higher-quality address data than AllConnect, but does not have pricing.
  • Will add a disclaimer for the data, with a link back to the allconnect reference.
  • Will further research data from various sources and URLs to see which mechanism seems most accurate.