Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move to monorepo #18

Open
eaton opened this issue Nov 3, 2022 · 0 comments
Open

Move to monorepo #18

eaton opened this issue Nov 3, 2022 · 0 comments

Comments

@eaton
Copy link
Contributor

eaton commented Nov 3, 2022

Long term, the structure of the project will be a bear; it's a toolbox that keeps growing and not everyone needs the same stuff. One possible structure:

  • Core: Project, Graph data model, and Spider.
  • CLI: Probably based on oclif, simple commands for kicking off a crawl, testing URLs in batches, etc
  • Reports: Bundle our wrappers for D3, SheetsJS, various canned AQL queries, and any other standard tools for presenting final output
  • Integration: Wrappers and helpers for pulling data from other APIs, particularly Google Analytics and Pagespeed/Lighthouse scores
  • Analysis: Analyzers and any additional graph entities that go along with them: htmlToText integration, readability scoring, language/tag extraction, URL-based hierarchy building, graph-based algorithms for pathfinding and fundability ranking, etc would go here.
@eaton eaton added this to Spidergram Nov 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: No status
Development

No branches or pull requests

1 participant