Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: Update Firecrawl to use v1 API #12574

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

ftonato
Copy link

@ftonato ftonato commented Jan 9, 2025

Summary

  • Updated API endpoints from v0 to v1 for scrape and crawl methods.
  • Enhanced error handling in scrape_url and check_crawl_status methods.
  • Introduced helper methods _extract_common_fields and _format_crawl_status_response for better code organization and readability.

Resolves #12571

- Updated API endpoints from v0 to v1 for scrape and crawl methods.
- Enhanced error handling in `scrape_url` and `check_crawl_status` methods.
- Introduced helper methods _extract_common_fields and _format_crawl_status_response for better code organization and readability.

Closes: langgenius#12571
@nickscamara
Copy link
Contributor

From Firecrawl v1 perspective, looks good!

@ftonato ftonato marked this pull request as ready for review January 10, 2025 14:31
@dosubot dosubot bot added the size:M This PR changes 30-99 lines, ignoring generated files. label Jan 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
size:M This PR changes 30-99 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Move Firecrawl from v0 to v1 API
2 participants