Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Experimental] Screenshot-based browsing #5324

Closed
wants to merge 16 commits into from
Closed

[Experimental] Screenshot-based browsing #5324

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
0c69d64
setup and add utils
ryanhoangt Nov 26, 2024
bf24832
update tool description
ryanhoangt Nov 28, 2024
3fe8097
add missing action translation
ryanhoangt Nov 29, 2024
48fea0c
switch obs to screenshot only
ryanhoangt Nov 29, 2024
002a2d8
wire up with fn calling
ryanhoangt Nov 29, 2024
bbdde56
simplify wiring up
ryanhoangt Nov 29, 2024
135550c
restructure
ryanhoangt Nov 29, 2024
55e078d
Merge branch 'main' into screenshot-based-browsing
ryanhoangt Nov 29, 2024
36670fe
fix litellm
ryanhoangt Dec 2, 2024
38eefce
add args validation, coordinate scaling, image resizing
ryanhoangt Dec 2, 2024
e177805
fix bugs
ryanhoangt Dec 3, 2024
ca3547c
use positional args & fix action not recognized
ryanhoangt Dec 9, 2024
32796a1
revert redundant code
ryanhoangt Dec 9, 2024
85a4a8d
Merge branch 'main' into screenshot-based-browsing
ryanhoangt Jan 3, 2025
32b0b05
use fork browsergym-core
ryanhoangt Jan 3, 2025
054c1d6
fix bug
ryanhoangt Jan 3, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
26 changes: 15 additions & 11 deletions poetry.lock
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion pyproject.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ packages = [
python = "^3.12"
datasets = "*"
pandas = "*"
litellm = "^1.52.3"
litellm = {git = "https://github.com/BerriAI/litellm.git", rev = "litellm_dev_11_29_2024"}
google-generativeai = "*" # To use litellm with Gemini Pro API
google-api-python-client = "*" # For Google Sheets API
google-auth-httplib2 = "*" # For Google Sheets authentication
Expand Down