Skip to content

A text based grasp objective #170

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Mar 4, 2025
Merged

A text based grasp objective #170

merged 1 commit into from
Mar 4, 2025

Conversation

pac48
Copy link

@pac48 pac48 commented Feb 26, 2025

No description provided.

@pac48 pac48 marked this pull request as draft February 26, 2025 20:43
@pac48 pac48 force-pushed the pr-text-grasp-objective branch from de839a2 to 77219e8 Compare February 26, 2025 20:57
@pac48 pac48 changed the base branch from main to v7.4 February 26, 2025 20:58
@pac48 pac48 marked this pull request as ready for review February 26, 2025 20:58
@EzraBrooks EzraBrooks requested a review from MikeWrock February 27, 2025 16:14
@davetcoleman
Copy link
Member

Can we move this to our moveit_pro repo instead? So all robot configs have access?

velocity_scale_factor="1.0"
waypoint_name="Above Pick Cube"
/>
<SubTree
Copy link
Collaborator

@MikeWrock MikeWrock Feb 27, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
<SubTree
<Action
ID="GetTextFromUser"
text_output="{prompts}"
default_values="an object"
prompts="Please specify an object to look for"
/>
<SubTree

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Dave told me he didn't like the user having to enter a value for text-based segmentation. I think we can add another variant that does this later.

clip_model_path="models/clip.onnx"
clipseg_model_path="models/clipseg.onnx"
erosion_size="2"
prompts="an object"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
prompts="an object"
prompts="{prompts}"

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See comment above

@MikeWrock
Copy link
Collaborator

I wish we had some equivalent of RetryUntilSuccessful and ForEach put together, and it would be nice for an inverter to swallow its children's errors (or maybe convert it to info?) but the objective you have works as expected. Thanks!

@pac48 pac48 merged commit ac8c1b1 into v7.4 Mar 4, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants