You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, the MoveToMouth tree moves to the staging location, waits to detect the mouth, and then moves to the user. The challenge with this is that while the robot is detecting the face, it is unclear to the user what is going on (the app just shows "thinking") and hence it is unclear to them what they should do to facilitate successful robot behaviors (e.g., move their head, teleoperate the arm down, etc.)
Instead, we should separate bite transfer into two separate action calls:
MoveToStagingConfiguration should move to the staging configuration.
Then, the app should subscribe to face detection and display the face detection stream for the user.
MoveToMouth should take in the results of face detection and move to the mouth.
For robustness, MoveToMouth should have some fallbacks in case the detected face is stale, plus it should convert it to the base frame at the timestamp in the message in case the robot has moved since.
The text was updated successfully, but these errors were encountered:
Currently, the
MoveToMouth
tree moves to the staging location, waits to detect the mouth, and then moves to the user. The challenge with this is that while the robot is detecting the face, it is unclear to the user what is going on (the app just shows "thinking") and hence it is unclear to them what they should do to facilitate successful robot behaviors (e.g., move their head, teleoperate the arm down, etc.)Instead, we should separate bite transfer into two separate action calls:
MoveToStagingConfiguration
should move to the staging configuration.MoveToMouth
should take in the results of face detection and move to the mouth.For robustness, MoveToMouth should have some fallbacks in case the detected face is stale, plus it should convert it to the base frame at the timestamp in the message in case the robot has moved since.
The text was updated successfully, but these errors were encountered: