Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error in Ground truth Airline task 26, 27 #37

Open
boazdavid opened this issue Feb 18, 2025 · 1 comment
Open

Error in Ground truth Airline task 26, 27 #37

boazdavid opened this issue Feb 18, 2025 · 1 comment

Comments

@boazdavid
Copy link

boazdavid commented Feb 18, 2025

in Airline tasks 26 and 27 (aarav_ahmed_6699), expected to cancel reservation NQNU5R.
it contains flight HAT214 on "2024-05-13".
but this flight "status": "landed"
the user should be transferred to human.

If any of the segments are already used, the agent cannot help and transfer is needed.

@boazdavid
Copy link
Author

More GT errors in cancel_reservation:

Task 10 (mia_kim_4397) expect {"name": "cancel_reservation", "arguments": {"reservation_id": "H9ZU1C"}}, but the reservation flights were not cancelled, the cabin is economy and there is no insurance.

Task 28 (amelia_davis_8890) expect { "name": "cancel_reservation", "arguments": {"reservation_id": "MSJ4OA"}, } she has insurance but the cancelation reason is not health or weather.

Task 31 (mohamed_hernandez_5188) expect {"name": "cancel_reservation", "arguments": {"reservation_id": "9HBUV8"}} same

Task 33 (sophia_silva_7557) expect {"name": "cancel_reservation", "arguments": {"reservation_id": "S61CZX"}} same

Task 34 (daiki_muller_1116) expect {"name": "cancel_reservation", "arguments": {"reservation_id": "XEHM4B"}}, {"name": "cancel_reservation", "arguments": {"reservation_id": "59XX6W"}}, same

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant