refactor: default for max_new_tokens to 512 in Hugging Face generators

[CKeibel]

Related Issues

• fixes #Hugging Face generators: set a default for max_new_tokens #7365

Proposed Changes:

1. Set a default value for max_new_tokens to 515 in "Hugging Face generators".
2. Adjustment of the tests that fail due to the change.

How did you test it?

Initialization tests had already been implemented but were adjusted based on the change.

Notes for the reviewer

There were several tests that were adjusted differently. I hope that the changes are correct, otherwise I will fix them as soon as possible.

There have been changes to the imports that I did not add on my own (I don't know if the pre-commit hooks can influence this or where they come from). If these seem strange, I will fix them as soon as possible.

[CLAassistant]

All committers have signed the CLA.

[coveralls]

Pull Request Test Coverage Report for Build 8330363069

Details

• 0 of 0 changed or added relevant lines in 0 files are covered.
• 11 unchanged lines in 3 files lost coverage.
• Overall coverage increased (+0.006%) to 89.21%

---

Files with Coverage Reduction	New Missed Lines	%
components/generators/hugging_face_local.py	1	95.08%
components/generators/chat/hugging_face_tgi.py	5	94.74%
components/generators/hugging_face_tgi.py	5	94.44%

Totals
Change from base Build 8326632443:	0.006%
Covered Lines:	5374
Relevant Lines:	6024

---

💛 - Coveralls

[julian-risch]

Looks very good to me! 👍 @CKeibel Thank you for your contribution to Haystack. I just adjusted four tests to make them pass and slightly changed the release note.
The changes to the import statements were added by the pre-commit hooks and they are correct. The change is just about the sorting of the imports.
Congratulations! Looking forward to more PRs from you! 🙂

[julian-risch]

Hey @CKeibel have you already signed the contributor license agreement? Before we can merge your PR, we need you to sign it please: #7370 (comment)

[CKeibel]

Hey @CKeibel have you already signed the contributor license agreement? Before we can merge your PR, we need you to sign it please: #7370 (comment)

Yes, I signed it on Friday but somehow it doesn't seem to update. But I can have another look :)

[CKeibel]

Apparently my local git setting must have been wrong, the user who made the commits is called christopherkeibel and not CKeibel. I'll have to see how I can fix it afterwards, because the CLA is signed with CKeibel.

[CKeibel]

Hey @julian-risch , apparently I have to edit my commits with a rebase. I'll do that later when I get home from work.