Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change topK to 10 in nanoGPT sample #363

Merged
merged 5 commits into from
Nov 13, 2024
Merged

Conversation

yizhuoz004
Copy link
Collaborator

@yizhuoz004 yizhuoz004 commented Nov 12, 2024

Note: top K helps stablize the result a bit but not much, the result of int8-weight-only can vary among several outputs on CI machine, but cannot be reproduced locally. Worth looking into this issue later on.

@yizhuoz004 yizhuoz004 force-pushed the dev-yizhuoz-fix-l1-again branch 4 times, most recently from e0aba00 to 4d8c27c Compare November 13, 2024 18:30
@yizhuoz004 yizhuoz004 force-pushed the dev-yizhuoz-fix-l1-again branch 4 times, most recently from 3813ac8 to fdc83eb Compare November 13, 2024 20:04
Signed-off-by: yizhuoz004 <[email protected]>
Signed-off-by: yizhuoz004 <[email protected]>
Signed-off-by: yizhuoz004 <[email protected]>
@yizhuoz004 yizhuoz004 merged commit ee30299 into main Nov 13, 2024
3 of 4 checks passed
@yizhuoz004 yizhuoz004 deleted the dev-yizhuoz-fix-l1-again branch November 13, 2024 22:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants