We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
I noticed that indices included in audit_dataset differ between runs even if random seeds are kept fixed.
Same audit dataset should be generated for fixed random seeds (and sizes etc).
Perhaps random number generators (streams) need to be global and used explicitly in all random functions.
Log audit dataset indices between two runs and check for agreement.
The text was updated successfully, but these errors were encountered:
Problem may be related to code in data_preparation.py in dev_utils function prepare_train_test_dataset.
Sorry, something went wrong.
No branches or pull requests
Issue
Problem Description
I noticed that indices included in audit_dataset differ between runs even if random seeds are kept fixed.
Expected Behavior
Same audit dataset should be generated for fixed random seeds (and sizes etc).
What Needs to be Done
Perhaps random number generators (streams) need to be global and used explicitly in all random functions.
How Can It Be Tested or Reproduced
Log audit dataset indices between two runs and check for agreement.
The text was updated successfully, but these errors were encountered: