Extend functionality of Wandb Config Diff script #687
+79
−25
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
flatten_dict()
in utilsflatten_dict()
to also flatten any dicts that exist in Listsflatten_dict()
Motivation is, while comparing configs, the current implementation doesn't perform comparison of some key aspects of the configs, namely config keys representing dataset paths (which are all List[str]) as well as keys like
config["evaluators.value"]
which areList[Dict]
.The current behavior looks something like this:
where we can see that the fields
data.value.paths
andevaluators.value
aren't easily comparable.The new behavior looks like this:
where it preserves behavior of original script under old keys, but performs side by side comparison of list elements also.
The downside, of course, is with a lot of dataset paths, these config diffs can become quite long to sift through.