feat(transform_conformance): custom reporter for exec test

[Boshen]

closes #7704

[graphite-app]

Your org has enabled the Graphite merge queue for merging into main

Add the label “0-merge” to the PR and Graphite will automatically add it to the merge queue when it’s ready to merge. Or use the label “hotfix” to add to the merge queue as a hot fix.

You must have a Graphite account and log in to Graphite in order to use the merge queue. Sign up using this link.

[Boshen]

• feat(transform_conformance): custom reporter for exec test #7715 👈 (View in Graphite)
• main

This stack of pull requests is managed by Graphite. Learn more about stacking.

[graphite-app]

Merge activity

• Dec 7, 6:24 AM EST: A user added this pull request to the Graphite merge queue.
• Dec 7, 6:29 AM EST: A user merged this pull request with the Graphite merge queue.

[codspeed-hq]

CodSpeed Performance Report

Merging #7715 will not alter performance

_{Comparing 12-07-feat_transform_conformance_custom_reporter_for_exec_test (5891166) with main (72eab6c)}

Summary

✅ 29 untouched benchmarks

[Dunqing]

I think we should keep the error stack trace, as it is very helpful for testing and debugging.

[overlookmotel]

@Dunqing I agree, but JsonReporter doesn't seem to include stack traces anywhere in output. We'd probably need to write our own reporter from scratch.

[overlookmotel]

Scratch that. #7722 adds stack traces to snapshot.