Add TrackOverlapMetrics to benchmarking

[msschwartz21]

No description provided.

[cmalinmayor]

Did the benchmarking fail just becuase it had an extra thing to run that wasn't in the baseline? How does the action deal with adding new benchmark functions?

[msschwartz21]

Did the benchmarking fail just becuase it had an extra thing to run that wasn't in the baseline? How does the action deal with adding new benchmark functions?

Honestly I have no idea what's happening. The updated benchmarking runs fine locally for me. I don't think the addition of a new function should cause a problem. We manually make a comparison when we build a pandas dataframe in the "generate report" section. In that case, I think we should just end up with a missing value for the new function on the base commit.

@tlambert03 Any guidance on troubleshooting action failures like this? https://github.com/Janelia-Trackathon-2023/traccuracy/actions/runs/6855566985/job/18642828648?pr=117

[tlambert03]

huh, strange. hard to say what's canceling it huh? i would just do some brute force stuff. maybe add -v to the pytest call to get a bit more information on whether it's hanging on exactly the test you've added. exclude/comment that test again just to ensure that it is indeed that test. then dig into the test itself and perhaps put debugging statements to see where in the metric it's canceling?

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (e5df26a) 83.64% compared to head (a2662f6) 83.66%.

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #117      +/-   ##
==========================================
+ Coverage   83.64%   83.66%   +0.01%     
==========================================
  Files          19       19              
  Lines         899      900       +1     
==========================================
+ Hits          752      753       +1     
  Misses        147      147              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.