How to Perf: Finding and Fixing Bottlenecks

1. Look at new relic reports for pointers to bottlenecks (login required)

2. Look at an environment, like cc elsa.capi.land

3. Find hotspot endpoints

4. Turn on mysql logging in the CC and restart

5. Construct scripts that hit the endpoint with hey. If hey isn't on your machine install it with go get -u github.com/rakyll/hey.

6. Observe pre-fix times issued by database, and log average and 90%-ile times by hey

7. Apply fix and restart CC

8. Rerun script and check the times for differences. If there's an improvement and tests pass, this fix is probably good.