Abnormally high memory usage in mainframe on staging

[jonathan-d-zhang]

Prod mainframe uses ~100MiB while staging uses ~250MiB. I suspect this is due to SQLAlchemy caching the distributions field that was recently added.

[jonathan-d-zhang]

SQLAlchemy's identity map would be collected as soon as the session was closed, so I don't think my original guess is correct. I also found https://docs.pydantic.dev/latest/concepts/json/#caching-strings, but by quick estimation a completely full cache with 63 character strings would be at most 2 MiB.

Also, when attempting to increase the memory usage by requesting a large time span with GET /package?since=<30 minutes ago> (to simulate the situation described in vipyrsec/bot#255), the memory usage jumped up to ~350MiB, but did not go down even after a few minutes. This leads me to believe that mainframe is somehow holding onto the memory used to build the response. I'm using memray to test.

[Robin5605]

Also, when attempting to increase the memory usage by requesting a large time span with GET /package?since=<30 minutes ago> (to simulate the situation described in vipyrsec/bot#255), the memory usage jumped up to ~350MiB, but did not go down even after a few minutes. This leads me to believe that mainframe is somehow holding onto the memory used to build the response. I'm using memray to test.

After some investigation, it doesn't seem like this issue is necessarily introduced by this PR. I've run memray against the main branch, then requested GET /package?since=<3 days ago> for a very large response body, and saw this memory usage graph:

A good chunk of memory is still being hung onto

[Robin5605]

This is about 91MB of memory being retained a while after the response was complete. Unsure why it's being held onto.