Server Crash - fatal error: Found bad pointer in go heap

[matrixbot]

This issue was originally created by @hugeblank at matrix-org/dendrite#3221.

Background information

• Dendrite version or git SHA: 3d02c81
• SQLite3 or Postgres?: postgres (PostgreSQL) 15.4
• Running in Docker?: No
• go version: go version go1.21.1 linux/amd64

Description

• What is the problem: Server Crashes infrequently and randomly, the first error before dumping a massive stack trace is: fatal error: found bad pointer in Go heap (incorrect use of unsafe or cgo?)
• Who is affected: Users of my server
• How is this bug manifesting: log of incident will be sent to @kegan:matrix.org as I'm not sure what in this log, if anything, would reveal information about my HS setup.
• When did this first appear: It has been a problem since I've set up this dendrite instance. This is the second instance of this happening, the trace beyond the first fatal error line in the log was different that first time. Unfortunately I accidentally overwrote that log when capturing this new one. If it happens again and more context is needed I'll capture another one.

Steps to reproduce

• Start a federated dendrite server
• Leave it alone for a while

[matrixbot]

This comment was originally posted by @hugeblank at matrix-org/dendrite#3221 (comment).

I actually created a DM with both users mentioned in the comment of the issue template. Element unfortunately does not clarify that this is just an invite only room, which kegan didn't accept. Neil did, but let me know that they're no longer a contributing member to dendrite. I didn't ask any further (mainly because they left before I noticed their message), but I'm sure they'd appreciate being removed from the template. I'll try a proper DM with kegan one more time, and if nothing else, some other member can drop a comment with their handle.

[matrixbot]

This comment was originally posted by @hugeblank at matrix-org/dendrite#3221 (comment).

I give up, they rejected a second time. Update the template, please. Here's the log:
dendrite_crash.log