INCIDENT 007 | Network.Socket.accept: resource exhausted (Too many open files)

[Christian-MK]

Trigger

• ⬛ suspected malware infections
• ⬛ access violations
• ✔️ anomalous system behaviors
• ⬛ human errors
• ⬛ unauthorized access attempts

Date

2023-11-23

Summary

The coop-publisher GRPC service exited with too many open file handles: Network.Socket.accept: resource exhausted (Too many open files). This was reported on the hour by internal monitoring and addressed promptly resulting in no loss of coverage.

Status

Resolved

Assessment

The GRPC service isn't closing all of its file handles as it should, which created the anomalous behavior. Steps for short-term rectification have been implemented. However, long-term rectification of the issue in the Plutus-Haskell GRPC implementation will require further investigation.

Additional Notes

n/a

Technical improvements

1. Short term workaround has been implemented while analysis of long term rectification continues; a for infinite loop has been integrated to re-launch process if anomalous system behaviors result in exit.

Documentation improvements

N/A