IPAMChangeHostPermission is prone to inducing latency

[Simponic]

Describe the bug
Adding a new api view, and using the permission_classes IsAuthenticated and IPAMChangeHostPermission induces latency of up to 15 seconds.

To Reproduce

1. Create a new view (in this case, extending APIView)
2. Set the view's permission_classes to (IsAuthenticated, IPAMChangeHostPermission)
3. Add a new request method
4. Call that request from a fetch or ajax call
5. The request in the network tab is not resolved until about 15 seconds later