[Bug]: Mismatched Mod Set

[Unleashed75]

Steps to Reproduce the Bug

Run a 1.21 server with Fabric and JEI installed
Client tries to join the server with Fabric but not with JEI installed but is rejected.

Expected Behavior

I expect to be able to join the server, with or without JEI installed.

Actual Behavior

Error message as pictured in the image.

Mod Pack URL (Optional)

No response

Mod Pack Version (Optional)

No response

Extra Notes (Optional)

The mod is installed on the server for the extra features it offers and for those who join to make use of but not everyone needs or wants to have the mod on their own system.
This only seems to effect those that have Fabric installed. I haven't tested much but I know vanilla players can join fine but Fabric users have to install JEI to join the server now. They never had to before.

Main mods on Client;
Fabric Loader; 0.16.7 - 1.21
Fabric API; 0.102.0 - 1.21

Main mods on Server;
Fabric Loader; 0.16.05 - 1.21
Fabric API; 0.102.0 - 1.21
JEI; 19.21.0.246 - 1.21

latest.log

https://gist.github.com/Unleashed75/8ebe40715bdd7361b612944aba13115e