MessageMaxBytes and CompressionType - MessageMaxBytes is enforced BEFORE compression

[sztrzask]

Description

MessageMaxBytes doesn't respect CompressionType - it checks message size BEFORE compression. Is there a reason or just stupid implementation?

If this behaviour is originating in librdkafka I'll happily publish it there.

How to reproduce

set
config.CompressionType = CompressionType.Lz4;

create an arbitrarily large message -
var numberOfCharacters = 3 * 1024 * 1024 / 2;
string largeString = new string('A', numberOfCharacters); // size will be 1.5 MB

and send it via Kafka.
The Producer will fail informing you that the message size is too large. Compressed message fits the limit.