Hello there,
Yes 4Mb is only for messages.
Messages can have no more than 4 MB of data. This restriction is due to the memory mapped files used by Message Queuing to store the message data. These memory-mapped files are stored in the MSMQ\Storage folder on the computer where the queue resides.
The information within the message is stored in different message properties. For example, even the contents of the message (as described above) are stored in the body property of the message.
Hope this resolves your Query !!
--If the reply is helpful, please Upvote and Accept it as an answer--