What minecraft version are you on? This does not occur for me.

Also what version is the server you are playing on? Do you use Multiconnect?

EDIT: It's been determined that this is an issue with AntiHunger specifically