The battery of my Whisper Flex (Ultimate) is running low while the fan is not on.

That may be true. The fan is in standby mode, so to speak, which means that the battery will run out at some point, even though it is not being used.