It's most siginificant with JS files since they are usually large text files...the size drop is ....HUGE.
The compression rates on HTML/CSS documents also tend to be excellent, as they tend to contain large amounts of repetitive text. This site's main stylesheet, for example, gzips down from 8615 bytes to 2655, for a 70% reduction in file size. Of course, being small to start with, it's still not that much of an overall benefit.
The effect for example on image is quite minimal from what I've seen
That's because common image file formats, such as JPEG, PNG, and GIF, are already compressed. As an example, my current desktop wallpaper is a 1024x768 image with 24-bit color. Uncompressed, it would be 1024 * 768 * 24 = 18,874,368 bits (2,359,296 bytes, or 2.25M). As a .jpg, it's an 84k file. That's about a 96.5% reduction in file size.

If you're lucky, gzipping a compressed image file might net you another 1-2% reduction in file size - but it's at least as likely to make the file 1-2% bigger instead.