It is possible that you are hearing the effect of dithering especially on a Mac. Usually this is audible if you use the volume control in iTunes instead of the main volume control for the Mac. It may also be possible to eliminate the noise by ensuring all sample rates are equal in Audio Settings. Click Here for the wiki link on that subject.
Let us know what you find.