You are correct that during infection or cold
or winter seasons there is a kind of sound which troubles that is due to cold and due to non function of tube behind the nose and connecting the middle part of ear.
There is fluid collection in the middle part of ear and because of which there is sound like buzzing of insect .
You should get an ENT consultation and get done ---Pure tone audiometry
and impedance audiometry to get this ruled out and take medicines accordingly.
In doubt do reply