Depending on where you stay, House dust mite allergy
gets worse in the winter (if you live in europe) while it gets worse in summer/rainy conditions (high humidity) at the tropics and you need to be on long-acting antihistamines and nasal sprays for that duration.
If HDM allergy is definitely proven on skin tests, or specific IgE blood test
then dsensitization is an option that you must discuss with your doctor.
Aletrnatively, optimise your medical therapy and moreso if you have asthma
definitely does NOT help with your allergies and sinuses
, so giving up will be the best thing you ever did.