Hello
Looking at your description this could be caused by inflammation or drying effect.

I would advise you tofollow these guidelines
you should do gargling with warm saline water or a mouth wash
You can take steam inhalation to make it moist and soothe.

Here I would like to know more information for better assessment of the condition like
Are you having cough or symptoms of cold ?
Do you smoke?

Please write back to me with more relevant information so that I will be able to tell you more accurately.
Best wishes