All these symptoms indicate that you might be having Pharyngitis
& Acute tonsillitis
1. Gargle with warm salt water to relieve throat pain.
2. Analgesics like paracetamol
3. Antibiotics depending upon culture & sensitivity reports to remove the causative organism.
4. Antihistamine preparations can also be used to provide symptomatic relief.
Intake of pain killers can only help you to get relief from the pain.
But unless the causative organism is removed, the symptoms cannot be eradicated completely.
So, it will be better to consult an ENT specialist
& start treatment accordingly.
Meanwhile...avoid taking cold
food & drinks, maintain adequate hydration & take soft, non-spicy foods.
Wish you good health & a speedy recovery.
Thanks & take care.