Thanks for consulting us.
Forgotten or retained tampons are a known cause of infection. This is really good that you have finally removed it, but your symptoms suggest infection. It is advisable that you visit a Gynecologist for local examination to exclude or treat infection. Get a urine test done as you are possibly suffering from a urinary tract infection
Once the infection is confirmed, a course of specific Antibiotics are likely to help you.