Hello and welcome to healthcare forum.
Any trauma to tissue causes inflammation and if the wound is contaminated by micro organism, as in your case tongue piercing
done with unsterile object it will lead to infection, which you are suppose to be having.
Start antibiotic and analgesic
medication under medical supervision and remove the object from the tongue, if it is still there.
wishing for your good health.