Most of these palpitations are benign and need reassurance rather than treatment. It is wise to get your doctor to confirm this is the case, with a 24 hour ECG. Even though it is usually not essential, drugs such as beta blockers can be used to suppress them.
One extra possibility in your case is that they are being caused by your levothyroxine
dose being too high. Your GP can check this as well.