Corpus luteal cyst
can cause off on pain especially when there is slight bleeding within the cyst. Besides other causes of pain due to cyst can be infection, rupture, torsion etc. These are more when size of the cyst is very big. You havent mentioned the size. But corpus luteal cyst are usually small and disappear in few cycles. All you can do is take some anti inflammatory like ibuprofen
for a week. Also get a repeat ultrasound
to know the condition of your cyst and rule out the above complications.