If it seems something different than smegma
or if it causes pain or bleeding on removal then you should see a Dermatologist
. It does not seem anything sinister to me but would need to know your age and also whether you have Phimosis
a condition in which the penile foreskin does not retract. Let me know and take care.