Your doctor might be right in thinking about Panic attacks after evaluating you. Im presuming you dont have any objective weakness..but you do describe some difficulty in moving your fingers.
The symptoms can occur as a part of a Stroke
and if you have trouble in holding objects or doing fine movements like putting a button you can revisit your doctor.
Lets hope there is nothing more than your doctor is anticipating and your numbness
improves with medications prescribed.