You must get it X-rayed as otherwise an undisplaced fracture
or even an incomplete fracture may get missed. A second fracture in a already healing/ healed fracture is not so painful as the first one, so my advice is --go to your doctor and get it Xrayed! Meanwhile wear a wrist splint
to support it and reduce the pain.