Drinking water during exercise is not only safe, but also encouraged to be hydrated.
Your arm pain
is probably due to lack of conditioning because you have recently started.
I recommend starting slowly and building intensity over a period of time. this would be less painful and safe.