I reccommend against it. People's hands go in and out of ice trays all the time. Hands can have bacteria such as fecal cauliforms or ecoli on them even after they've been washed. It's not a good idea simply because of that fact, but anything that is not clean can cause serious UT infections or Bacterial Vaginosis
, so just as a saftey measure avoid it in the future.