They're not dangerous, but they're annoying.
To get rid of them, you have a few options:
1) Wait for them to starve (messy, stinky)
2) Fill up the waterbowl and wait for them to drown (see above)
3) Put in drinking straws plugged at one end, remove when they hide in them (never tried this myself)