picture formats

What are the differences between .jpg, .gif, and .png's? What makes saving as .jpg's better or worse than .gif's of .png's? I've noticed quite a few icons saved as .png's and I wondered why... :)