quick question

I've noticed that most of the .jpg icons are about 20kb. However, when I try to save my icons as .jpg, they are normally at about 4kb and blurry. 4kb to 20kb is a big difference, so how do I optimize the quality of my icons?