My buddy told me to stack 30 second shots instead of going for 2 minutes on my new tracker. The Andromeda shot came out way cleaner. | Astronomy Photos - Opinions Matter
Actually, it makes a big difference if you ever print the photo or look at it on a good screen. That noise really shows up in shadows and dark areas. The stacking software does most of the work, so it's not that hard once you set it up. For some types of photos, like night skies, it's the only way to get a clean shot without a fancy camera.
Oscar_ellis has a point about printing. Saw a side-by-side comparison in a magazine once, and the stacked shot was way cleaner in the blacks. Makes you wonder why more people don't try it.