Tom's Hardware Guide has written a guide to aid users to find superior open source alternatives for nearly every element of Windows and remove the redundant Windows programs from your system.
The average Windows user tends to be less than satisfied with Windows. And that's no surprise, either, given the rather woeful state of its default applications. Consider that both Wordpad and Notepad refuse to open larger files, the integrated audio recorder limits recordings to 60 seconds, and Paint, the integrated graphics program, offers only the most rudimentary of features. Worse still, Internet Explorer can neither be considered modern nor safe for browsing, while Outlook Express is known for its affinity for contracting any number of worms and viruses. In short, the out-of-the-box Windows configuration is usually outdated and problem laden.
Check it out over here. Although I do think they are exaggerating a bit in the snip I just quoted, especially about Internet Explorer and Outlook Express. Both programs aren't bug free but I believe if you use them smart then they aren't really much more 'leaky' than other browsers/mailing clients.