An editor I worked for told me he'd been taught to always go back over anything he wrote and eliminate every exclamation point except one---and then, go back one more time and take that one out too.

I'd say only use them when writing dialogue, and then very, very sparingly.