Right now all my posts and pages come by default with a 'Leave a Reply' and a 'Post Comment' fields. How to I remove these? I don't this to be a default, but a feature that I can only enable in certain areas.

Go to Settings -> Discussion -> and look for Default article settings and disable "Allow people to post comments on new articles". Thats it