Have a good paper shredder on hand, or contact a shredding service for big jobs.
For documents you’re getting rid of, make sure to dispose of them properly. If something has any sort of personal or identifying or confidential information on it, definitely shred it. It’s better to be safe than sorry with this type of information. If you have a lot of documents that need to be shredded, you might want to seek out a professional document shredding service. These services allow you bring them boxes and boxes of papers at a time; in some cases they can bring a shredding van to you. If you have an ongoing need for shredding, these services can provide you with a locked bin that they can simply pick up when it is full.
If you have just a small amount to shred, it’s worthwhile to buy a small shredder. Avoid the cheap, $20 shredders—they just don’t hold up for very long. The better ones are in the $80 to $150 range, and they are a worthwhile investment if you anticipate needing to shred papers on an ongoing basis. The less expensive shredders, while they seem attractive at first, can usually only handle 2 or 3 sheets at a time and they tend to jam or burn out very quickly.