And by toss, I mean place carefully in your battery recycling bin.
By free batteries, I mean the generic brand AA and AAA batteries you get prepackaged with products. The number of times I've had those cheapo batteries leak inside my tools/toys/etc is ridiculous.
Go buy a megapack of Duracells or good brand rechargeables. It's worth it.