Glass, plastic, and metal containers hold all sorts of edible and inedible materials that can leave all sorts of gunk inside afterward. Especially that darn peanut butter!
A quick rinse is fine for most containers, but don't worry about getting your containers sparkling clean. The main concern is actually the paper in your bin, which food and moisture can ruin.
What about peanut butter jars? Try this for peanut butter: if you have a soft spatula, scoop out what you can and use it to make one more sandwich. Then fill it about a quarter of the way up with water and add a drop of soap. Put on the top, give it a vigorous shake, and dump out the gunk.