Seeing as how I age most of my stuff the band usually just slides right off. (The cigar usually becomes a tiny bit smaller when aged) If it doesn't slide off I will wait until it comes off easily. One exception to this is when I am doing a review. I think the band adds a bit of "pop" to the images.

The only downside to removing the band is that my dry cleaner charges extra to get the stains out of my white gloves.