I tend to leave them on. There have been times that I cracked the wrapper a bit or cut a wee bit too much of the cap off, and some clever moving of the band keeps things together and smoking fine.

I also smoke alone 99% of the time, so showing off or seeing what others are enjoying is of no concern to me. I simply leave it in case I need it, and remove it when the burn dictates it is time.