The big reason I never carried it was that I could never find the right holster that didn't make my pants fall down.
What pistol did you carry?
Either your pants were too large or your rig was too heavy or both. I'm skinny. I carry a very small, very light weight pistol. I would rather have a pair of 1911's or Beretta 92's on me, but practical wear dictates having a smaller handgun on me and that still beats the Hell out of having a larger, more powerful caliber, larger capacity one I left at home.
Finding the combination of a holster, gun belt, clothing and handgun that works takes as much effort as getting a bike that fits properly, a seat that works perfectly with your backside, pedals that work with you riding style and clothing that keep you comfortable on the bike.
No more. No less.