With the right equipment, I don't think you'll have as much trouble as you might think. I'm 5'9" and about 150 pounds..maybe a little less. I carry a Sig P226 IWB in an MTAC holster at right about 3 o'clock. Usually in no more than a T-Shirt. Nobody has ever noticed. I even went somewhere with one of my friends the other day who also has his CHL and knows I carry. Even he couldn't tell after specifically looking for "it". He thought I had left it at home for some reason.
Here's an example of how I'm usually dressed. It's taken in the mirror so it looks like I'm carrying on left, but it's actually right.
