I tote mygrandson all around with the Kimber on my hip. Not a big deal. Out in public, the sheep are looking at the baby and could care less what the big lumpy grey haired grandpa is doing.
If anyone would be concerned it would be my daughter-in-law, and believe me if she had concerns, she would speak up. She has been around us enough where the sight of a firearm is no big deal. She knows I will take appropriate measure to protect the grandson both from any ND and from the bad guys too.
I remove the pistol when I am doing serious grandson time since grandsons require large amounts of rambuctious play with grandpa.
Around the house, be yourself. In public, your mode of carry may have to be adjusted. Let Jbird carry the child while he accompanies you shopping.
Anygun