What kind of holster do you have? Its too heavy for a hip holster, it pulls your pants down, especially if its fully loaded. Its too big to conceal really down by your ankle unless you have really baggy pant legs. (And I meant too big if your planning to carry on a regular basis, fine for every once in a while. I'd recommend a 9mm or similar for carrying often).
I use a blackhawk SERPA Paddle holster, so long as you wear a good belt it's fine. I'm a small guy and have no problem concealing it.
'Course if given the option and I know i'll be going someplace that I know I wont be taking my jacket off, I wear a shoulder holster.
Been looking for a good IWB holster if anyone has any pointers.
(BTW the blackhawk holster is the SHIT! just saying)