I'm 6' 1" and 31-inch waist, and slim fit are fine, generally not too snug. just stay away from skinny fit and you'll be fine.
as much as I dislike massive global brands, I have to say I've picked up a couple of good pairs of slim-fit demin jeans at the gap. also recently picked up some lightweight summer chinos at h&m that are inexpensive ($35) and slim but not too slim. note that current style is a slightly shorter leg length, so hopefully you aren't put off by trousers/jeans that don't reach all the way down to your shoes in the traditional sense. get a pair of those no-show socks and flash a little ankle while composing poetry-on-request.