I actually am on Atkin's (modified now, of course) and I have yogurt very often. I think yogurt is one of those YMMV things - what works for some, doesn't work for others.

Personally, I love my yogurt (and yocheese) and I feel it adds more variety to my diet. It also satisfies my sweet tooth.