I've seen many people on here loose successfully and still drink their coffee - it varies from person to person. If you find yourself at a plateau for a few weeks, you may then start thinking about cutting back or eliminating it.

Just be carefull of the sweetener and creamer that you put in there - be sure to count those carbs!