Call of Duty based some maps on real places. Not everyone was happy.

Washington Post - Technology News 

But litigation against game companies using real buildings and places as inspiration is not unprecedented. In 2008, Rockstar Games was sued by ESS Entertainment for its depiction of a gentleman's club in "Grand Theft Auto: San Andreas." ESS, the operator of the real Los Angeles establishment Play Pen Gentlemen's Club, alleged that Rockstar infringed upon its trademark with its virtual club, Pig Pen. The court ruled in favor of Rockstar.