updated 07/18/2011 AT 8:00 AM ET
•originally published 07/19/2011 AT 1:20 PM ET
He can’t say that for some of his high-profile pals.
“I have friends who are like prisoners. Brad Pitt and Angelina Jolie, for instance,” Damon, 40, told German television TELE 5 over the weekend. “They can’t just go someplace. If they go for a walk, it turns into an international incident.”
In contrast, says Damon, “I’m really lucky, because I have the best of both worlds. I do the work that I love and need, but don’t need paramilitary troops to protect me when I walk out my front door.”
Besides, fame just isn’t Damon’s game.
“I’m not as crazy as most of the other stars. I don’t really know why, probably because I married a woman who isn’t an actress. And we live in New York,” he said. “As long as we don’t show up in typical tourist spots, we can walk the streets without being noticed. New Yorkers are very cool, they don’t flip out if they see me.”