Ben Affleck‘s Dunkin’ Donuts commercial was one of the highlights of the Super Bowl telecast, but not everyone was loving the star’s antics at the drive-thru.

The actor admits some customers were annoyed with him as they tried to get their caffeine fix before work. In fact some even cursed out the Boston native.

Ben tells the Wall Street Journal, “It’s Boston, after all, so we had some rather coarse and agitated people who were willing to voice their displeasure in a colorful way, and I’m still lobbying to include the most interesting of those in some of the edgiest social spots.”

On Monday, Dunkin’ released outtakes from the commercial, but they left out most of the colorful language.