Tagg Romney's remarks came during an interview with TalkRadio 850 WPTF's Bill LuMaye.
LuMaye asked the candidate's son - and one of his closest campaign advisers - what it's like to hear President Obama call his father a "liar."
"You want to rush down the debate stage and take a swing at him but you know you can't do that because, well first cause there is a lot of secret service between you and him," Tagg Romney said of what he would have liked to during the presidential debate earlier this week.
"This is the nature of the process," the Romney son said, who sounded jovial in his remarks. "You know they are going to do everything they can to try to make my dad into someone he's not. We signed up for it. We gotta kinda sit there and take our punches, and then send them back the other way."
A campaign aide later told ABC News that Tagg Romney's remarks were all in jest, adding that he was joking about how frustrating the campaign process can be for family.
ABC News' David Muir and Emily Friedman contributed to this report. Click here for more political coverage from ABC News.