It happened about 4:45 p.m. at the PNC Bank at 400 S. Wall Street.
Once on scene, police determined shots were fired prior to police arrival. It's unclear whether the suspect was shot by police or someone inside the bank.
He was taken to WakeMed for treatment.
No one else was injured.
Ashleigh Nelson lives across the street from where it happened. She said she didn't hear any gunfire.
"I poked my head out and saw the ambulance and the Town of Benson firefighters trucks, and this street was lined with police officers," Nelson said. "Next thing I know, they brought a gentleman from around the house and he looked labored -- like he was in pain -- and loaded him in the ambulance and left.
"It's definitely concerning just because this is just a quiet little town," Nelson added. "It's a good town. It's real neighborly. Part of the reason we moved here is because it's such a good little town."
"The Benson Police Department and the Town of Benson are committed to releasing details as soon as possible," said Benson Police Chief Kenneth Edwards. "There is no reason to believe the public is in any danger related to this incident."
The case is still under investigation.