Authorities said 23-year-old Cameron Reese Bray tried to take two M4 rifles.
He was in town with the North Carolina National Guard for their annual training.
Bray was believed to be heading to Greensboro, his hometown, but turned himself in.
He was booked into the Cumberland County Jail.
He faces multiple charges including possession of stolen good/property and felony to obtain property by false pretense.
According to officials, Bray has a criminal history.