According to officials, the call was received just before noon.
It happened less than a mile north of the former location of the Cape Hatteras Lighthouse.
Stay on top of breaking news stories with the ABC11 News App
The 53-year-old, from Bellbrook, Ohio, was brought back to shore but CPR efforts were unsuccessful.
"Our staff offer our sincere condolences to his family and friends," said National Parks of Eastern North Carolina Superintendent David Hallac. "We urge all visitors to be very careful when swimming in the Atlantic Ocean."
On Monday, the risk for rip currents was listed as high for most beaches along the coast.