The allegation is that fraternity members allegedly took a group of pledges off campus, blindfolded them and beat them with a wooden paddle.
Sources at the school tell Eyewitness News that the complaint came in anonymously - possibly from a single person.
Dean of Students Landon Hadley met with several fraternity members this week to discuss the allegations.
"At this point, all we have are allegations," said Janice Haynie, the university's vice chancellor for student affairs. "But we certainly don't condone hazing."
Alpha Phi Alpha was founded in 1906 at Cornell University and is one of the oldest black fraternal organizations in existence.
Famous members include Dr. Martin Luther King, who joined the fraternity at Morehouse College, Olympian Jesse Owens, plus former ambassador and Atlanta mayor Andrew Young.
Fayetteville State is a historically black institution and is one of 16 public universities in North Carolina.
