Wake County Sheriff's investigators arrested Daniel Evans Friday at the Legislative Office Building.
Arrest warrants show Evans is charged with first-degree rape, statutory rape, and indecent liberties involving two children.
The warrants show the alleged incidents happened between 2002 and 2008.
Evans resigned from his position Monday.
His bail has been set at $1 million.