Current secretary Kenneth Lay - a former Bank of America executive who took the Cabinet position when Perdue took office in January 2009 - has handed in his resignation effective October 22.
"I thank Ken Lay for his service to the state, and for the progress he has made in seeking a new strategic direction for the Department of Revenue," said Gov. Perdue in a news release.
The Revenue Department under Lay delayed tax refunds the past two years because of cash flow problems within state government.
The tax office also was under scrutiny after its new policy made it harder for North Carolina residents to get refunds when they overpaid their taxes by mistake.
Incoming secretary Hoyle - a Democrat from Gaston County - has served nearly 18 years in the State Senate.
"I am happy to welcome David Hoyle to the cabinet. He recognizes my commitment to setting government straight and I believe he will garner the respect and trust of taxpayers," said Perdue,