Charges in the most recent case involve missing drug money.
A state investigation into the matter could result in charges next month.
An audit of the department recommended changes to the departments' finances after a sheriff's office clerk was charged with embezzling more than $113,000.
Two years later, another review of the department shows some of those changes were never made.
Friday, the sheriff said his staff has continued to make improvements.
He has met with his staff and has plans to meet with county commissioners next week.
"We're just embarrassed that it happened especially happened twice," Sheriff Worth Hill said.
The county has recommended the sheriff hire a financial consultant, but Sheriff Hill says that would be a challenge.
He says he is faced with cutting 15 positions after the county asked him to cut $758,000 from next year's budget.