The man told investigators he was cleaning his yard when he made the discovery and picked up the hand grenade to see if it was real.
When he could tell, he called police who contacted the State Bureau of Investigation's bomb squad.
The SBI removed the device and no one was hurt.
Rocky Mount police say they haven't heard if the grenade was real or not.
