Police say that man's two adult children found the possible human remains while excavating the basement of the home on Olive Street in Lake Grove.
Their father, George Carroll, has been missing since 1961, six years after the family bought the home.
Detectives say it was family lore that the father was buried in the basement.
Authorities are also not even sure if the father was ever officially reported missing.
The mother is deceased and the siblings own the house.
DNA testing will now be used to identify the remains.