Bob Harris retired from his role as the school's radio voice back in 2017 after 41 years on the job.
"We are deeply saddened to learn of the passing of Bob Harris," said Duke Vice President & Director of Athletics Nina King.
"We send our heartfelt condolences to Phyllis and the entire Harris family. Duke, the Atlantic Coast Conference and the entire collegiate athletics community has lost a true icon. For over four decades, Bob represented Duke with the utmost professionalism while delivering to our fans worldwide an acute account of Blue Devil football and men's basketball games. He will be greatly missed, but his legacy will live forever."
Harris was a three-time recipient of the North Carolina Broadcaster of the Year award.
"Duke lost another one of its greatest treasures with the passing of Bob Harris," said former Duke head basketball coach Mike Krzyzewski.
Harris called 1,392 men's basketball games, 13 Final Fours and all five of the Blue Devils' NCAA championships (1991, 1992, 2001, 2010 and 2015) under Krzyzewski.
Harris closed his tenure calling football games in November 2016 with 471 straight games, as well as six bowl games and Duke's trip to the 2013 Atlantic Coast Conference football championship game.
"For decades as our radio play-by-play broadcaster, Bob told the story of Duke Athletics better than anyone," Krzyzewski said. "He was much more than an announcer to all of us. He was a family member who absolutely loved Duke and everything it stands for.
"We are so thankful that it was his voice that shared our journey each season with so many Duke fans around the world. He was adored by so many of them. The Krzyzewski family offers our deepest condolences to Phyllis and their loved ones. It was my honor to call Bob my friend."
In addition to his wife, Harris is survived by daughter Bobbi Harris-McCoy; son-in-law, Ron McCoy; and two grandchildren.
The Associated Press contributed to this report.