Gibbon was probably the primary source for much of HoR

Though definitely a major influence, Duncan describes reading through the work as a child, I don't think it was his primary source. He had learned enough about history to doubt Gibbon, and tried to read available primary sources as much as he could.