The fire broke out at the Old Shuford Mill on Falls Avenue in Granite Falls, right across the street from the Granite Falls Police Department.