A building explosion is under investigation in Colbert County.