He had the kids on Father's Day and was supposed to drop them back at their mother's home Sunday night.