One of the Secret Service agents linked to the Colombia prostitution scandal brought a woman back to the Hilton Cartagena, the same hotel where President Barack Obama later stayed, five days before the president arrived in Colombia, a source familiar with the investigation told CNN on Monday.