Inside Mary-Kate & Heath's relationship

Certainly friends, definitely party pals and maybe more, Heath Ledger and Mary-Kate Olsen first met over the summer of 2006, at the time he was living at the Chateau Marmont in Hollywood, PEOPLE has learned.