Rory McIlroy reportedly felt Caroline Wozniacki was hurting his golf game