Report: Matt Harvey was partying at club until 4 am day of absence