Fans said the same thing about Cam Ward leaving Miami's bowl game