Torrey Smith says Patriots fans sent him ‘rude tweets,’ references brother’s death