‘People’s reaction’ to Ed Sheeran’s Game of Thrones cameo ‘muddied his joy to it’