Peter Casey accused of ‘racist stereotyping’ and faces calls to withdraw from election over ‘appalling and reckless’ remarks about Travellers