This paper makes a novel contribution to the academic debate on Brexit and racism. It emphasizes the need to distinguish different manifestations of post-racial xeno-racism in the aftermath of the Brexit Referendum as either direct, structural or cultural violence. This distinction of different types of violence is important for everyday and academic contexts, because it affects the ways in which racist behaviour is identified and addressed. Cultural violence in the form of nationalist defensive, anti-immigration statements is the most common type of racist violence that we found in our analysis. Yet, it also tends to be more readily dismissed as “not racist” by its perpetrators and targets, and contributes to feelings of subdual and powerlessness amongst the latter. Our arguments are based on findings from 15 semi-structured interviews that we conducted in 2017 with British and non-British residents of Great Yarmouth, a seaside borough in East Anglia.