I've been in here for some 4 months.From I gather I think you Brits think that EU migrants are keeping wages to low for natives.My opinion is that these wages still make your economy competitive and leaving is not a solution but...hey! ...your country,your rules!.I'm neutral on this,I shy away from an opinion with my British aquaintances,you will decide.
I agree with your deduction, however I think its people at the lower social ladder that are more anti E.U. It's people who have to face competition in working class jobs that usually complain about there being too many Europeans during interviews etc, that's something I have heard personally.
In regards to such a perception, I also know people who run businesses and are involved in agriculture who are desperate for the U.K to remain in E.U. My own business is considering extending to Europe so a E.U exit will definitely create more hurdles in the sector that we are involved in.
Also I found this study that to an extent corroborates my view of class division among the Remain and Leave camps:
"Looking at social class a majority of pro-EU voters are middle class (57% are in social classes ABC1, compared to 47% of anti-EU voters). Here the traditional turnout advantage would work the other way, middle class voters tend to be more likely to turnout at elections, and are more likely to support Britain remaining in the EU.
Pro-European voters have a higher household income, are more likely to be in work, but less likely to own their house outright. 37% of pro-EU voters have a university degree, only 15% of anti-EU voters do. All these differences are to some degree factors of age (older people grew up when fewer people went to university and house prices were lower) but in summary, younger, middle class, graduates tend to be pro-EU, older,
working class, less well educated people tend to be anti-EU."
https://yougov.co.uk/news/2015/09/22/eu-referendum-state-public-opinion/