You don't understand anything. Look at Bangladesh today. It is much more conservative Muslim country than mere decades before. Try to understand from a West Bengali Hindu perspective. They constantly see images from Bangladesh of large Madrassahs, like Hathazari. They see waves of Muslims clad in those long white kurtas, all wearing skullcaps and having beards, crowding the streets. You think West Bengali Hindus want to live in such a society? They see all those women in black burqas covered head to toe. So they may be Bengali, but you are totally alien to them. They don't feel comfortable around you. They see Hefazat-e-Islam and other fundamentalist groups mushrooming everywhere. The adhan is blasted on loudspeaker five times a day in every street corner of Dhaka, Chittagong and other major cities. You think West Bengali Hindus want to live in such a society? West Bengali Hindus may seem tolerant and cultured people, but you should know they are among India's most elitist and bigoted Hindus, they just don't show it as crassly and crudely as other Hindus from western India. All those Roys, Sharmas and Thakurs of West Bengal, these are the most elitist Hindus of the country.
As a Muslim, I certainly don't want to live in a society where everyone looks like a medieval Brahmin with a shaved head and shikha and all kinds of intimidating forehead markings, wearing dhotis and saffron colored clothes. Even if they are my race and speak my language, I will totally feel like a stranger among them.
So you have to learn human psychology to appreciate the dynamics of this world.