The vast majority stays silent because of the militant reaction of those who carry out such wrongs. I am very commonly asked "why does the Pakistani public not come out on the streets and take matters into their own hands?" and to me the answer is quite simple. Unless and until the government and the public take on these wrongs together, it won't happen. More specifically, which poor tom, dick or harry wants to give his life, the only source of sustenance for his family, for a cause which may not find other backers (you need powerful ones too to take on the extremist lobby). The fact that a person like Salman Taseer was murdered and then on top of that his son was kidnapped to blackmail the family on the case against that murderer-cum-bodyguard tells you that in Pakistan people are scared to take on certain elements.