people pay Zakat. the problem is its not channelized, its more or less personally distributed, not through the system; bait ul mal. still alot goes into govt hands as well and they do give away money to needy, which should not be the way, as its taken as easy money and not really helping to improve way of life.
Govt do initiate such Finance program as well, loan bank at community level was initiated during Ayub, my grandfather was made its incharge in lahore, and eventually he had to pay off the loan money to govt from his own wealth, as people who took loan, refused to return or used delaying tactics.. similarly, he took an initiative of helping the needy in the community, say for daughter's marriage or financial help in business etc, which too didnt work, and he along with others ended up wasting alot of money as people used it as easy money and didnt care.
Your intentions are noble, no doubt about it, but this is very risky and not result oriented.
The better is to find "reliable" skilled workers and get their work exported, like Lok Virsa is a group of some 50-60 people from all over Pakistan, they hold exhibitions throughout Pakistan of traditional dresses and products, which are exportable, but then again if your intentions are to serve you got to get down and engage, lending money is not going to help !
and I dont very much believe in money lending unless its to start a school or a cottage industry....
