muse
ELITE MEMBER
- Joined
- Oct 26, 2006
- Messages
- 13,006
- Reaction score
- 0
Know-alls
Sep 25th 2008
From The Economist
Electronic snooping by the state may safeguard libertyand also threaten it
Kobal Collection
IF A Muslim chemistry graduate takes an ill-paid job at a farm-supplies store what does it signify? Is he just earning extra cash, or getting close to a supply of potassium nitrate (used in fertiliser, and explosives)? What if apparent strangers with Arabic names have wired him money? What if he has taken air flights with one of those men, with separate reservations and different seats, paid in cash? What if his credit-card records show purchases of gadgets such as timing devices?
If the authorities can and do collect such bits of data, piecing them together offers the tantalising prospect of foiling terrorist conspiracies. It also raises the spectre of criminalising or constraining innocent peoples eccentric but legal behaviour.
In November 2002 news reports revealed the existence of a big, secret Pentagon programme called Total Information Awareness. This aimed to identify suspicious patterns of behaviour by data mining (also known as pattern recognition): computer-driven searches of large quantities of electronic information. After a public outcry it was dubbed, perhaps more palatably, Terrorism Information Awareness. But protests continued, and in September 2003 Congress blocked its funding.
That, many people may have assumed, was that. But six of TIAs seven components survived as secret stand-alone projects with classified funding. A report in February by Americas Department of Homeland Security named three programmes it operates to sniff out suspicious patterns in the transport of goods. Similar projects have mushroomed in, among other countries, Britain, China, France, Germany and Israel.
Civil-liberties defenders are trying hard to stop data-mining becoming a routine tool for the FBI to spy on ordinary Americans. They say that the administration is racing in its final months to formalise in law programmes that have run solely under authorisation from the White House that bypasses Congress. One pending change would authorise more intelligence sharing between federal and local officials. In a federal court filing made public on September 20th, Americas attorney-general, Michael Mukasey, sought legal immunity for telecoms firms which have provided details on international phone calls. What happens in practice, and what the law permits, is a hot and unresolved issue.
Last month, after a briefing by the Department of Justice about a secret data-mining plan for the FBI, a group of American lawmakers wrote to Mr Mukasey complaining that the plan would allow the FBI to spy on Americans without any basis for suspicion. The proposed project could be made public in coming weeks.
No similar pan-European data-mining programme is operating, at least to public knowledge. Yet under an agreement signed in July last year airlines flying from the European Union to America have had to provide the authorities there with reservations data, as well as information obtained by airport-security screeners. This can include passengers race, religion, occupation, relatives, hotel reservations and credit card details. Internet service providers and telecoms firms in the EU must now keep for up to two years, though not automatically hand over, data on websites visited and phone calls made and received (but not the content of conversations).
Fast company
FAST, a Norwegian company bought by Microsoft this year for $1.3 billion, collects data from more than 300 sources (including the web) for national data-mining programmes in a dozen countries in Asia, Europe and North America. In April British members of Parliament learned that almost a year earlier the home secretary, Jacqui Smith, had secretly authorised the transfer of licence-plate data recorded by roadside cameras to foreign intelligence agencies. In June the Swedish Parliament voted into law a data-mining programme strongly backed by the defence ministry. From January 1st it will provide sweeping powers to monitor international electronic messages and telephone traffic.
The staggering, and fast-growing, information-crunching capabilities of data-mining technology broaden the definition of what is considered suspicious. In June Americas Departments of Justice and Homeland Security and a grouping of American police chiefs released the Suspicious Activity ReportSupport and Implementation Project. Inspired in part by the approach of the Los Angeles Police Department, it urges police to question people who, among other things, use binoculars, count footsteps, take notes, draw diagrams, change appearance, speak with security staff, and photograph objects with no apparent aesthetic value.
Companies, and especially credit-reporting firms, generally enjoy more latitude than government bodies do in making personal information available to third parties. They find intelligence agencies are eager clients. Chris Westphal, head of Visual Analytics, a firm in Poolesville, Maryland that operates data-mining software for security and intelligence agencies, says the data provided by such firms is very significant. Narayanan Kulathuramaiyer, an expert in data mining at UNIMAS, a Malaysian university, says companies are selling database access to intelligence and law-enforcement agencies at a level you would not even imagine.
Legal challenges to governments use of personal information held by companies have reached high courts in many countries, including Americas Supreme Court. Rulings, however, have for the most part frustrated privacy advocates. Suzanne Spaulding, a former legal adviser to the Senate and House intelligence committees, says improvements in data-mining technology have enabled intelligence agencies to milk favourable court rulings in ways that exceed judicial intent. For example, such cases typically concern permission to use data from a single source, such as a phone companys billing records. When different databases are mined simultaneously, the value of information increases exponentially.
Spies are increasingly snooping on private internet use. Katharina von Knop, a data-mining expert at the University of German Federal Armed Forces in Munich, says many systems remotely analyse the content of web pages people visit. A man who has travelled to, say, Peshawar, a stronghold of Islamist extremism in Pakistan, is considered more dangerous if he also reads the blog of an extremist Muslim cleric. If the cleric lives in Peshawar, the mans suspicion score rises further. Data-mining software develops profiles by taking into account all web pages visited by a computer user; if a suspect visits a stamp-collecting website, the suspicion score is lowered.
Such profiling increasingly relies on sentiment analysis. Hsinchun Chen, head of the Artificial Intelligence Lab at the University of Arizona says this technique, which he performs for American and international intelligence agencies, is an emerging and booming field. The goal is to identify changes in the behaviour and language of internet users that could indicate that angry young men are becoming potential suicide-bombers. For example, a person who exhibits curiosity by visiting many Islamist websites and asking numerous questions in online forums might be flagged by sentiment-analysis software if he shows signs of resentment and eventually turns to radicalising others by, say, justifying violence and providing links to militant videos. Mr Chen says intelligence agencies in the United States, Canada, China, Germany, Israel, Singapore and Taiwan are customers for this technique.
Does it work?
Donald Tighe, vice-president for public affairs at In-Q-Tel, a non-profit investment outfit that helps the CIA stay abreast of advances in computing, says that data mining is now so powerful it has become essential to our national security. But campaigners for privacy have many worries. One fear, prevalent in Britain after incidents in which officials lost huge quantities of confidential personal information, is that the state may be even more careless with data than private firms are. Another is that innocents are flagged for further investigation or added to watch-lists that may impede air travel, banking and gaining jobs in places where radioactive materials are used, such as hospitals. The American Civil Liberties Union (ACLU), a lobby, says the list maintained by the Terrorist Screening Centre at the FBI now has more than 900,000 names, with 20,000 more every month. Being removed is tricky.
Data-mining may be bad for national security as well as for civil liberties. The software is often modelled on the fraud-detection applications used by financial institutions. But terrorism is much rarer. So spotting conditions that may precede attacks is harder. Mike German, a former FBI agent who now advises the ACLU, says intelligence agencies too readily believe in the snake oil of total information awareness, which drains effort from more useful activities such as using informers and infiltrators.
Explosive data
Abdul Bakier, a former official in Jordans General Intelligence Department, says that tips to foil data-mining systems are discussed at length on some extremist online forums. Tricks such as calling phone-sex hotlines can help make a profile less suspicious. The new generation of al-Qaeda is practising all that, he says.
Last year two pattern-detection programmes, ADVISE and TALON, run respectively by Americas Department of Homeland Security and the Pentagon, were shut down following privacy concerns and irregularities. Privacy advocates, however, say that other programmes continueand many are operated, with minimal oversight, by the National Security Agency. The NSA insists that it does keep Congress informed. It also vigorously defends data mining, saying that if todays systems were in place before the terrorist attacks of September 11th 2001, some of the hijackers would have been identified.
In July, after fierce debate, Congress imposed new limitations on government wiretapping when it renewed the expiring Foreign Intelligence Surveillance Act (FISA) sought by President George Bush after September 11th. The main law governing data mining, this has provided the administration with broad and unprecedented electronic-spying powers. But civil-liberties lobbies such as Amnesty International and Human Rights Watch say the renewed, restricted law leaves largely untouched far-reaching secret black programmes, run by the NSA, which crunch data on great numbers of people, including millions of Americans. Much of that is personal financial information collected by the Treasury.
Mr Bush says that FISA helps protect citizens liberties while maintaining the vital flow of intelligence. Several hours after the president signed the bill into law, the ACLU filed a federal lawsuit, on the grounds that the executive branchs expanded wiretapping powers violated the constitution.
In 2001 American-led forces routed the Taliban in Afghanistan, destroying al-Qaeda training camps there. Berndt Thamm, who advises Germanys armed forces on terrorism, says that in retreat the Islamists left valuable clues about their online communications and electronic plotting. It is in following up these leads that data mining and pattern analysis can, and should, be used. Such techniques, says Mr Thamm, are the only answer to jihadist extremists. That is the argument which the strenuous objections of civil libertarians need to overcome.
Sep 25th 2008
From The Economist
Electronic snooping by the state may safeguard libertyand also threaten it
Kobal Collection
IF A Muslim chemistry graduate takes an ill-paid job at a farm-supplies store what does it signify? Is he just earning extra cash, or getting close to a supply of potassium nitrate (used in fertiliser, and explosives)? What if apparent strangers with Arabic names have wired him money? What if he has taken air flights with one of those men, with separate reservations and different seats, paid in cash? What if his credit-card records show purchases of gadgets such as timing devices?
If the authorities can and do collect such bits of data, piecing them together offers the tantalising prospect of foiling terrorist conspiracies. It also raises the spectre of criminalising or constraining innocent peoples eccentric but legal behaviour.
In November 2002 news reports revealed the existence of a big, secret Pentagon programme called Total Information Awareness. This aimed to identify suspicious patterns of behaviour by data mining (also known as pattern recognition): computer-driven searches of large quantities of electronic information. After a public outcry it was dubbed, perhaps more palatably, Terrorism Information Awareness. But protests continued, and in September 2003 Congress blocked its funding.
That, many people may have assumed, was that. But six of TIAs seven components survived as secret stand-alone projects with classified funding. A report in February by Americas Department of Homeland Security named three programmes it operates to sniff out suspicious patterns in the transport of goods. Similar projects have mushroomed in, among other countries, Britain, China, France, Germany and Israel.
Civil-liberties defenders are trying hard to stop data-mining becoming a routine tool for the FBI to spy on ordinary Americans. They say that the administration is racing in its final months to formalise in law programmes that have run solely under authorisation from the White House that bypasses Congress. One pending change would authorise more intelligence sharing between federal and local officials. In a federal court filing made public on September 20th, Americas attorney-general, Michael Mukasey, sought legal immunity for telecoms firms which have provided details on international phone calls. What happens in practice, and what the law permits, is a hot and unresolved issue.
Last month, after a briefing by the Department of Justice about a secret data-mining plan for the FBI, a group of American lawmakers wrote to Mr Mukasey complaining that the plan would allow the FBI to spy on Americans without any basis for suspicion. The proposed project could be made public in coming weeks.
No similar pan-European data-mining programme is operating, at least to public knowledge. Yet under an agreement signed in July last year airlines flying from the European Union to America have had to provide the authorities there with reservations data, as well as information obtained by airport-security screeners. This can include passengers race, religion, occupation, relatives, hotel reservations and credit card details. Internet service providers and telecoms firms in the EU must now keep for up to two years, though not automatically hand over, data on websites visited and phone calls made and received (but not the content of conversations).
Fast company
FAST, a Norwegian company bought by Microsoft this year for $1.3 billion, collects data from more than 300 sources (including the web) for national data-mining programmes in a dozen countries in Asia, Europe and North America. In April British members of Parliament learned that almost a year earlier the home secretary, Jacqui Smith, had secretly authorised the transfer of licence-plate data recorded by roadside cameras to foreign intelligence agencies. In June the Swedish Parliament voted into law a data-mining programme strongly backed by the defence ministry. From January 1st it will provide sweeping powers to monitor international electronic messages and telephone traffic.
The staggering, and fast-growing, information-crunching capabilities of data-mining technology broaden the definition of what is considered suspicious. In June Americas Departments of Justice and Homeland Security and a grouping of American police chiefs released the Suspicious Activity ReportSupport and Implementation Project. Inspired in part by the approach of the Los Angeles Police Department, it urges police to question people who, among other things, use binoculars, count footsteps, take notes, draw diagrams, change appearance, speak with security staff, and photograph objects with no apparent aesthetic value.
Companies, and especially credit-reporting firms, generally enjoy more latitude than government bodies do in making personal information available to third parties. They find intelligence agencies are eager clients. Chris Westphal, head of Visual Analytics, a firm in Poolesville, Maryland that operates data-mining software for security and intelligence agencies, says the data provided by such firms is very significant. Narayanan Kulathuramaiyer, an expert in data mining at UNIMAS, a Malaysian university, says companies are selling database access to intelligence and law-enforcement agencies at a level you would not even imagine.
Legal challenges to governments use of personal information held by companies have reached high courts in many countries, including Americas Supreme Court. Rulings, however, have for the most part frustrated privacy advocates. Suzanne Spaulding, a former legal adviser to the Senate and House intelligence committees, says improvements in data-mining technology have enabled intelligence agencies to milk favourable court rulings in ways that exceed judicial intent. For example, such cases typically concern permission to use data from a single source, such as a phone companys billing records. When different databases are mined simultaneously, the value of information increases exponentially.
Spies are increasingly snooping on private internet use. Katharina von Knop, a data-mining expert at the University of German Federal Armed Forces in Munich, says many systems remotely analyse the content of web pages people visit. A man who has travelled to, say, Peshawar, a stronghold of Islamist extremism in Pakistan, is considered more dangerous if he also reads the blog of an extremist Muslim cleric. If the cleric lives in Peshawar, the mans suspicion score rises further. Data-mining software develops profiles by taking into account all web pages visited by a computer user; if a suspect visits a stamp-collecting website, the suspicion score is lowered.
Such profiling increasingly relies on sentiment analysis. Hsinchun Chen, head of the Artificial Intelligence Lab at the University of Arizona says this technique, which he performs for American and international intelligence agencies, is an emerging and booming field. The goal is to identify changes in the behaviour and language of internet users that could indicate that angry young men are becoming potential suicide-bombers. For example, a person who exhibits curiosity by visiting many Islamist websites and asking numerous questions in online forums might be flagged by sentiment-analysis software if he shows signs of resentment and eventually turns to radicalising others by, say, justifying violence and providing links to militant videos. Mr Chen says intelligence agencies in the United States, Canada, China, Germany, Israel, Singapore and Taiwan are customers for this technique.
Does it work?
Donald Tighe, vice-president for public affairs at In-Q-Tel, a non-profit investment outfit that helps the CIA stay abreast of advances in computing, says that data mining is now so powerful it has become essential to our national security. But campaigners for privacy have many worries. One fear, prevalent in Britain after incidents in which officials lost huge quantities of confidential personal information, is that the state may be even more careless with data than private firms are. Another is that innocents are flagged for further investigation or added to watch-lists that may impede air travel, banking and gaining jobs in places where radioactive materials are used, such as hospitals. The American Civil Liberties Union (ACLU), a lobby, says the list maintained by the Terrorist Screening Centre at the FBI now has more than 900,000 names, with 20,000 more every month. Being removed is tricky.
Data-mining may be bad for national security as well as for civil liberties. The software is often modelled on the fraud-detection applications used by financial institutions. But terrorism is much rarer. So spotting conditions that may precede attacks is harder. Mike German, a former FBI agent who now advises the ACLU, says intelligence agencies too readily believe in the snake oil of total information awareness, which drains effort from more useful activities such as using informers and infiltrators.
Explosive data
Abdul Bakier, a former official in Jordans General Intelligence Department, says that tips to foil data-mining systems are discussed at length on some extremist online forums. Tricks such as calling phone-sex hotlines can help make a profile less suspicious. The new generation of al-Qaeda is practising all that, he says.
Last year two pattern-detection programmes, ADVISE and TALON, run respectively by Americas Department of Homeland Security and the Pentagon, were shut down following privacy concerns and irregularities. Privacy advocates, however, say that other programmes continueand many are operated, with minimal oversight, by the National Security Agency. The NSA insists that it does keep Congress informed. It also vigorously defends data mining, saying that if todays systems were in place before the terrorist attacks of September 11th 2001, some of the hijackers would have been identified.
In July, after fierce debate, Congress imposed new limitations on government wiretapping when it renewed the expiring Foreign Intelligence Surveillance Act (FISA) sought by President George Bush after September 11th. The main law governing data mining, this has provided the administration with broad and unprecedented electronic-spying powers. But civil-liberties lobbies such as Amnesty International and Human Rights Watch say the renewed, restricted law leaves largely untouched far-reaching secret black programmes, run by the NSA, which crunch data on great numbers of people, including millions of Americans. Much of that is personal financial information collected by the Treasury.
Mr Bush says that FISA helps protect citizens liberties while maintaining the vital flow of intelligence. Several hours after the president signed the bill into law, the ACLU filed a federal lawsuit, on the grounds that the executive branchs expanded wiretapping powers violated the constitution.
In 2001 American-led forces routed the Taliban in Afghanistan, destroying al-Qaeda training camps there. Berndt Thamm, who advises Germanys armed forces on terrorism, says that in retreat the Islamists left valuable clues about their online communications and electronic plotting. It is in following up these leads that data mining and pattern analysis can, and should, be used. Such techniques, says Mr Thamm, are the only answer to jihadist extremists. That is the argument which the strenuous objections of civil libertarians need to overcome.