Data Mining Update

A week ago, I voiced my concerns on this site (in a post entitled “What’s Mine Is Not Necessarily Yours�) about the Bush Administration’s use of data mining technologies and the ways such would very likely infringe on the privacy of each and every one of us. Now, as reported in today’s Christian Science Monitor, there is alarming news that the government is moving forward in implementing these technologies and doing so without adequate oversight or privacy protections. Here is a brief excerpt from the article, entitled “U.S. Plans Massive Data Sweep�:

The US government is developing a massive computer system that can collect huge amounts of data and, by linking far-flung information from blogs and e-mail to government records and intelligence reports, search for patterns of terrorist activity.

The system – parts of which are operational, parts of which are still under development – is already credited with helping to foil some plots. It is the federal government’s latest attempt to use broad data-collection and powerful analysis in the fight against terrorism. But by delving deeply into the digital minutiae of American life, the program is also raising concerns that the government is intruding too deeply into citizens’ privacy.

“We don’t realize that, as we live our lives and make little choices, like buying groceries, buying on Amazon, Googling, we’re leaving traces everywhere,” says Lee Tien, a staff attorney with the Electronic Frontier Foundation. “We have an attitude that no one will connect all those dots. But these programs are about connecting those dots – analyzing and aggregating them – in a way that we haven’t thought about. It’s one of the underlying fundamental issues we have yet to come to grips with.”

The core of this effort is a little-known system called Analysis, Dissemination, Visualization, Insight, and Semantic Enhancement (ADVISE). Only a few public documents mention it. ADVISE is a research and development program within the Department of Homeland Security (DHS), part of its three-year-old “Threat and Vulnerability, Testing and Assessment” portfolio. The TVTA received nearly $50 million in federal funding this year. more…