2013 to 2019: The disclosures · Surveillance & Privacy

What Edward Snowden's NSA Documents Revealed

Period covered: 2013 to 2018 · 17 sources

Summary

In 2013 a contractor at the National Security Agency gave reporters thousands of internal documents. They show the government collecting the phone records of every Verizon customer, taking email and files from the servers of Google, Facebook, and Apple, working to break the encryption that protects the internet, and logging thousands of violations of its own rules in a year.

On June 5, 2013, the Guardian published a four page court order. It came from the Foreign Intelligence Surveillance Court, the secret court that approves government surveillance requests, and it was addressed to Verizon Business Network Services. The order required Verizon to hand over to the National Security Agency, every day, "all call detail records or telephony metadata" for calls "wholly within the United States, including local telephone calls," and for calls between the United States and other countries. That means the numbers on both ends of every call, the time, the length, and the identifiers of the phones. It did not cover the words spoken on the calls or the names of the customers. Verizon was barred from telling anyone the order existed. It was signed by Judge Roger Vinson on April 25, 2013 and ran until July 19.

Four days later the Guardian named the source, at his own request. Edward Snowden was 29, a contractor for Booz Allen Hamilton working at an NSA facility in Hawaii. He had copied the documents and given them to reporters from the Guardian and the Washington Post. The papers published them over the next five years, and other outlets in Germany, France, Brazil, Spain, Norway, the Netherlands, and elsewhere published the ones that concerned their countries. The Snowden Archive holds every published document in chronological order.

PRISM

The day after the Verizon order, the Washington Post and the Guardian published slides from an NSA presentation dated April 2013 on a program called PRISM. The slides describe collection "directly from the servers" of nine American companies: Microsoft, Yahoo, Google, Facebook, PalTalk, YouTube, Skype, AOL, and Apple. What the agency gets, the slides say, varies by provider but in general includes email, chat including video and voice, videos, photos, stored data, internet phone calls, file transfers, video conferencing, notifications of target activity such as logins, and social networking details. One slide gives the date each company came on: Microsoft in September 2007, Yahoo in March 2008, Google in January 2009, Facebook in June 2009, PalTalk in December 2009, YouTube in September 2010, Skype in February 2011, AOL in March 2011, and Apple in October 2012. The program cost about $20 million a year. Another slide explains why the agency collects inside the United States: much of the world's communications flow through the country, because a message takes the cheapest path and not the most direct one.

A slide published in July shows that PRISM was one of two kinds of collection under Section 702 of the FISA Amendments Act. The other, called upstream, is collection "on fiber cables and infrastructure as data flows past," under the program names FAIRVIEW, STORMBREW, BLARNEY, and OAKSTAR.

The rules for Americans

Section 702 is supposed to be aimed at foreigners outside the United States. Two sets of procedures signed by the attorney general in 2009 and published by the Guardian on June 20, 2013 show how that works in practice. The targeting procedures say an analyst decides whether a target is foreign by looking at "the totality of the circumstances," using the lead that brought the target to the agency's attention, research in NSA databases, and technical analysis of the account. When there is no specific information either way, a person "reasonably believed to be located outside the United States or whose location is not known will be presumed to be a non-United States person."

The minimization procedures cover what happens to Americans' communications that get picked up anyway. A communication between two people in the United States is supposed to be destroyed when it is recognized, unless the director of the NSA decides in writing that it contains significant foreign intelligence, evidence of a crime, information about a security vulnerability, or a threat of serious harm. Communications of Americans that are kept can be held for five years, and encrypted communications can be held for as long as they are of use in breaking the encryption. Evidence of a crime can be handed to law enforcement.

The audit

In August 2013 the Washington Post published an internal NSA audit, a quarterly report from the oversight office of the Signals Intelligence Directorate dated May 3, 2012. It counts the times the agency broke its own rules or a court order: 546 incidents in the second quarter of 2011, 588 in the third, 777 in the fourth, and 865 in the first quarter of 2012. That is 2,776 in a year. The report says the number rose 11 percent in the last quarter, that most incidents in every category were database queries that went wrong through human error, and that one directorate, S2, accounted for 89 percent of them. Of the 195 incidents under FISA that quarter, 185 involved unintentional collection. The most common cause was analysts working with "inaccurate or insufficient research information," followed by failure to follow standard procedures. Some incidents were "roamers," foreign targets whose phones showed up in the United States. The report attributes an increase in those to Chinese travel for the Lunar New Year holiday.

A one page training aid published with the audit, titled "So you got U.S. Person Information?", tells analysts what to do in each case. If they targeted an American on purpose or by mistake, they stop, cancel the reports, notify a supervisor, and write it up. If they targeted a foreigner and got an American's communications along the way, that is "incidental," it "does not constitute a violation," and it does not have to be reported.

Chaining through Americans

A Justice Department memo from November 20, 2007, published by the Guardian on June 27, 2013, asked the attorney general to approve a change in how the NSA analyzes metadata, the records of who called or emailed whom. Until then, when the agency built a chain of contacts out from a target, its practice was to stop when the chain reached a number or address believed to belong to an American. The memo says the agency believed it was "over-identifying" Americans and wanted permission to chain through them. An internal NSA newsletter from January 2011, published by the New York Times, announces that the new procedures were signed in November 2010 and that analysts could now do contact chaining "from and through any selector, irrespective of nationality or location." It says analysts had already been using the method for a year and a half under a pilot program.

Counting it all

Two documents published on June 8, 2013 describe a tool the agency built to count its own collection. Boundless Informant reads every valid metadata record passing through the NSA's systems and shows, on a map, how many records were collected against each country. The FAQ says it was built because the old way of finding out what the agency collected was to send around a data call or "ask a 30-year SIGINTer." The tool counts records only, not content, and it does not count FISA data or programs like MUSCULAR that store their data elsewhere.

Breaking encryption

On September 5, 2013 the Guardian published a classification guide for a program called BULLRUN, dated June 16, 2010. It describes "NSA's abilities to defeat the encryption used in specific network communication technologies," using computer network exploitation, interdiction, "industry relationships," collaboration with other agencies, and mathematics. It lists, as a fact classified top secret, that the agency has "some capabilities against the encryption in TLS/SSL, HTTPS, SSH, VPNs, VoIP, WEBMAIL, and other network communication technologies." Those are the systems that protect online banking, email, and every website with a padlock in the address bar.

Inside Google

On October 30, 2013 the Washington Post published a slide from a presentation by the NSA's Special Source Operations. It is titled "Current Efforts - Google" and it is a hand drawn sketch: the public internet on one side, Google's cloud on the other, and the Google front end server between them. An arrow points to the spot where "SSL added and removed here," with a smiley face drawn next to it. On the Google side the note reads "traffic in clear text here." The program, called MUSCULAR and run with the British agency GCHQ, took the traffic from the links between Google's and Yahoo's data centers overseas, where it was not encrypted. A second document, speaker's notes from a briefing, says MUSCULAR was pulling in so much archived Yahoo email that target offices complained it was "diluting" their work. The archived mail was a quarter of the site's daily collection, and 59 percent of it had been sent more than six months earlier.

Tor

On October 4, 2013 the Guardian published a presentation titled "Tor Stinks" from a joint NSA and GCHQ workshop on the anonymity network. The first slide says "We will never be able to de-anonymize all Tor users all the time," and that with manual analysis the agencies could identify "a very small fraction" of users but had never identified a specific user on demand. The rest of the slides list the methods tried, including cookie leakage, attacks on the web browser, and a category labeled "dumb users."

Using what they find

A document published by the Huffington Post on November 26, 2013 shows one use of the collection. The NSA assessment, drawing on communications collected between January 2008 and September 2012, looks at six "radicalizers," people it considered influential preachers of extremism, and identifies "vulnerabilities" that could be used to discredit them. The list includes "viewing sexually explicit material online," using donations to cover personal expenses, and charging high speaking fees. The document notes that very few of the contacts of the English language radicalizers were associated with terrorism.

A 2006 item from the agency's internal newsletter, published by the Guardian on October 24, 2013, says a U.S. official gave the NSA 200 phone numbers for 35 world leaders. The agency tasked the numbers for collection and asked its staff to find more officials willing to share their contact lists.

The Fourth Amendment says the right of the people to be secure in their persons, houses, papers, and effects against unreasonable searches shall not be violated, and that a warrant must describe the particular place to be searched and the things to be seized. The Verizon order names no suspect and no place. It applies to every call the company connected. Every published document is in the Snowden Archive, readable in full and downloadable.

← 2013 to 2019

Primary Sources (17)

Documents, court filings, official reports, and broadcasts cited in this report.

2013
Published by The Guardian. Orders daily production to the NSA of all call records, including calls wholly within the United States. On this site.
2013
Published by The Washington Post. Collection directly from the servers of nine U.S. companies, the date each joined, and the cost of about $20 million a year. On this site.
2013
Published by The Guardian. On this site.
2013
The Guardian. Snowden identifies himself as the source of the documents.
2013
Published by The Guardian. What happens to Americans' communications that are collected, including the five year retention and the exceptions for keeping domestic communications. On this site.
2013
Published by The Guardian. How an analyst decides a target is foreign, including the presumption when location is unknown. On this site.
2013
Published by The Washington Post. On this site.
2013
Published by The Washington Post. The internal audit counting 546, 588, 777, and 865 incidents across four quarters, 2,776 in all. On this site.
2013
Published by The Guardian. On this site.
2013
Published by The Guardian. On this site.
2013
Published by The Washington Post. The hand drawn slide with the note SSL added and removed here. On this site.
2013
Published by The Huffington Post. On this site.

Documented Records (13)

Chronological entries extracted from the primary sources above.

2006
October 27, 2006
An NSA newsletter reported that a U.S. official had given the agency 200 phone numbers for 35 world leaders, that the numbers were tasked for collection, and that the agency wanted staff to find more officials willing to share their contact lists.
“In one recent case, a US official provided NSA with 200 phone numbers to 35 world leaders.”
NSA. Violates: None in law. Listed for the record.. Source: Customers Can Help SID Obtain Targetable Phone Numbers (NSA internal newsletter, October 27, 2006), Published by The Guardian
2007
November 20, 2007
The Justice Department asked the attorney general to let the NSA analyze the phone and email metadata of Americans and chain contacts through them. The agency's practice had been to stop a chain when it reached a number believed to belong to an American. The memo says the NSA believed it was over identifying Americans.
“NSA believes that it is over-identifying numbers and addresses that belong to United States persons”
Justice Department National Security Division, NSA. Violates: Fourth Amendment. Source: Justice Department memorandum to the Attorney General on NSA analysis of communications metadata of persons in the United States (November 20, 2007), Published by The Guardian
2009
2009
Under the NSA's targeting procedures for Section 702, a person whose location is not known is presumed to be foreign unless there is specific information otherwise, and the decision rests on an analyst's reading of the totality of the circumstances.
“a person reasonably believed to be located outside the United States or whose location is not known will be presumed to be a non-United States person”
NSA, Attorney General. Violates: The requirement that Section 702 be aimed only at foreigners abroad. Source: NSA targeting procedures under Section 702 of FISA (Exhibit A, 2009), Published by The Guardian
2009
Under the minimization procedures, a communication between two people in the United States that is picked up is to be destroyed unless the director of the NSA decides in writing to keep it, for reasons that include evidence of any crime. Communications of Americans that are kept can be held five years, and encrypted ones for as long as they are useful for breaking the encryption.
“A communication identified as a domestic communication will be promptly destroyed upon recognition unless the Director (or Acting Director) of NSA specifically determines, in writing, that...”
NSA, Attorney General. Violates: Fourth Amendment. Source: NSA minimization procedures under Section 702 of FISA (Exhibit B, 2009), Published by The Guardian
2010
June 16, 2010
The classification guide for a program called BULLRUN lists as top secret the fact that the NSA has capabilities against the encryption in TLS/SSL, HTTPS, SSH, VPNs, VoIP, and webmail, the systems that protect online banking, email, and every website with a padlock. The program uses computer network exploitation, interdiction, and industry relationships.
“NSA/CSS has some capabilities against the encryption in TLS/SSL, HTTPS, SSH, VPNs, VoIP, WEBMAIL, and other network communication technologies”
NSA Cryptanalysis and Exploitation Services. Violates: None in law. Listed for what it means for every encrypted connection.. Source: Project BULLRUN classification guide (June 16, 2010), Published by The Guardian
November 29, 2010
The NSA signed a directive letting analysts chain contacts from and through any phone number or email address regardless of nationality or location. An internal newsletter said analysts had already been doing it for a year and a half under a pilot program.
“these new procedures permit contact chaining, and other analysis, from and through any selector, irrespective of nationality or location”
NSA Signals Intelligence Directorate. Violates: Fourth Amendment. Source: New Contact-Chaining Procedures to Allow Better, Faster Analysis (NSA internal newsletter, January 3, 2011), Published by The New York Times
2011
November 2011
An NSA training aid tells analysts that collecting an American's communications while targeting a foreigner is incidental, is not a violation, and does not have to be reported to the inspector general.
“This does not constitute a USSID SP0018 violation, so it does not have to be reported in the IG quarterly.”
NSA. Violates: Fourth Amendment. Source: Lesson 4: So you got U.S. Person Information? (NSA training aid, revised November 2011), Published by The Washington Post
2012
May 3, 2012
The NSA's own quarterly oversight report counted 546, 588, 777, and 865 incidents of the agency breaking its rules or a court order over four quarters, 2,776 in a year, and said most were database queries that went wrong through human error. One directorate accounted for 89 percent of them.
“The majority of incidents in all authorities were database query incidents due to human error.”
NSA Signals Intelligence Directorate. Violates: Executive Order 12333, FISA, and the agency's own procedures, by its own count. Source: NSAW SID Intelligence Oversight Quarterly Report, first quarter 2012 (May 3, 2012), Published by The Washington Post
2012
A joint NSA and GCHQ presentation on the Tor anonymity network says the agencies will never be able to identify all Tor users all the time and had never identified a specific user on demand, and lists the methods tried, including cookie leakage and attacks on the web browser.
“We will never be able to de-anonymize all Tor users all the time.”
NSA, GCHQ. Violates: None in law. Listed for the record.. Source: Tor Stinks (NSA and GCHQ presentation), Published by The Guardian
2012
An NSA assessment identified vulnerabilities that could be used to discredit six people it considered radicalizers, including viewing sexually explicit material online and using donations for personal expenses. It notes that very few of the contacts of the English language radicalizers were associated with terrorism.
“Viewing sexually explicit material online or using sexually explicit persuasive language when communicating with inexperienced young girls”
NSA. Violates: None in law claimed. Listed for the use of collected material.. Source: NSA SIGINT assessment on the vulnerabilities of radicalizers (2012), Published by The Huffington Post
2013
2013
A hand drawn NSA slide titled Current Efforts - Google shows where the agency, in a program called MUSCULAR run with GCHQ, took traffic from the links between Google's data centers, where it was not encrypted. The note at the spot reads SSL added and removed here, with a smiley face. Speaker's notes from a briefing say archived Yahoo email from the program was a quarter of the site's daily collection and that 59 percent of it was more than six months old.
“SSL added and removed here! Traffic in clear text here.”
NSA Special Source Operations, GCHQ. Violates: None in U.S. law claimed by the agency, since the taps were overseas. Listed for what was taken.. Source: Special Source Operations slide, Current Efforts - Google, Published by The Washington Post
2007 to 2012
NSA slides from April 2013 describe PRISM, collection directly from the servers of Microsoft, Yahoo, Google, Facebook, PalTalk, YouTube, Skype, AOL, and Apple: email, chat, videos, photos, stored data, internet calls, file transfers, and notifications of logins. Microsoft joined in September 2007 and Apple in October 2012. The program cost about $20 million a year.
“Collection directly from the servers of these U.S. Service Providers: Microsoft, Yahoo, Google, Facebook, PalTalk, AOL, Skype, YouTube, Apple.”
NSA, nine technology companies. Violates: Fourth Amendment. Source: PRISM/US-984XN overview slides (April 2013), Published by The Washington Post
April 25, 2013
The Foreign Intelligence Surveillance Court ordered Verizon Business Network Services to give the NSA, every day, the records of every call on its network, including calls wholly within the United States and local calls: the numbers on both ends, the time, the length, and the phone identifiers. The order barred Verizon from disclosing it. It was signed by Judge Roger Vinson and ran until July 19, 2013.
“all call detail records or "telephony metadata" created by Verizon for communications (i) between the United States and abroad; or (ii) wholly within the United States, including local telephone calls.”
Foreign Intelligence Surveillance Court, FBI, NSA. Violates: Fourth Amendment requirement that a warrant describe the particular place to be searched and the things to be seized. Source: Foreign Intelligence Surveillance Court secondary order to Verizon Business Network Services (April 25, 2013), Published by The Guardian

Timeline Events (6)

Dated events from this investigation in the site timeline.

October 30, 2013
MUSCULAR: the NSA taps the lines between Google's data centers
A hand drawn slide marks the spot where encryption is added and removed, with a smiley face.
September 5, 2013
BULLRUN: the NSA's program against internet encryption
A classification guide lists the agency's capabilities against TLS/SSL, HTTPS, SSH, VPNs, VoIP, and webmail.
August 16, 2013
NSA audit shows 2,776 rule violations in a year
The Washington Post published the agency's own quarterly oversight report from May 2012. Most of the incidents were database queries that went wrong through human error.
June 9, 2013
Edward Snowden identifies himself as the source
A 29 year old contractor for Booz Allen Hamilton at an NSA facility in Hawaii, he asked the Guardian to name him.
June 6, 2013
PRISM slides published
NSA slides describe collection directly from the servers of Microsoft, Yahoo, Google, Facebook, PalTalk, YouTube, Skype, AOL, and Apple, at a cost of about $20 million a year.
June 5, 2013
The Guardian publishes a secret court order for every Verizon call record
The order from the Foreign Intelligence Surveillance Court required Verizon to hand over the records of all calls on its network, including local calls, every day, and barred the company from saying so. It was the first of the documents from Edward Snowden.
What Edward Snowden's NSA Documents Revealed | Spirit of '76