US spies lag rivals in seizing on data hiding in plain sight

Jan 11, 2023, 12:22 PM | Updated: Jan 13, 2023, 2:47 am
Karolina Hird, a Russia Analyst, works at her desk at the Institute for the Study of War, Wednesday...

Karolina Hird, a Russia Analyst, works at her desk at the Institute for the Study of War, Wednesday, Jan. 11, 2023, in Washington. (AP Photo/Alex Brandon)

(AP Photo/Alex Brandon)

              George Barros, left, a Geospatial Analyst on the Russia Team, Kateryna Stepanenko, a Russia Analyst, and Karolina Hird, a Russia Analyst, pose for a photograph at the Institute for the Study of War, Wednesday, Jan. 11, 2023, in Washington. (AP Photo/Alex Brandon)
            
              George Barros, left, a Geospatial Analyst on the Russia Team, Kateryna Stepanenko, a Russia Analyst, and Karolina Hird, a Russia Analyst, pose for a photograph at the Institute for the Study of War, Wednesday, Jan. 11, 2023, in Washington. (AP Photo/Alex Brandon)
            
              George Barros, a Geospatial Analyst on the Russia Team, works at his desk at the Institute for the Study of War, Wednesday, Jan. 11, 2023, in Washington. (AP Photo/Alex Brandon)
            
              Kateryna Stepanenko, a Russia Analyst, works as her desk at the Institute for the Study of War, Wednesday, Jan. 11, 2023, in Washington. (AP Photo/Alex Brandon)
            
              Kateryna Stepanenko, a Russia Analyst, works as her desk at the Institute for the Study of War, Wednesday, Jan. 11, 2023, in Washington. (AP Photo/Alex Brandon)
            
              Kateryna Stepanenko, a Russia Analyst, works as her desk at the Institute for the Study of War, Wednesday, Jan. 11, 2023, in Washington. (AP Photo/Alex Brandon)
            
              Karolina Hird, a Russia Analyst, works at her desk at the Institute for the Study of War, Wednesday, Jan. 11, 2023, in Washington. (AP Photo/Alex Brandon)
            
              Karolina Hird, a Russia Analyst, works at her desk at the Institute for the Study of War, Wednesday, Jan. 11, 2023, in Washington. (AP Photo/Alex Brandon)

WASHINGTON (AP) — As alarms began to go off globally about a novel coronavirus spreading in China, officials in Washington turned to the intelligence agencies for insights about the threat the virus posed to America.

But the most useful early warnings came not from spies or intercepts, according to a recent congressional review of classified reports from December 2019 and January 2020. Officials were instead relying on public reporting, diplomatic cables and analysis from medical experts — some examples of so-called open source intelligence, or OSINT.

Predicting the next pandemic or the next government to fall will require better use of open source material, the review found.

“There is little indication that the Intelligence Community’s exquisite collection capabilities were generating information that was valuable to policymakers,” wrote the authors of the review, conducted by Democrats on the House Intelligence Committee.

That echoes what many current and former intelligence officials are increasingly warning: The $90 billion U.S. spy apparatus is falling behind because it has not embraced collecting open-source intelligence as adversaries including China ramp up their efforts.

This doesn’t diminish the importance of traditional intelligence. Spy agencies have unique powers to penetrate global communications and cultivate agents. They scored a high-profile success when the Biden administration publicized ultimately correct intelligence findings that Russian President Vladimir Putin intended to invade Ukraine.

But officials and experts worry that the U.S. hasn’t invested enough people or money in analyzing publicly available data or taking advantage of advanced technologies that can yield critical insights. Commercial satellite imagery, social media and other online data have given private companies and independent analysts new powers to reveal official secrets. And China is known to have stolen or acquired control over huge amounts of data on Americans, with growing concerns in Washington about Beijing’s influence over widely used apps like TikTok.

“Open source is really a bellwether for whether the intelligence community can protect the country,” said Kristin Wood, a former senior official at the CIA who is now chief executive at the Grist Mill Exchange, a commercial data platform. “We collectively as a nation aren’t preparing a defense for the ammunition that our adversaries are stockpiling.”

Intelligence agencies face several obstacles to using open source intelligence. Some are technological. Officers working on classified networks are often not able to easily access the unclassified internet or open data sources, for example. There are also concerns about civil liberties and protecting First Amendment rights.

But some experts also question whether agencies are held back by a reflexive belief that top-secret information is more valuable.

Rep. Jim Himes, a Connecticut Democrat and longtime Intelligence Committee member, said he believed there needed to be “some cultural change inside places like the CIA where people are doing what they’re doing for the excitement of stealing critical secrets as opposed to reviewing social media pages.”

In one 2017 test held by the National Geospatial-Intelligence Agency, a human team competed against a computer programmed with algorithms to identify Chinese surface-to-air missile sites using commercial imagery.

Both the humans and the computer identified 90% of the sites, Stanford University professor Amy Zegart wrote in the book “Spies, Lies, and Algorithms,” but the computer needed just 42 minutes — and it took the human team 80 times longer.

Reports created using commercial satellites, online posts and other open sources — like the daily analyses on Russian and Ukrainian military tactics published by the Institute for the Study of War — are widely read by lawmakers and intelligence officials.

“There is a lot of open-source capability that the U.S. intelligence community can pretty much rely on to be there,” said Frederick Kagan, a senior fellow at the American Enterprise Institute who oversees the creation of those reports. “What it needs to do is figure out how to leverage that ecosystem instead of trying to buy it.”

Most of the 18 U.S. spy agencies have open-source programs, from the CIA’s Open Source Enterprise to a 10-person program in the Department of Homeland Security’s intelligence arm. But top officials acknowledge there isn’t consistency across those programs in how they analyze open-source information or how they use and share it.

“We’re not paying enough attention to each other and so we’re not learning the lessons that different parts of the (intelligence community) are learning, and we’re not scaling solutions,” said Avril Haines, the U.S. director of national intelligence, at an industry event last year sponsored by the Potomac Officers Club. “And we’re not taking advantage of some of the outside expertise and information and work that could be taken advantage of.”

The Open Source Enterprise headquartered at the CIA is the successor to the Foreign Broadcast Information Service, where for generations employees monitored broadcasts to translate them for analysts.

Much of that work was transformed in the last decade. Where people once had to travel long distances to pick up tapes of radio broadcasts in remote places or areas where Americans weren’t welcome, sensors now transmit more signals automatically. And machine translation has largely taken the place of people who had to listen to the tapes and transcribe them.

But officials acknowledge they have to do more.

Haines has begun multiple open-source reviews since becoming director of national intelligence and is expected to finalize recommendations this year. Some people involved in those reviews have suggested that the Open Source Enterprise no longer be designated as leading OSINT efforts across the spy agencies, said people familiar with the reviews who spoke on condition of anonymity to discuss internal government deliberations.

Three people familiar with Open Source Enterprise say the center had cut its budget for multiple years running prior to last year. They argue that’s a sign that open-source work has not always been prioritized at a consistent level.

The CIA recently appointed new leadership for the Open Source Enterprise and in 2021 created a “mission center” dedicated to technology.

“We recognize the importance of open source is only growing as the sheer volume of data openly available increases,” the agency said in a statement. “CIA is working not just to keep pace with this trend, but to get ahead of it — and ahead of our adversaries who also utilize open-source information.”

There’s no consensus on whether the U.S. should create a new open-source agency or center. Supporters say a new organization could focus on adopting advanced technologies and creating more useful products, while opponents question whether it would be unnecessary bloat and take away resources from other agencies.

Carmen Medina, a retired CIA deputy director of intelligence, now studies how spy agencies can incorporate outside ideas and encourage employees to be more creative and intuitive.

She suggests a pilot program in which a cell of open-source analysts would compete for a number of years against the regular output of people with top-secret clearances.

Medina and others who have worked in top positions and briefed White House officials think that on most days, an open-source group would be competitive and might even produce better analysis using information that’s broadly available.

“You can’t make sense of the world today by just packaging tidbits,” she said. “I’ve come to believe that almost all of the time, the open source way of thinking about it is correct.”

Copyright © The Associated Press. All rights reserved. This material may not be published, broadcast, rewritten or redistributed.

AP

Associated Press

Belgian police seize $1.6 million in sex trafficking probe

BRUSSELS (AP) — About 1.5 million euros ($1.6 million) in cash were seized during raids in Belgium targeting an alleged criminal organization suspected of sending Chinese women to Europe and forcing them into prostitution, the federal prosecutor’s office said Wednesday. In addition, investigators took hold of four tons of coins with an unspecified value, prosecutors […]
1 day ago
Associated Press

Blaze at US drone plant in Latvia; arson not suspected

HELSINKI (AP) — Firefighters worked for a second day Wednesday to fully extinguish a blaze at a U.S. company’s drone plant in Latvia. Local police said nothing had been found so far to indicate sabotage. Latvia’s State Fire and Rescue Service was alerted Tuesday afternoon that a fire had broken out at Edge Autonomy’s drone […]
1 day ago
FILE - The Activision Blizzard Booth during the Electronic Entertainment Expo in Los Angeles, June ...
Associated Press

UK watchdog says Microsoft’s Activision deal hurts gamers

LONDON (AP) — Microsoft’s stalled $68.7 billion deal to buy video game company Activision Blizzard has hit a fresh hurdle in the United Kingdom, where the antitrust watchdog said Wednesday that it will stifle competition and hurt gamers. Britain’s Competition and Markets Authority said its in-depth investigation found that the deal could strengthen Microsoft’s position […]
1 day ago
People walk past St. John's Baptistery, one of the oldest churches in Florence, central Italy, Tues...
Associated Press

Visitors can see Florence Baptistry mosaics up close

FLORENCE, Italy (AP) — Visitors to one of Florence’s most iconic monuments — the Baptistry of San Giovanni, opposite the city’s Duomo — are getting a once-in-a-lifetime chance to see its ceiling mosaics up close thanks to an innovative approach to a planned restoration effort. Rather than limit the public’s access during the six-year cleaning […]
1 day ago
Volunteers distribute aid to people in Antakya, southern Turkey, Wednesday, Feb. 8, 2023. Thinly st...
Associated Press

Live Updates | Turkey, Syria quake is deadliest in decade

The catastrophic earthquake that razed thousands of buildings in Turkey and Syria became one of the deadliest quakes worldwide in more than a decade Wednesday and the death toll kept rising, surpassing 11,000. Rescue crews braved freezing overnight temperatures in quake-hit areas in both countries in hopes of reaching more survivors and to pull more […]
1 day ago
FILE - The Container ship Cam Cgm Arctic (MT) is moored at Maersk APM Terminals Pacific, Pier 400, ...
Associated Press

Shipper Maersk reports most profitable year, warns of drop

COPENHAGEN, Denmark (AP) — The world’s biggest shipper, Denmark’s A.P. Moeller-Maersk, said Wednesday that 2022 was its most profitable year in “the history of the company” but warned that a plunge in container volumes and freight rates would lead to a drop in earnings this year. Full-year revenue increased by 32%, to $81.5 billion from […]
1 day ago

Sponsored Articles

safety from crime...

As crime increases, our safety measures must too

It's easy to be accused of fearmongering regarding crime, but Seattle residents might have good reason to be concerned for their safety.
Comcast Ready for Business Fund...
Ilona Lohrey | President and CEO, GSBA

GSBA is closing the disparity gap with Ready for Business Fund

GSBA, Comcast, and other partners are working to address disparities in access to financial resources with the Ready for Business fund.
SHIBA WA...

Medicare open enrollment is here and SHIBA can help!

The SHIBA program – part of the Office of the Insurance Commissioner – is ready to help with your Medicare open enrollment decisions.
Lake Washington Windows...

Choosing Best Windows for Your Home

Lake Washington Windows and Doors is a local window dealer offering the exclusive Leak Armor installation.
Anacortes Christmas Tree...

Come one, come all! Food, Drink, and Coastal Christmas – Anacortes has it all!

Come celebrate Anacortes’ 11th annual Bier on the Pier! Bier on the Pier takes place on October 7th and 8th and features local ciders, food trucks and live music - not to mention the beautiful views of the Guemes Channel and backdrop of downtown Anacortes.
Swedish Cyberknife Treatment...

The revolutionary treatment of Swedish CyberKnife provides better quality of life for majority of patients

There are a wide variety of treatments options available for men with prostate cancer. One of the most technologically advanced treatment options in the Pacific Northwest is Stereotactic Body Radiation Therapy using the CyberKnife platform at Swedish Medical Center.
US spies lag rivals in seizing on data hiding in plain sight