Studies of the role of intelligence operations inevitably have a Rashomon-like quality, with the same events yielding various, sometimes contradictory, interpretations. The world of intelligence, after all, is one of secrets, special-access compartments, covert action, clandestine relationships and occasionally off-the-books escapades. This makes it very difficult to assess successes and failures, and to chronicle the role of intelligence in political leaders’ decisions.
Harvard historian Calder Walton confronts this challenge head on in a new book, Spies: The Epic Intelligence War Between East and West, which recounts the rise and role of modern intelligence capabilities through the history of the West’s competition with the Russian security services. It is an ambitious and entertaining story, but one that is also firmly grounded in academic research.
Walton’s account sheds new light on seemingly well-studied events, from the Bolshevik Revolution and World War II to the deployment of moles in the ranks of US, British, and Russian intelligence services at the end of the century.
Illustration: Tania Chou
Walton draws on newly opened archives, formerly classified in-house histories, memoirs, and interviews with policymakers and spies. He illuminates how intelligence contributed to episodes like the 1962 Cuban Missile Crisis and the 1983 Able Archer incident, when a NATO drill triggered Soviet fears of a Western first strike, bringing the world to the brink of nuclear war.
However, Walton does more than add previously secret details to old accounts. In an example of “applied history,” he uses his examination of the past to weigh in on current events, such as the Ukraine war, and raise important questions about the future, including whether Western intelligence can prevail against China in the new cold war.
Spies details the rise and role of Russia’s intelligence services, from Vladimir Lenin’s Cheka to Joseph Stalin’s KGB to their post-Soviet incarnations. It offers new insights into their domestic and international missions, from the murderous role of the People’s Commissariat for Internal Affairs (NKVD), the KGB’s predecessor, in Stalin’s Great Purge to the penetration of the Manhattan Project by Soviet spies gathering secrets vital to Moscow’s nuclear breakthrough. It describes how the SVR and the FSB, the KGB’s successors, still use a Soviet-era playbook to guide their espionage, disinformation, and covert action abroad and repression at home.
Thanks to Russian President Vladimir Putin — a former KGB man himself — KGB alumni dominate the Russian elite, including its corrupt economic oligarchy, and lead the powerful coercive institutions that are transforming Russia into an authoritarian security state. Whatever their labels, Russia’s security services have formed the backbone of its ruling regimes in the 20th and 21st centuries.
However, as Walton demonstrates, Russia’s intelligence services have always had significant deficiencies, rooted not least in a totalitarian culture that has made it impossible to speak truth to power. From the deadly purges that reached deep into the NKVD in the 1930s to the top-down decisionmaking in Putin’s Kremlin, the message to the rank and file has remained simple: Say what your leader wants to hear, because unvarnished reporting and analysis can have deadly — not just career-ending — consequences.
The crippling conformity that characterized Soviet intelligence assessments meant that they played at most a marginal role in the Kremlin’s Cold War decisionmaking, Walton says.
The disconnect between approved narratives and reality has also led to signature strategic failures, such as Stalin’s rejection of intelligence warning of Hitler’s impending invasion in 1941 and Putin’s disastrous decision to invade Ukraine last year.
Walton’s historical perspective also provides a valuable framework for assessing the performance of Russia’s Western counterparts. From the outset, he argues, Western leaders only belatedly recognized the vulnerabilities of their open societies and the magnitude of the threat posed by Soviet intelligence.
In fact, US intelligence got off to a rocky start. When the CIA was created in 1947, then-chairman of the US Joint Chiefs of Staff Omar Bradley was angry that he was not put in charge. So, he teamed up with then-FBI Director J. Edgar Hoover, himself no fan of the intelligence start-up, to keep the CIA’s director at the time, Roscoe Hillenkoetter, in the dark. Hillenkoetter was thus not informed of the top-secret Venona project or the revelations of far-reaching Soviet spying, before, during, and after World War II, that the program’s cryptologists produced. This US intelligence “mess,” as Walton aptly calls it, lasted until 1952.
Of course, bureaucratic rivalries and political infighting continued, even as the US intelligence community matured. However, popular ambivalence has also affected the trajectory of US intelligence services, owing to disagreements about their role in a democracy, together with decades of controversy, from failed covert-action programs and proxy wars abroad to abuses of power at home.
As a changing world transforms the security landscape, national leaders would need public cooperation. However, deep polarization and growing popular distrust in government, exemplified by (but not confined to) those who believe former US president Donald Trump’s claims about the mythical “deep state,” pose significant hurdles and threaten US democracy and the country’s international role.
While Walton acknowledges this danger, he is far more concerned about the threat China poses in an increasingly technology-driven world. Here, Walton does not mince words. US leaders, he contends, have ignored China’s massive, multi-front intelligence offensive, underfunding collection and counterintelligence, and underplaying the economic, technological, and strategic challenge the country poses.
“If I were to situate where we ... are [regarding China] today,” he writes, “I would place us at approximately the year 1947.”
That said, Walton’s case for action on China lacks the depth of analysis that buttresses his judgements about Russia. His recommendations for future intelligence efforts — based on “lessons” from the past 100 years — are thought-provoking, though less than persuasive.
“The age of the secret service is over,” he writes in his conclusion. “In a world that will be increasingly dominated by open-source information, the future of intelligence lies in the private sector, not with governments.”
Maybe so, but Walton’s faith in technology as the intelligence world’s silver bullet, and in the power of persuasion to enlist corporations that demonstrate daily their reluctance to leave the Chinese market, merit skepticism.
As Walton notes, history might not repeat itself, but it does, as Mark Twain quipped, sometimes rhyme. Whether high-tech tools and open-source collection or classic espionage will deliver what countries need remains to be seen.
However, one thing is certain: In any democratic society, popular and political support for intelligence is vital. The success of any intelligence service begins at home.
Kent Harrington, a former senior CIA analyst, served as US intelligence officer for East Asia, chief of station in Asia and the CIA’s director of public affairs.
Copyright: Project Syndicate
As Taiwan’s domestic political crisis deepens, the opposition Chinese Nationalist Party (KMT) and Taiwan People’s Party (TPP) have proposed gutting the country’s national spending, with steep cuts to the critical foreign and defense ministries. While the blue-white coalition alleges that it is merely responding to voters’ concerns about corruption and mismanagement, of which there certainly has been plenty under Democratic Progressive Party (DPP) and KMT-led governments, the rationales for their proposed spending cuts lay bare the incoherent foreign policy of the KMT-led coalition. Introduced on the eve of US President Donald Trump’s inauguration, the KMT’s proposed budget is a terrible opening
The Chinese Nationalist Party (KMT) caucus in the Legislative Yuan has made an internal decision to freeze NT$1.8 billion (US$54.7 million) of the indigenous submarine project’s NT$2 billion budget. This means that up to 90 percent of the budget cannot be utilized. It would only be accessible if the legislature agrees to lift the freeze sometime in the future. However, for Taiwan to construct its own submarines, it must rely on foreign support for several key pieces of equipment and technology. These foreign supporters would also be forced to endure significant pressure, infiltration and influence from Beijing. In other words,
“I compare the Communist Party to my mother,” sings a student at a boarding school in a Tibetan region of China’s Qinghai province. “If faith has a color,” others at a different school sing, “it would surely be Chinese red.” In a major story for the New York Times this month, Chris Buckley wrote about the forced placement of hundreds of thousands of Tibetan children in boarding schools, where many suffer physical and psychological abuse. Separating these children from their families, the Chinese Communist Party (CCP) aims to substitute itself for their parents and for their religion. Buckley’s reporting is
Last week, the Chinese Nationalist Party (KMT) and the Taiwan People’s Party (TPP), together holding more than half of the legislative seats, cut about NT$94 billion (US$2.85 billion) from the yearly budget. The cuts include 60 percent of the government’s advertising budget, 10 percent of administrative expenses, 3 percent of the military budget, and 60 percent of the international travel, overseas education and training allowances. In addition, the two parties have proposed freezing the budgets of many ministries and departments, including NT$1.8 billion from the Ministry of National Defense’s Indigenous Defense Submarine program — 90 percent of the program’s proposed