Machines Like Us

In the chaotic early months of his second term, Donald Trump has attacked the Canadian economy and mused about turning Canada into the “51st state.” Now, after decades of close allyship with the U.S., our relationship with America has suddenly become fraught. Which means that Canadians are now starting to ask what a more sovereign Canada might look like – a question Jim Balsillie has been thinking about for 30 years. Balsillie is the former co-CEO of Research in Motion, the company that developed the Blackberry, and is one of the most successful business people in Canada. He’s also one of the patriotic, which makes his recent criticism of our country that much more meaningful. As Balsillie has pointed out, our GDP per capita is currently about 70% of what it is in the U.S., our productivity growth has been abysmal for years, and our high cost of living means that 1 in 4 Canadians are now food insecure.

But, according to Balsillie, none of this can be blamed on Trump. He thinks that over the last thirty years we’ve clung to an outdated economic model and have allowed our politics to be captured by corporate interests.

So, with less than a week to go before the federal election, I thought it was the perfect time to sit down with Jim and ask him how we might build a stronger, more sovereign Canada.

Mentioned:

“Agreement on Trade-Related Aspects of Intellectual Property Rights (TRIPS),” The World Trade Organization

“Reinforcing Canada’s security and sovereignty in the Arctic,” Prime Minister of Canada

“Ontario Welcomes Siemens’ $150 Million Investment to Establish New Technology Centre in Oakville,” news release from the Government of Ontario

Further Reading:

“We are all economic nationalists now,” by Jim Balsillie (National Post)

We have a really exciting episode coming out on Tuesday: an interview with former RIM co-CEO Jim Balsillie about the fight for Canada’s economic sovereignty. 

In the meantime, we wanted to share a conversation between Taylor and political journalist Paul Wells. Every week, Paul sits down with the people trying to solve the biggest problems in Canada and around the world. And this week, that person is Taylor. 

He joins Paul to discuss his work on election interference and share his wish list for the next government’s digital policy.

We’re a few weeks into a federal election that is currently too close to call. And while most Canadians are wondering who our next Prime Minister will be, my guests today are preoccupied with a different question: will this election be free and fair?

In her recent report on foreign interference, Justice Marie-Josée Hogue wrote that “information manipulation poses the single biggest risk to our democracy”. Meanwhile, senior Canadian intelligence officials are predicting that India, China, Pakistan and Russia will all attempt to influence the outcome of this election. To try and get a sense of what we’re up against, I wanted to get two different perspectives on this. My colleague Aengus Bridgman is the Director of the Media Ecosystem Observatory, a project that we run together at McGill University, and Nina Jankocwicz is the co-founder and CEO of the American Sunlight Project. Together, they are two of the leading authorities on the problem of information manipulation.

Mentioned:

“Public Inquiry Into Foreign Interference in Federal Electoral Processes and Democratic Institutions,” by the Honourable Marie-Josée Hogue
"A Pro-Russia Content Network Foreshadows the Automated Future of Info Ops,” by the American Sunlight Project

Further Reading:

“Report ties Romanian liberals to TikTok campaign that fueled pro-Russia candidate,” by Victor Goury-Laffont (Politico)

“2025 Federal Election Monitoring and Response,” by the Canadian Digital Media Research Network

“Election threats watchdog detects Beijing effort to influence Chinese Canadians on Carney,” by Steven Chase (Globe & Mail)

“The revelations and events that led to the foreign-interference inquiry,” by Steven Chase and Robert Fife (Globe & Mail)

“Foreign interference inquiry finds ‘problematic’ conduct,” by The Decibel

If you’re having a conversation about the state of journalism, it’s bound to get a little depressing. 

Since 2008, more than 250 local news outlets have closed down in Canada. The U.S. has lost a third of the newspapers they had in 2005. But this is about more than a failing business model. Only 31 percent of Americans say they trust the media. In Canada, that number is a little bit better – but only a little. 

The problem is not just that people are losing their faith in journalism. It’s that they’re starting to place their trust in other, often more dubious sources of information: TikTok influencers, Elon Musk’s X feed, and The Joe Rogan Experience. 

The impact of this shift can be seen almost everywhere you look. 15 percent of Americans believe climate change is a hoax. 30 percent believe the 2020 election was stolen. 10 percent believe the earth is flat. 

A lot of this can be blamed on social media, which crippled journalism's business model and led to a flourishing of false information online. But not all of it. People like Jay Rosen have long argued that journalists themselves are at least partly responsible for the post-truth moment we now find ourselves in. 

Rosen is a professor of journalism at NYU who’s been studying, critiquing, and really shaping, the press for nearly 40 years. He joined me a couple of weeks ago at the Attention conference in Montreal to explain how we got to this place – and where we might go from here. 

A note: we recorded this interview before the Canadian election was called, so we don’t touch on it here. But over the course of the next month, the integrity of our information ecosystem will face an inordinate amount of stress, and conversations like this one will be more important than ever. 
 

Mentioned:
"Digital News Report Canada 2024 Data: An Overview," by Colette Brin, Sébastien Charlton, Rémi Palisser, Florence Marquis 

"America’s News Influencers,"  by Galen Stocking, Luxuan Wang, Michael Lipka, Katerina Eva Matsa,Regina Widjaya,Emily Tomasik andJacob Liedke

Further Reading: 

"Challenges of Journalist Verification in the Digital Age on Society: A Thematic Review," Melinda Baharom, Akmar Hayati Ahmad Ghazali, Abdul Muati, Zamri Ahmad

"Making Newsworthy News: The Integral Role of Creativity and Verification in the Human Information Behavior that Drives News Story Creation," Marisela Gutierrez Lopez, Stephann Makri, Andrew MacFarlane, Colin Porlezza, Glenda Cooper, Sondess Missaoui

"The Trump Administration and the Media (2020)," by Leonard Downie Jr. for the Committee to Protect Journalists.

When the American company OpenAI released ChatGPT, it was the first time that a lot of people had ever interacted with Generative AI. ChatGPT has become so popular that, for many, it’s now synonymous with artificial intelligence.

But that may be changing. Earlier this year a Chinese startup called DeepSeek launched its own AI chatbot, sending shockwaves across Silicon Valley. According to DeepSeek, their model – DeepSeek-R1 – is just as powerful as ChatGPT but was developed at a fraction of the cost. In other words, this isn’t just a new company, it could be an entirely different approach to building artificial intelligence.

To try and understand what DeepSeek means for the future of AI, and for American innovation, I wanted to speak with Karen Hao. Hao was the first reporter to ever write a profile on OpenAI and has covered AI for The MIT Tech Review, The Atlantic and the Wall Street Journal. So she’s better positioned than almost anyone to try and make sense of this seemingly monumental shift in the landscape of artificial intelligence.

Mentioned:

“The messy, secretive reality behind OpenAI’s bid to save the world,” by Karen Hao

Further Reading:

“DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning,” by DeepSeek-AI and others.

“A Comparison of DeepSeek and Other LLMs,” by Tianchen Gao, Jiashun Jin, Zheng Tracy Ke, Gabriel Moryoussef

“Technical Report: Analyzing DeepSeek-R1′s Impact on AI Development,” by Azizi Othman

Do I have your attention right now? I’m guessing probably not. Or, at least, not all of it. In all likelihood, you’re listening to this on your morning commute, or while you wash the dishes or check your e-mail.

We are living in a world of perpetual distraction. There are more things to read, watch and listen to than ever before – but our brains, it turns out, can only absorb so much. Politicians like Donald Trump have figured out how to exploit this dynamic. If you’re constantly saying outrageous things, it becomes almost impossible to focus on the things that really matter. Trump’s former strategist Steve Bannon called this strategy “flooding the zone.”

As the host of the MSNBC show All In, Chris Hayes has had a front-row seat to the war for our attention – and, now, he’s decided to sound the alarm with a new book called The Sirens’ Call: How Attention Became the World’s Most Endangered Resource.

Hayes joined me to explain how our attention became so scarce, and what happens to us when we lose the ability to focus on the things that matter most.

Mentioned:

"Twitter and Tear Gas: The Power and Fragility of Networked Protest," by Zeynep Tufekci

Further Reading:

"Ethics of the Attention Economy: The Problem of Social Media Addiction," by Vikram R. Bhargava and Manuel Velasquez.

"The Attention Economy Labour, Time and Power in Cognitive Capitalism," by Claudio Celis Bueno

“The business of news in the attention economy: Audience labor and MediaNews Group’s efforts to capitalize on news consumption,” Brice Nixon

It’s become pretty easy to spot phishing scams: UPS orders you never made, banking alerts from companies you don’t bank with, phone calls from unfamiliar area codes. But over the past decade, these scams – and the technology behind them – have become more sophisticated, invasive and sinister, largely due to the rise of something called ‘mercenary spyware.’

The most potent version of this tech is Pegasus, a surveillance tool developed by an Israeli company called NSO Group. Once Pegasus infects your phone, it can see your texts, track your movement, and download your passwords – all without you realizing you’d been hacked.

We know a lot of this because of Ron Deibert. Twenty years ago, he founded Citizen Lab, a research group at the University of Toronto that has helped expose some of the most high profile cases of cyber espionage around the world.

Ron has a new book out called Chasing Shadows: Cyber Espionage, Subversion, and the Global Fight for Democracy, and he sat down with me to explain how spyware works, and what it means for our privacy – and our democracy.

Note: We reached out to NSO Group about the claims made in this episode and they did not reply to our request for comment.

Mentioned:

“Chasing Shadows: Cyber Espionage, Subversion, and the Global Fight for Democracy,” by Ron Deibert

“Meta’s WhatsApp says spyware company Paragon targeted users in two dozen countries,” by Raphael Satter, Reuters

Further Reading:

“The Autocrat in Your iPhone,” by Ron Deibert

“A Comprehensive Analysis of Pegasus Spyware and Its Implications for Digital Privacy and Security,” Karwan Kareem

“Stopping the Press: New York Times Journalist Targeted by Saudi-linked Pegasus Spyware Operator,” by Bill Marczak, Siena Anstis, Masashi Crete-Nishihata, John Scott-Railton, and Ron Deibert

We’ve spent a lot of time on this show talking about AI: how it’s changing war, how your doctor might be using it, and whether or not chatbots are curing, or exacerbating, loneliness.

But what we haven’t done on this show is try to explain how AI actually works. So this seemed like as good a time as any to ask our listeners if they had any burning questions about AI. And it turns out you did.

Where do our queries go once they’ve been fed into ChatGPT? What are the justifications for using a chatbot that may have been trained on plagiarized material? And why do we even need AI in the first place?

To help answer your questions, we are joined by Derek Ruths, a Professor of Computer Science at McGill University, and the best person I know at helping people (including myself) understand artificial intelligence.

Further Reading:

“Yoshua Bengio Doesn’t Think We’re Ready for Superhuman AI. We’re Building It Anyway,” Machines Like Us podcast

“ChatGPT is blurring the lines between what it means to communicate with a machine and a human,” by Derek Ruths

“A Brief History of Artificial Intelligence: What It Is, Where We Are, and Where We Are Going,” by Michael Wooldridge

“Artificial Intelligence: A Guide for Thinking Humans,” by Melanie Mitchell

“Anatomy of an AI System,” by Kate Crawford and Vladan Joler“

Two years after the launch of ChatGPT, how has generative AI helped businesses?,” by Joe Castaldo

We spend a lot of time talking about AI on this show: how we should govern it, the ideologies of the people making it, and the ways it's reshaping our lives.

But before we barrel into a year where I think AI will be everywhere, we thought this might be a good moment to step back and ask an important question: what exactly is AI? 

On our next episode, we'll be joined by Derek Ruths, a Professor of Computer Science at McGill University.

And he's given me permission to ask him anything and everything about AI. 

If you have questions about AI, or how its impacting your life, we want to hear them. Send an email or a voice recording to: [email protected]

Thanks – and we’ll see you next Tuesday!

In February, 2024, Megan Garcia’s 14-year-old son Sewell took his own life.

As she tried to make sense of what happened, Megan discovered that Sewell had fallen in love with a chatbot on Character.AI – an app where you can talk to chatbots designed to sound like historical figures or fictional characters. Now Megan is suing Character.AI, alleging that Sewell developed a “harmful dependency” on the chatbot that, coupled with a lack of safeguards, ultimately led to her son’s death.

They’ve also named Google in the suit, alleging that the technology that underlies Character.AI was developed while the founders were working at Google.

I sat down with Megan Garcia and her lawyer, Meetali Jain, to talk about what happened to Sewell. And to try to understand the broader implications of a world where chatbots are becoming a part of our lives – and the lives of our children.

We reached out to Character.AI and Google about this story. Google did not respond to our request for comment by publication time.

A spokesperson for Character.AI made the following statement:

“We do not comment on pending litigation.

Our goal is to provide a space that is both engaging and safe for our community. We are always working toward achieving that balance, as are many companies using AI across the industry. As part of this, we have launched a separate model for our teen users – with specific safety features that place more conservative limits on responses from the model.

The Character.AI experience begins with the Large Language Model that powers so many of our user and Character interactions. Conversations with Characters are driven by a proprietary model we continuously update and refine. For users under 18, we serve a version of the model that is designed to further reduce the likelihood of users encountering, or prompting the model to return, sensitive or suggestive content. This initiative – combined with the other techniques described below – combine to produce two distinct user experiences on the Character.AI platform: one for teens and one for adults.

Additional ways we have integrated safety across our platform include:

Model Outputs: A “classifier” is a method of distilling a content policy into a form used to identify potential policy violations. We employ classifiers to help us enforce our content policies and filter out sensitive content from the model’s responses. The under-18 model has additional and more conservative classifiers than the model for our adult users.

User Inputs: While much of our focus is on the model’s output, we also have controls to user inputs that seek to apply our content policies to conversations on Character.AI.This is critical because inappropriate user inputs are often what leads a language model to generate inappropriate outputs. For example, if we detect that a user has submitted content that violates our Terms of Service or Community Guidelines, that content will be blocked from the user’s conversation with the Character. We also have a process in place to suspend teens from accessing Character.AI if they repeatedly try to input prompts into the platform that violate our content policies.

Additionally, under-18 users are now only able to access a narrower set of searchable Characters on the platform. Filters have been applied to this set to remove Characters related to sensitive or mature topics.

We have also added a time spent notification and prominent disclaimers to make it clear that the Character is not a real person and should not be relied on as fact or advice. As we continue to invest in the platform, we will be rolling out several new features, including parental controls. For more information on these new features, please refer to the Character.AI blog HERE.

There is no ongoing relationship between Google and Character.AI. In August, 2024, Character.AI completed a one-time licensing of its technology and Noam went back to Google.”

If you or someone you know is thinking about suicide, support is available 24-7 by calling or texting 988, Canada’s national suicide prevention helpline.

Mentioned:

Megan Garcia v. Character Technologies, Et Al.

“Google Paid $2.7 Billion to Bring Back an AI Genius Who Quit in Frustration” by Miles Kruppa and Lauren Thomas

“Belgian man dies by suicide following exchanges with chatbot,” by Lauren Walker

“Can AI Companions Cure Loneliness?,” Machines Like Us

“An AI companion suggested he kill his parents. Now his mom is suing,” by Nitasha Tiku

Further Reading:

“Can A.I. Be Blamed for a Teen’s Suicide?” by Kevin Roose

“Margrethe Vestager Fought Big Tech and Won. Her Next Target is AI,” Machines Like Us

In July, there was a recall on two brands of plant-based milks, Silk and Great Value, after a listeria outbreak that led to at least 20 illnesses and three deaths. Public health officials determined the same strain of listeria had been making people sick for almost a year. When Globe reporters began looking into what happened, they found a surprising fact: the facility that the bacteria was traced to had not been inspected for listeria in years.

The reporters learned that in 2019 the Canadian Food Inspection Agency introduced a new system that relies on an algorithm to prioritize sites for inspectors to visit. Investigative reporters Grant Robertson and Kathryn Blaze Baum talk about why this new system of tracking was created, and what went wrong.

The board game Go has more possible board configurations than there are atoms in the universe.

Because of that seemingly infinite complexity, developing software that could master Go has long been a goal of the AI community.

In 2016, researchers at Google’s DeepMind appeared to meet the challenge. Their Go-playing AI defeated one of the best Go players in the world, Lee Sedol.

After the match, Lee Sedol retired, saying that losing to an AI felt like his entire world was collapsing.

He wasn’t alone. For a lot of people, the game represented a turning point – the moment where humans had been overtaken by machines.

But Frank Lantz saw that game and was invigorated. Lantz is a game designer (his game “Hey Robot” is a recurring feature on The Tonight Show Starring Jimmy Fallon), the director of the NYU game center, and the author of The Beauty of Games. He’s spent his career thinking about how technology is changing the nature of games – and what we can learn about ourselves when we sit down to play them.

Mentioned:

“AlphaGo”

“The Beauty of Games” by Frank Lantz

“Adversarial Policies Beat Superhuman Go AIs” by Tony Wang Et al.

“Theory of Games and Economic Behavior” by John von Neumann and Oskar Morgenstern

“Heads-up limit hold’em poker is solved” by Michael Bowling Et al.

Further Reading:

“How to Play a Game” by Frank Lantz

“The Afterlife of Go” by Frank Lantz

“How A.I. Conquered Poker” by Keith Romer

“In Two Moves, AlphaGo and Lee Sedol Redefined the Future” by Cade Metz

Hey Robot by Frank Lantz

Universal Paperclips by Frank Lantz

The past few months have seen a series of bold proclamations from the most powerful people in tech.

In September, Mark Zuckerberg announced that Meta had developed “the most advanced glasses the world had ever seen.” That same day, Open AI CEO Sam Altman predicted we could have artificial super intelligence within a couple of years. Elon Musk has said he’ll land rockets on Mars by 2026.

We appear to be living through the kinds of technological leaps we used to only dream about. But whose dreams were those, exactly?

In her latest book, Imagination: A Manifesto, Ruha Benjamin argues that our collective imagination has been monopolized by the Zuckerbergs and Musks of the world. But, she says, it doesn’t need to be that way.

Mentioned:

“Imagination: A Manifesto,” by Ruha Benjamin

Summer of Soul (...Or, When the Revolution Could Not Be Televised), directed by Questlove

“The Black Woman: An Anthology,” by Toni Cade Bambara

“The New Artificial Intelligentsia,” by Ruha Benjamin

“Race After Technology,” by Ruha Benjamin

Breonna's Garden, with Ju'Niyah Palmer

“Viral Justice,” by Ruha Benjamin

The Parable Series, by Octavia Butler

Further Reading:

“AI could make health care fairer—by helping us believe what patients say,” by Karen Hao

“How an Attempt at Correcting Bias in Tech Goes Wrong,” by Sidney Fussell

“Unmasking AI: My Mission to Protect What Is Human in a World of Machines,’” by Joy Buolamwini

“The TESCREAL bundle: Eugenics and the promise of utopia through artificial general intelligence,” by Timnit Gebru and Émile P. Torres

Margrethe Vestager has spent the past decade standing up to Silicon Valley. As the EU’s Competition Commissioner, she’s waged landmark legal battles against tech giants like Meta, Microsoft and Amazon. Her two latest wins will cost Apple and Google billions of dollars.

With her decade-long tenure as one of the world’s most powerful anti-trust watchdogs coming to an end, Vestager has turned her attention to AI. She spearheaded the EU’s AI Act, which will be the first and, so far, most ambitious piece of AI legislation in the world.

But the clock is ticking – both on her term and on the global race to govern AI, which Vestager says we have “very little time” to get right.

Mentioned:

The EU Artificial Intelligence Act

“Dutch scandal serves as a warning for Europe over risks of using algorithms,” by Melissa Heikkilä

“Belgian man dies by suicide following exchanges with chatbot” by Lauren Walker

The Digital Services Act

The Digital Markets Act

General Data Protection Regulation (GDPR)

“The future of European competitiveness” by Mario Draghi

“Governing AI for Humanity: Final Report” by the United Nations Secretary-General’s High-level Advisory Body

The Artificial Intelligence and Data Act (AIDA)

Further Reading:

“Apple, Google must pay billions in back taxes and fines, E.U. court rules” by Ellen Francis and Cat Zakrzewski

“OpenAI Lobbied the E.U. to Water Down AI Regulation” by Billy Perrigo

“The total eclipse of Margrethe Vestager” by Samuel Stolton

“Digital Empires: The Global Battle to Regulate Technology” by Anu Bradford

“The Brussels Effect: How the European Union Rules the World” by Anu Bradford

We’re off this week, so we’re bringing you an episode from our Globe and Mail sister show Lately. 

That creeping feeling that everything online is getting worse has a name: “enshittification,” a term for the slow degradation of our experience on digital platforms. The enshittification cycle is why you now have to wade through slop to find anything useful on Google, and why your charger is different from your BFF’s. 

According to Cory Doctorow, the man who coined the memorable moniker, this digital decay isn’t inevitable. It’s a symptom of corporate under-regulation and monopoly – practices being challenged in courts around the world, like the US Department of Justice’s antitrust suit against Google.

Cory Doctorow is a British-Canadian journalist, blogger and author of Chokepoint Capitalism, as well as speculative fiction works like The Lost Cause and the new novella Spill. 

Every Friday, Lately takes a deep dive into the big, defining trends in business and tech that are reshaping our every day. It’s hosted by Vass Bednar. 

Machines Like Us will be back in two weeks.

The tech lobby has quietly turned Silicon Valley into the most powerful political operation in America. 

Pro crypto donors are now responsible for almost half of all corporate donations this election. Elon Musk has gone from an occasional online troll to, as one of our guests calls him, “MAGA’s Minister of Propaganda.” And for the first time, the once reliably blue Silicon Valley seems to be shifting to the right. What does all this mean for the upcoming election? 

To help us better understand this moment, we spoke with three of the most prominent tech writers in the U.S. Charles Duhigg (author of the bestseller Supercommunicators) has a recent piece in the New Yorker called “Silicon Valley, the New Lobbying Monster.” Charlie Warzel is a staff writer at the Atlantic, and Nitasha Tiku is a tech culture reporter at the Washington Post.

Mentioned:

“Silicon Valley, the New Lobbying Monster” by Charles Duhigg

“Big Crypto, Big Spending: Crypto Corporations Spend an Unprecedented $119 Million Influencing Elections” by Rick Claypool via Public Citizen

“I’m Running Out of Ways to Explain How Bad This Is” by Charlie Warzel

“Elon Musk Has Reached a New Low” by Charlie Warzel

“The movement to diversify Silicon Valley is crumbling amid attacks on DEI” by Naomi Nix, Cat Zakrzewski and Nitasha Tiku

“The Techno-Optimist Manifesto” by Marc Andreessen

“Trump Vs. Biden: Tech Policy,” The Ben & Marc Show 

“The MAGA Aesthetic Is AI Slop” by Charlie Warzel

Further Reading:

“Biden's FTC took on big tech, big pharma and more. What antitrust legacy will Biden leave behind?” by Paige Sutherland and Meghna Chakrabarti

“Inside the Harris campaign’s blitz to win back Silicon Valley” by Cat Zakrzewski, Nitasha Tiku and Elizabeth Dwoskin

“The Little Tech Agenda” by Marc Andreessen and Ben Horowitz

“Silicon Valley had Harris’s back for decades. Will she return the favor?” by Cristiano Lima-Strong and Cat Zakrzewski

“SEC’s Gensler turns tide against crypto in courts” by Declan Harty

“Trump vs. Harris is dividing Silicon Valley into feuding political camps” by Trisha Thadani, Elizabeth Dwoskin, Nitasha Tiku and Gerrit De Vynck

“Inside the powerful Peter Thiel network that anointed JD Vance” by Elizabeth Dwoskin, Cat Zakrzewski, Nitasha Tiku and Josh Dawsey

What kind of future are we building for ourselves? In some ways, that’s the central question of this show.

It’s also a central question of speculative fiction. And one that few people have tried to answer as thoughtfully – and as poetically – as Emily St. John Mandel.

Mandel is one of Canada’s great writers. She’s the author of six award winning novels, the most recent of which is Sea of Tranquility – a story about a future where we have moon colonies and time travelling detectives. But Mandel might be best known for Station Eleven, which was made into a big HBO miniseries in 2021. In Station Eleven, Mandel envisioned a very different future. One where a pandemic has wiped out nearly everyone on the planet, and the world has returned to a pre industrial state. In other words, a world without technology.

I think speculative fiction carries tremendous power. In fact, I think that AI is ultimately an act of speculation. The AI we have chosen to build, and our visions of what AI could become, have been shaped by acts of imagination.

So I wanted to speak to someone who has made a career imagining other worlds, and thinking about how humans will fit into them.

Mentioned:

“Last Night in Montreal” by Emily St. John Mandel

“Station Eleven” by Emily St. John Mandel

The Nobel Prize in Literature 2014 – Lecture by Patrick Modiano

“The Glass Hotel” by Emily St. John Mandel

“Sea of Tranquility” by Emily St. John Mandel

Summary of the 2023 WGA MBA, Writers Guild of America

Her (2013)

“The Handmaid’s Tale” by Margaret Atwood

“Shell Game” by Evan Ratliff

Replika

Further Reading:

“Can AI Companions Cure Loneliness?,” Machines Like Us

“Yoshua Bengio Doesn’t Think We’re Ready for Superhuman AI. We’re Building it Anyway.,” Machines Like Us

“The Road” by Cormac McCarthy

A couple of weeks ago, I was at this splashy AI conference in Montreal called All In. It was – how should I say this – a bit over the top. There were smoke machines, thumping dance music, food trucks. It was a far cry from the quiet research labs where AI was developed. 

While I remain skeptical of the promise of artificial intelligence, this conference made it clear that the industry is, well, all in. The stage was filled with startup founders promising that AI was going to revolutionize the way we work, and government officials saying AI was going to supercharge the economy. 

And then there was Yoshua Bengio. 

Bengio is one of AI’s pioneering figures. In 2018, he and two colleagues won the Turing Award – the closest thing computer science has to a Nobel Prize – for their work on deep learning. In 2022, he was the most cited computer scientist in the world. It wouldn’t be hyperbolic to suggest that AI as we know it today might not exist without Yoshua Bengio. 

But in the last couple of years, Bengio has had an epiphany of sorts. And he now believes that, left unchecked, AI has the potential to wipe out humanity. So these days, he’s dedicated himself to AI safety. He’s a professor at the University of Montreal and the founder of MILA - the Quebec Artificial Intelligence Institute.  

And he was at this big AI conference too, amidst all these Silicon Valley types, pleading with the industry to slow down before it’s too late. 

Mentioned:

“Personal and Psychological Dimensions of AI Researchers Confronting AI Catastrophic Risks” by Yoshua Bengio

“Deep Learning” by Yann LeCun, Yoshua Bengio, Geoffrey Hinton

“Computing Machinery and Intelligence” by Alan Turing

“International Scientific Report on the Safety of Advanced AI” 

“Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress?” by R. Ren et al.

“SB 1047: Safe and Secure Innovation for Frontier Artificial Intelligence Models Act”

Further reading:

“‘Deep Learning’ Guru Reveals the Future of AI” by Cade Metz

“Montréal Declaration for a Responsible Development of Artificial Intelligence” 

“This A.I. Subculture’s Motto: Go, Go, Go” By Kevin Roose

“Reasoning through arguments against taking AI safety seriously” by Yoshua Bengio

In 2015, 195 countries gathered in Paris to discuss how to address the climate crisis. Although there was plenty they couldn’t agree on, there was one point of near-absolute consensus: if the planet becomes 2°C hotter than it was before industrialization, the effects will be catastrophic. Despite that consensus, we have continued barrelling toward that 2°C threshold. And while the world is finally paying attention to climate change, the pace of our action is radically out of step with the severity of the problem. What is becoming increasingly clear is that just cutting our emissions – by switching to clean energy or driving electric cars – will not be sufficient. We will also need some bold technological solutions if we want to maintain some semblance of life as we know it.

Luckily, everything is on the table. Grinding entire mountains into powder and dumping them into oceans. Sucking carbon directly out of the air and burying it underground. Spraying millions of tons of sulphur dioxide directly into the atmosphere.

Gwynne Dyer has spent the past four years interviewing the world’s leading climate scientists about the moonshots that could save the planet. Dyer is a journalist and historian who has written a dozen books over his career, and has become one of Canada’s most trusted commentators on war and geopolitics.

But his latest book, Intervention Earth, is about the battle to save the planet.

Like any reporting on the climate, it’s inevitably a little depressing. But with this book Dyer has also given us a different way of thinking about the climate crisis – and maybe even a road map for how technology could help us avoid our own destruction.

Mentioned:

“Intervention Earth: Life-Saving Ideas from the World’s Climate Engineers” by Gwynne Dyer

“Scientists warn Earth warming faster than expected – due to reduction in ship pollution” by Nicole Mortillaro

“Global warming in the pipeline” by James Hansen, et al.

“Albedo Enhancement by Stratospheric Sulfur Injections: A Contribution to Resolve a Policy Dilemma?” by Paul Crutzen

Further Reading:

Interview with Hans Joachim Schellnhuber and Gwynne Dyer

For nearly a year now, the world has been transfixed – and horrified – by what’s happening in the Gaza Strip. Yet for all the media coverage, there seems to be far less known about how this war is actually being fought. And the how of this conflict, and its enormous human toll, might end up being its most enduring legacy.

In April, the Israeli magazine +972 published a story describing how Israel was using an AI system called Lavender to target potential enemies for air strikes, sometimes with a margin of error as high as 10 per cent.

I remember reading that story back in the spring and being shocked, not that such tools existed, but that they were already being used at this scale on the battlefield. P.W. Singer was less surprised. Singer is one of the world’s foremost experts on the future of warfare. He’s a strategist at the think tank New America, a professor of practice at Arizona State University, and a consultant for everyone from the US military to the FBI.

So if anyone can help us understand the black box of autonomous weaponry and AI warfare, it’s P.W. Singer.

Mentioned:

“‘The Gospel’: how Israel uses AI to select bombing targets in Gaza” by Harry Davies, Bethan McKernan, and Dan Sabbagh

“‘Lavender’: The AI machine directing Israel’s bombing spree in Gaza” by Yuval Abraham

“Ghost Fleet: A Novel of the Next World War” by P. W. Singer and August Cole

Further Reading:

“Burn-In: A Novel of the Real Robotic Revolution” by P. W. Singer and August Cole

“The AI revolution is already here” by P. W. Singer

“Humans must be held responsible for decisions AI weapons make” in The Asahi Shimbun

“Useful Fiction”