ZME Science
No Result
View All Result
ZME Science
No Result
View All Result
ZME Science

Home → Future

A human just defeated an AI in Go. Here’s why that matters

Go is arguably the most complex game devised by mankind.

Mihai AndreibyMihai Andrei
February 24, 2023
in Future, Technology
A A
Share on FacebookShare on TwitterSubmit to Reddit

In 2016, the news was that AI beat humans at Go. Fast forward seven years, and the news is that humans beat AI at Go. But it’s not like we got much smarter between tries — we simply learned to exploit its bugs.

A game of Go. Simple in essence, but extremely complex in practice. Image credits: Elena Popova.

Go is so mind-bendingly complex that it makes chess seem like tic tac toe. Go is played on a 19 by 19 board (compared to just 8 by 8 for chess), and a typical game of around 150 moves has around  10360 possible moves, or 1 followed by 360 zeroes — a number that’s simply unfathomable. For comparison, it’s estimated that there are some 1082 atoms in the universe.

Calculating everything in the game of Go is simply not possible, so players often rely on their intuition and pattern recognition skills, which is why Go was thought to be unconquerable by AIs. But in 2016, DeepMind’s AlphaGo turned all that on its head. Despite staunch resistance from mankind’s champion, AI triumphed and got more and more ahead of humanity.

The best player of Go is currently KataGo, a machine-learning algorithm that taught itself how to play, surpassing even previous AI iterations.

KataGo is a monster, it just wipes the floor with all opponents. But researchers have been looking for potential flaws or weaknesses in KataGo. Recently, a team of researchers published a preprint of their research in which they describe how they train their own AI opponents, specifically aimed at KataGo. They don’t want to become better players, they just want to trick the AI.

“Notably, our adversaries do not win by learning to play Go better than KataGo – in fact, our adversaries are easily beaten by human amateurs,” the team wrote in their paper. “Instead, our adversaries win by tricking KataGo into making serious blunders.”

This is where Kellin Pelrine steps in. Pelrine is a good player, but an amateur. Specifically, he’s one level below the top amateur ranking. He’s also one of the study authors, so he was well aware of the vulnerabilities of KataGo, so he thought why not try his own hand?

Apparently, it was surprisingly easy to find a way to defeat AI by exploiting its weakness. Pelrine managed to beat KataGo 14 out of 15 times. For comparison, KataGo beat AlphaGo 100 times out of 100, and AlphaGo beat mankind’s best player 4-1.

RelatedPosts

Scientists investigate cannabis terpenes as possible COVID-19 treatment
Waste-cooking solar toilet unveiled in India
The Future of Robot Swarms Is Here—And It’s Being Controlled by Just One Person. Here’s What DARPA Says
Book review: ‘Ecological Statistics: Contemporary theory and application’

But as is so often the case, this isn’t about the game itself, it’s about what this means for the future of artificial intelligence. The main takeaway is that performance doesn’t always translate into robustness. This failure of the Go-playing algorithm is a bit like a self-driving car crashing into a tree because the bark had a specific color. In other words, even when something seems to be performing extremely well, there could be fringe situations where it behaves badly. This is less of a problem in Go, and more of a problem when AI steps into the real world, so this is an important cautionary tale.

Crucially, Pelrine’s tactic would have been quite easily spotted by a human. He simply created a loop of stones to encircle the opponent’s stones, but then started making moves in the corners of the board to distract the AI. It’s not completely trivial, says Pelrine, but not very difficult.

Artificial systems, however, don’t have the ability to react to situations they’re not prepared for. They don’t have “common sense”. In fact, this is why game-playing AIs are so important: they teach us about how these algorithms behave — not just in terms of opportunities and performance, but also in terms of what can go wrong.

It’s common to find flaws and exploits in AI systems. Ironically, this is also done with the aid of computers, but this field is extremely important and often overlooked. More and more, we’re seeing AIs being deployed into the world with little verification. Maybe, just maybe, we should learn from this type of event and pay more attention to how we deploy such systems in real life.

ShareTweetShare
Mihai Andrei

Mihai Andrei

Dr. Andrei Mihai is a geophysicist and founder of ZME Science. He has a Ph.D. in geophysics and archaeology and has completed courses from prestigious universities (with programs ranging from climate and astronomy to chemistry and geology). He is passionate about making research more accessible to everyone and communicating news and features to a broad audience.

Related Posts

News

NASA Astronaut Snaps Rare Sprite Flash From Space and It’s Blowing Minds

byTibi Puiu
38 minutes ago
Climate

Deadly Heatwave Killed 2,300 in Europe, and 1,500 of those were due to climate change

byMihai Andrei
56 minutes ago
Mind & Brain

You’re not imagining it, Mondays really are bad for your health

byAlexandra Gerea
1 hour ago
Biology

These fig trees absorb CO2 from the air and convert it into stone

byMihai Andrei
2 hours ago

Recent news

NASA Astronaut Snaps Rare Sprite Flash From Space and It’s Blowing Minds

July 9, 2025

Deadly Heatwave Killed 2,300 in Europe, and 1,500 of those were due to climate change

July 9, 2025

You’re not imagining it, Mondays really are bad for your health

July 9, 2025
  • About
  • Advertise
  • Editorial Policy
  • Privacy Policy and Terms of Use
  • How we review products
  • Contact

© 2007-2025 ZME Science - Not exactly rocket science. All Rights Reserved.

No Result
View All Result
  • Science News
  • Environment
  • Health
  • Space
  • Future
  • Features
    • Natural Sciences
    • Physics
      • Matter and Energy
      • Quantum Mechanics
      • Thermodynamics
    • Chemistry
      • Periodic Table
      • Applied Chemistry
      • Materials
      • Physical Chemistry
    • Biology
      • Anatomy
      • Biochemistry
      • Ecology
      • Genetics
      • Microbiology
      • Plants and Fungi
    • Geology and Paleontology
      • Planet Earth
      • Earth Dynamics
      • Rocks and Minerals
      • Volcanoes
      • Dinosaurs
      • Fossils
    • Animals
      • Mammals
      • Birds
      • Fish
      • Amphibians
      • Reptiles
      • Invertebrates
      • Pets
      • Conservation
      • Animal facts
    • Climate and Weather
      • Climate change
      • Weather and atmosphere
    • Health
      • Drugs
      • Diseases and Conditions
      • Human Body
      • Mind and Brain
      • Food and Nutrition
      • Wellness
    • History and Humanities
      • Anthropology
      • Archaeology
      • History
      • Economics
      • People
      • Sociology
    • Space & Astronomy
      • The Solar System
      • Sun
      • The Moon
      • Planets
      • Asteroids, meteors & comets
      • Astronomy
      • Astrophysics
      • Cosmology
      • Exoplanets & Alien Life
      • Spaceflight and Exploration
    • Technology
      • Computer Science & IT
      • Engineering
      • Inventions
      • Sustainability
      • Renewable Energy
      • Green Living
    • Culture
    • Resources
  • Videos
  • Reviews
  • About Us
    • About
    • The Team
    • Advertise
    • Contribute
    • Editorial policy
    • Privacy Policy
    • Contact

© 2007-2025 ZME Science - Not exactly rocket science. All Rights Reserved.