ZME Science
No Result
View All Result
ZME Science
No Result
View All Result
ZME Science

Home → Science → News

Algorithm beats any opponent at heads-up Texas hold’em poker

Tibi PuiubyTibi Puiu
January 9, 2015
in News, Science, Technology
A A
Share on FacebookShare on TwitterSubmit to Reddit

RelatedPosts

Google just let an Artificial Intelligence take care of cooling a data center
Computer squares off against professional poker players – and loses badly
Google’s Gemini AI Just Embarrassed Itself Over Cheese
This AI probably knows where your photos were taken. Should we be worried?

We’ve come to understand that human players will never stand a chance against a computer with enough fire power at  finite and open games like checkers or chess. Poker is sensibly different because the computer doesn’t know his human opponent’s hands. No matter, a group of computer scientists  from the University of Alberta in Canada have programmed an AI to play heads-up Texas hold’em poker so good (or perfect according to its authors) that it can’t lose in the face of any opponent. There’s a gist though – it can only win at limit Texas hold’em, where there’s a limit to how much you can bet, otherwise it just can’t handle it.

Poker has been solved – almost

Illustration credit: PETER AND MARIA HOEY
Illustration credit: PETER AND MARIA HOEY

The computer program in question is called Cepheus and is the first to play an essentially perfect game of poker, according to its makers. In the simplest terms, the AI is programmed to play the game with a strategy that is guaranteed to not lose money in the long run, statistically speaking. In other words, yes the computer will lose some hands, but given enough time and hands it’s certain to win.

It’s more than just winning at Poker, though. It’s about setting a milestone in artificial intelligence and game theory. Previously, games like checkers, connect 4, Othello and chess had been solved, leaving little chances for a human player to best the computer. All of these games, however, have in common one important characteristic: they all have perfect information, where all players have all of the relevant information to make their decisions. In this respect, Poker is the antithesis of perfect information where the one most relevant piece of information, the other players’ cards, is exactly what is not known.

Overall, in any given game of heads-on limit hold’em Poker there are 3 x 10^14 possible decisions, which means a computer would have to run on 262 terabytes of memory to be able to solve it. Luckily, using algorithms you can refine the play and only consider those decisions that are important. The Canadian team devised such an algorithm called counterfactual regret minimisation (CFR), which essentially is all about learning from past mistakes. When Cepheus thinks about placing a bet and decides to eventually bet random, if it loses it will store that information. Later, it will retrace its steps and see how much it would have won had the program placed a bet correctly – this is the regret value. This way, the algorithm will avoid making the same mistake twice, the authors write in the journal Science.

Given enough hands, it will eventually go through enough mistakes to play almost perfectly. In fact, it played 24 trillion hands of poker over 70 days on 200 computers running the CFR+ algorithm with 32 GB of RAM and 24 central processing units. Now, Cepheus only uses 11 terabytes of ram. Next up, the researchers plan on tweaking Cepheus to play no-limit poker, where any bet of any value can be submitted. In this case, the number of possible combinations are absolutely astronomical, but even so the authors hope the computer can beat even the best players in the world.

Story via ASAP Science

Tags: artificial intelligencepoker

ShareTweetShare
Tibi Puiu

Tibi Puiu

Tibi is a science journalist and co-founder of ZME Science. He writes mainly about emerging tech, physics, climate, and space. In his spare time, Tibi likes to make weird music on his computer and groom felines. He has a B.Sc in mechanical engineering and an M.Sc in renewable energy systems.

Related Posts

Inventions

China’s New Mosquito Drone Could Probably Slip Through Windows and Spy Undetected

byMihai Andrei
1 week ago
Future

Your Brain Could Reveal a Deadly Heart Risk. AI Is Learning to Read the Signs

byMihai Andrei
2 weeks ago
Future

Can you upload a human mind into a computer? Here’s what a neuroscientist has to say about it

byDobromir Rahnev
1 month ago
AI-generated image.
Future

Does AI Have Free Will? This Philosopher Thinks So

byMihai Andrei
2 months ago

Recent news

Coolness Isn’t About Looks or Money. It’s About These Six Things, According to Science

July 1, 2025

Ancient Roman Pompeii had way more erotic art than you’d think

July 1, 2025

Wild Orcas Are Offering Fish to Humans and Scientists Say They May Be Trying to Bond with Us

July 1, 2025
  • About
  • Advertise
  • Editorial Policy
  • Privacy Policy and Terms of Use
  • How we review products
  • Contact

© 2007-2025 ZME Science - Not exactly rocket science. All Rights Reserved.

No Result
View All Result
  • Science News
  • Environment
  • Health
  • Space
  • Future
  • Features
    • Natural Sciences
    • Physics
      • Matter and Energy
      • Quantum Mechanics
      • Thermodynamics
    • Chemistry
      • Periodic Table
      • Applied Chemistry
      • Materials
      • Physical Chemistry
    • Biology
      • Anatomy
      • Biochemistry
      • Ecology
      • Genetics
      • Microbiology
      • Plants and Fungi
    • Geology and Paleontology
      • Planet Earth
      • Earth Dynamics
      • Rocks and Minerals
      • Volcanoes
      • Dinosaurs
      • Fossils
    • Animals
      • Mammals
      • Birds
      • Fish
      • Amphibians
      • Reptiles
      • Invertebrates
      • Pets
      • Conservation
      • Animal facts
    • Climate and Weather
      • Climate change
      • Weather and atmosphere
    • Health
      • Drugs
      • Diseases and Conditions
      • Human Body
      • Mind and Brain
      • Food and Nutrition
      • Wellness
    • History and Humanities
      • Anthropology
      • Archaeology
      • History
      • Economics
      • People
      • Sociology
    • Space & Astronomy
      • The Solar System
      • Sun
      • The Moon
      • Planets
      • Asteroids, meteors & comets
      • Astronomy
      • Astrophysics
      • Cosmology
      • Exoplanets & Alien Life
      • Spaceflight and Exploration
    • Technology
      • Computer Science & IT
      • Engineering
      • Inventions
      • Sustainability
      • Renewable Energy
      • Green Living
    • Culture
    • Resources
  • Videos
  • Reviews
  • About Us
    • About
    • The Team
    • Advertise
    • Contribute
    • Editorial policy
    • Privacy Policy
    • Contact

© 2007-2025 ZME Science - Not exactly rocket science. All Rights Reserved.