Quantcast
ZME Science
  • News
  • Environment
  • Health
  • Future
  • Space
  • Features
    Menu
    Natural Sciences
    Health
    History & Humanities
    Space & Astronomy
    Technology
    Culture
    Resources
    Natural Sciences

    Physics

    • Matter and Energy
    • Quantum Mechanics
    • Thermodynamics

    Chemistry

    • Periodic Table
    • Applied Chemistry
    • Materials
    • Physical Chemistry

    Biology

    • Anatomy
    • Biochemistry
    • Ecology
    • Genetics
    • Microbiology
    • Plants and Fungi

    Geology and Paleontology

    • Planet Earth
    • Earth Dynamics
    • Rocks and Minerals
    • Volcanoes
    • Dinosaurs
    • Fossils

    Animals

    • Mammals
    • Birds
    • Fish
    • Reptiles
    • Amphibians
    • Invertebrates
    • Pets
    • Conservation
    • Animals Facts

    Climate and Weather

    • Climate Change
    • Weather and Atmosphere

    Geography

    Mathematics

    Health
    • Drugs
    • Diseases and Conditions
    • Human Body
    • Mind and Brain
    • Food and Nutrition
    • Wellness
    History & Humanities
    • Anthropology
    • Archaeology
    • Economics
    • History
    • People
    • Sociology
    Space & Astronomy
    • The Solar System
    • The Sun
    • The Moon
    • Planets
    • Asteroids, Meteors and Comets
    • Astronomy
    • Astrophysics
    • Cosmology
    • Exoplanets and Alien Life
    • Spaceflight and Exploration
    Technology
    • Computer Science & IT
    • Engineering
    • Inventions
    • Sustainability
    • Renewable Energy
    • Green Living
    Culture
    • Culture and Society
    • Bizarre Stories
    • Lifestyle
    • Art and Music
    • Gaming
    • Books
    • Movies and Shows
    Resources
    • How To
    • Science Careers
    • Metascience
    • Fringe Science
    • Science Experiments
    • School and Study
    • Natural Sciences
    • Health
    • History and Humanities
    • Space & Astronomy
    • Culture
    • Technology
    • Resources
  • Reviews
  • More
    • Agriculture
    • Anthropology
    • Biology
    • Chemistry
    • Electronics
    • Geology
    • History
    • Mathematics
    • Nanotechnology
    • Economics
    • Paleontology
    • Physics
    • Psychology
    • Robotics
  • About Us
    • About
    • The Team
    • Advertise
    • Contribute
    • Privacy Policy
    • Contact
No Result
View All Result
ZME Science

No Result
View All Result
ZME Science

Home → Science

AI is outpacing Moore’s Law

AI performance is doubling nearly every 3 months, a new report shows.

Tibi Puiu by Tibi Puiu
December 16, 2019
in News, Science

In 1965, American engineer Gordon Moore made the prediction that the number of transistors integrated on a silicon chip doubles every two years or so. This has proven to be true to this day, allowing software developers to double the performance of their applications. However, the performance of artificial intelligence (AI) algorithms seems to have outpaced Moore’s Law.

Credit: Pixabay.

According to a new report produced by Stanford University, AI computational power is accelerating at a much higher rate than the development of processor chips.

“Prior to 2012, AI results closely tracked Moore’s Law, with compute doubling every two years,” the authors of the report wrote. “Post-2012, compute has been doubling every 3.4 months.”

Stanford’s AI Index 2019 annual report examined how AI algorithms have improved over time. In one chapter, the authors tracked the performance of image classification programs based on ImageNet, one of the most widely used training datasets for machine learning.

According to the authors, over a time span of 18 months, the time required to train a network for supervised image recognition fell from about three hours in late 2017 to about 88 seconds in July 2019.

This phenomenal jump in training time didn’t compromise accuracy. When the Stanford researchers analyzed the ResNet image classification model, they found the algorithm needed 13 days of training time to achieve 93% accuracy in 2017. The cost of training was estimated at $2,323. Only one year later, the same performance cost only $12.

The report also highlighted dramatic improvements in computer vision that can automatically recognize human actions and activities from videos.

These findings highlight the dramatic pace at which AI is advancing. They mean that, more often than not, a new algorithm running on an older computer will be better than an older algorithm on a newer computer.

Other key insights from the report include:

  • AI is the buzzword all over the news, but also in classrooms and labs across academia. Many Ph.D. candidates in computer science choose an AI field for their specialization in 2018 (21%).
  • From 1998 to 2018, peer-reviewed AI research grew by 300%.
  • In 2019, global private AI investment was over $70 billion, with startup investment $37 billion, mergers and acquisitions $34 billion, IPOs $5 billion, and minority stake $2 billion.
  • In terms of volume, China now publishes the most journal and conference papers in AI, having surpassed Europe last year. It’s been in front of the US since 2006.
  • But that’s just volume, qualitatively-speaking researchers in North America lead the field — more than 40% of AI conference paper citations are attributed to authors from North America, and about 1 in 3 come from East Asia.
  • Singapore, Brazil, Australia, Canada, and India experienced the fastest growth in AI hiring from 2015 to 2019.
  • The vast majority of AI patents filed between 2014-2018 were filed in nations like the U.S. and Canada, and 94% of patents are filed in wealthy nations.
  • Between 2010 and 2019, the total number of AI papers on arXiv increased 20 times.

Was this helpful?
Thanks for your feedback!
Related posts:
  1. If Moore’s law applied to life, then it should be 10bn years old. But the Earth is 4.5bn years old. Hum…
  2. Apps aimed at kids are a sponge of personal data, in direct violation of federal law, study reports
  3. How scientists discovered a new law of nature that explains why animals grow ‘pointy’ parts
  4. Scientists just found humans broke a natural law of ocean life
  5. Mice in the Andes grow bigger on the rainier side of the mountains — and this could be a law of nature
Tags: AIcomputer science

ADVERTISEMENT
  • News
  • Environment
  • Health
  • Future
  • Space
  • Features
  • Reviews
  • More
  • About Us

© 2007-2021 ZME Science - Not exactly rocket science. All Rights Reserved.

No Result
View All Result
  • News
  • Environment
  • Health
  • Future
  • Space
  • Features
    • Natural Sciences
    • Health
    • History and Humanities
    • Space & Astronomy
    • Culture
    • Technology
    • Resources
  • Reviews
  • More
    • Agriculture
    • Anthropology
    • Biology
    • Chemistry
    • Electronics
    • Geology
    • History
    • Mathematics
    • Nanotechnology
    • Economics
    • Paleontology
    • Physics
    • Psychology
    • Robotics
  • About Us
    • About
    • The Team
    • Advertise
    • Contribute
    • Privacy Policy
    • Contact

© 2007-2021 ZME Science - Not exactly rocket science. All Rights Reserved.

Don’t you want to get smarter every day?

YES, sign me up!

Over 35,000 subscribers can’t be wrong. Don’t worry, we never spam. By signing up you agree to our privacy policy.

✕
ZME Science News

FREE
VIEW