Quantcast
ZME Science
  • News
  • Environment
  • Health
  • Future
  • Space
  • Features
    Menu
    Natural Sciences
    Health
    History & Humanities
    Space & Astronomy
    Technology
    Culture
    Resources
    Natural Sciences

    Physics

    • Matter and Energy
    • Quantum Mechanics
    • Thermodynamics

    Chemistry

    • Periodic Table
    • Applied Chemistry
    • Materials
    • Physical Chemistry

    Biology

    • Anatomy
    • Biochemistry
    • Ecology
    • Genetics
    • Microbiology
    • Plants and Fungi

    Geology and Paleontology

    • Planet Earth
    • Earth Dynamics
    • Rocks and Minerals
    • Volcanoes
    • Dinosaurs
    • Fossils

    Animals

    • Mammals
    • Birds
    • Fish
    • Reptiles
    • Amphibians
    • Invertebrates
    • Pets
    • Conservation
    • Animals Facts

    Climate and Weather

    • Climate Change
    • Weather and Atmosphere

    Geography

    Mathematics

    Health
    • Drugs
    • Diseases and Conditions
    • Human Body
    • Mind and Brain
    • Food and Nutrition
    • Wellness
    History & Humanities
    • Anthropology
    • Archaeology
    • Economics
    • History
    • People
    • Sociology
    Space & Astronomy
    • The Solar System
    • The Sun
    • The Moon
    • Planets
    • Asteroids, Meteors and Comets
    • Astronomy
    • Astrophysics
    • Cosmology
    • Exoplanets and Alien Life
    • Spaceflight and Exploration
    Technology
    • Computer Science & IT
    • Engineering
    • Inventions
    • Sustainability
    • Renewable Energy
    • Green Living
    Culture
    • Culture and Society
    • Bizarre Stories
    • Lifestyle
    • Art and Music
    • Gaming
    • Books
    • Movies and Shows
    Resources
    • How To
    • Science Careers
    • Metascience
    • Fringe Science
    • Science Experiments
    • School and Study
    • Natural Sciences
    • Health
    • History and Humanities
    • Space & Astronomy
    • Culture
    • Technology
    • Resources
  • Reviews
  • More
    • Agriculture
    • Anthropology
    • Biology
    • Chemistry
    • Electronics
    • Geology
    • History
    • Mathematics
    • Nanotechnology
    • Economics
    • Paleontology
    • Physics
    • Psychology
    • Robotics
  • About Us
    • About
    • The Team
    • Advertise
    • Contribute
    • Privacy Policy
    • Contact
No Result
View All Result
ZME Science

No Result
View All Result
ZME Science

Home → Science → News

Microsoft’s new A.I. writes captions for images (and it’s hilarious)

We tested Microsoft's CaptionBot and had some laughs.

Tibi Puiu by Tibi Puiu
April 14, 2016
in News, Tech

The big tech companies in Silicon Valley are betting big on artificial intelligence, for good reason too. Previously, ZME Science told you all about how Google’s amazing dream-like neural networks operate to make sense of images. Later, I had a lot of fun toying with a similar neural network from Microsoft also available to the public which can interpret emotions based on facial expressions. Now, Microsoft is showcasing another powerful tool that writes captions for images.

They’re very basic — essentially descriptions of what the neural network algorithm “sees”. Sometimes the CaptionBot does a pretty good job.

a4

a10

a2

Pretty good. It seems to be handling celebrities and portraits nicely but gets really confused if there are more things in focus.

a1
This darling is CNUT, the ZME Science office cat.

In fact, after I gave it a couple more spins it started to sound like a half-blind uncle!

It's a freaking golf ball, c'mon!
It’s a freaking golf ball, c’mon!

Then it really showed its (hilarious) limitations.

I would definitely
Ok… where’s the restaurant?

a7
Close, I guess.

Well...
Well…

Time-keeping wizards, yes.
Time-keeping wizards, yes.

a11
It’s the Grand Canyon FYI. The sheep though where’d you get that?

a6
Close, but no cigar.

 

The CaptionBot uses two neural networks, one to parse the images and the other to generate the caption. The images are identified using Microsoft’s Computer Vision API, mixed  with data from the Bing Image Search API. The Emotion API is what detects facial expressions. As it gets fed more photos, including these I played with, it will naturally get better and better. You can try it on your own here. Post some in the comments. This should be fun!

Was this helpful?


Thanks for your feedback!

Related posts:
  1. Paleontologist finds new horned-dinosaur species, calls it “Hellboy” then writes a marriage proposal in the paper
  2. Trippy AI writes interactive text adventure game on the fly
  3. Elon Musk is acting like a ‘Space Karen’, says scientist in hilarious Twitter tirade
  4. Disappointed Babylonian trader writes oldest complaint letter 3,766 years ago
  5. A virus walks into a bar… or how science jokes can be hilarious
Tags: artificial intelligence

ADVERTISEMENT
  • News
  • Environment
  • Health
  • Future
  • Space
  • Features
  • Reviews
  • More
  • About Us

© 2007-2021 ZME Science - Not exactly rocket science. All Rights Reserved.

No Result
View All Result
  • News
  • Environment
  • Health
  • Future
  • Space
  • Features
    • Natural Sciences
    • Health
    • History and Humanities
    • Space & Astronomy
    • Culture
    • Technology
    • Resources
  • Reviews
  • More
    • Agriculture
    • Anthropology
    • Biology
    • Chemistry
    • Electronics
    • Geology
    • History
    • Mathematics
    • Nanotechnology
    • Economics
    • Paleontology
    • Physics
    • Psychology
    • Robotics
  • About Us
    • About
    • The Team
    • Advertise
    • Contribute
    • Privacy Policy
    • Contact

© 2007-2021 ZME Science - Not exactly rocket science. All Rights Reserved.

Don’t you want to get smarter every day?

YES, sign me up!

Over 35,000 subscribers can’t be wrong. Don’t worry, we never spam. By signing up you agree to our privacy policy.

✕
ZME Science News

FREE
VIEW