Quantcast
ZME Science
  • News
  • Environment
  • Health
  • Future
  • Space
  • Features
  • ZME & more
    • About
    • The Team
    • Advertise
    • Contribute
    • Our stance on climate change
    • Privacy Policy
    • Contact
No Result
View All Result
ZME Science

No Result
View All Result
ZME Science
Home Science News

Microsoft’s new A.I. writes captions for images (and it’s hilarious)

We tested Microsoft's CaptionBot and had some laughs.

by Tibi Puiu
April 14, 2016
in News, Tech
A A

The big tech companies in Silicon Valley are betting big on artificial intelligence, for good reason too. Previously, ZME Science told you all about how Google’s amazing dream-like neural networks operate to make sense of images. Later, I had a lot of fun toying with a similar neural network from Microsoft also available to the public which can interpret emotions based on facial expressions. Now, Microsoft is showcasing another powerful tool that writes captions for images.

They’re very basic — essentially descriptions of what the neural network algorithm “sees”. Sometimes the CaptionBot does a pretty good job.

a4

a10

a2

Pretty good. It seems to be handling celebrities and portraits nicely but gets really confused if there are more things in focus.

a1
This darling is CNUT, the ZME Science office cat.

In fact, after I gave it a couple more spins it started to sound like a half-blind uncle!

It's a freaking golf ball, c'mon!
It’s a freaking golf ball, c’mon!

Then it really showed its (hilarious) limitations.

I would definitely
Ok… where’s the restaurant?
a7
Close, I guess.
Well...
Well…
Time-keeping wizards, yes.
Time-keeping wizards, yes.
a11
It’s the Grand Canyon FYI. The sheep though where’d you get that?
a6
Close, but no cigar.

 

The CaptionBot uses two neural networks, one to parse the images and the other to generate the caption. The images are identified using Microsoft’s Computer Vision API, mixed  with data from the Bing Image Search API. The Emotion API is what detects facial expressions. As it gets fed more photos, including these I played with, it will naturally get better and better. You can try it on your own here. Post some in the comments. This should be fun!

Tags: artificial intelligence

ADVERTISEMENT
ADVERTISEMENT
  • News
  • Environment
  • Health
  • Future
  • Space
  • Features
  • ZME & more

© 2007-2021 ZME Science - Not exactly rocket science. All Rights Reserved.

No Result
View All Result
  • News
  • Environment
  • Health
  • Future
  • Space
  • Features
  • ZME & more
    • About
    • The Team
    • Advertise
    • Contribute
    • Our stance on climate change
    • Privacy Policy
    • Contact

© 2007-2021 ZME Science - Not exactly rocket science. All Rights Reserved.