Tench: When data is messy

栏目: IT技术 · 发布时间: 3年前

内容简介:There’s a story I tell in mybook because it’s a great illustration of how AI gets the wrong idea about what problem we’re asking it to solve:Researchers at the University of TuebingenHuman fingers against a green background!

There’s a story I tell in mybook because it’s a great illustration of how AI gets the wrong idea about what problem we’re asking it to solve:

Researchers at the University of Tuebingen trained a neural net to recognize images , and then had it point out which parts of the images were the most important for its decision. When they asked it to highlight the most important pixels for the category “tench” (a kind of fish), this is what it highlighted:

Tench: When data is messy

Human fingers against a green background!

Why was it looking for human fingers when it was supposed to be looking for a fish? It turns out that most of the tench pictures the neural net had seen were of people holding the fish as a trophy. It doesn’t have any context for what a tench actually is, so it assumes the fingers are part of the fish.

The image-generating neural net inArtBreeder (calledBigGAN) was also trained on the same dataset, called ImageNet, and when you ask it to generate tenches, this is what it does:

Tench: When data is messy

The humans are much more distinct than the fish, and I’m fascinated by the highly exaggerated human fingers.

There are other categories in ImageNet that have similar problems. Here’s “microphone”.

Tench: When data is messy

It’s figured out about dramatic stage lighting and human forms, but many of its images don’t contain anything that remotely resembles a microphone. In so many of its training pictures the microphone is a tiny part of the image, easy to overlook. There are similar problems with small instruments like “flute” and “oboe”.

In other cases, there might be evidence of pictures being mislabeled. In these generated images of “football helmet”, some of them are clearly of people NOT wearing helmets, and a few even look suspiciously like baseball helmets.

Tench: When data is messy

ImageNet is a really messy dataset. It has a category for agama, but none for giraffe. Rather than horse as a category, it has sorrel (a specific color of horse). “Bicycle built for two” is a category, but not skateboard.

Tench: When data is messy

A huge reason for ImageNet’s messiness is that it was automatically scraped from images on the internet. The images were supposed to have been filtered by the crowdsourced workers who labeled them, but plenty of weirdness slipped through.And horribleness - many images and labels that definitely shouldn’t have appeared in a general-purpose research dataset, and images that looked like they had gotten there without the consent of the people pictured. After several years of widespread use by the AI community, the ImageNet team has reportedly been removing some of that content . Other problematic datasets - like those scraped from online images without permission, or from surveillance footage - have been removed recently . (Others, likeClearview AI’s, are still in use.)

This week Vinay Prabhu and Abeba Birhane pointed out major problems with another dataset, 80 Million Tiny Images , which scraped images and automatically assigned tags to them with the help of another neural net trained on internet text. The internet text, you may be shocked to hear, had some pretty offensive stuff in it. MIT CSAIL removed that dataset permanently rather than manually filter all 80 million images.

This is not just a problem with bad data , but with a system where major research groups can release datasets with such huge issues with offensive language and lack of consent. As tech ethicist Shannon Vallor put it , ”For any institution that does machine learning today, ‘we didn’t know’ isn’t an excuse, it’s a confession”. Like the algorithm that upscaled Obama into a white man , ImageNet is the product of a machine learning community where there’s a huge lack of diversity . (Did you notice that most of the generated humans in this blog post are white? If you didn’t notice, that might be because so much of Western culture treats white as default).

It takes a lot of work to create a better dataset - and to be more aware of which datasets should never be created. But it’s work worth doing.

Bonus material this week: a few of my favorite BigGAN image categories. Enter your emailhere for a gallery!

My book on AI is out, and, you can now get it any of these several ways!Amazon -Barnes & Noble -Indiebound -Tattered Cover -Powell’s -Boulder Bookstore


以上所述就是小编给大家介绍的《Tench: When data is messy》,希望对大家有所帮助,如果大家有任何疑问请给我留言,小编会及时回复大家的。在此也非常感谢大家对 码农网 的支持!

查看所有标签

猜你喜欢:

本站部分资源来源于网络,本站转载出于传递更多信息之目的,版权归原作者或者来源机构所有,如转载稿涉及版权问题,请联系我们

Python自然语言处理

Python自然语言处理

(英)伯德、(英)克莱因、(美)洛普 / 东南大学出版社 / 2010-6 / 64.00元

《Python自然语言处理(影印版)》提供了非常易学的自然语言处理入门介绍,该领域涵盖从文本和电子邮件预测过滤,到自动总结和翻译等多种语言处理技术。在《Python自然语言处理(影印版)》中,你将学会编写Python程序处理大量非结构化文本。你还将通过使用综合语言数据结构访问含有丰富注释的数据集,理解用于分析书面通信内容和结构的主要算法。 《Python自然语言处理》准备了充足的示例和练习,......一起来看看 《Python自然语言处理》 这本书的介绍吧!

CSS 压缩/解压工具
CSS 压缩/解压工具

在线压缩/解压 CSS 代码

在线进制转换器
在线进制转换器

各进制数互转换器

XML 在线格式化
XML 在线格式化

在线 XML 格式化压缩工具