BT

Electronic Frontier Foundation Measuring Progress of Artificial Intelligence

| by Roland Meertens Follow 8 Followers on Jul 07, 2017. Estimated reading time: 1 minute | NOTICE: QCon.ai - Applied AI for Developers Apr 15 - 17, 2019, San Francisco. Join us!

The Electronic Frontier Foundation (EFF) started a document containing progress artificial intelligence (AI) research on multiple tasks.

The goal of the document is to be the place for people to find progress on difficult tasks. Currently, many tasks don't have the metrics, datasets, and benchmarks to keep track of them. To bootstrap the overview of the state of the art in AI, they went through many blog posts and websites. The EFF made a Jupyter Notebook to which researchers and developers can contribute on Github. They encourage others to create pull requests for additional datasets and include the speed and efficiency of training methods.

The reason behind the overview is that the EFF wants to know the state of AI for political reasons. Their goal is to learn what types of AI they have to engage with on legal, political, and technical safety fronts. Through this overview journalists, policy makers, and technology users can understand how far the field of machine learning and AI is at the moment. Because algorithms can be designed to violate privacy, threaten safety, and perpetuate inequality and injustice, people must be able to anticipate these risks before they arise.

People can also contribute by adding visualizations to their data. Progress is continuously updated. Although the project started as an EFF project, the goal is to grow it to be a self-sustaining community effort.

Rate this Article

Adoption Stage
Style

Hello stranger!

You need to Register an InfoQ account or or login to post comments. But there's so much more behind being registered.

Get the most out of the InfoQ experience.

Tell us what you think

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread

good by xw kong

interesting!

Re: good by Roland Meertens

Yes! So far they added many metrics on the Atari games set, and added a category for the best linear learners! The notebook keeps improving :D

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread

2 Discuss
BT