Facilitating the spread of knowledge and innovation in professional software development



Choose your language

InfoQ Homepage News Electronic Frontier Foundation Measuring Progress of Artificial Intelligence

Electronic Frontier Foundation Measuring Progress of Artificial Intelligence

This item in japanese

Lire ce contenu en français


The Electronic Frontier Foundation (EFF) started a document containing progress artificial intelligence (AI) research on multiple tasks.

The goal of the document is to be the place for people to find progress on difficult tasks. Currently, many tasks don't have the metrics, datasets, and benchmarks to keep track of them. To bootstrap the overview of the state of the art in AI, they went through many blog posts and websites. The EFF made a Jupyter Notebook to which researchers and developers can contribute on Github. They encourage others to create pull requests for additional datasets and include the speed and efficiency of training methods.

The reason behind the overview is that the EFF wants to know the state of AI for political reasons. Their goal is to learn what types of AI they have to engage with on legal, political, and technical safety fronts. Through this overview journalists, policy makers, and technology users can understand how far the field of machine learning and AI is at the moment. Because algorithms can be designed to violate privacy, threaten safety, and perpetuate inequality and injustice, people must be able to anticipate these risks before they arise.

People can also contribute by adding visualizations to their data. Progress is continuously updated. Although the project started as an EFF project, the goal is to grow it to be a self-sustaining community effort.

Rate this Article


Hello stranger!

You need to Register an InfoQ account or or login to post comments. But there's so much more behind being registered.

Get the most out of the InfoQ experience.

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Community comments

  • good

    by xw kong,

    Your message is awaiting moderation. Thank you for participating in the discussion.


  • Re: good

    by Roland Meertens,

    Your message is awaiting moderation. Thank you for participating in the discussion.

    Yes! So far they added many metrics on the Atari games set, and added a category for the best linear learners! The notebook keeps improving :D

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p


Is your profile up-to-date? Please take a moment to review and update.

Note: If updating/changing your email, a validation request will be sent

Company name:
Company role:
Company size:
You will be sent an email to validate the new email address. This pop-up will close itself in a few moments.