The online interactive magazine of the Association for the Advancement of Artificial Intelligence

The Success of Conversational AI and the AI Evaluation Challenge it Reveals

By Ian Beaver

Research interest in Conversational AI has experienced a massive growth over the last few years and several recent advancements have enabled systems to produce rich and varied turns in conversations similar to humans. However, this apparent creativity is also creating a real challenge in the objective evaluation of such systems as authors are becoming reliant on crowd worker opinions as the primary measurement of success and, so far, few papers are reporting all that is necessary for others to compare against in their own crowd experiments. This challenge is not unique to ConvAI, but demonstrates as AI systems mature in more “human” tasks that involve creativity and variation, evaluation strategies need to mature with them.

Looking Back, Looking Ahead: Humans, Ethics, and AI

By Ashok Goel

Concerns about ethics of AI are older than AI itself. The phrase “artificial intelligence” was first used by McCarthy and colleagues in 1955 (McCarthy et al. 1955). However, in 1920 Capek already had published his science fiction play in which robots suffering abuse rebelled against human tyranny (Capek 1920), and by 1942, Asimov had proposed his famous three “laws of robotics” about robots not harming humans, not harming other robots, and not harming themselves (Asimov 1942). During much of the last century, when AI was mostly confined to research laboratories, concerns about ethics of AI were mostly limited to futurist writers of fiction and fantasy. In this century, as AI has begun to penetrate almost all aspects of life, worries about AI ethics have started permeating mainstream media. In this column, I briefly examine three broad classes of ethical concerns about AI, and then highlight another concern that has not yet received as much attention.

AAAI Honors High School Students at ISEF

AAAI is pleased to announce the winners of the recent AAAI Special Awards at the Intel International Science and Engineering Fair, held virtually May 16-21, 2021. T

Looking Back, Looking Ahead: Symbolic versus Connectionist AI

By Ashok Goel; School of Interactive Computing, Georgia Institute of Technology

Like much of the AI community, I have watched the ongoing discussion between symbolic AI and connectionist AI with fascination. While symbolic AI posits the use of knowledge in reasoning and learning as critical to producing intelligent behavior, connectionist AI postulates that learning of associations from data (with little or no prior knowledge) is crucial for understanding behavior. The recent debate between the two AI paradigms has been prompted by advances in connectionist AI since the turn of the century that have significant applications.

The Role of Open-Source Software in Artificial Intelligence

By Jim Spohrer

With this publication, we launch a new column for AI Magazine on the role of open-source software in artificial intelligence. As the column editor, I would like to extend my welcome and invite AI Magazine readers to send short articles for future columns, which may appear in the traditional print version of AI Magazine, or on the AI Magazine interactive site currently under development. This introductory column serves to highlight my interests in open-source software and to propose a few topics for future columns.

Latest from AI Magazine

Cover of AI Magazine issue 267AI: The Social Disruption – Interdisciplinary discourse on AI innovations and disruptions in the 20th century.

Vol. 42 No. 1

Ask-Me-Anything – AI Experts Answer Your Questions

Submit your questions to our first Ask-Me-Anything (AMA) with guests Drs. Brent Venable and Odd Erik Gundersen, co-editors of AI Magazine.

Recent Posts

The Success of Conversational AI and the AI Evaluation Challenge it Reveals

By Ian Beaver

Research interest in Conversational AI has experienced a massive growth over the last few years and several recent advancements have enabled systems to produce rich and varied turns in conversations similar to humans. However, this apparent creativity is also creating a real challenge in the objective evaluation of such systems as authors are becoming reliant on crowd worker opinions as the primary measurement of success and, so far, few papers are reporting all that is necessary for others to compare against in their own crowd experiments. This challenge is not unique to ConvAI, but demonstrates as AI systems mature in more “human” tasks that involve creativity and variation, evaluation strategies need to mature with them.

The Seventeenth International Conference on Intelligent Environments (IE 2021): A Report

Juan Carlos Augusto, Philippe Lalanda, Massimo Mecella

Intelligent Environments are populated with numerous devices and have multiple occupants, inherently exhibit increasingly intelligent behaviour, support consistent functionality and human-centric operation (humans, as opposed to mere users, have increased requirements from a system, including, for example, intuitive interaction, protection of privacy, fault-tolerance etc.), and provide optimized resource usage. The development of Intelligent Environments is considered the first and primary step towards the realization of the Ambient Intelligence vision and requires input from research and contributions from several scientific and engineering disciplines, including computer science, software engineering, artificial intelligence, architecture, social sciences, art and design. The series of IE conferences have been consistently creating a unique blend of researchers in these disciplines, fostering cross-disciplinary discussions, debate and collaborations.

Reports of the Association for the Advancement of Artificial Intelligence’s 15th International Conference on Web and Social Media

Karl Aberer, Ebrahim Bagheri, Marya Bazzi, Rumi Chunara, Ziv Epstein, Fabian Flöck, Adriana Iamnitchi, Diana Inkpen, Maurice Jakesch, Kyraki Kalimeri, Elena Kochkina, Ugur Kursuncu, Maria Liakata, Yelena Mejova, George Mohler, Daniela Paolotti, Jérémie Rappaz, Manon Revel, Horacio Saggion, Indira Sen, Panayiotis Smeros, Katrin Weller, Sanjaya Wijeratne, Christopher C. Yang, Fattane Zarrinkalam

The Association for the Advancement of Artificial Intelligence’s 2021 International Conference on Web and Social Media was held virtually from June 8-10, 2021. There were 8 workshops in the program: Data for the Wellbeing of Most Vulnerable, Emoji 2021: International Workshop on Emoji Understanding and Applications in Social Media, Information Credibility and Alternative Realities in Troubled Democracies, International Workshop on Cyber Social Threats (CySoc 2021), International Workshop on Social Sensing (SocialSens 2021): Special Edition on Information Operations on Social Media, Participatory Development of Quality Guidelines for Social Media Research: A Structured, Hands-on Design Workshop, Mediate 2021: News Media and Computational Journalism, Mining Actionable Insights from Social Networks: Special Edition on Healthcare Social Analytics.

To the AI Community

COVID-19 Update: A Special Message to the AI Community from AAAI

AAAI would like to wish all of our members, affiliated volunteers, and the greater international AI community all the best during this most challenging time. Read more on AAAI.org..

AAAI Statement Condemning Racism and Calling to Action

As a scientific society, AAAI is against the violence against Black people and the systemic racism that has gone unaddressed for too long. Read more on AAAI.org…

Letter from the Editor

By Ashok Goel

We are delighted to bring the brand new Interactive AI Magazine to you, a digital and expanded version of AI Magazine.

 

 


 

AI Magazine Archives →

AI for Social Impact – the role of AI in fighting social injustice and improving society

Vol. 41 No. 4

Cover of Issue 261 - AI MagazineChallenges of Human-Aware AI Systems – Research challenges, progress, ethical quandries

Vol. 41 No. 3

AI Magazine Cover Summer2020 The Defense Advanced Research Project Agency’s (DARPA) Impact on Artificial Intelligence

Vol. 41 No. 2

AI Magazine Cover Spring2020Innovative Applications of Artificial Intelligence (IAAI-18): The SURTAC Application

Vol. 41 No. 1

AI Magazine Cover Winter2019Standing on the Feet of Giants — Successful Research in AI

Vol. 40 No. 4

AI Magazine Cover Fall 2019AI and Context – Addressing context for human-machine teams

Vol. 40 No. 3