ACM Comm 2017 09 Moving Beyond the Turing Test with the Allen AI Science Challenge (Notes)
Moving Beyond the Turing Test with the Allen AI Science Challenge |
Contents
Automatic Program Repair with Evolutionary Computation
The authors ran the first AI2 Challenge in 2015.
Always interested in how intelligence is defined.
People
- Lee Sedol[1]
- John Markoff[2]
- Gary Marcus[3]
- Chaim Linhart[4] Won first prize.
- Benedikt Wilbertz[5] Won second prize leading the Talkwalker team.
- Alejandro Mosquera[6] Won third place.
Ideas
- Determining whether a system truly displays artificial intelligence is difficult and complex, and well-known assessments like the Turing Test are not suited to the task.
- The Allen Institute for Artificial Intelligence suggests that answering science exam questions successfully is a better measure of machine intelligence and designed a global competition to engage the research community in this approach.
- The outcome of the Allen AI Science Challenge highlights the current limitations of AI research in language understanding, reasoning, and commonsense knowledge; the highest scores are still limited to the capabilities of information-retrieval methods.
- AI2 ran the first challenge as answering eighth-grade science questions.
- John Markoff wrote that the Turing Test is more a test of human gullibility than machine intelligence. Which is true.
- Turing Olympics - Tests from across A.I. sub disciplines for a more comprehensive result.
References
- Allen Institute for Artificial Intelligence (AI2)[7]
- AlphaGo[8]
- Kaggle[9] Site for online science projects.
- Talkwalker[10]
- FreeBase[11]
- Wolfram Alpha[12]
- START
Internal Links
Parent Article: Reading Notes