Advancing Cognitive Science and AI with Cognitive-AI Benchmarking

Published in Proceedings of the Annual Meeting of the Cognitive Science Society, 2023

Recommended citation: Binder, F. J., Cross, L. M., Friedman, Y., Hawkins, R., Yamins, D. L., & Fan, J. E. (2023). Advancing cognitive science and AI with Cognitive-AI Benchmarking. In Proceedings of the Annual Meeting of the Cognitive Science Society (Vol. 45, No. 45). https://escholarship.org/uc/item/5v56249j

Workshop Description

What are the current limits of AI models in explaining human cognition and behavior? How might approaches from the cognitive sciences drive the development of more robust and reliable AI systems? The goal of this workshop is bring together researchers across cognitive science and artificial intelligence (AI) to engage with these questions and identify opportunities to work together to advance progress in both fields. In particular, we propose Cognitive-AI Benchmarking as a particularly promising strategy — that is, the community-coordinated establishment of common benchmarks, tools, and best practices for model-human comparisons across diverse and ecologically relevant domains and tasks. We will host a combination of talks, panel discussion, and breakout activities to: highlight past successes in Cognitive-AI Benchmarking and limitations of current approaches, share tools and best practices, and outline future challenges and goals for the field.

Access paper here Workshop website