Difference between revisions of "Cognitive Robotics Resources"

From David Vernon's Wiki
Jump to: navigation, search
(Courses)
(White Papers)
 
(14 intermediate revisions by the same user not shown)
Line 14: Line 14:
  
 
== Symposia and Workshops ==
 
== Symposia and Workshops ==
 
+
[http://www.aicworkshopseries.org/ AIC - Artificial Intelligence and Cognition International Workshop Series] <BR>
[[File:new.jpg]] [https://visca.engin.umich.edu/ Virtual International Symposium on Cognitive Architecture (VISCA 2021)], with videos and slides, including a session on robot cognitive architectures.
+
[[File:new.jpg]] [https://transair-bridge.org/workshop-2021/ Cognitive Architectures for Robot Agents], 2021, with videos of 15 short talks by leading experts <BR>
<BR>
+
[[File:new.jpg]] [https://transair-bridge.org/workshop-2021/ Cognitive Architectures for Robot Agents], with videos.
+
 
[http://ifrr.org/cognitive-robotics International Foundation for Robotics Research Colloquium on Cognitive Robotics], 8 October 2020;  the video proceedings are [https://www.youtube.com/watch?v=VKB9m4hOjlc&feature=youtu.be here] <BR>
 
[http://ifrr.org/cognitive-robotics International Foundation for Robotics Research Colloquium on Cognitive Robotics], 8 October 2020;  the video proceedings are [https://www.youtube.com/watch?v=VKB9m4hOjlc&feature=youtu.be here] <BR>
[http://www.aicworkshopseries.org/ AIC - Artificial Intelligence and Cognition International Workshop Series]
+
[[File:new.jpg]] [https://ease-crc.org/teaching-cognitive-robotics/ Teaching & Training Students for Cognitive Robotics, International Conference on Intelligent Robots and Systems], IROS, Detroit, USA, 1-5 October, 2023 <BR>
 +
[https://visca.engin.umich.edu/ Virtual International Symposium on Cognitive Architecture (VISCA 2021)], with videos and slides, including a session on robot cognitive architectures.<BR>
  
 
== Cognitive Architectures ==
 
== Cognitive Architectures ==
Line 83: Line 82:
 
=== Videos ===
 
=== Videos ===
  
 +
[[File:new.jpg]] [https://www.youtube.com/watch?v=W3gIV81GYm4 iCub Explained] <BR>
 +
[[File:new.jpg]] [https://www.youtube.com/watch?v=qAG3XkkXH1A Automata: movement and states of consciousness]. Compelling demonstrations of the impact of motion on the way humans understand other agents. <BR>
 
[[File:new.jpg]] [https://transair-bridge.org/workshop-2021/ Cognitive Architectures for Robot Agents]: a collection of 15 talks from leading experts <BR>
 
[[File:new.jpg]] [https://transair-bridge.org/workshop-2021/ Cognitive Architectures for Robot Agents]: a collection of 15 talks from leading experts <BR>
 
[https://www.youtube.com/watch?v=7s0CpRfyYp8 The real reason for brains] featuring Daniel Wolpert <BR>
 
[https://www.youtube.com/watch?v=7s0CpRfyYp8 The real reason for brains] featuring Daniel Wolpert <BR>
Line 90: Line 91:
 
[https://www.youtube.com/watch?v=hrnoY6J8ddE&feature=youtu.be EASE Milestone Spoon Challenge] <BR>
 
[https://www.youtube.com/watch?v=hrnoY6J8ddE&feature=youtu.be EASE Milestone Spoon Challenge] <BR>
 
[http://www.vernon.eu/euCognition_Elizabeth_Spelke.mp4 Core Knowledge of Number and Geometry] featuring Elizabeth Spelke at [http://www.vernon.eu/euCognition/inaugural.htm the inaugural meeting] of [http://www.eucognition.org euCognition] in 2006<BR>
 
[http://www.vernon.eu/euCognition_Elizabeth_Spelke.mp4 Core Knowledge of Number and Geometry] featuring Elizabeth Spelke at [http://www.vernon.eu/euCognition/inaugural.htm the inaugural meeting] of [http://www.eucognition.org euCognition] in 2006<BR>
[[File:new.jpg]] [https://www.eva.mpg.de/psycho/publications-and-videos/study-videos/ Videos] from the Warneken and Tomasello (2006) paper on altruistic helping in human infants and young chimpanzees: Science, 311, 1301-1303. <BR>
+
[https://www.eva.mpg.de/psycho/publications-and-videos/study-videos/ Videos] from the Warneken and Tomasello (2006) paper on altruistic helping in human infants and young chimpanzees: Science, 311, 1301-1303. <BR>
 +
[[File:new.jpg]] [https://eu-robotics.net/video-eurobin-advancing-cognition-enabled-transferable-embodied-ai/ euROBIN – Advancing Cognition-Enabled Transferable Embodied AI] featuring Michael Beetz<BR>
 +
[[File:new.jpg]] [https://www.youtube.com/watch?v=mhWwoaoxIyc How the body shapes the way we think] Rolf Pfeifer at TEDxZurich
  
 
== Research ==
 
== Research ==
Line 105: Line 108:
 
[https://daniel86.github.io/KER-robot-ontologies/ Ontology-based Approaches to Robot Autonomy]<BR>
 
[https://daniel86.github.io/KER-robot-ontologies/ Ontology-based Approaches to Robot Autonomy]<BR>
 
[https://ease-crc.github.io/soma/ Socio-physical Models of Activities (SOMA)]
 
[https://ease-crc.github.io/soma/ Socio-physical Models of Activities (SOMA)]
 +
 +
=== Dynamic Field Theory ===
 +
[[File:new.jpg]] [https://dynamicfieldtheory.org Dynamic Field Theory]<BR>
 +
[[File:new.jpg]] [https://www.frontiersin.org/articles/10.3389/fnbot.2016.00014/full Developing Dynamic Field Theory Architectures for Embodied Cognitive Systems with cedar]<BR>
  
 
=== Robot Platforms ===
 
=== Robot Platforms ===
Line 117: Line 124:
  
 
=== White Papers ===
 
=== White Papers ===
[http://www.kutayzorlu.com/wp-content/uploads/2017/08/Computing_Cognition_WhitePaper.pdf Computing, cognition and the future of knowing] John Kelly, Senior Vice President, IBM Research and Solutions Portfolio. <BR>[http://www.vernon.eu/euCognition/network_actions/NA057-1_outcome.pdf Dynamic Field Theory (DFT): Applications in Cognitive Science and Robotics]<BR>
+
[[File:new.jpg]] [https://www.uni-bielefeld.de/(en)/ZiF/FG/2019Behavior/ Cognitive Behavior of Humans, Animals, and Machines: Situation Model Perspectives] <BR>
 +
[http://www.kutayzorlu.com/wp-content/uploads/2017/08/Computing_Cognition_WhitePaper.pdf Computing, cognition and the future of knowing] John Kelly, Senior Vice President, IBM Research and Solutions Portfolio. <BR>
 +
[http://www.vernon.eu/euCognition/network_actions/NA057-1_outcome.pdf Dynamic Field Theory (DFT): Applications in Cognitive Science and Robotics]<BR>
 
[http://www.vernon.eu/euCognition/network_actions/NA149-1_outcome.pdf Observing Human Behaviour in Image Sequences: The Video-Hermeneutic Challenge]<BR>
 
[http://www.vernon.eu/euCognition/network_actions/NA149-1_outcome.pdf Observing Human Behaviour in Image Sequences: The Video-Hermeneutic Challenge]<BR>
 
[http://www.vernon.eu/euCognition/network_actions/NA018-1_outcome.pdf Cognitive Ontologies: Mapping Structure and Function of the Brain from a Systemic View]<BR>
 
[http://www.vernon.eu/euCognition/network_actions/NA018-1_outcome.pdf Cognitive Ontologies: Mapping Structure and Function of the Brain from a Systemic View]<BR>
Line 124: Line 133:
 
[http://www.vernon.eu/euCognition/enactive_AI_white_paper.pdf Enactive Artificial Intelligence]<BR>
 
[http://www.vernon.eu/euCognition/enactive_AI_white_paper.pdf Enactive Artificial Intelligence]<BR>
 
[http://www.vernon.eu/euCognition/coevolution_white_paper.pdf CoEvolutionary Approaches in Cognitive Robotic Systems Design]<BR>
 
[http://www.vernon.eu/euCognition/coevolution_white_paper.pdf CoEvolutionary Approaches in Cognitive Robotic Systems Design]<BR>
[http://www.vernon.eu/euCognition/asm-whitepaper-final-060804.pdf Action Selection for Intelligent Systems]
+
[http://www.vernon.eu/euCognition/asm-whitepaper-final-060804.pdf Action Selection for Intelligent Systems] <BR>
 +
[[File:new.jpg]] [https://www.uni-bielefeld.de/einrichtungen/zif/groups/previous/archive-rg/2019cognitive-behavior/index.xml Cognitive Behavior of Humans, Animals, and Machines: Situation Model Perspectives]<BR>
  
 
=== Classic Papers ===
 
=== Classic Papers ===
Line 171: Line 181:
 
[http://cognitive-robotics.csail.mit.edu/ 2nd Summer School on Cognitive Robotics] MIT 2018<BR>
 
[http://cognitive-robotics.csail.mit.edu/ 2nd Summer School on Cognitive Robotics] MIT 2018<BR>
 
[https://sites.usc.edu/cognitive-robotics/ 3rd Summer School on Cognitive Robotics] USC 2019<BR>
 
[https://sites.usc.edu/cognitive-robotics/ 3rd Summer School on Cognitive Robotics] USC 2019<BR>
[[File:new.jpg]] [https://ease-crc.org/ease-fall-school-2021/ EASE Fall School 2021] Cognition-enabled Robot Manipulation<BR>
+
[https://ease-crc.org/ease-fall-school-2021/ EASE Fall School 2021] Cognition-enabled Robot Manipulation<BR>
[[File:new.jpg]] [https://ease-crc.org/ease-fall-school-2022/ EASE Fall School 2022] Cognition-enabled Robot Manipulation
+
[https://ease-crc.org/ease-fall-school-2022/ EASE Fall School 2022] Cognition-enabled Robot Manipulation
  
 
== Teaching Resources ==
 
== Teaching Resources ==
Line 199: Line 209:
 
=== Courses ===
 
=== Courses ===
  
[http://www.vernon.eu/cognitive_robotics/index.htm Introduction to Cognitive Robotics] ([[www.cognitiverobotics.net]])<BR>
+
[http://www.vernon.eu/cognitive_robotics/index.htm Introduction to Cognitive Robotics] (www.cognitiverobotics.net)<BR>
 
[http://www.vernon.eu/ACS.htm Artificial Cognitive Systems]; teaching material for [http://vernon.eu/publications/14_Vernon_Artificial_Cognitive_Systems_Preamble.pdf Artificial Cognitive Systems - A Primer], [http://mitpress.mit.edu/books/artificial-cognitive-systems MIT Press], 2014; click '''[[Artificial Cognitive Systems|here]]''' for additional support material.<BR>
 
[http://www.vernon.eu/ACS.htm Artificial Cognitive Systems]; teaching material for [http://vernon.eu/publications/14_Vernon_Artificial_Cognitive_Systems_Preamble.pdf Artificial Cognitive Systems - A Primer], [http://mitpress.mit.edu/books/artificial-cognitive-systems MIT Press], 2014; click '''[[Artificial Cognitive Systems|here]]''' for additional support material.<BR>
 
[http://www.vernon.eu/ECVision/education/On-line_Cognitive_Vision_Course.htm Cognitive Computer Vision]<BR>
 
[http://www.vernon.eu/ECVision/education/On-line_Cognitive_Vision_Course.htm Cognitive Computer Vision]<BR>
Line 210: Line 220:
 
== Degrees in Cognitive Systems ==
 
== Degrees in Cognitive Systems ==
  
The following is a sample of the Master-level degrees that are available in cognitive systems.   
+
The following is a sample of the Master-level degrees that are available in cognitive systems.  
 
+
    
 +
[[File:new.jpg]] [https://www.ouc.ac.cy/index.php/en/studies/master/cos Open University of Cyprus  and University of Cyprus] Joint Master's Degree Program in Cognitive Systems (120 ECTS) <BR>
 
[https://his.se/en/education/informatics/human-robot-interaction-masters-programme-mrima/ University of Skövde, Sweden] Human-Robot Interaction (120 ECTS) <BR>
 
[https://his.se/en/education/informatics/human-robot-interaction-masters-programme-mrima/ University of Skövde, Sweden] Human-Robot Interaction (120 ECTS) <BR>
 
[http://www.birmingham.ac.uk/postgraduate/courses/taught/psych/computation-neuro-cognitive-robotics.aspx University of Birmingham] Computational Neuroscience and Cognitive Robotics MSc <BR>
 
[http://www.birmingham.ac.uk/postgraduate/courses/taught/psych/computation-neuro-cognitive-robotics.aspx University of Birmingham] Computational Neuroscience and Cognitive Robotics MSc <BR>
Line 218: Line 229:
 
[http://www2.warwick.ac.uk/fac/sci/dcs/teaching/pgcourses/cogsys-msc/ University of Warwick] M.Sc. in Cognitive Systems<BR>
 
[http://www2.warwick.ac.uk/fac/sci/dcs/teaching/pgcourses/cogsys-msc/ University of Warwick] M.Sc. in Cognitive Systems<BR>
 
[http://www.degrees.uzh.ch/studiengang.php?CG_SAP_id=50332893&SC_SAP_id=50332888&lang=en University of Zurich] Master of Science in Informatics: Field of study Multimodal and Cognitive Systems<BR>
 
[http://www.degrees.uzh.ch/studiengang.php?CG_SAP_id=50332893&SC_SAP_id=50332888&lang=en University of Zurich] Master of Science in Informatics: Field of study Multimodal and Cognitive Systems<BR>
[http://robotics.jacobs-university.de/node/280 Jacobs University, Germany] Cognitive Systems and Processes<BR>
 
  
 
== Research Networks and Societies ==
 
== Research Networks and Societies ==

Latest revision as of 23:55, 20 November 2023

New.jpg signifies a recently added item

What is Cognition?

42 definitions of cognition ... it has proved difficult to define cognition: read Aaron Sloman's argument that it isn't worth trying (go to the end of the article)
A definition of a cognitive system from the Springer Reference Guide to Computer Vision
What is Cognition? in Current Biology 29, R603-R622, 2019
Cognitive Robotics, Sandini et al., in Encyclopedia of Robotics, M. Ang, O. Khatib, and B. Siciliano (Eds.), Springer, Berlin, Heidelberg, in press.

Robots

IEEE Guide to the World of Robots

Symposia and Workshops

AIC - Artificial Intelligence and Cognition International Workshop Series
New.jpg Cognitive Architectures for Robot Agents, 2021, with videos of 15 short talks by leading experts
International Foundation for Robotics Research Colloquium on Cognitive Robotics, 8 October 2020; the video proceedings are here
New.jpg Teaching & Training Students for Cognitive Robotics, International Conference on Intelligent Robots and Systems, IROS, Detroit, USA, 1-5 October, 2023
Virtual International Symposium on Cognitive Architecture (VISCA 2021), with videos and slides, including a session on robot cognitive architectures.

Cognitive Architectures

Design Principles Articles

Design principles for biologically inspired cognitive robotics
Desiderata for Developmental Cognitive Architectures
A Standard Model of the Mind, now referred to as a Common Model of Cognition

Survey Articles

I. Kotseruba and J. Tsotsos (2020). 40 years of cognitive architectures: core cognitive abilities and practical applications
Companion website for 40 years of cognitive architectures: core cognitive abilities and practical applications
Biologically Inspired Cognitive Architectures Society (BICA) comparison of 25 cognitive architectures
B. Goertzl et al. (2010). A world survey of artificial brain projects, Part II: Biologically inspired cognitive architectures
Summaries of twenty cognitive architectures from D. Vernon, C. von Hofsten, and L. Fadiga. "A Roadmap for Cognitive Development in Humanoid Robots", Cognitive Systems Monographs (COSMOS), Vol. 11, Springer, 2010.

Individual Architecture Articles

MECA The Multipurpose Enhanced Cognitive Architecture (MECA)
MECA An Overview of the Multipurpose Enhanced Cognitive Architecture (MECA)
iCub The iCub Software Architecture: Evolution and Lessons Learned; not a cognitive architecture but relevant to the system architecture / software architecture aspects relevant to the implementation of a cognitive architecture.
iCub iCub-HRI: A Software Framework for Complex Human–Robot Interaction Scenarios on the iCub Humanoid Robot ibid.

Websites

Symbolic / Cognitivist
MusiCog

Emergent
SPA (Semantic Pointer Architecture) in Nengo

Hybrid
ACT-R
CLARION
CRAM
The iCog Initiative
LIDA
Soar

Presentations, Talks, Lectures

Yann LeCun Cake Analogy 2.0

Lectures from Cognitive Robotics at www.cognitiverobotics.net
Module 7, Lecture 1. Role and requirements; desirable characteristics; core cognitive abilities.
Module 7, Lecture 2. Cognitive architectures: Example cognitive architectures: Example cognitive architectures: Soar, ACT-R, CLARION, ICARUS, BBD, ISAC.
Module 7, Lecture 3. The CRAM cognitive architecture: design principles; structure.
Module 7, Lecture 4. The CRAM cognitive architecture: operation.

Lectures from Artificial Cognitive Systems at www.vernon.eu/ACS.htm
Lecture 7: Cognitive Architectures 1: What is a cognitive architecture? Desirable characteristics. Designing a cognitive architecture.
Lecture 8: Cognitive Architectures 2: Example cognitive architectures: Soar, ACT/R, ICARUS, Global Workspace, SASE, Darwin.
Lecture 9: Cognitive Architectures 3: Example cognitive architectures: ISAC.
Lecture 10: Cognitive Architectures 4: Example cognitive architectures: CLARION.
Lecture 11: Cognitive Architectures 5: Example cognitive architectures: CRAM. The Common Model of Cognition.

Videos

New.jpg iCub Explained
New.jpg Automata: movement and states of consciousness. Compelling demonstrations of the impact of motion on the way humans understand other agents.
New.jpg Cognitive Architectures for Robot Agents: a collection of 15 talks from leading experts
The real reason for brains featuring Daniel Wolpert
Open Research and the Soar Cognitive Architecture featuring John Laird
Tutorial on the CRAM Cognitive Architecture featuring Gayane Kazhoyan
New.jpg EASE Milestone Robot Demo and a related IEEE Spectrum article: "It’s (Still) Really Hard for Robots to Autonomously Do Household Chores"
EASE Milestone Spoon Challenge
Core Knowledge of Number and Geometry featuring Elizabeth Spelke at the inaugural meeting of euCognition in 2006
Videos from the Warneken and Tomasello (2006) paper on altruistic helping in human infants and young chimpanzees: Science, 311, 1301-1303.
New.jpg euROBIN – Advancing Cognition-Enabled Transferable Embodied AI featuring Michael Beetz
New.jpg How the body shapes the way we think Rolf Pfeifer at TEDxZurich

Research

Research Challenges

Social Cognition for Human-Robot Symbiosis—Challenges and Building Blocks
The limits and potentials of deep learning for robotics
Building machines that learn and think like people
Controversies in Cognitive Systems Research
A First Draft Analysis of Some Meta-Requirements for Cognitive Systems in Robots

Knowledge-based Approaches

Ontology-based Approaches to Robot Autonomy
Socio-physical Models of Activities (SOMA)

Dynamic Field Theory

New.jpg Dynamic Field Theory
New.jpg Developing Dynamic Field Theory Architectures for Embodied Cognitive Systems with cedar

Robot Platforms

openEASE Open Knowledge for AI-Enabled Robots
iCub open source cognitive humanoid robotic platform

Research Networks

TC-CORO: IEEE Technical Committee on Cognitive Robotics
EUCog: European Society for Cognitive Systems
BICA: Biologically Inspired Cognitive Architectures Society

White Papers

New.jpg Cognitive Behavior of Humans, Animals, and Machines: Situation Model Perspectives
Computing, cognition and the future of knowing John Kelly, Senior Vice President, IBM Research and Solutions Portfolio.
Dynamic Field Theory (DFT): Applications in Cognitive Science and Robotics
Observing Human Behaviour in Image Sequences: The Video-Hermeneutic Challenge
Cognitive Ontologies: Mapping Structure and Function of the Brain from a Systemic View
Coordinating with the Future: the Anticipatory Nature of Representation
Communication and Distributed Control in Multi-Agent Systems: Preliminary Model of Micro-unmanned Aerial Vehicle (MAV) Swarms
Enactive Artificial Intelligence
CoEvolutionary Approaches in Cognitive Robotic Systems Design
Action Selection for Intelligent Systems
New.jpg Cognitive Behavior of Humans, Animals, and Machines: Situation Model Perspectives

Classic Papers

New.jpg Cognitive Maps in Rats and Men (if you are short of time, read the first paragraph and then the text at the end, after the last figure)

Journals

IEEE Transactions on Cognitive and Developmental Systems
Cognitive Systems Research
Biologically Inspired Cognitive Architectures
Cognitive Computation and Systems

Books

Cognitive Architectures by M. Ferreira, J. Sequeira, and R. Ventura (Eds.)

Research Centers and Labs

New.jpg Center for Cognitive Robotics Fraunhofer IPA, Germany
New.jpg Cognitive Robotics and AI Lab Kent University, USA

Software Resources

EASE - Everyday Activity Science and Engineering: Open Knowledge for AI-Enabled Robots
CRAM: Cognitive Robot Abstract Machine
KnowRob: Knowledge Processing for Robots
The CLARION Cognitive Architecture Project
BECCA: Brain-Emulating Cognition and Control Architecture
AKIRA: C++ development framework to build cognitive architectures and complex artificial intelligent agents
AmonI: Artificial Models of Natural Intelligence]
CAST: The CoSy Architecture Schema Toolkit
YARP: Yet Another Robot Platform.
ROS: Robot Operating System

Datasets

EASE - Everyday Activity Science and Engineering
ALFRED Benchmark for Interpreting Grounded Instructions for Everyday Tasks

Ethics

New.jpg Principles of Robotics
New.jpg International Conference Series on Robot Ethics and Standards

Summer Schools

1st Summer School on Cognitive Robotics MIT 2017
2nd Summer School on Cognitive Robotics MIT 2018
3rd Summer School on Cognitive Robotics USC 2019
EASE Fall School 2021 Cognition-enabled Robot Manipulation
EASE Fall School 2022 Cognition-enabled Robot Manipulation

Teaching Resources

Learning Environments

New.jpg Interactive Learning Environment for Cognitive Robotics (INTEL4CORO)

Tutorials

IEEE Robotics and Automation Magazine Tutorials
Tutorial on Embodiment
Control engineering of autonomous cognitive vehicles - a practical tutorial
The dynamic neural field approach to cognitive robotics
Neuronal Dynamics Approaches to Cognitive Robotics

Books

New.jpg Human-Robot Interaction - An Introduction An online textbook by C. Bartneck, T. Belpaeme, F. Eyssel, T. Kanda, M. Keijsers, and S. Šabanović

Model Curricula

euCognition Cognitive Systems Model Curriculum
University of Skövde MSc in Cognitive Systems Model Curriculum

Courses

Introduction to Cognitive Robotics (www.cognitiverobotics.net)
Artificial Cognitive Systems; teaching material for Artificial Cognitive Systems - A Primer, MIT Press, 2014; click here for additional support material.
Cognitive Computer Vision
The Construct A Platform to Learn/Teach Robotics from Zero ... everything from robotics theory to ROS based robot programming
MIT Open Courseware: Computational Cognitive Science
MIT Center for Brains, Minds and Machines (CBMM) Science of Intelligence Learning Hub
Introduction to Mobile Robotics University of Freiburg
Autonomous Mobile Robots ETH Zürich

Degrees in Cognitive Systems

The following is a sample of the Master-level degrees that are available in cognitive systems.

New.jpg Open University of Cyprus and University of Cyprus Joint Master's Degree Program in Cognitive Systems (120 ECTS)
University of Skövde, Sweden Human-Robot Interaction (120 ECTS)
University of Birmingham Computational Neuroscience and Cognitive Robotics MSc
Universitat Pompeu Fabra, Spain Interdisciplinary Master in Cognitive Systems and Interactive Media (60 ECTS)
Technical University of Munich Robotics, Cognition, and Intelligence
University of Warwick M.Sc. in Cognitive Systems
University of Zurich Master of Science in Informatics: Field of study Multimodal and Cognitive Systems

Research Networks and Societies

TC-CORO: IEEE Technical Committee on Cognitive Robotics
euCognition: European Network for the Advancement of Artificial Cognitive Systems. This network was the first in a series of three networks, culminating in EUCog below.
EUCog: European Society for Cognitive Systems
BICA: Biologically Inspired Cognitive Architectures Society
ESSCS: European Society for the Study of Cognitive Systems