{"id":174750,"date":"2023-10-26T01:23:46","date_gmt":"2023-10-26T06:23:46","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2023\/10\/human-like-systematic-generalization-through-a-meta-learning-neural-network"},"modified":"2023-10-26T01:23:46","modified_gmt":"2023-10-26T06:23:46","slug":"human-like-systematic-generalization-through-a-meta-learning-neural-network","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2023\/10\/human-like-systematic-generalization-through-a-meta-learning-neural-network","title":{"rendered":"Human-like systematic generalization through a meta-learning neural network"},"content":{"rendered":"

<\/a><\/p>\n

The power of human language and thought arises from systematic compositionality\u2014the algebraic ability to understand and produce novel combinations from known components. Fodor and Pylyshyn1 famously argued that artificial neural networks lack this capacity and are therefore not viable models of the mind. Neural networks have advanced considerably in the years since, yet the systematicity challenge persists. Here we successfully address Fodor and Pylyshyn\u2019s challenge by providing evidence that neural networks can achieve human-like systematicity when optimized for their compositional skills. To do so, we introduce the meta-learning for compositionality (MLC) approach for guiding training\u2026 More.<\/p>\n

\n

Over 35 years ago, when Fodor and Pylyshyn raised the issue of systematicity in neural networks1<\/a><\/sup>, today\u2019s models19<\/a><\/sup> and their language skills were probably unimaginable. As a credit to Fodor and Pylyshyn\u2019s prescience, the systematicity debate has endured. Systematicity continues to challenge models11<\/a>,12<\/a>,13<\/a>,14<\/a>,15<\/a>,16<\/a>,17<\/a>,18<\/a><\/sup> and motivates new frameworks34<\/a>,35<\/a>,36<\/a>,37<\/a>,38<\/a>,39<\/a>,40<\/a>,41<\/a><\/sup>. Preliminary experiments reported in Supplementary Information 3<\/a> suggest that systematicity is still a challenge, or at the very least an open question, even for recent large language models such as GPT-4. To resolve the debate, and to understand whether neural networks can capture human-like compositional skills, we must compare humans and machines side-by-side, as in this Article and other recent work7<\/a>,42<\/a>,43<\/a><\/sup>. In our experiments, we found that the most common human responses were algebraic and systematic in exactly the ways that Fodor and Pylyshyn1<\/a><\/sup> discuss. However, people also relied on inductive biases that sometimes support the algebraic solution and sometimes deviate from it; indeed, people are not purely algebraic machines3<\/a>,6<\/a>,7<\/a><\/sup>. We showed how MLC enables a standard neural network optimized for its compositional skills to mimic or exceed human systematic generalization in a side-by-side comparison. MLC shows much stronger systematicity than neural networks trained in standard ways, and shows more nuanced behaviour than pristine symbolic models. MLC also allows neural networks to tackle other existing challenges, including making systematic use of isolated primitives11<\/a>,16<\/a><\/sup> and using mutual exclusivity to infer meanings44<\/a><\/sup>.<\/p>\n

Our use of MLC for behavioural modelling relates to other approaches for reverse engineering human inductive biases. Bayesian approaches enable a modeller to evaluate different representational forms and parameter settings for capturing human behaviour, as specified through the model\u2019s prior45<\/a><\/sup>. These priors can also be tuned with behavioural data through hierarchical Bayesian modelling46<\/a><\/sup>, although the resulting set-up can be restrictive. MLC shows how meta-learning can be used like hierarchical Bayesian models for reverse-engineering inductive biases (see ref. 47<\/a><\/sup> for a formal connection), although with the aid of neural networks for greater expressive power. Our research adds to a growing literature, reviewed previously48<\/a><\/sup>, on using meta-learning for understanding human49<\/a>,50<\/a>,51<\/a><\/sup> or human-like behaviour52<\/a>,53<\/a>,54<\/a><\/sup>. In our experiments, only MLC closely reproduced human behaviour with respect to both systematicity and biases, with the MLC (joint) model best navigating the trade-off between these two blueprints of human linguistic behaviour. Furthermore, MLC derives its abilities through meta-learning, where both systematic generalization and the human biases are not inherent properties of the neural network architecture but, instead, are induced from data.<\/p>\n

Despite its successes, MLC does not solve every challenge raised in Fodor and Pylyshyn1<\/a><\/sup>. MLC does not automatically handle unpractised forms of generalization or concepts outside the meta-learning distribution, reducing the scope of entirely novel structures it can correctly process (compare the encouraging results on learning novel rules reported in Supplementary Information 1<\/a>, with its failure on the SCAN and COGS productivity splits). Moreover, MLC is failing to generalize to nuances in inductive biases that it was not optimized for, as we explore further through an additional behavioural and modelling experiment in Supplementary Information 2<\/a>. In the language of machine learning, we conclude that the meta-learning strategy succeeds when generalization makes a new episode in-distribution with respect to the training episodes, even when the specific test items are out-of-distribution with respect to the study examples in the episode. However, meta-learning alone will not allow a standard network to generalize to episodes that are in turn out-of-distribution with respect to the ones presented during meta-learning. The current architecture also lacks a mechanism for emitting new symbols2<\/a><\/sup>, although new symbols introduced through the study examples could be emitted through an additional pointer mechanism55<\/a><\/sup>. Last, MLC is untested on the full complexity of natural language and on other modalities; therefore, whether it can achieve human-like systematicity, in all respects and from realistic training experience, remains to be determined. Nevertheless, our use of standard transformers will aid MLC in tackling a wider range of problems at scale. For example, a large language model could receive specialized meta-training56<\/a><\/sup>, optimizing its compositional skills by alternating between standard training (next word prediction) and MLC meta-training that continually introduces novel words and explicitly improve systematicity (Fig. 1<\/a>). For vision problems, an image classifier or generator could similarly receive specialized meta-training (through current prompt-based procedures57<\/a><\/sup>) to learn how to systematically combine object features or multiple objects with relations.<\/p>\n","protected":false},"excerpt":{"rendered":"

The power of human language and thought arises from systematic compositionality\u2014the algebraic ability to understand and produce novel combinations from known components. Fodor and Pylyshyn1 famously argued that artificial neural networks lack this capacity and are therefore not viable models of the mind. Neural networks have advanced considerably in the years since, yet the systematicity [\u2026]<\/p>\n","protected":false},"author":359,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[],"class_list":["post-174750","post","type-post","status-publish","format-standard","hentry","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/174750","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/359"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=174750"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/174750\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=174750"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=174750"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=174750"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}