{"id":108346,"date":"2020-06-08T03:45:33","date_gmt":"2020-06-08T10:45:33","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2020\/06\/openai-uberai-proposed-a-new-method-to-neural-architecture-search"},"modified":"2020-06-08T03:45:33","modified_gmt":"2020-06-08T10:45:33","slug":"openai-uberai-proposed-a-new-method-to-neural-architecture-search","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2020\/06\/openai-uberai-proposed-a-new-method-to-neural-architecture-search","title":{"rendered":"OpenAI &amp; UberAI Proposed A New Method To Neural Architecture Search"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/openai-uberai-proposed-a-new-method-to-neural-architecture-search2.jpg\"><\/a><\/p>\n<p>Recently, <a href=\"https:\/\/analyticsindiamag.com\/openai-gpt-2-xl-released\/\">OpenAI<\/a> collaborated with <a href=\"https:\/\/analyticsindiamag.com\/uber-ai-labs-layoffs\/\">UberAI<\/a> to propose a new approach \u2014 <a href=\"https:\/\/arxiv.org\/pdf\/2005.13092.pdf\" target=\"_blank\" rel=\"nofollow\">Synthetic Petri Dish<\/a> \u2014 for accelerating the most expensive step of <a href=\"https:\/\/analyticsindiamag.com\/neural-architecture-search-unsupervised\/\">Neural Architecture Search<\/a> (NAS). The researchers explored whether the computational efficiency of NAS can be improved by creating a new kind of surrogate, one that can benefit from miniaturised training and still generalise beyond the observed distribution of ground-truth evaluations.<\/p>\n<p><a href=\"https:\/\/analyticsindiamag.com\/top-time-series-model-state-of-the-art\/\">Deep neural networks<\/a> have been witnessing success and are able to mitigate various business challenges such as speech recognition, image recognition, machine translation, among others for a few years now.<\/p>\n<p>According to the researchers, <a href=\"https:\/\/analyticsindiamag.com\/neural-architecture-search-an-overview\/\">Neural Architecture Search<\/a> (NAS) explores a large space of architectural motifs and is a compute-intensive process that often involves ground-truth evaluation of each motif by instantiating it within a large network, and training and evaluating the network with thousands or more data samples. By motif, the researchers meant the design of a repeating recurrent cell or activation function that is repeated often in a larger <a href=\"https:\/\/analyticsindiamag.com\/facebook-ai-research-launches-blender-a-human-like-chatbot\/\">Neural Network<\/a> blueprint.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Recently, OpenAI collaborated with UberAI to propose a new approach \u2014 Synthetic Petri Dish \u2014 for accelerating the most expensive step of Neural Architecture Search (NAS). The researchers explored whether the computational efficiency of NAS can be improved by creating a new kind of surrogate, one that can benefit from miniaturised training and still generalise [\u2026]<\/p>\n","protected":false},"author":396,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[43,6],"tags":[],"class_list":["post-108346","post","type-post","status-publish","format-standard","hentry","category-business","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/108346","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/396"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=108346"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/108346\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=108346"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=108346"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=108346"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}