{"id":165771,"date":"2023-06-14T16:27:13","date_gmt":"2023-06-14T21:27:13","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2023\/06\/mean-shift-exploration-in-shape-assembly-of-robot-swarms-communications"},"modified":"2023-06-14T16:27:13","modified_gmt":"2023-06-14T21:27:13","slug":"mean-shift-exploration-in-shape-assembly-of-robot-swarms-communications","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2023\/06\/mean-shift-exploration-in-shape-assembly-of-robot-swarms-communications","title":{"rendered":"Mean-shift exploration in shape assembly of robot swarms Communications"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/mean-shift-exploration-in-shape-assembly-of-robot-swarms-communications2.jpg\"><\/a><\/p>\n<p>The fascinating collective behaviors of biological systems have inspired extensive studies on shape assembly of robot swarms<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Ren, W., Beard, R. W. & Atkins, E. M. Information consensus in multivehicle cooperative control. IEEE Control Syst. Mag. 27, 71&ndash;82 (2007).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR6\" id=\"ref-link-section-d32938973e535\">6<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Brambilla, M., Ferrante, E., Birattari, M. & Dorigo, M. Swarm robotics: a review from the swarm engineering perspective. Swarm Intell. 7, 1&ndash;41 (2013).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR7\" id=\"ref-link-section-d32938973e535_1\">7<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Oh, K. K., Park, M. C. & Ahn, H. S. A survey of multi-agent formation control. Automatica 53424&ndash;440 (2015).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR8\" id=\"ref-link-section-d32938973e535_2\">8<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 9\" title=\"Oh, H., Shirazi, A. R., Sun, C. & Jin, Y. Bio-inspired self-organising multi-robot pattern formation: a review. Rob. Autom. Syst. 91, 83&ndash;100 (2017).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR9\" id=\"ref-link-section-d32938973e538\">9<\/a><\/sup>. One class of strategies widely studied in the literature are based on goal assignment in either centralized or distributed ways<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Alonso-Mora, J., Breitenmoser, A., Rufli, M., Siegwart, R. & Beardsley, P. Image and animation display with multiple mobile robots. Int. J. Robot. Res. 31753&ndash;773 (2012).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR10\" id=\"ref-link-section-d32938973e542\">10<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Sakurama, K. & Ahn, H. S. Multi-agent coordination over local indexes via clique-based distributed assignment. Automatica 112, 108670 (2020).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR11\" id=\"ref-link-section-d32938973e542_1\">11<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 12\" title=\"Wang, H. & Rubenstein, M. Shape formation in homogeneous swarms using local task swapping. IEEE Trans. Robot. 36597&ndash;612 (2020).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR12\" id=\"ref-link-section-d32938973e545\">12<\/a><\/sup>. Once a swarm of robots are assigned unique goal locations in a desired shape, the consequent task is simply to plan collision-free trajectories for the robots to reach their goal locations<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 10\" title=\"Alonso-Mora, J., Breitenmoser, A., Rufli, M., Siegwart, R. & Beardsley, P. Image and animation display with multiple mobile robots. Int. J. Robot. Res. 31753&ndash;773 (2012).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR10\" id=\"ref-link-section-d32938973e549\">10<\/a><\/sup> or conduct distributed formation control based on locally sensed information<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 6\" title=\"Ren, W., Beard, R. W. & Atkins, E. M. Information consensus in multivehicle cooperative control. IEEE Control Syst. Mag. 27, 71&ndash;82 (2007).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR6\" id=\"ref-link-section-d32938973e553\">6<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 13\" title=\"Anderson, B. D., Yu, C., Fidan, B. & Hendrickx, J. M. Rigid graph control architectures for autonomous formations. IEEE Control Syst. Mag. 28, 48&ndash;63 (2008).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR13\" id=\"ref-link-section-d32938973e556\">13<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 14\" title=\"Zhao, S. & Zelazo, D. Bearing rigidity theory and its applications for control and estimation of network systems: Life beyond distance rigidity. IEEE Control Syst. Mag. 39, 66&ndash;83 (2019).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR14\" id=\"ref-link-section-d32938973e559\">14<\/a><\/sup>. It is notable that centralized goal assignment is inefficient to support large-scale swarms since the computational complexity increases rapidly as the number of robots increases<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 15\" title=\"Kuhn, H. W. The Hungarian method for the assignment problem. Naval Res. Logistics 2, 83&ndash;97 (1955).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR15\" id=\"ref-link-section-d32938973e563\">15<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 16\" title=\"Bertsekas, D. P. The auction algorithm: a distributed relaxation method for the assignment problem. Ann. Oper. Res. 14105&ndash;123 (1988).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR16\" id=\"ref-link-section-d32938973e566\">16<\/a><\/sup>. Moreover, when robots fail to function normally, additional algorithms for fault-tolerant detection and goal re-assignment are required to handle such situations<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 17\" title=\"Kamel, M. A., Yu, X. & Zhang, Y. Formation control and coordination of multiple unmanned ground vehicles in normal and faulty situations: a review. Annu. Rev. Control 49128&ndash;144 (2020).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR17\" id=\"ref-link-section-d32938973e571\">17<\/a><\/sup>. As a comparison, distributed goal assignment can support large-scale swarms by decomposing the centralized assignment into multiple local ones<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 11\" title=\"Sakurama, K. & Ahn, H. S. Multi-agent coordination over local indexes via clique-based distributed assignment. Automatica 112, 108670 (2020).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR11\" id=\"ref-link-section-d32938973e575\">11<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 12\" title=\"Wang, H. & Rubenstein, M. Shape formation in homogeneous swarms using local task swapping. IEEE Trans. Robot. 36597&ndash;612 (2020).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR12\" id=\"ref-link-section-d32938973e578\">12<\/a><\/sup>. It also exhibits better robustness to robot faults. However, since distributed goal assignments are based on locally sensed information, conflicts among local assignments are inevitable and must be resolved by sophisticated algorithms such as local task swapping<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 11\" title=\"Sakurama, K. & Ahn, H. S. Multi-agent coordination over local indexes via clique-based distributed assignment. Automatica 112, 108670 (2020).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR11\" id=\"ref-link-section-d32938973e582\">11<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 12\" title=\"Wang, H. & Rubenstein, M. Shape formation in homogeneous swarms using local task swapping. IEEE Trans. Robot. 36597&ndash;612 (2020).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR12\" id=\"ref-link-section-d32938973e585\">12<\/a><\/sup>.<\/p>\n<p>Another class of strategies for shape assembly that have also attracted extensive research attention are free of goal assignment<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Rubenstein, M., Cornejo, A. & Nagpal, R. Programmable self-assembly in a thousand-robot swarm. Science 345795&ndash;799 (2014).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR18\" id=\"ref-link-section-d32938973e592\">18<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Slavkov, I. et al. Morphogenesis in robot swarms. Sci. Robot. 3, eaau9178 (2018).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR19\" id=\"ref-link-section-d32938973e592_1\">19<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Gauci, M., Nagpal, R. & Rubenstein, M. Programmable self-disassembly for shape formation in large-scale robot collectives, pp. 573&ndash;586 (Springer, Cambridge, 2018).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR20\" id=\"ref-link-section-d32938973e592_2\">20<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 21\" title=\"Alhafnawi, M., Hauert, S. & O\u2019Dowd, P. Self-organised saliency detection and representation in robot swarms. IEEE Robot. Autom. Lett. 6, 1487&ndash;1494 (2021).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR21\" id=\"ref-link-section-d32938973e595\">21<\/a><\/sup>. For instance, the method proposed in ref. <sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 18\" title=\"Rubenstein, M., Cornejo, A. & Nagpal, R. Programmable self-assembly in a thousand-robot swarm. Science 345795&ndash;799 (2014).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR18\" id=\"ref-link-section-d32938973e599\">18<\/a><\/sup> can assemble complex shapes using thousands of homogeneous robots. An interesting feature of this method is that it does not rely on external global positioning systems. Instead, it establishes a local positioning system based on a small number of pre-localized seed robots. As a consequence of the local positioning system, the proposed edge-following control method requires that only the robots on the edge of a swarm can move while those inside must stay stationary. The method in ref. <sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 19\" title=\"Slavkov, I. et al. Morphogenesis in robot swarms. Sci. Robot. 3, eaau9178 (2018).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR19\" id=\"ref-link-section-d32938973e603\">19<\/a><\/sup> can generate swarm shapes spontaneously from a reaction-diffusion network similar to embryogenesis in nature. However, this method is not able to generate user-specified shapes precisely. The method in ref. <sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 21\" title=\"Alhafnawi, M., Hauert, S. & O\u2019Dowd, P. Self-organised saliency detection and representation in robot swarms. IEEE Robot. Autom. Lett. 6, 1487&ndash;1494 (2021).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR21\" id=\"ref-link-section-d32938973e607\">21<\/a><\/sup> can aggregate robots on the frontier of shapes based on saliency detection. The user-defined shape is specified by a digital light projector. An interesting feature of this method is that it does not require centralized edge detectors. Instead, edge detection is realized in a distributed manner by fusing the beliefs of a robot with its neighbors. However, since the robots cannot self-localize themselves relative to the desired shape, they make use of random walks to search for the edges, which would lead to random trajectories. Another class of methods that do not require goal assignment is based on artificial potential fields<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Hsieh, M. A., Kumar, V. & Chaimowicz, L. Decentralized controllers for shape generation with robotic swarms. Robotica 26691&ndash;701 (2008).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR22\" id=\"ref-link-section-d32938973e611\">22<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Sabattini, L., Secchi, C. & Fantuzzi, C. Arbitrarily shaped formations of mobile robots: artificial potential fields and coordinate transformation. Auto. Robots 30,385 (2011).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR23\" id=\"ref-link-section-d32938973e611_1\">23<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Hou, S. P. & Cheah, C. C. Dynamic compound shape control of robot swarm. IET Control Theory Appl. 6454&ndash;460 (2012).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR24\" id=\"ref-link-section-d32938973e611_2\">24<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 25\" title=\"Vickery, C. & Salehi, S.A. A mean shift-based pattern formation algorithm for robot swarms. in 7th Int. Conf. Autom., Robot. Appl., pp. 16&ndash;20 (Prague, Czech Republic, IEEE, 2021).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR25\" id=\"ref-link-section-d32938973e614\">25<\/a><\/sup>. One limitation of this class of methods is that robots may easily get trapped in local minima, making it difficult to assemble nonconvex complex shapes.<\/p>\n<p>Here, we propose a strategy for shape assembly of robot swarms based on the idea of mean-shift exploration: when a robot is surrounded by neighboring robots and unoccupied locations, it would actively give up its current location by exploring the highest density of nearby unoccupied locations in the desired shape. This idea does not rely on goal assignment. It is realized by adapting the mean-shift algorithm<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Fukunaga, K. & Hostetler, L. The estimation of the gradient of a density function, with applications in pattern recognition. IEEE Trans. Inf. Theory 21, 32&ndash;40 (1975).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR26\" id=\"ref-link-section-d32938973e621\">26<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Cheng, Y. Mean shift, mode seeking, and clustering. IEEE Trans. Pattern Anal. Mach. Intell. 17790&ndash;799 (1995).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR27\" id=\"ref-link-section-d32938973e621_1\">27<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 28\" title=\"Comaniciu, D. & Meer, P. Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24603&ndash;619 (2002).\" href=\"https:\/\/www.nature.com\/articles\/s41467-023-39251-5#ref-CR28\" id=\"ref-link-section-d32938973e624\">28<\/a><\/sup>, which is an optimization technique widely used in machine learning for locating the maxima of a density function. Moreover, a distributed negotiation mechanism is designed to allow robots to negotiate the final desired shape with their neighbors in a distributed manner. This negotiation mechanism enables the swarm to maneuver while maintaining a desired shape based on a small number of informed robots. The proposed strategy empowers robot swarms to assemble nonconvex complex shapes with strong adaptability and high efficiency, as verified by numerical simulation results and real-world experiments with swarms of 50 ground robots. The strategy can be adapted to generate interesting behaviors including shape regeneration, cooperative cargo transportation, and complex environment exploration.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The fascinating collective behaviors of biological systems have inspired extensive studies on shape assembly of robot swarms6,7,8,9. One class of strategies widely studied in the literature are based on goal assignment in either centralized or distributed ways10,11,12. Once a swarm of robots are assigned unique goal locations in a desired shape, the consequent task is [\u2026]<\/p>\n","protected":false},"author":662,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,41,6,1491],"tags":[],"class_list":["post-165771","post","type-post","status-publish","format-standard","hentry","category-biological","category-information-science","category-robotics-ai","category-transportation"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/165771","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/662"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=165771"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/165771\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=165771"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=165771"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=165771"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}