{"id":167109,"date":"2023-07-08T04:22:57","date_gmt":"2023-07-08T09:22:57","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2023\/07\/encoding-integers-and-rationals-on-neuromorphic-computers-using-virtual-neuron"},"modified":"2023-07-08T04:22:57","modified_gmt":"2023-07-08T09:22:57","slug":"encoding-integers-and-rationals-on-neuromorphic-computers-using-virtual-neuron","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2023\/07\/encoding-integers-and-rationals-on-neuromorphic-computers-using-virtual-neuron","title":{"rendered":"Encoding integers and rationals on neuromorphic computers using virtual neuron"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/encoding-integers-and-rationals-on-neuromorphic-computers-using-virtual-neuron2.jpg\"><\/a><\/p>\n<p>Neuromorphic computers perform computations by emulating the human brain<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 1\" title=\"Calimera, A., Macii, E. & Poncino, M. The human brain project and neuromorphic computing. Funct. Neurol. 28,191 (2013).\" href=\"https:\/\/www.nature.com\/articles\/s41598-023-35005-x#ref-CR1\" id=\"ref-link-section-d251463515e408\">1<\/a><\/sup>. Akin to the human brain, they are extremely energy efficient in performing computations<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2\" title=\"Grollier, J. et al. Neuromorphic spintronics. Nat. Electron. 3360&ndash;370 (2020).\" href=\"https:\/\/www.nature.com\/articles\/s41598-023-35005-x#ref-CR2\" id=\"ref-link-section-d251463515e412\">2<\/a><\/sup>. For instance, while CPUs and GPUs consume around 70\u2013250 W of power, a neuromorphic computer such as IBM\u2019s TrueNorth consumes around 65 mW of power, (i.e., 4\u20135 orders of magnitude less power than CPUs and GPUs)<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 3\" title=\"Akopyan, F. et al. Truenorth: Design and tool flow of a 65 mw 1 million neuron programmable neurosynaptic chip. IEEE Trans. Comput. Aid. Des. Integr. Circuits Syst. 34, 1537&ndash;1557 (2015).\" href=\"https:\/\/www.nature.com\/articles\/s41598-023-35005-x#ref-CR3\" id=\"ref-link-section-d251463515e416\">3<\/a><\/sup>. The structural and functional units of neuromorphic computation are neurons and synapses, which can be implemented on digital or analog hardware and can have different architectures, devices, and materials in their implementations<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 4\" title=\"Schuman, C. D. et al. A survey of neuromorphic computing and neural networks in hardware. arXiv:1705.06963 (2017).\" href=\"https:\/\/www.nature.com\/articles\/s41598-023-35005-x#ref-CR4\" id=\"ref-link-section-d251463515e420\">4<\/a><\/sup>. Although there are a wide variety of neuromorphic computing systems, we focus our attention on spiking neuromorphic systems composed of these neurons and synapses. Spiking neuromorphic hardware implementations include Intel\u2019s Loihi<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 5\" title=\"Davies, M. et al. Loihi: A neuromorphic manycore processor with on-chip learning. IEEE Micro 38, 82&ndash;99 (2018).\" href=\"https:\/\/www.nature.com\/articles\/s41598-023-35005-x#ref-CR5\" id=\"ref-link-section-d251463515e424\">5<\/a><\/sup>, SpiNNaker2<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 6\" title=\"Mayr, C., Hoeppner, S. & Furber, S. Spinnaker 2: A 10 million core processor system for brain simulation and machine learning. arXiv:1911.02385 (2019).\" href=\"https:\/\/www.nature.com\/articles\/s41598-023-35005-x#ref-CR6\" id=\"ref-link-section-d251463515e429\">6<\/a><\/sup>, BrainScales2<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 7\" title=\"Pehle, C. et al. The brainscales-2 accelerated neuromorphic system with hybrid plasticity. Front. Neurosci. 16, 1&ndash;10 (2022).\" href=\"https:\/\/www.nature.com\/articles\/s41598-023-35005-x#ref-CR7\" id=\"ref-link-section-d251463515e433\">7<\/a><\/sup>, TrueNorth<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 3\" title=\"Akopyan, F. et al. Truenorth: Design and tool flow of a 65 mw 1 million neuron programmable neurosynaptic chip. IEEE Trans. Comput. Aid. Des. Integr. Circuits Syst. 34, 1537&ndash;1557 (2015).\" href=\"https:\/\/www.nature.com\/articles\/s41598-023-35005-x#ref-CR3\" id=\"ref-link-section-d251463515e437\">3<\/a><\/sup>, and DYNAPS<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 8\" title=\"Moradi, S., Qiao, N., Stefanini, F. & Indiveri, G. A scalable multicore architecture with heterogeneous memory structures for dynamic neuromorphic asynchronous processors (dynaps). IEEE Trans. Biomed. Circuits Syst. 12106&ndash;122 (2017).\" href=\"https:\/\/www.nature.com\/articles\/s41598-023-35005-x#ref-CR8\" id=\"ref-link-section-d251463515e441\">8<\/a><\/sup>. These characteristics are crucial for the energy efficiency of neuromorphic computers. For the purposes of this paper, we define neuromorphic computing as any computing paradigm (theoretical, simulated, or hardware) that performs computations by emulating the human brain by using neurons and synapses to communicate with binary-valued signals (also known as spikes).<\/p>\n<p>Neuromorphic computing is primarily used in machine learning applications, almost exclusively by leveraging spiking neural networks (SNNs)<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 9\" title=\"Ghosh-Dastidar, S. & Adeli, H. Spiking neural networks. Int. J. Neural Syst. 19295&ndash;308 (2009).\" href=\"https:\/\/www.nature.com\/articles\/s41598-023-35005-x#ref-CR9\" id=\"ref-link-section-d251463515e448\">9<\/a><\/sup>. In recent years, however, it has also been used in non-machine learning applications such as graph algorithms, Boolean linear algebra, and neuromorphic simulations<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Kay, B., Date, P. & Schuman, C. Neuromorphic graph algorithms: Extracting longest shortest paths and minimum spanning trees. In Proceedings of the Neuro-inspired Computational Elements Workshop, 1&ndash;6 (2020).\" href=\"https:\/\/www.nature.com\/articles\/s41598-023-35005-x#ref-CR10\" id=\"ref-link-section-d251463515e452\">10<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Schuman, C. D. et al. Sparse binary matrix-vector multiplication on neuromorphic computers. In 2021 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), 308&ndash;311 (IEEE, 2021).\" href=\"https:\/\/www.nature.com\/articles\/s41598-023-35005-x#ref-CR11\" id=\"ref-link-section-d251463515e452_1\">11<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 12\" title=\"Hamilton, K., Date, P., Kay, B. & Schuman D, C. Modeling epidemic spread with spike-based models. In International Conference on Neuromorphic Systems 2020, 1&ndash;5 (2020).\" href=\"https:\/\/www.nature.com\/articles\/s41598-023-35005-x#ref-CR12\" id=\"ref-link-section-d251463515e455\">12<\/a><\/sup>. Researchers have also shown that neuromorphic computing is Turing-complete (i.e., capable of general-purpose computation)<sup><a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 13\" title=\"Date, P., Potok, T., Schuman, C. & Kay, B. Neuromorphic computing is Turing-complete. In Proceedings of the International Conference on Neuromorphic Systems, 1&ndash;10 (2022).\" href=\"https:\/\/www.nature.com\/articles\/s41598-023-35005-x#ref-CR13\" id=\"ref-link-section-d251463515e459\">13<\/a><\/sup>. This ability to perform general-purpose computations and potentially use orders of magnitude less energy in doing so is why neuromorphic computing is poised to be an indispensable part of the energy-efficient computing landscape in the future.<\/p>\n<p>Neuromorphic computers are seen as accelerators for machine learning tasks by using SNNs. To perform any other operation (e.g., arithmetic, logical, relational), we still resort to CPUs and GPUs because no good neuromorphic methods exist for these operations. These general-purpose operations are important for <i>preprocessing<\/i> data before it is transferred to a neuromorphic processor. In the current neuromorphic workflow\u2014 <i>preprocessing<\/i> on CPU\/GPU and inferencing on neuromorphic processor\u2014more than 99% of the time is spent in data transfer (see Table 7). This is highly inefficient and can be avoided if we do the <i>preprocessing<\/i> on the neuromorphic processor. Devising neuromorphic approaches for performing these <i>preprocessing<\/i> operations would drastically reduce the cost of transferring data <i>between<\/i> a neuromorphic computer and CPU\/GPU. This would enable performing all types of computation (<i>preprocessing<\/i> as well as inferencing) efficiently on low-power neuromorphic computers deployed on the edge.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Neuromorphic computers perform computations by emulating the human brain1. Akin to the human brain, they are extremely energy efficient in performing computations2. For instance, while CPUs and GPUs consume around 70\u2013250 W of power, a neuromorphic computer such as IBM\u2019s TrueNorth consumes around 65 mW of power, (i.e., 4\u20135 orders of magnitude less power than [\u2026]<\/p>\n","protected":false},"author":599,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[41,6],"tags":[],"class_list":["post-167109","post","type-post","status-publish","format-standard","hentry","category-information-science","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/167109","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/599"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=167109"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/167109\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=167109"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=167109"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=167109"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}