Neuromorphic_Computing
Neuromorphic_Computing
e
spring 2021 · volume 17 · issue 1
ALSO FEATURING
E L E M E N T S • The Digital Pandemic
the undergraduate research journal of boston college • The Force on the Front
neuromorphic computing
Explaining how Projected SNN Training will Largely Impact
our Interactions with Technology
will riherd
in the face of increasingly large computational demands and the impending halt to
moore’s law, the semiconductor industry has been forced to re-evaluate the tradi-
tional computing paradigm. central to this re-evaluation has been the novel devel-
tion with large implications on the daily lives of consumers. the future of the tech-
nology, however, is uncertain. with the rise of high performance and quantum com-
the extent to which neuromorphic computing can emerge as a viable and feasible
underpinnings of the neuromorphic approach and predict the likelihood of its im-
neuromorphic computing
through to a deep neural net, and wait for the response treme integration of artificial intelligence into our daily
when you’re traveling down a freeway at 70 miles an hour” lives (Ferry). Suma describes a future in which a technol-
(Greengard). The long-term draw of neuromorphic com- ogy like Siri transcends basic voice commands (i.e., a Siri
puting, is energy-efficient, on-board processing that is ap- that listens and sees all of your conversations and interac-
plicable to a wide range of technologies, from autonomous tions). If you were to ask Siri what idea your friend Melissa
vehicles to independently operating interstellar spacecraft. came up with regarding your wife’s birthday gift, the effi-
Neuromorphic chips are also poised to play a large role in cient, continuous, on-board processing of data made pos-
36 future medical devices and artificial body parts that can sible by neuromorphic computing would enable Siri to re-
benefit from increasingly fast, on-site processing. call the conversation with your friend the week prior,
bringing up both the idea and a variety of similar, person-
While neuromorphic architecture could become ubiqui- alized ideas. The salient point in Suma’s eyes is that the
tous beyond 2030, it is important to note the false dichoto- efficiency of neuromorphic chips would enable the local
my between standard computer architecture and neuro- storage of information, resolving widespread privacy con-
morphic hardware.15 The promise of neuromorphic chips cerns regarding consumer data. From autonomous vehi-
lies in the creation of an adaptive system capable of the cles to smart homes and edge devices, Suma’s point is
efficient processing of highly noisy, increasingly complex, clear: the promise of neuromorphic technology is a future
spatio-temporal data, not the high-speed processing of pre- characterized by the extreme integration of artificial intel-
dictable, deterministic processes (Greengard). It is short- ligence into our daily lives.
sighted, therefore, to view neuromorphic computing as a Semiconductor Industry
fundamental alternative to traditional computing: the two
technologies are complementary to each other, excelling in Research scientist at Hewlett Packard Enterprise, Suhas
tasks suited to their specific design. It is also important to Kumar, summarizes the state of computing as a “huge
note the uncertainty surrounding the long-term ubiquity rush to find something” that can continue the improve-
of neuromorphic computing, namely, that there is a three- ment in computer science that we have witnessed the past
way race between neuromorphic computing, high perfor- half century. Semiconductor manufacturers, therefore, are
mance computing, and quantum computing (Vorhies).16 faced with a critical choice of whether to invest in risky
Given the advancements of competing fields, it is possible chip research to compete in a future characterized by ad-
the technology is outperformed before it is commercially vanced computing technologies. While IBM has seen suc-
viable (either by existing competitors or a novel approach cess with its TrueNorth system, Intel has exhibited the
yet to be developed). The future of computing, then, is strongest commitment to neuromorphic research, evi-
largely undecided, with the only certainty being that our denced by its continued progress in creating increasingly
current computing paradigm will shift in response to the scalable neuromorphic systems. Intel’s competitors are
impending halt to Gordon Moore’s 1965 prediction. also faced with the challenge of determining the type of
research they wish to undertake (i.e., whether they believe
high performance or quantum computing will ultimately
IMPLICATIONS
outperform the neuromorphic approach). Regardless, the
Consumers and AI Integration challenge is clear: the computing industry will witness a
Despite uncertainties regarding the path of computing, a shift in the coming decades, and the companies that lead
future characterized by the widespread adoption of neuro- this shift will capitalize on the widespread adoption of
morphic technology would have significant implications their novel technology.
on the way consumers interact with digital devices. Peter
Suma, co-CEO of Applied Brain Research, imagines a
world in which neuromorphic technology enables an ex-
neuromorphic computing
as well as various GPU systems to compare power consump- NanoSystems Institute at the University of California at Los An-
tion (Russel). The Loihi test chip slightly outperformed the GPU geles, further describes how “conventional von Neumann-based
systems (in inferences per second) at significantly lower power computing systems” perform very well with “high-speed, pre-
consumption. dictable, deterministic processes,” but struggle with increasing
complexity. The promise of neuromorphic computing, therefore,
is the opening up of “an entirely new and unexplored area of
computing”—one that allows us to “do things with computers
that we couldn’t have imagined in the past” (See Greengard).
38 16. High-performance computing (HPC) can be generalized as
a process of optimizing chip architecture for existing deep learn-
ing algorithms (Vorhies). The majority of attention is currently
placed on HPC, with large technology firms beginning to enter
the chip manufacturing field by developing their own propri-
etary chips (e.g., Google’s Tensor Processing Unit) (Tiernan,
It is important to note that Loihi’s strong performance is largely “Facebook’s Yann LeCun”). Conversely, quantum computing is
the result of the entire system (in this case, robotic sensors, data analogous to neuromorphic computing in that it represents a
formats, algorithms, and the Loihi architecture) being “re-engi- rethinking of existing computer architecture. Rather than operat-
neered in an event-based paradigm” (Mike Davies, Director of ing in bits (0 or 1), quantum computing employs quantum bits
Neuromorphic Research at Intel. See Russel). Put simply, when (qubits) that can be set to 0, 1, or both simultaneously (Cho).
the system is consistent with Loihi’s event-based architecture,
neuromorphic hardware outperforms traditional GPU’s when it
comes to energy efficiency.
12. Existing deep learning algorithms depend on stochastic references
gradient descent and error backpropagation to efficiently “learn”
a given ANN. Since SNNs operate in discontinuous, non-differ-
Best, Jo. “Neuromorphic Computing Could Solve the Tech
entiable spikes, it is impossible to apply existing learning rules Industry’s Looming Crisis.” ZDNet, 5 Oct. 2020, `
directly to SNN training (Pfeiffer and Pfeil). www.zdnet.com/article/neuromorphic-computing-could-
solve-the-tech-industrys-looming-crisis/.
13. At the 2019 International Solid State Circuits Conference in
San Francisco, LeCun heavily criticized neuromorphic comput-
ing in his opening keynote address. While Intel’s Mike Davies Blain, Loz. “Intel’s Neuromorphic Loihi Chip Is Rapidly
agrees that there is a lot of progress to be made on the algorith- Learning to Discern Smells.” New Atlas, 17 Mar. 2020, ne-
mic front, which he claims is “holding back the field,” Yann’s watlas.com/science/intel-neuromorphic-loihi-smells/.
criticism resulted in a fireback from Davies citing the efficacy of
neuromorphic chips in a December report produced by Applied
Cho, Adrian. “The Biggest Flipping Challenge in Quan-
Brain Research of Waterloo, Ontario. Davies’s fireback was met
with a detailed Facebook post by LeCun outlining the issues he tum Computing.” Science, The American Association For
sees with neuromorphic hardware, specifically citing the lack of The Advancement of Science, 9 July 2020, www.sci-
an efficient training algorithm. encemag.org/news/2020/07/biggest-flipping-challenge-
14. It is important to point out that SNNs are not optimized for quantum-computing.
performance on existing AI Benchmarks (e.g., ImageNet). Just
how the brain is not optimized (but capable of) classifying an Davies, Mike, et al. “2018 CES: Neuromorphic Computing
image that is quickly flashed on the retina, SNNs struggle with Mimics the Human Brain.” Youtube, Intel Newsroom, 8
the typical frame-based test of software accuracy. The evaluation Jan. 2018, www.youtube.com/
of SNNs, therefore, requires benchmark testing that emphasizes watch?v=gXNCz26UhyY&feature=emb_title.
the functionality of spiking networks—i.e., “making decisions
based on continuous input streams while moving in the real
world” (Pfeiffer and Pfeil). Ferry, Jeff. “The Future of AI Is Neuromorphic.” Circuit
Insight, www.circuitinsight.com/programs/55035.html.
15. Dan Hutcheson, CEO of VLSI Research (an independent
market analysis and consulting firm that tracks the semiconduc-
tor industry), describes the false dichotomy as follows: “Today’s Fulton III, Scott. “What Neuromorphic Engineering Is,
computers are very good at what they do. They will continue to and Why It’s Triggered an Analog Revolution.” ZDNet, 8
outperform neuromorphic computing systems for conventional Feb. 2019, www.zdnet.com/article/what-neuromorphic-
processing tasks. The technologies are complementary and so engineering-is-and-why-its-triggered-an-analog-revolu-
they will coexist.” Adam Stieg, associate director of the California tion/.
Hamblen, Matt. “Intel Shares Pohoiki Springs Chassis Ray, Tiernan. “Intel’s Neuro Guru Slams Deep Learning:
with AI Researchers.” FierceElectronics, 18 Mar. 2020, ‘It’s Not Actually Learning’.” ZDNet, 23 Feb. 2019, www.
www.fierceelectronics.com/electronics/intel-shares-pohoi- zdnet.com/article/intels-neuro-guru-slams-deep-learning- 39
ki-springs-chassis-ai-researchers. its-not-actually-learning/.
Irving, Michael. “Artificial Synapses Fill the Gaps for Ray, Tiernan. “Neuromorphic Computing Finds New Life
Brainier Computer Chips.” New Atlas, 23 Jan. 2018, newat- in Machine Learning.” ZDNet, 1 July 2019, www.zdnet.
las.com/neuromorphic-chip-mit/53081/?itm_ com/article/neuromorphic-computing-finds-new-life-in-
source=newatlas. machine-learning/.
Jhonsa, Eric. “Intel Teams with Uncle Sam to Research Rouse, Margaret. “What Is Neuromorphic Computing?”
Chip Packages, ‘Neuromorphic’ Systems.” TheStreet, 2 SearchEnterpriseAI, TechTarget, 11 Feb. 2020, searchen-
Oct. 2020, www.thestreet.com/investing/intel-teams- terpriseai.techtarget.com/definition/neuromorphic-com-
with-uncle-sam-to-research-chip-packages-neuromorphic- puting.
systems-loihi-foveros-emib.
Russell, John. “Get a Grip: Intel Neuromorphic Chip Used
LeCun, Yann. ISSC Keynote Address. Facebook, 23 Feb. to Give Robotics Arm a Sense of Touch.” HPCwire, 17 July
2019, https://m.facebook.com/story.php?story_fbid=1015 2020, www.hpcwire.com/2020/07/15/get-a-grip-intel-
5808247852143&id=722677142. neuromorphic-chip-used-to-give-robotics-arm-a-sense-of-
touch/.
Molter, Tim. “A Brief History of Neuromorphic Comput-
ing.” Knowm.org, 4 Apr. 2015, knowm. Soni, Devin. “Spiking Neural Networks, the Next Genera-
org/a-brief-history-of-neuromorphic-computing/. tion of Machine Learning.” Medium, Towards Data Sci-
ence, 16 July 2019, https://towardsdatascience.com/spik-
Muir, Dylan. “Putting the Neural Back into Networks.” Me- ing-neural-networks-the-next-generation-of-machine-
dium, 15 Jan. 2020, medium.com/neuromorphic-intelli- learning-84e167f4eb2b
gence/putting-the-neural-back-into-networks-f0fd-
b19a5efd. Vorhies, William. “The Three Way Race to the Future of
AI. Quantum vs. Neuromorphic vs. High Performance
Norman, Jeremy M. “Carver Mead Writes the First Book Computing.” Data Science Central, Tech Target, 14 Nov.
on Neuromorphic Computing.” Carver Mead Writes the 2017, www.datasciencecentral.com/profiles/blogs/the-
First Book on Neuromorphic Computing : History of In- three-way-race-to-the-future-of-ai-quantum-vs-neuromor-
formation, 25 Oct. 2020, www.historyofinformation.com/ phic-vs.
detail.php?id=3900.
Wiggers, Kyle. “Intel Debuts Pohoiki Springs, a Powerful
Panetta, Kasey. “Gartner Top 10 Strategic Predictions for Neuromorphic Research System for AI Workloads.” Ven-
2021 and Beyond.” Smarter With Gartner, 21 Oct. 2020, tureBeat, 18 Mar. 2020, venturebeat.com/2020/03/18/in-
www.gartner.com/smarterwithgartner/gartner-top- tel-debuts-pohoiki-springs-a-powerful-neuromorphic-re-
10-strategic-predictions-for-2021-and-beyond/. search-system-for-ai-workloads/.
Pfeiffer, Michael, and Thomas Pfeil. “Deep Learning With “Neuromorphic Computing - Next Generation of AI.” In-
Spiking Neurons: Opportunities and Challenges.” Fron- tel–Neuromorphic Computing, Intel, 2020, www.intel.
tiers in neuroscience vol. 12 774. 25 Oct. 2018, doi:10.3389/ com/content/www/us/en/research/neuromorphic-com-
fnins.2018.00774. puting.html.
neuromorphic computing
“Intel and Sandia National Labs Collaborate on Neuromor-
phic Computing.” Intel Newsroom, Intel, 2 Oct. 2020,
newsroom.intel.com/news/intel-sandia-national-labs-
neuromorphic-computing/.
28 figure 1
© originally tweeted by User:@realDonaldTrump (account suspended) on 26 May, 2020.
28 figure 2
© GDI report: Ad-funded COVID-19 Disinformation: Money, Brands, and Tech (https://disinformationindex.
org/wp-content/uploads/2020/07/GDI_Ad-funded-COVID-19-Disinformation-1.pdf), „Share of ad revenues
generated by COVID Disinfo Sites“.
28 figure 3, panel a
© originally published in Bursztyn, Rao, Roth, Yanagaziwa-Drott: Misinformation During a Pandemic (https://
www.nber.org/papers/w27417), „RF estimates of effect of differential viewership on cases and deaths (extend-
ed)“.
28 figure 3, panel b
© originally published in Bursztyn, Rao, Roth, Yanagaziwa-Drott: Misinformation During a Pandemic (https://
www.nber.org/papers/w27417), „2SLS estimates of effect of differential viewership on cases and deaths (ex-
tended)“.
29 figure 4, panel a
© originally published in Bursztyn, Rao, Roth, Yanagaziwa-Drott: Misinformation During a Pandemic (https://
www.nber.org/papers/w27417), „Implied COVID-19 Curves, Panel A: Estimates on Cases“.
29 figure 4, panel b
© originally published in Bursztyn, Rao, Roth, Yanagaziwa-Drott: Misinformation During a Pandemic (https://
www.nber.org/papers/w27417), „Implied COVID-19 Curves, Panel B: Estimates on Deaths“.
35 artificial synapses based on ferro-electric tunnel junctions
© Mike Davies Intel Labs, Intel Corporation et. al: (https://commons.wikimedia.org/wiki/File:Artificial_syn-
apses_based_on_FTJs.png), https://creativecommons.org/licenses/by-sa/4.0/legalcode
71 figure 1
© Samadi, Moradi, Moradinazar, Mostafai, Pasdar: Dietary pattern in relation to the risk of Alzheimer’s disease:
a systematic review (https://link.springer.com/article/10.1007/s10072-019-03976-3), „Figure 2: Healthy and
unhealthy diet in relation to AD.“
100 german american bund rally, new york, madison square garen, feb 1939
© Department of Defense. Department of the Army. Office of the Chief Signal Officer. (09/18/1947 -
02/28/1964); ARC Identifier 36068 / Local Identifier 111-OF-2 1943 (https://commons.wikimedia.org/wiki/
File:Nazi_Strike_2.jpg), „Nazi Strike 2“, marked as public domain, more details on Wikimedia Commons:
https://commons.wikimedia.org/wiki/Template:PD-US