Research on Fault-tolerant Spiking Neuromorphic System based on Packet Switched On-chip Network & On-chip Learning
Research Background†
With the increasing demand for computing machines that more closely model the biological brain, the field of neuro-inspired computing has progressed to the exploration of Spiking Neural Networks (SNN). SNN is the third generation of the computing paradigm "Neuro-inspired computing", modeled after the neural networks of the biological brain to best the setbacks of conventional Von Neumann architecture. This computing paradigm tries to model specifications that make the biological brain achieve rapid parallel computations in real-time, fault tolerance, power efficiency, and the ability to perform tasks like image recognition and language learning, that the conventional computing machine cannot. Unlike its predecessors, the neurons in SNN mimic the information transfer in biological neurons (event triggered), and this immensely enhances its performance.
It has been understood that spiking neural networks (SNNs) and synaptic devices can achieve high energy efficiency and fault tolerance in complex tasks by emulating biological neurons and synapses. Hence, they have a big potential for the replacement of traditional von Neumann computers. [WWW.ref].
SNNs can achieve better power efficiency when more powerful encoding methods are applied, or when SNNs are optimized for short latency. Second, the inference results in SNNs can be gotten faster than ANNs, though the precision may be lower. The inference precision would then rise with more evidence accumulated over time Ref. Spiking neurons are only activated when sufficient signals are integrated from other neurons, therefore the neural activities at the network level are usually sparse, which can make
executing SNNs by matrix-based operation on a traditional CPU or GPU inefficient.Ref.
Neuromorphic hardware is designed to accelerate the running of SNNs by allocating spiking neurons and synapses to neuromorphic chips and it can increase the power efficiency of SNNs by event-based computing.
Research Goal†
The goal of this Doctoral thesis is to research and implement a Deep Spiking Neural Network Architecture with on-chip learning scheme and based on the previously developed schemes NASH1
The expected outputs from this research are:
- (1) An efficient adaptive configuration method which enables reconfiguration of different SNN parameters (spike weights, routing, hidden layers, topology, etc.)
- (2) An Efficient Multicast Fault-tolerant Routing Algorithm for the neurochip
- (3) Efficient on-chip learning Algorithm
- (4) To demonstrate the performance of the algorithms and the system, an FPGA implementation shall be developed and evalauted with several biological SNNs. In addition, a VLSI implementation shall be also developed.
Research Schedule†
| Date | Task |
| Complete on-chip learning with STDP |
| write and submit conference paper |
| July 1, 2020 to December 31, 2021 | Integrate SNPC into 3D-NoC architecture |
| September 1, 2020 to January 20, 2021 | Write and submit journal paper |
| April 1, 2021 to September 30, 2021 | Explore Fault tolerance in the SNPC and in the entire 3D-NoC SNN |
| April 15, 2021 to August 31, 2021 | Write and submit a journal paper |
| October 1, 2021 to April 28, 2022 | Explore Biological SNNs. |
Hardware Implementation of learning algorithm on SNPC†
- 10/31 Hardware Implementation of learning algorithm on SNPC
- submit a new conference
- Draft_v1.0 (11/04/2019, Time:03:55 PM)
(latex, pdf)
- Draft_v1.1 (11/08/2019, Time:03:26 PM)
(latex, pdf)
- Draft_v1.2 (11/18/2019, Time:05:16 PM)
(latex, pdf)
- Draft_v1.3 (01/23/2020, Time:05:16 PM)
(latex, pdf)
- Draft_v1.4 (02/03/2020, Time:10:43 AM)
(latex, pdf)
- Draft_v1.5 (02/14/2020, Time:10:42 AM)
(latex, pdf)
- Draft_v1.6 (04/29/2020, Time:09:32 PM)
(latex, pdf)
Research Progress Seminar†
- Research on Event Driven Fault-tolerant Spiking Neuromorphic System based on Packet Switched On-chip Network & On-chip Learning (06/22/2020, Time:05:00 PM)
(pdf)
Achievement†
new paper†
Published papers†
Design and Evaluation of SNPC for (IEEE_BigCom2020) conference. Full paper submisison due date: Sept 30, 2019†
- Draft_v1.0 (08/02/2019, Time:08:03 PM) (latex, pdf)
- Draft_v1.1 (08/21/2019, Time:02:28 PM)
(latex, pdf)
- Draft_v1.2 (08/23/2019, Time:02:28 PM)
(latex, pdf)
- Draft_v1.3 (08/21/2019, Time:08:27 PM)
(latex, pdf)
- Draft_v1.4 (09/23/2019, Time:12:58 PM)
(latex, pdf)
- Draft_v1.5 (09/25/2019, Time:05:19 PM)
(latex, pdf)
- Draft_v1.6 (10/01/2019, Time:05:00 PM)
(latex, pdf)
- Light-weight Spiking Neuron Processing Core for Large-scale 3D-NoC based Spiking Neural Network Processing Systems(Submitted Copy) (10/01/2019, Time:05:14 PM)
(latex, pdf)
- Light-weight_Spiking_Neuron_Processing_Core_For_Large-scale_3D-NoC_Based_Spiking_Neural_Network_Processing_Systems(camera-ready_copy) (12/17/2019, Time:09:38 AM)
(latex, pdf)
- Light-weight_Spiking_Neuron_Processing_Core_For_Large-scale_3D-NoC_Based_Spiking_Neural_Network_Processing_Systems (02/19/2020, Time:10:09 PM)
(Slides)
The ACM Chapter International Conference on Educational Technology, Language and Technical Communication (ETLTC). Full paper submisison due date: Nov. 19, 2019†
- Spiking Neuro-core for 3D-NoC Neuromorphic System. (11/18/2019, Time:01:36 PM) (Word, pdf)
- Spiking Neuro-core for 3D-NoC Neuromorphic System.
(01/13/2020, Time:01:07 PM) (Latex, pdf)
- Architecture_and_Design_of_a_Spiking_Neuron_Processor_Core_Towards_the_Design_of_a_Large-scale_Event-Driven_3D-NoC-based_Neuromorphic_Processor(camera_ready_copy).
(02/04/2020, Time:01:56 PM) (Latex, pdf)
My Shared Google Drive Folder†
Update History†
- April 29, 2020: site updtaed, by B.
- May 6, 2019: Schedule updtaed, by B.
- April 17, 2019: Page created, by B.