Fault-tolerant Spiking Neuromorphic System based on 3D-NoC and On-chip Learning
Research Background†
With the increasing demand for computing machines that more closely model the biological brain, the field of neuro-inspired computing has progressed to the exploration of Spiking Neural Networks (SNN). SNN is the third generation of the computing paradigm "Neuro-inspired computing", modeled after the neural networks of the biological brain to best the setbacks of conventional Von Neumann architecture. This computing paradigm tries to model specifications that make the biological brain achieve rapid parallel computations in real-time, fault tolerance, power efficiency, and the ability to perform tasks like image recognition and language learning, that the conventional computing machine cannot. Unlike its predecessors, the neurons in SNN mimic the information transfer in biological neurons (event triggered), and this immensely enhances its performance.
It has been understood that spiking neural networks (SNNs) and synaptic devices can achieve high energy efficiency and fault tolerance in complex tasks by emulating biological neurons and synapses. Hence, they have a big potential for the replacement of traditional von Neumann computers. Commonly, the implementation technology for an SNN can be categorized into synaptic materials and devices, integrating memory, on-line learning elements, analog circuits, and digital computing structures.
The complexity of an SNN architecture is mainly dependent on the number of electronic synapses that form active neuronal links between artificial neurons [WWW.ref].
Hardware implementations (neuromorphic chips) that do not have the architectural limitation of the Von Neumann architecture, and aim at taking advantage of the sparsity of Spikes in SNN to reduce power, are presented as an alternative.
Research Goal†
The goal of this Doctoral thesis is to research and implement a Deep Spiking Neural Network Architecture with on-chip learning scheme and based on the previously developed schemes NASH1
The expected outputs from this research are:
- (1) An efficient adaptive configuration method which enables reconfiguration of different SNN parameters (spike weights, routing, hidden layers, topology, etc.)
- (2) An Efficient Multicast Fault-tolerant Routing Algorithm for the neurochip
- (3) Efficient on-chip learning Algorithm
- (4) To demonstrate the performance of the algorithms and the system, an FPGA implementation shall be developed and evalauted with several biological SNNs. In addition, a VLSI implementation shall be also developed.
Research Schedule†
| Date | Task |
| May?? to June ??, 2020 | Complete on-chip learning with STDP |
| - | -write and submit conference paper |
| - | Explore reconfigurable learning and reconfigurable Neuron on the SNPC |
| - | -Write and submit conference paper |
| - | Integrate SNPC into 3D-NoC architecture |
| - | -Write and submit journal paper |
| - | Explore applications and application mapping for 3D-NoC SNN |
| - | -Write ans submit journal paper |
| - | Explore Fault tolerance in the SNPC and in the entire 3D-NoC SNN |
| - | -Write and submit a journal paper |
Hardware Implementation of learning algorithm on SNPC†
- 10/31 Hardware Implementation of learning algorithm on SNPC
- submit a new conference
- Draft_v1.0 (11/04/2019, Time:03:55 PM)
(latex, pdf)
- Draft_v1.1 (11/08/2019, Time:03:26 PM)
(latex, pdf)
- Draft_v1.2 (11/18/2019, Time:05:16 PM)
(latex, pdf)
- Draft_v1.3 (01/23/2020, Time:05:16 PM)
(latex, pdf)
- Draft_v1.4 (02/03/2020, Time:10:43 AM)
(latex, pdf)
- Draft_v1.5 (02/14/2020, Time:10:42 AM)
(latex, pdf)
- Draft_v1.6 (04/29/2020, Time:09:32 PM)
(latex, pdf)
Achievement†
new paper†
Published papers†
Design and Evaluation of SNPC for (IEEE_BigCom2020) conference. Full paper submisison due date: Sept 30, 2019†
- Draft_v1.0 (08/02/2019, Time:08:03 PM) (latex, pdf)
- Draft_v1.1 (08/21/2019, Time:02:28 PM)
(latex, pdf)
- Draft_v1.2 (08/23/2019, Time:02:28 PM)
(latex, pdf)
- Draft_v1.3 (08/21/2019, Time:08:27 PM)
(latex, pdf)
- Draft_v1.4 (09/23/2019, Time:12:58 PM)
(latex, pdf)
- Draft_v1.5 (09/25/2019, Time:05:19 PM)
(latex, pdf)
- Draft_v1.6 (10/01/2019, Time:05:00 PM)
(latex, pdf)
- Light-weight Spiking Neuron Processing Core for Large-scale 3D-NoC based Spiking Neural Network Processing Systems(Submitted Copy) (10/01/2019, Time:05:14 PM)
(latex, pdf)
- Light-weight_Spiking_Neuron_Processing_Core_For_Large-scale_3D-NoC_Based_Spiking_Neural_Network_Processing_Systems(camera-ready_copy) (12/17/2019, Time:09:38 AM)
(latex, pdf)
- Light-weight_Spiking_Neuron_Processing_Core_For_Large-scale_3D-NoC_Based_Spiking_Neural_Network_Processing_Systems (02/19/2020, Time:10:09 PM)
(Slides)
The ACM Chapter International Conference on Educational Technology, Language and Technical Communication (ETLTC). Full paper submisison due date: Nov. 19, 2019†
- Spiking Neuro-core for 3D-NoC Neuromorphic System. (11/18/2019, Time:01:36 PM) (Word, pdf)
- Spiking Neuro-core for 3D-NoC Neuromorphic System.
(01/13/2020, Time:01:07 PM) (Latex, pdf)
- Architecture_and_Design_of_a_Spiking_Neuron_Processor_Core_Towards_the_Design_of_a_Large-scale_Event-Driven_3D-NoC-based_Neuromorphic_Processor(camera_ready_copy).
(02/04/2020, Time:01:56 PM) (Latex, pdf)
My Google Shared Folder†
Update History†
- April 29, 2020: site updtaed, by B.
- May 6, 2019: Schedule updtaed, by B.
- April 17, 2019: Page created, by B.