Mark Ogbodo
をテンプレートにして作成
[
トップ
] [
新規
|
一覧
|
単語検索
|
最終更新
|
ヘルプ
|
ログイン
]
開始行:
-[[Members-Internal]]
----
CENTER:COLOR(#81111F){SIZE(40){''On the Design of Adaptive Digital Neuromorphic System''}}
CENTER:COLOR(#81111F){SIZE(15){''Research on Fault-tolerant Spiking Neuromorphic System based on Packet Switched On-chip Network & On-chip Learning''}}
----
*NASH progress meetings [#q3ad2946]
-[[Minutes>https://adaptive.u-aizu.ac.jp/aslint/index.php?NASH-Minutes]]
*Research Background [#h2f74bf8]
As artificial neural networks (ANNs) are executed in a fully synchronized manner, most of the computation is inherently uselessly
done. For instance, a visual-based ANN performing object tracking analyses the entire image at each timestamp while most of the information remains unchanged within small time intervals. Another consequence of the synchronous execution is that traditional ANNs are not optimized to extract the timing information. In contrast, neuromorphic systems are characterized by
the asynchronous and independent execution of the neurons
within the neural net, therefore enabling more flexibility, as
well as the ability to learn the timing information. [www].
It has been understood that spiking neural networks (SNNs) and synaptic devices can achieve high energy efficiency and ''fault tolerance'' in complex tasks by emulating biological neurons and synapses. Hence, they have a big potential for the replacement of traditional von Neumann computers. [WWW.ref].
SNNs can achieve better power efficiency when more powerful encoding methods are applied, or when SNNs are optimized for short latency. Second, the inference results in SNNs can be gotten faster than ANNs, though the precision may be lower. The inference precision would then rise with more evidence accumulated over time [[Ref>https://www.researchgate.net/publication/342481278_Robustness_to_Noisy_Synaptic_Weights_in_Spiking_Neural_Networks]]. Spiking neurons are only activated when sufficient signals are integrated from other neurons, therefore the neural activities at the network level are usually sparse, which can make
executing SNNs by matrix-based operation on a traditional CPU or GPU inefficient.[[Ref>https://www.researchgate.net/publication/342481278_Robustness_to_Noisy_Synaptic_Weights_in_Spiking_Neural_Networks]].
One issue in SNNs is that the spike function is non-differentiable, making it impossible to use backpropagation to train the network. To address this issue, several
solutions have been proposed, such as converting DNNs to SNNs, and approximating the derivative of the spike function [ref]
Neuromorphic hardware is designed to accelerate the running of SNNs by allocating spiking neurons and synapses to neuromorphic chips and it can increase the power efficiency of SNNs by event-based computing.
*Research Goal [#m37fbd2d]
The goal of this Doctoral thesis is to research and implement a Deep Spiking Neural Network Architecture with on-chip learning scheme and based on the previously developed schemes [[NASH1>https://adaptive.u-aizu.ac.jp/aslint/index.php?Vu%20Huy%20The]]
The expected outputs from this research are:
-(1) An efficient adaptive configuration method which enables reconfiguration of different SNN parameters (spike weights, routing, hidden layers, topology, etc.)
-(2) An Efficient Multicast Fault-tolerant Routing Algorithm for the neurochip
-(3) Efficient on-chip learning Algorithm
-(4) To demonstrate the performance of the algorithms and the system, an FPGA implementation shall be developed and evalauted with several biological SNNs. In addition, a VLSI implementation shall be also developed.
*Research Schedule [#ldf95f0f]
|Date|Task|
|☑️April 1st 2019 - August 30, 2019|Survey, etc.|
|☑️September 1st, 2019 - July 31,2020 |Complete SNPC on-chip learning with STDP|
|September 21, 2020|COLOR(red){JoS paper draft}|
|☑️August 16, 2020 to September 21, 2020|Understand and run demo of k-means clustering based fault-tolerant multicast spike routing algorithm|
|☑️August 16, 2020 to September 21, 2020|Replace spike injector with SNPC and run again the demo of k-means clustering based fault-tolerant multicast spike routing algorithm|
|☑️September 1, 2020 to December 4, 2020|''Integrate SNPC into 3D-NoC architecture''|
|☑️September 1, 2020 to February 28, 2021|COLOR(red){Prepare journal paper draft on the 3D-NoC SNN}|
|☑️March 1, 2021 to March 3, 2021|COLOR(red){Prepare journal draft for MDPI Electronics}|
|☑️March 3, 2021 to March 5, 2021|COLOR(red){Prepare conference draft for UNET21}|
|☑️March 5, 2021 to March 21, 2021|COLOR(red){Prepare conference draft for Reversible Computing 13}|
|☑️March 19, 2021 to March 24, 2021|COLOR(red){Update journal manuscript for MDPI Electronics}|
|☑️April 2, 2021 to April 17, 2021|''NASH tutorial''|
|☑️April 6, 2021 to April 9, 2021|''Desertation draft structure ''|
|May 18, 2021 to May 30, 2021|''Investigate more biological benchmarks on NASH, including Hand Gesture Recognition''|
|☑️April 28, 2021 to May 6, 2021|''UNET Camera ready paper''|
|☑️April 18, 2021 to May 21, 2021|''Dissertation draft completion preparation of documents for the Doctoral Dissertation Preliminary Review'' |
| ☑️May 10, 2021| ''Preparation of documents for the Doctoral Dissertation Preliminary Review'' |
|☑️June 7|First Dissertation Preliminary Presentation Rehearsal|
|☑️June 14|Second Dissertation Preliminary Presentation Rehearsal|
|July 1, 2021 to September 31, 2021|Begin work on NeuroSys|
|☑️July 1, 2021 to July 12, 2021|Complete initial exploration of RBTC application|
|☑️August 1, 2021 to August 7, 2021|Survey on invasive and non-invasive prosthetics, investigate gesture recognition ANN implementation on Raspberry pi |
|August 8, 2021 to August 14, 2021|Update prosthetics journal draft with Williams, Begin implementation of gesture recognition ANN on raspberry pi|
|August 15, 2021 to August 28, 2021|Implementation of gesture recognition ANN on raspberry pi|
|September 1, 2021 to September 31, 2022|Preparation of Dissertation Draft version 2, SNN implementatioin on raspberry pi|
|☑️August 26, 2021 to September 3, 2021| Journal Paper first draft|
|☑️January 3, 2021| Completion of Final review slides|
|☑️January 6, 2022| Final review presentation rehearsal|
|February 5, 2022 | Final dissertation update and appendix completion|
|January 27, 2022 to February 18, 2022 | Implementation of ANN for early classification comparison with SNN, Make a presentation of the comparison result|
|February 13, 2022 | Conference paper complete draft|
|☑️February 7, 2022 | Meeting with professor to confirm thesis update and appendix|
|February 13, 2022 | Conference paper complete draft|
|☑️February 15, 2022 | Submission of finalized Dissertations and their abstracts|
|☑️February 16, 2022 |Doctoral Dissertation public presentation|
|☑️February 30, 2022 | Graduation DVD completion|
|March 15, 2022 | Desk cleanup completion|
CENTER:COLOR(green){''Schedule last Updated on: 17/02/2022''}
*Doctoral Dissertation Review Procedure (AY2022 Spring [[Ref>https://www.u-aizu.ac.jp/en/graduate/curriculum/doctor/]]) [#cf0b2887]
|Date|Task|
| ☑️March 22, 2021|Submission of dissertation title and list of referees|
| ☑️May 17, 2021|Submission of the documents for the Doctoral Dissertation Preliminary Review|
| ☑️June 18, 2021|Doctoral dissertation Rreliminary Review|
| ☑️December 17, 2021|Submission of the documents for the Doctoral Dissertation final Review|
| ☑️January 12, 2022|Doctoral Dissertation Final Review|
| ☑️January 19, 2022|Submission of final review report|
| ☑️January 24, 2022|Committee Meeting|
| ☑️February 9, 2022|Submission of the materials for the presentation|
|☑️February 15, 2022|Submission of finalized Dissertations and their abstracts|
|☑️February 15, 2022|Submission of the Abstracts of the Results Regarding the Final Doctoral Dissertation Review|
|☑️February 15, 2022|Submission of Consent to Use of Academic Paper / Repository Registration Request Form|
|☑️February 15, 2022|Submission of the Application Form for the Academic Degree|
|☑️February 16, 2022|Dissertation presentation|
CENTER:COLOR(green){''Schedule last Updated on: 17/02/2022''}
*Doctoral Dissertation [#ya1fe18c]
- Dissertation
-- Preliminary Dissertation COLOR(blue){(21/05/2019, Time:11:29 AM)}
([[latex>https://drive.google.com/file/d/1vfrbQNF996v5U1dyP1ecQDnsEnf-GlSw/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1onSqrgmlDNARNTucCez-rTzIknywVR-8/view?usp=sharing]])
-- Final Dissertation COLOR(blue){(28/01/2019, Time:12:34 AM)}
([[latex>https://drive.google.com/file/d/12GZws9Ud3ERwiOIOpF4EOs2cj324AY9v/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/16-8PEl189mRrBI59yVCEYN1laK8fxCjb/view?usp=sharing]])
*Research Progress - COLOR(gold){''===>''} [[previous tasks>https://adaptive.u-aizu.ac.jp/aslint/index.php?Mark%20-%20Research%20schedule]] [#he192396]
**Ongoing Papers [#nb94e66a]
//%*** %%Hardware Implementation of learning algorithm on SNPC%% [#a3f77254]
//-10/31 %%Hardware Implementation of learning algorithm on SNPC%%
//--submit a new conference
//--Draft_v1.0 COLOR(blue){(04/11/2019, Time:03:55 PM)}
//[[latex>https://drive.google.com/file/d/1QxBlxFkdCkWI6jy63QA18ENVlx_jGA6g/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1QrTgBnW9P0nRqZZVMncBsYyk2s_jzFf-/view?usp=sharing]])
//--Draft_v1.1 COLOR(blue){(08/11/2019, Time:03:26 PM)}
//([[latex>https://drive.google.com/file/d/1EmkfnVr7LS7iqRs-On5VMxqSCoKn2uy5/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/163MV3Q0ZXbONpH1TOcXF8QapEGZL1LFs/view?usp=sharing]])
//--Draft_v1.2 COLOR(blue){(18/11/2019, Time:05:16 PM)}
//([[latex>https://drive.google.com/file/d/1EFw3shfH-uVhgI_qw7arw8YzhGkX3Ffy/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/14_ML-QDszmwi47vJ7r7fuaKdecBU-aRW/view?usp=sharing]])
//%--Draft_v1.3 COLOR(blue){(23/01/2020, Time:05:16 PM)}
//%([[latex>https://drive.google.com/file/d/12hY8otUvDwdYpAB9HK_FUcx5Ivi4itxB/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/14_ML-QDszmwi47vJ7r7fuaKdecBU-aRW/view?usp=sharing]])
//%--Draft_v1.4 COLOR(blue){(03/02/2020, Time:10:43 AM)}
//%([[latex>https://drive.google.com/file/d/1S1MvBFDrB0H7LYe_J2MvXvL6aCPFZQX_/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1wNEK-ctx5RUM-tRD1Fxb7m4oyURtDMwy/view?usp=sharing]])
//%--Draft_v1.5 COLOR(blue){(14/02/2020, Time:10:42 AM)}
//%([[latex>https://drive.google.com/file/d/1lvpBp-j1zKQK_06DEE1MLbtEjghASeDi/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1JFCPRo1_PkHflUkztykXUvM-rDTULhMI/view?usp=sharing]])
//%--Draft_v1.6 COLOR(blue){(29/04/2020, Time:09:32 PM)}
//%([[latex>https://drive.google.com/file/d/1ZtL9I2FkM__c7z9hqfmh0jmDJir80Oo8/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1yr8FeBaoBGu0BoK7Cbli8o8JdPOAdqmw/view?usp=sharing]])
//***Fault-tolerant Scalable Three Dimensional NoC-based Digital Neuromorphic System [#o94effcf]
//-- Submitted to MDPI Electronics 1st version COLOR(blue){(06/03/2021, //Time:04:00 PM)}
//([[latex>https://drive.google.com/file/d/1NMw5xlmsDs_USzn-wBUp27gvQMiWeN3M/view?usp=sharing]], //[[pdf>https://drive.google.com/file/d/16QAhNshy-q4x9xZlylk-//K-lV-w0nKMrq/view?usp=sharing]])
//-- Submitted to MDPI Electronics 2nd version COLOR(blue){(24/03/2021, //Time:08:57 PM)}
//([[latex>https://drive.google.com/file/d/11ador2d3ciGUtdHcOsjTgu_x6ACgQCzm/view?usp=sharing]], //[[pdf>https://drive.google.com/file/d/1g6egLGqFcPi1jCMdXYmLDSjyjuaB5Zhk/view?//usp=sharing]])
***65k-Synapse 256-Neuron Online-Learning Spiking Neuron-Processing Core for Digital 3D-NoC-based Neuromorphic Processor [#xce22f6e]
-- Submitted to [[13th Conference on Reversible Computation>https://reversible-computation-2021.github.io/]], Nagoya, Japan 1st version COLOR(blue){(21/03/2021, Time:04:12 PM)}
([[latex>https://drive.google.com/file/d/1RQdRB7q9bjsntgE5arstn-KQz4tqzIAg/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1x6LtDDLGUBkiXKHEru_CpUmaUk4aeTPL/view?usp=sharing]]), Notification to authors:
April 24, 2021
***Study of a Multi-modal Neurorobotic Prosthetic Arm Control System based on Recurrent Spiking Neural Network [#j58e392a]
-- Submitted to [[The 4th International Conference on ICT Integration in Technical Education January 25-28, 2022>https://etltc-acmchap-japanconf.org/etltc2022]], Aizuwakamatsu, Japan COLOR(blue){(28/01/2022, Time:12:34 PM)}
([[Slide>https://drive.google.com/file/d/1iOgokhofkWZ_2C90isUo40yl7NQl5u3U/view?usp=sharing]], [[pdf]])
*Tutorials [#ya1fe18c]
--NASH_tutorial COLOR(blue){(12/07/2021, Time:06:52 PM)}
([[Files>https://drive.google.com/file/d/1mUVaBeaQ6xeh4yN91BM82GnHVm8dmGDb/view?usp=sharing]], [[Slides>https://drive.google.com/file/d/1viUlHuvAMffXsFFx62rTlDwwLD0FlBDa/view?usp=sharing]])
--Robot_arm_tutorial COLOR(blue){(12/07/2021, Time:06:52 PM)}
([[Slides>https://drive.google.com/file/d/17otGa9U0j8zPXh43mMJOjNn9UtJRlYZQ/view?usp=sharing]])
*Achievement [#d1905b56]
**Published papers [#k51ad403]
***%%Three Dimensional NoC-based Digital Neuromorphic System with On-chip Learning%% [#l3c26c76]
-- Submitted to International [[Symposium on Ubiquitous Networking 2021 (UNET21)>http://unet-conf.org/#home-section]], Marakesh, Morocco 1st version COLOR(blue){(06/03/2021, Time:04:00 PM)}
([[latex>https://drive.google.com/file/d/1Yl9WD3QQHUJirHFRA9lnnCz3UjHAjjOj/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1L7u1zxSpOhyfHG9vto_BRA-4wOoQh-9b/view?usp=sharing]]), Notification April 25th, 2021
-- ''Energy-efficient Spike-based Scalable Architecture for Next-generation Cognitive AI Computing Systems'', Camera ready version COLOR(blue){(08/05/2021, Time:10:49 AM)}
([[latex>https://drive.google.com/file/d/14zFsEa4PbhFFbT8BIjerzA5J9MSrQJXu/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/10Dq795y4sv3bCk9K_4ZwIjgnvbuGlCx2/view?usp=sharing]]),
***On the Design of a Fault-tolerant Scalable Three Dimensional NoC-based Digital Neuromorphic System with On-chip Learning [#z882260d]
-- Submitted to IEEE Access 1st version COLOR(blue){(01/03/2021, Time:04:00 PM)}
([[latex>https://drive.google.com/file/d/1FGttcZmF8Zj9ozPwJDXlcbS_WfwyI567/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1r0qPhVuiM82aAuS41_RzMGjTtaOAioJ-/view?usp=sharing]])
-- Submitted to IEEE Access 2nd version COLOR(blue){(02/04/2021, Time:11:03 AM)}
([[latex>https://drive.google.com/file/d/1rLVPewFy5pq2bY8Oqzad9dKFiwyV0XTG/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1ueRx6sGhc-koXith0f7sDIwXcVfhy3q1/view?usp=sharing]])
***Design and Evaluation of SNPC for ([[IEEE_BigCom2020>http://www.bigcomputing.org/]]) conference. COLOR(green){Full paper submisison due date: Sept 30, 2019} [#x97368f9]
--Draft_v1.0 COLOR(blue){(02/08/2019, Time:08:03 PM)} ([[latex>https://drive.google.com/file/d/1xOuXKJrLe4oyCuwEv2CyNzTQiDt65P8w/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1Gb17zieXevpdtYsa99XNEfEK9koArsAk/view?usp=sharing]])
--Draft_v1.1 COLOR(blue){(21/08/2019, Time:02:28 PM)}
([[latex>https://drive.google.com/file/d/1F_ehXCAJs-Ou_2XazEQKFoRAIINHD4lQ/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1Nss5xVY_CHys_4h4A_ybu2ET6DqQ9dFd/view?usp=sharing]])
-- Draft_v1.2 COLOR(blue){(23/08/2019, Time:02:28 PM)}
([[latex>https://drive.google.com/file/d/14BLRZ3F-I7fserY6kp1FsI8k5I2XZvpk/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/13uvaSVb15oi-RGTzl5tqMdif_9kljGcd/view?usp=sharing]])
--Draft_v1.3 COLOR(blue){(21/08/2019, Time:08:27 PM)}
([[latex>https://drive.google.com/file/d/1VE6x1UWOOG5k5LpL84nkmPuTr5GJC4Rb/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1NcGMpnzBvWmz9hVnkV3GlCfL6a4BDHJm/view?usp=sharing]])
--Draft_v1.4 COLOR(blue){(23/09/2019, Time:12:58 PM)}
([[latex>https://drive.google.com/file/d/1usjr17Tmm0tWkIXoQUOKmpYJnSCemwHT/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1Suzf4yQPtvevj_YB10ldXlpvFLzzaers/view?usp=sharing]])
--Draft_v1.5 COLOR(blue){(25/09/2019, Time:05:19 PM)}
([[latex>https://drive.google.com/file/d/1Aa1IEuh6MAzlOjv5xdyGIMH0Q4qBt5Xz/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1gniUmRSzJBHT8LHny-m7h8uoq9Adwl9b/view?usp=sharing]])
--Draft_v1.6 COLOR(blue){(01/10/2019, Time:05:00 PM)}
([[latex>https://drive.google.com/file/d/14Y_pRUQmQTrPf1h_DfJa9lwtSS62NzwW/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1eN_f8D5pTEF2LA8lslSueezNALdLIFIn/view?usp=sharing]])
--Light-weight Spiking Neuron Processing Core for Large-scale 3D-NoC based Spiking Neural Network Processing Systems(Submitted Copy) COLOR(blue){(01/10/2019, Time:05:14 PM)}
([[latex>https://drive.google.com/file/d/1YJK_o1rQXabvlZZo_81kUWM_PoJCn_2j/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/14v_64CKQXJoREbcb5HcqbL-roKtZNjL0/view?usp=sharing]])
--Light-weight_Spiking_Neuron_Processing_Core_For_Large-scale_3D-NoC_Based_Spiking_Neural_Network_Processing_Systems(camera-ready_copy) COLOR(blue){(17/12/2019, Time:09:38 AM)}
([[latex>https://drive.google.com/file/d/1MjPjjdwrWUK22WR46pLsYKky8ZoX6whO/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1KpmV9DTfLBDgxMuGZ2QnhXLMlXi2WFPj/view?usp=sharing]])
--Light-weight_Spiking_Neuron_Processing_Core_For_Large-scale_3D-NoC_Based_Spiking_Neural_Network_Processing_Systems COLOR(blue){(19/02/2020, Time:10:09 PM)}
([[Slides>https://drive.google.com/file/d/1gWkEb1GY7einAe8PtEcoeYSb22joLPmp/view?usp=sharing]])
***The ACM Chapter International Conference on Educational Technology, Language and Technical Communication ([[ETLTC>https://www.acmchapterseminarjapan.com/etltchome2020]]). COLOR(green){Full paper submisison due date: Nov. 19, 2019} [#v4c70797]
--Spiking Neuro-core for 3D-NoC Neuromorphic System. COLOR(blue){(18/11/2019, Time:01:36 PM)} ([[Word>https://drive.google.com/file/d/1nORGt7hk-YCOdLRACPZJ_g8X_qSzzYjQ/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1ZKoQPIs5g0Ar6VRP4dyeHrLsIeTvx7Dc/view?usp=sharing]])
--Spiking Neuro-core for 3D-NoC Neuromorphic System.
COLOR(blue){(13/01/2020, Time:01:07 PM)} ([[Latex>https://drive.google.com/file/d/1IQyBn8S1vAHShuCb0jm5mnTlp4UgBGG4/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1QVJnCqlSdBp9E8eh-w6QJdgKVBjmDoPb/view?usp=sharing]])
--Spiking Neuro-core for 3D-NoC Neuromorphic System.
COLOR(blue){(27/01/2020, Time:09:24 AM)} ([[Presentation_slides.pdf>https://drive.google.com/file/d/1huKY-zZ1VHJ9n3i6rmCherqeoWFKSsbc/view?usp=sharing]])
--Architecture_and_Design_of_a_Spiking_Neuron_Processor_Core_Towards_the_Design_of_a_Large-scale_Event-Driven_3D-NoC-based_Neuromorphic_Processor(camera_ready_copy).
COLOR(blue){(04/02/2020, Time:01:56 PM)} ([[Latex>https://drive.google.com/file/d/1HQkBvEnMVXOqc-AFeYlWTKVa__pw4OzK/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1Xek3tUYM5YYyV4zhKYKY3kl6Jbwz249K/view?usp=sharing]])
*** UoA Research Progress Seminar [#h6b2ab57]
--Research on Event Driven Fault-tolerant Spiking Neuromorphic System based on Packet Switched On-chip Network & On-chip Learning COLOR(blue){(22/06/2020, Time:05:00 PM)}
([[pdf>https://drive.google.com/file/d/1XisfKV1Uik6H0DfNJwzWRjGnDkYWN_OO/view?usp=sharing]])
***Preliminary Theis [#z1db403c]
***Final Thesis [#y8c5525b]
*COLOR(gold){My Shared Google Drive Folder} [#m2f492d0]
-[[My Shared GoogleDrive Folder>https://drive.google.com/drive/folders/1kfl95PzZoGM2iTi9wz8gSjcCZ70lsu1a?usp=sharing]]
-[[Ebooks>https://adaptive.u-aizu.ac.jp/aslint/index.php?Free%20Books]]
-[[Power Estimation with Vivado>https://www.xilinx.com/video/hardware/power-estimation-analysis-using-vivado.html]]
*Update History [#uf46292e]
-July 26, 2020: updated by B.
-April 29, 2020: updated by B.
-May 6, 2019: updated by B.
-April 17, 2019: updated by B.
終了行:
-[[Members-Internal]]
----
CENTER:COLOR(#81111F){SIZE(40){''On the Design of Adaptive Digital Neuromorphic System''}}
CENTER:COLOR(#81111F){SIZE(15){''Research on Fault-tolerant Spiking Neuromorphic System based on Packet Switched On-chip Network & On-chip Learning''}}
----
*NASH progress meetings [#q3ad2946]
-[[Minutes>https://adaptive.u-aizu.ac.jp/aslint/index.php?NASH-Minutes]]
*Research Background [#h2f74bf8]
As artificial neural networks (ANNs) are executed in a fully synchronized manner, most of the computation is inherently uselessly
done. For instance, a visual-based ANN performing object tracking analyses the entire image at each timestamp while most of the information remains unchanged within small time intervals. Another consequence of the synchronous execution is that traditional ANNs are not optimized to extract the timing information. In contrast, neuromorphic systems are characterized by
the asynchronous and independent execution of the neurons
within the neural net, therefore enabling more flexibility, as
well as the ability to learn the timing information. [www].
It has been understood that spiking neural networks (SNNs) and synaptic devices can achieve high energy efficiency and ''fault tolerance'' in complex tasks by emulating biological neurons and synapses. Hence, they have a big potential for the replacement of traditional von Neumann computers. [WWW.ref].
SNNs can achieve better power efficiency when more powerful encoding methods are applied, or when SNNs are optimized for short latency. Second, the inference results in SNNs can be gotten faster than ANNs, though the precision may be lower. The inference precision would then rise with more evidence accumulated over time [[Ref>https://www.researchgate.net/publication/342481278_Robustness_to_Noisy_Synaptic_Weights_in_Spiking_Neural_Networks]]. Spiking neurons are only activated when sufficient signals are integrated from other neurons, therefore the neural activities at the network level are usually sparse, which can make
executing SNNs by matrix-based operation on a traditional CPU or GPU inefficient.[[Ref>https://www.researchgate.net/publication/342481278_Robustness_to_Noisy_Synaptic_Weights_in_Spiking_Neural_Networks]].
One issue in SNNs is that the spike function is non-differentiable, making it impossible to use backpropagation to train the network. To address this issue, several
solutions have been proposed, such as converting DNNs to SNNs, and approximating the derivative of the spike function [ref]
Neuromorphic hardware is designed to accelerate the running of SNNs by allocating spiking neurons and synapses to neuromorphic chips and it can increase the power efficiency of SNNs by event-based computing.
*Research Goal [#m37fbd2d]
The goal of this Doctoral thesis is to research and implement a Deep Spiking Neural Network Architecture with on-chip learning scheme and based on the previously developed schemes [[NASH1>https://adaptive.u-aizu.ac.jp/aslint/index.php?Vu%20Huy%20The]]
The expected outputs from this research are:
-(1) An efficient adaptive configuration method which enables reconfiguration of different SNN parameters (spike weights, routing, hidden layers, topology, etc.)
-(2) An Efficient Multicast Fault-tolerant Routing Algorithm for the neurochip
-(3) Efficient on-chip learning Algorithm
-(4) To demonstrate the performance of the algorithms and the system, an FPGA implementation shall be developed and evalauted with several biological SNNs. In addition, a VLSI implementation shall be also developed.
*Research Schedule [#ldf95f0f]
|Date|Task|
|☑️April 1st 2019 - August 30, 2019|Survey, etc.|
|☑️September 1st, 2019 - July 31,2020 |Complete SNPC on-chip learning with STDP|
|September 21, 2020|COLOR(red){JoS paper draft}|
|☑️August 16, 2020 to September 21, 2020|Understand and run demo of k-means clustering based fault-tolerant multicast spike routing algorithm|
|☑️August 16, 2020 to September 21, 2020|Replace spike injector with SNPC and run again the demo of k-means clustering based fault-tolerant multicast spike routing algorithm|
|☑️September 1, 2020 to December 4, 2020|''Integrate SNPC into 3D-NoC architecture''|
|☑️September 1, 2020 to February 28, 2021|COLOR(red){Prepare journal paper draft on the 3D-NoC SNN}|
|☑️March 1, 2021 to March 3, 2021|COLOR(red){Prepare journal draft for MDPI Electronics}|
|☑️March 3, 2021 to March 5, 2021|COLOR(red){Prepare conference draft for UNET21}|
|☑️March 5, 2021 to March 21, 2021|COLOR(red){Prepare conference draft for Reversible Computing 13}|
|☑️March 19, 2021 to March 24, 2021|COLOR(red){Update journal manuscript for MDPI Electronics}|
|☑️April 2, 2021 to April 17, 2021|''NASH tutorial''|
|☑️April 6, 2021 to April 9, 2021|''Desertation draft structure ''|
|May 18, 2021 to May 30, 2021|''Investigate more biological benchmarks on NASH, including Hand Gesture Recognition''|
|☑️April 28, 2021 to May 6, 2021|''UNET Camera ready paper''|
|☑️April 18, 2021 to May 21, 2021|''Dissertation draft completion preparation of documents for the Doctoral Dissertation Preliminary Review'' |
| ☑️May 10, 2021| ''Preparation of documents for the Doctoral Dissertation Preliminary Review'' |
|☑️June 7|First Dissertation Preliminary Presentation Rehearsal|
|☑️June 14|Second Dissertation Preliminary Presentation Rehearsal|
|July 1, 2021 to September 31, 2021|Begin work on NeuroSys|
|☑️July 1, 2021 to July 12, 2021|Complete initial exploration of RBTC application|
|☑️August 1, 2021 to August 7, 2021|Survey on invasive and non-invasive prosthetics, investigate gesture recognition ANN implementation on Raspberry pi |
|August 8, 2021 to August 14, 2021|Update prosthetics journal draft with Williams, Begin implementation of gesture recognition ANN on raspberry pi|
|August 15, 2021 to August 28, 2021|Implementation of gesture recognition ANN on raspberry pi|
|September 1, 2021 to September 31, 2022|Preparation of Dissertation Draft version 2, SNN implementatioin on raspberry pi|
|☑️August 26, 2021 to September 3, 2021| Journal Paper first draft|
|☑️January 3, 2021| Completion of Final review slides|
|☑️January 6, 2022| Final review presentation rehearsal|
|February 5, 2022 | Final dissertation update and appendix completion|
|January 27, 2022 to February 18, 2022 | Implementation of ANN for early classification comparison with SNN, Make a presentation of the comparison result|
|February 13, 2022 | Conference paper complete draft|
|☑️February 7, 2022 | Meeting with professor to confirm thesis update and appendix|
|February 13, 2022 | Conference paper complete draft|
|☑️February 15, 2022 | Submission of finalized Dissertations and their abstracts|
|☑️February 16, 2022 |Doctoral Dissertation public presentation|
|☑️February 30, 2022 | Graduation DVD completion|
|March 15, 2022 | Desk cleanup completion|
CENTER:COLOR(green){''Schedule last Updated on: 17/02/2022''}
*Doctoral Dissertation Review Procedure (AY2022 Spring [[Ref>https://www.u-aizu.ac.jp/en/graduate/curriculum/doctor/]]) [#cf0b2887]
|Date|Task|
| ☑️March 22, 2021|Submission of dissertation title and list of referees|
| ☑️May 17, 2021|Submission of the documents for the Doctoral Dissertation Preliminary Review|
| ☑️June 18, 2021|Doctoral dissertation Rreliminary Review|
| ☑️December 17, 2021|Submission of the documents for the Doctoral Dissertation final Review|
| ☑️January 12, 2022|Doctoral Dissertation Final Review|
| ☑️January 19, 2022|Submission of final review report|
| ☑️January 24, 2022|Committee Meeting|
| ☑️February 9, 2022|Submission of the materials for the presentation|
|☑️February 15, 2022|Submission of finalized Dissertations and their abstracts|
|☑️February 15, 2022|Submission of the Abstracts of the Results Regarding the Final Doctoral Dissertation Review|
|☑️February 15, 2022|Submission of Consent to Use of Academic Paper / Repository Registration Request Form|
|☑️February 15, 2022|Submission of the Application Form for the Academic Degree|
|☑️February 16, 2022|Dissertation presentation|
CENTER:COLOR(green){''Schedule last Updated on: 17/02/2022''}
*Doctoral Dissertation [#ya1fe18c]
- Dissertation
-- Preliminary Dissertation COLOR(blue){(21/05/2019, Time:11:29 AM)}
([[latex>https://drive.google.com/file/d/1vfrbQNF996v5U1dyP1ecQDnsEnf-GlSw/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1onSqrgmlDNARNTucCez-rTzIknywVR-8/view?usp=sharing]])
-- Final Dissertation COLOR(blue){(28/01/2019, Time:12:34 AM)}
([[latex>https://drive.google.com/file/d/12GZws9Ud3ERwiOIOpF4EOs2cj324AY9v/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/16-8PEl189mRrBI59yVCEYN1laK8fxCjb/view?usp=sharing]])
*Research Progress - COLOR(gold){''===>''} [[previous tasks>https://adaptive.u-aizu.ac.jp/aslint/index.php?Mark%20-%20Research%20schedule]] [#he192396]
**Ongoing Papers [#nb94e66a]
//%*** %%Hardware Implementation of learning algorithm on SNPC%% [#a3f77254]
//-10/31 %%Hardware Implementation of learning algorithm on SNPC%%
//--submit a new conference
//--Draft_v1.0 COLOR(blue){(04/11/2019, Time:03:55 PM)}
//[[latex>https://drive.google.com/file/d/1QxBlxFkdCkWI6jy63QA18ENVlx_jGA6g/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1QrTgBnW9P0nRqZZVMncBsYyk2s_jzFf-/view?usp=sharing]])
//--Draft_v1.1 COLOR(blue){(08/11/2019, Time:03:26 PM)}
//([[latex>https://drive.google.com/file/d/1EmkfnVr7LS7iqRs-On5VMxqSCoKn2uy5/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/163MV3Q0ZXbONpH1TOcXF8QapEGZL1LFs/view?usp=sharing]])
//--Draft_v1.2 COLOR(blue){(18/11/2019, Time:05:16 PM)}
//([[latex>https://drive.google.com/file/d/1EFw3shfH-uVhgI_qw7arw8YzhGkX3Ffy/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/14_ML-QDszmwi47vJ7r7fuaKdecBU-aRW/view?usp=sharing]])
//%--Draft_v1.3 COLOR(blue){(23/01/2020, Time:05:16 PM)}
//%([[latex>https://drive.google.com/file/d/12hY8otUvDwdYpAB9HK_FUcx5Ivi4itxB/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/14_ML-QDszmwi47vJ7r7fuaKdecBU-aRW/view?usp=sharing]])
//%--Draft_v1.4 COLOR(blue){(03/02/2020, Time:10:43 AM)}
//%([[latex>https://drive.google.com/file/d/1S1MvBFDrB0H7LYe_J2MvXvL6aCPFZQX_/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1wNEK-ctx5RUM-tRD1Fxb7m4oyURtDMwy/view?usp=sharing]])
//%--Draft_v1.5 COLOR(blue){(14/02/2020, Time:10:42 AM)}
//%([[latex>https://drive.google.com/file/d/1lvpBp-j1zKQK_06DEE1MLbtEjghASeDi/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1JFCPRo1_PkHflUkztykXUvM-rDTULhMI/view?usp=sharing]])
//%--Draft_v1.6 COLOR(blue){(29/04/2020, Time:09:32 PM)}
//%([[latex>https://drive.google.com/file/d/1ZtL9I2FkM__c7z9hqfmh0jmDJir80Oo8/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1yr8FeBaoBGu0BoK7Cbli8o8JdPOAdqmw/view?usp=sharing]])
//***Fault-tolerant Scalable Three Dimensional NoC-based Digital Neuromorphic System [#o94effcf]
//-- Submitted to MDPI Electronics 1st version COLOR(blue){(06/03/2021, //Time:04:00 PM)}
//([[latex>https://drive.google.com/file/d/1NMw5xlmsDs_USzn-wBUp27gvQMiWeN3M/view?usp=sharing]], //[[pdf>https://drive.google.com/file/d/16QAhNshy-q4x9xZlylk-//K-lV-w0nKMrq/view?usp=sharing]])
//-- Submitted to MDPI Electronics 2nd version COLOR(blue){(24/03/2021, //Time:08:57 PM)}
//([[latex>https://drive.google.com/file/d/11ador2d3ciGUtdHcOsjTgu_x6ACgQCzm/view?usp=sharing]], //[[pdf>https://drive.google.com/file/d/1g6egLGqFcPi1jCMdXYmLDSjyjuaB5Zhk/view?//usp=sharing]])
***65k-Synapse 256-Neuron Online-Learning Spiking Neuron-Processing Core for Digital 3D-NoC-based Neuromorphic Processor [#xce22f6e]
-- Submitted to [[13th Conference on Reversible Computation>https://reversible-computation-2021.github.io/]], Nagoya, Japan 1st version COLOR(blue){(21/03/2021, Time:04:12 PM)}
([[latex>https://drive.google.com/file/d/1RQdRB7q9bjsntgE5arstn-KQz4tqzIAg/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1x6LtDDLGUBkiXKHEru_CpUmaUk4aeTPL/view?usp=sharing]]), Notification to authors:
April 24, 2021
***Study of a Multi-modal Neurorobotic Prosthetic Arm Control System based on Recurrent Spiking Neural Network [#j58e392a]
-- Submitted to [[The 4th International Conference on ICT Integration in Technical Education January 25-28, 2022>https://etltc-acmchap-japanconf.org/etltc2022]], Aizuwakamatsu, Japan COLOR(blue){(28/01/2022, Time:12:34 PM)}
([[Slide>https://drive.google.com/file/d/1iOgokhofkWZ_2C90isUo40yl7NQl5u3U/view?usp=sharing]], [[pdf]])
*Tutorials [#ya1fe18c]
--NASH_tutorial COLOR(blue){(12/07/2021, Time:06:52 PM)}
([[Files>https://drive.google.com/file/d/1mUVaBeaQ6xeh4yN91BM82GnHVm8dmGDb/view?usp=sharing]], [[Slides>https://drive.google.com/file/d/1viUlHuvAMffXsFFx62rTlDwwLD0FlBDa/view?usp=sharing]])
--Robot_arm_tutorial COLOR(blue){(12/07/2021, Time:06:52 PM)}
([[Slides>https://drive.google.com/file/d/17otGa9U0j8zPXh43mMJOjNn9UtJRlYZQ/view?usp=sharing]])
*Achievement [#d1905b56]
**Published papers [#k51ad403]
***%%Three Dimensional NoC-based Digital Neuromorphic System with On-chip Learning%% [#l3c26c76]
-- Submitted to International [[Symposium on Ubiquitous Networking 2021 (UNET21)>http://unet-conf.org/#home-section]], Marakesh, Morocco 1st version COLOR(blue){(06/03/2021, Time:04:00 PM)}
([[latex>https://drive.google.com/file/d/1Yl9WD3QQHUJirHFRA9lnnCz3UjHAjjOj/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1L7u1zxSpOhyfHG9vto_BRA-4wOoQh-9b/view?usp=sharing]]), Notification April 25th, 2021
-- ''Energy-efficient Spike-based Scalable Architecture for Next-generation Cognitive AI Computing Systems'', Camera ready version COLOR(blue){(08/05/2021, Time:10:49 AM)}
([[latex>https://drive.google.com/file/d/14zFsEa4PbhFFbT8BIjerzA5J9MSrQJXu/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/10Dq795y4sv3bCk9K_4ZwIjgnvbuGlCx2/view?usp=sharing]]),
***On the Design of a Fault-tolerant Scalable Three Dimensional NoC-based Digital Neuromorphic System with On-chip Learning [#z882260d]
-- Submitted to IEEE Access 1st version COLOR(blue){(01/03/2021, Time:04:00 PM)}
([[latex>https://drive.google.com/file/d/1FGttcZmF8Zj9ozPwJDXlcbS_WfwyI567/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1r0qPhVuiM82aAuS41_RzMGjTtaOAioJ-/view?usp=sharing]])
-- Submitted to IEEE Access 2nd version COLOR(blue){(02/04/2021, Time:11:03 AM)}
([[latex>https://drive.google.com/file/d/1rLVPewFy5pq2bY8Oqzad9dKFiwyV0XTG/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1ueRx6sGhc-koXith0f7sDIwXcVfhy3q1/view?usp=sharing]])
***Design and Evaluation of SNPC for ([[IEEE_BigCom2020>http://www.bigcomputing.org/]]) conference. COLOR(green){Full paper submisison due date: Sept 30, 2019} [#x97368f9]
--Draft_v1.0 COLOR(blue){(02/08/2019, Time:08:03 PM)} ([[latex>https://drive.google.com/file/d/1xOuXKJrLe4oyCuwEv2CyNzTQiDt65P8w/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1Gb17zieXevpdtYsa99XNEfEK9koArsAk/view?usp=sharing]])
--Draft_v1.1 COLOR(blue){(21/08/2019, Time:02:28 PM)}
([[latex>https://drive.google.com/file/d/1F_ehXCAJs-Ou_2XazEQKFoRAIINHD4lQ/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1Nss5xVY_CHys_4h4A_ybu2ET6DqQ9dFd/view?usp=sharing]])
-- Draft_v1.2 COLOR(blue){(23/08/2019, Time:02:28 PM)}
([[latex>https://drive.google.com/file/d/14BLRZ3F-I7fserY6kp1FsI8k5I2XZvpk/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/13uvaSVb15oi-RGTzl5tqMdif_9kljGcd/view?usp=sharing]])
--Draft_v1.3 COLOR(blue){(21/08/2019, Time:08:27 PM)}
([[latex>https://drive.google.com/file/d/1VE6x1UWOOG5k5LpL84nkmPuTr5GJC4Rb/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1NcGMpnzBvWmz9hVnkV3GlCfL6a4BDHJm/view?usp=sharing]])
--Draft_v1.4 COLOR(blue){(23/09/2019, Time:12:58 PM)}
([[latex>https://drive.google.com/file/d/1usjr17Tmm0tWkIXoQUOKmpYJnSCemwHT/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1Suzf4yQPtvevj_YB10ldXlpvFLzzaers/view?usp=sharing]])
--Draft_v1.5 COLOR(blue){(25/09/2019, Time:05:19 PM)}
([[latex>https://drive.google.com/file/d/1Aa1IEuh6MAzlOjv5xdyGIMH0Q4qBt5Xz/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1gniUmRSzJBHT8LHny-m7h8uoq9Adwl9b/view?usp=sharing]])
--Draft_v1.6 COLOR(blue){(01/10/2019, Time:05:00 PM)}
([[latex>https://drive.google.com/file/d/14Y_pRUQmQTrPf1h_DfJa9lwtSS62NzwW/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1eN_f8D5pTEF2LA8lslSueezNALdLIFIn/view?usp=sharing]])
--Light-weight Spiking Neuron Processing Core for Large-scale 3D-NoC based Spiking Neural Network Processing Systems(Submitted Copy) COLOR(blue){(01/10/2019, Time:05:14 PM)}
([[latex>https://drive.google.com/file/d/1YJK_o1rQXabvlZZo_81kUWM_PoJCn_2j/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/14v_64CKQXJoREbcb5HcqbL-roKtZNjL0/view?usp=sharing]])
--Light-weight_Spiking_Neuron_Processing_Core_For_Large-scale_3D-NoC_Based_Spiking_Neural_Network_Processing_Systems(camera-ready_copy) COLOR(blue){(17/12/2019, Time:09:38 AM)}
([[latex>https://drive.google.com/file/d/1MjPjjdwrWUK22WR46pLsYKky8ZoX6whO/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1KpmV9DTfLBDgxMuGZ2QnhXLMlXi2WFPj/view?usp=sharing]])
--Light-weight_Spiking_Neuron_Processing_Core_For_Large-scale_3D-NoC_Based_Spiking_Neural_Network_Processing_Systems COLOR(blue){(19/02/2020, Time:10:09 PM)}
([[Slides>https://drive.google.com/file/d/1gWkEb1GY7einAe8PtEcoeYSb22joLPmp/view?usp=sharing]])
***The ACM Chapter International Conference on Educational Technology, Language and Technical Communication ([[ETLTC>https://www.acmchapterseminarjapan.com/etltchome2020]]). COLOR(green){Full paper submisison due date: Nov. 19, 2019} [#v4c70797]
--Spiking Neuro-core for 3D-NoC Neuromorphic System. COLOR(blue){(18/11/2019, Time:01:36 PM)} ([[Word>https://drive.google.com/file/d/1nORGt7hk-YCOdLRACPZJ_g8X_qSzzYjQ/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1ZKoQPIs5g0Ar6VRP4dyeHrLsIeTvx7Dc/view?usp=sharing]])
--Spiking Neuro-core for 3D-NoC Neuromorphic System.
COLOR(blue){(13/01/2020, Time:01:07 PM)} ([[Latex>https://drive.google.com/file/d/1IQyBn8S1vAHShuCb0jm5mnTlp4UgBGG4/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1QVJnCqlSdBp9E8eh-w6QJdgKVBjmDoPb/view?usp=sharing]])
--Spiking Neuro-core for 3D-NoC Neuromorphic System.
COLOR(blue){(27/01/2020, Time:09:24 AM)} ([[Presentation_slides.pdf>https://drive.google.com/file/d/1huKY-zZ1VHJ9n3i6rmCherqeoWFKSsbc/view?usp=sharing]])
--Architecture_and_Design_of_a_Spiking_Neuron_Processor_Core_Towards_the_Design_of_a_Large-scale_Event-Driven_3D-NoC-based_Neuromorphic_Processor(camera_ready_copy).
COLOR(blue){(04/02/2020, Time:01:56 PM)} ([[Latex>https://drive.google.com/file/d/1HQkBvEnMVXOqc-AFeYlWTKVa__pw4OzK/view?usp=sharing]], [[pdf>https://drive.google.com/file/d/1Xek3tUYM5YYyV4zhKYKY3kl6Jbwz249K/view?usp=sharing]])
*** UoA Research Progress Seminar [#h6b2ab57]
--Research on Event Driven Fault-tolerant Spiking Neuromorphic System based on Packet Switched On-chip Network & On-chip Learning COLOR(blue){(22/06/2020, Time:05:00 PM)}
([[pdf>https://drive.google.com/file/d/1XisfKV1Uik6H0DfNJwzWRjGnDkYWN_OO/view?usp=sharing]])
***Preliminary Theis [#z1db403c]
***Final Thesis [#y8c5525b]
*COLOR(gold){My Shared Google Drive Folder} [#m2f492d0]
-[[My Shared GoogleDrive Folder>https://drive.google.com/drive/folders/1kfl95PzZoGM2iTi9wz8gSjcCZ70lsu1a?usp=sharing]]
-[[Ebooks>https://adaptive.u-aizu.ac.jp/aslint/index.php?Free%20Books]]
-[[Power Estimation with Vivado>https://www.xilinx.com/video/hardware/power-estimation-analysis-using-vivado.html]]
*Update History [#uf46292e]
-July 26, 2020: updated by B.
-April 29, 2020: updated by B.
-May 6, 2019: updated by B.
-April 17, 2019: updated by B.
ページ名: