Neuromorphic
をテンプレートにして作成
[
トップ
] [
新規
|
一覧
|
検索
|
最終更新
|
ヘルプ
]
開始行:
[[ASL Wiki]]
#CONTENTS
*Specila ISssues [#f27679fc]
-[[ACM:Special Issue on Hardware and Algorithms for Learn...
-[[SECTION: Special Issue on Neuromorphic Computing>http:...
-[[ACM Journal on Emerging Technologies in Computing Syst...
--
*How the brain Works [#r004783c]
Although the brain is often compared to a computer, the e...
''Potassium in the Brain'':
The action potential in neurons depends on electrolytes, ...
*Neuron models - There are three types of neurons: [#s900...
[[CENTER:&ref(neron_types.jpg,,80%);>https://www.youtube....
CENTER:The Neuron
-1. ''Binary signal neuron'': The binary neuron model was...
-2. ''Continuous value neuron'': The continuous value neu...
function of this neuron model is usually a sigmoid functi...
the-art Machine Learning algorithms employ this type of n...
-3. ''Spiking neuron'': The third type of neuron model is...
events instead of being interpreted as spiking frequency ...
-''Activation funciton'' : An activation function for lim...
-''Bia'': The model of a neuron also includes an external...
**[[Biological Neuron Model>https://en.wikipedia.org/wiki...
*Memory [#t554edd1]
-http://science.howstuffworks.com/life/inside-the-mind/hu...
*ANN Classification [#hfed3f7f]
CENTER:[[&ref(Classification-of-ANN.jpg,,80%);>https://dr...
*Neuromorphic [#m434927c]
- Originally, the term ??neuromorphic?? (coined by Carver...
--Paper: [[Mead C 1990 Neuromorphic electronic systems Pr...
*SNN [#t2063fe0]
[[Spiking neural networks (SNN) are a set of neurons that...
popular since they mimic the spiking nature of biological...
plausible and more powerful than non-spiking ones [20] [2...
spiking neurons. It clearly describes the subcellular lev...
of details, the Hodgkin-Huxley model is too complex to be...
model that is simple, has good performance both on comput...
For large scale hardware implementations, simplified mode...
and same is the case for this thesis. Such simpler models...
comparatively low level [22]. In this thesis, the neuron ...
would lead us to a more low power implementation. Details...
-SNN consists of spiking neurons that do not generate out...
its membrane potential (Vm) reaches a specific value. Th...
-Spiking neural network implementation using CPU and CUDA...
--Introduction https://www.youtube.com/watch?v=Oe1ldwEEwsI
--Code https://github.com/jirihybek/cuda-nnet
-Ref. 5 Z. Wang, L. Guo, and M. Adjouadi, A biological pl...
Integrate-and-Fire neuron model??, in 2014 36th Annual In...
of the IEEE Engineering in Medicine and Biology Society, ...
*CNN [#q76763f8]
-[[Lec 01>https://www.youtube.com/watch?v=FmpDIaiMIeA]] -...
-[[Lec 2>https://www.youtube.com/watch?v=s716QXfApa0]]
-[[Lec 3>https://www.youtube.com/watch?v=3iCifD8gZ0Q]]
-[[Lec 4>https://www.youtube.com/watch?v=SQ67NBCLV98]]
-[[Lec 5 CNN with Mathlab>https://www.youtube.com/watch?v...
*RNN [#qcef5bdb]
-[[Lec 01>https://www.youtube.com/watch?v=AqEF2HIMjYA]]
*[[Learning>learning]] [#ie6daeb6]
CENTER:&ref(STDP.jpg,,80%);
Learning in spiking neural networks is devised based on s...
The main principle of STDP is that synaptic plasticity is...
There are many variations of STDP, but all of them follow...
Offline training: weights are pre-defined by software tra...
Online training: weights are updated during run-time; Spe...
CENTER:[[&ref(List_of_Neuron_models.jpg,,80%);>https://dr...
-References:
--1.G.-Q. Bi and M.-M. Poo, \Synaptic modi cations in cul...
--2.[[Adaptive Neural Algorithms: the What, Why, and How,...
*Simulation [#z253d7c8]
-[[Spike Simulator>http://www.lloydwatts.com/spike2.html]...
-[[NES3>https://sourcesup.renater.fr/wiki/n2s3]]
*Applications [#tf665c60]
- [[2014 Neuromorphic Electronic Circuits for Building Au...
-[[2001G. Indiveri, ?ơ?A neuromorphic VLSI device for imp...
-[[2000. G. Indiveri and R. Douglas, ?ơ?Robotic vision: N...
*Memristor, others [#b8608ba8]
Definition: COLOR(red){According to the characterizing ma...
- [[2012 ''Why Are Memristor and Memistor Different Devic...
-[[2013.Integration of nanoscale memristor synapses in ne...
Note:
-L. O. Chua, ??Memristor-the missing circuit element,?? I...
- L. O. Chua, ??Resistance switching memories are memrist...
*Conductive-bridge random access memory (CBRAM) [#oed41ee9]
-2016. [[Scalable Neuron Circuit Using Conductive-Bridge ...
*References/Projects [#jc744550]
***Singapore http://www3.ntu.edu.sg/home/arindam.basu/wr...
-[[A Low-Voltage, Low Power STDP Synapse Implementation U...
***Swiss - EPFL Lauzanne [#m937b092]
-https://infoscience.epfl.ch/search?ln=en&p=Neural+Networ...
--[[2015 These H. Zhang, J. d. R. Millán Ruiz (Dir.)...
--[[2015. E. Fischi Gomez, J.-P. Thiran (Dir.). Connectom...
--[[F. Zenke, W. Gerstner (Dir.). Memory formation and re...
--http://robogen.org/
---Paper: https://infoscience.epfl.ch/record/200995/files...
--[[A Comprehensive Workflow for General-Purpose Neural M...
--[[PhD Thesis: Supernumerary Robotic Arm for Three-Hande...
***Neuromorphic Computing at Tennessee [#q9ca8abd]
-[[DANA on FPGA>http://neuromorphic.eecs.utk.edu/pages/re...
--[[2016 An Application Development Platform for Neuromor...
---[[Slides :Dynamic Adaptive Neural Network Arrays: A Ne...
---[[more slides from MLHPC2015 conference.html>http://or...
***Europe [#g572315b]
-[[NeuRAM Cube: NEUral computing aRchitectures in Advance...
---[[ESSDERC 2016 Workshop Presentations>http://www.neura...
***Japan [#k672528c]
-Tohoko Univ.: Soft Computing Integrated Systems Lab, Yos...
-UEC: The University of Electro-Communications, Brain Sci...
--Project Professor Shigeru TANAKA http://tanaka-lab.net/
--http://kjk.office.uec.ac.jp/Profiles/63/0006220/prof_e....
*Multicast Routing [#t995dafc]
-[41]Joshi, S.; Deiss, S.; Arnold, M.; Jongkil Park; Yu, ...
-[42] Zamarreno-Ramos, C.; Linares-Barranco, A.; Serrano-...
-[43] A. K. Mishra, N. Vijaykrishnan, Chita R. Das, [["A ...
-[44] Matos, D.; Concatto, C.; Carro, L.; Kastensmidt, F....
-[45] N. E. Jerger, L. S. Peh, and M. Lipasti, [[??Virtua...
-[46]. J. Wu, and S. Furber, ??[[A Multicast Routing Sche...
*How to Generate Artificial Spike train [#gede1c61]
...Theinput stimuli are a series of Poisson spike trains,...
-[[Poisson Model of Spike Generation>http://www.cns.nyu.e...
*LTP and LTD [#tec17953]
-[[LTP Video>https://www.youtube.com/watch?v=vso9jgfpI_c]...
***AMPA and NMDA Receptors [#q05f12aa]
&ref(SAMPA and NMDA Receptors.jpg,,40%);
-[[AMPA and NMDA Receptors>https://www.youtube.com/watch?...
[[Long Term Potentiation and Memory Formation, Animation>...
&ref(signals-to-hypocupsu.jpg,,40%);
&ref(wired-back-to-the-cortex.jpg,,60%);
&ref(brain-uses-synapse-for-communication.jpg,,60%);
&ref(weak-and-strong-synapses.jpg,,60%);
***Glutamate receptors [#w97556c2]
They are responsible for the glutamate-mediated postsynap...
----
----
*Tools and [#pdfaf4fd]
-http://openvibe.inria.fr/downloads/ Look at MindWave mob...
*Workshops [#q99ce29d]
-[[NICE 2017>https://www.src.org/calendar/e006125/]]
-[[NICE 2016>https://www.youtube.com/watch?v=skLG-MBj0OI&...
-[[Neuromorphic2016>http://ornlcda.github.io/neuromorphic...
-[[ESSDERC 2016 Workshop Presentations>http://www.neuram3...
----
-?ե????ɥե???ɥ˥塼???ͥåȥ?? (Feed-forward
Neural Networks)
- ?ꥫ???ȥ˥塼???ͥåȥ?? (Recurrent Neural
Networks; RNNs)
- ???߹??ߥ˥塼???ͥåȥ?? (Convolutional Neural
Networks; CNNs)
- ?Ƶ??˥塼???ͥåȥ?? (Recursive Neural Networks)
*Funds [#m9967c1c]
-https://docs.google.com/spreadsheets/d/1Fz4B4e1miLOm-7sM...
-----
*Tools [#ead6d8fe]
-http://image.online-convert.com/convert-to-eps
*KTH [#n6e4893d]
http://kth.diva-portal.org/smash/search.jsf?dswid=-6128
*Existing Deep Learning Frameworks [#ledb3c1b]
*** Caffee [#kc7f59e9]
Caffee is a framework developed by the Berkley Vision and...
community contributors [JSD+14]. As examples demonstrate,...
used to train a state of the art neural networks using th...
utilizes only the available CPUs, or, if compatible, also...
nVidia Tegra K1 GPU, the support was recently added6
.
*** Torch [#hebfd329]
Torch is another computing framework, which supports deep...
[CBM02]. It can use GPUs to seed up computation. Recent p...
to run on mobile devices like iOS, Android and FPGAs.
*** Theano [#fa48b6e8]
Theano also supports deep learning algorithms with effici...
arrays [BLP+12]. The python library includes GPU support ...
symbolic differentiation. Support for mobile devices has ...
the software yet.
*** Deeplearning4j [#h741c4f4]
Deeplearning4j tries to solve some issues of the other fr...
a more robust and portable language and providing commerc...
. This
enables the framework to run on any platform with Java su...
strong support to scale over many parallel GPUs or CPUs i...
***Tensorflow [#pd0acb25]
Tensorflow is an open-source framework for numerical comp...
recently released by Google [AAB+]. It facilitates large-...
distributed systems. Without changing code, it can run on...
in a server or mobile device.
*Actication funciton [#p5da14a2]
-What makes neural networks a nonlinear classification mo...
--https://stats.stackexchange.com/questions/222639/what-m...
--[[Tutorial>http://www2.econ.iastate.edu/tesfatsi/Neural...
*WWW Labs [#p20c4539]
-Neuromorphic - Architectures, Learning, Applicaiotns (Un...
--http://neuromorphic.eecs.utk.edu/pages/research-projects/
-Neuromorphic Laboratory (Boston University)
-- http://nl.bu.edu/
-Neuromorphic and Cognitive Integrated Circuits
-- http://www.lumerink.com/pages/neuromorphic.html
-Neuromorphic Machine Intelligence Lab Cognition, Neurosc...
--http://nmi-lab.org/
-Comutaional Evolutionnary Intelligence Lab, USA
--http://cei.pratt.duke.edu/research/neuromorphic-computing
-Departmnet bof Humnan Intelligence System, Japan
--http://www.brain.kyutech.ac.jp/people/people_e.html
-http://www.brain.kyutech.ac.jp/coe21/english/sub_ishii.h...
_Neuro-computer, Japan
-- Workshop: http://www.airc.aist.go.jp/info_details/2017...
-The 3rd Workshop on Bio-Inspired Energy-Efficient Inform...
in the University of Tokyo on March 12th, 2018.
--http://park.itc.u-tokyo.ac.jp/EEIP-SCP/workshop20180312...
--http://park.itc.u-tokyo.ac.jp/EEIP-SCP/workshop20160302...
-The 2nd Neuromorphic Research Retreat in AIST
-The 4th brainware seminar (H29), (Research Institute of ...
--http://www.riec.tohoku.ac.jp/ja/events/others/2018/01/p...
*[[Spike Computing]] [#x176dca1]
終了行:
[[ASL Wiki]]
#CONTENTS
*Specila ISssues [#f27679fc]
-[[ACM:Special Issue on Hardware and Algorithms for Learn...
-[[SECTION: Special Issue on Neuromorphic Computing>http:...
-[[ACM Journal on Emerging Technologies in Computing Syst...
--
*How the brain Works [#r004783c]
Although the brain is often compared to a computer, the e...
''Potassium in the Brain'':
The action potential in neurons depends on electrolytes, ...
*Neuron models - There are three types of neurons: [#s900...
[[CENTER:&ref(neron_types.jpg,,80%);>https://www.youtube....
CENTER:The Neuron
-1. ''Binary signal neuron'': The binary neuron model was...
-2. ''Continuous value neuron'': The continuous value neu...
function of this neuron model is usually a sigmoid functi...
the-art Machine Learning algorithms employ this type of n...
-3. ''Spiking neuron'': The third type of neuron model is...
events instead of being interpreted as spiking frequency ...
-''Activation funciton'' : An activation function for lim...
-''Bia'': The model of a neuron also includes an external...
**[[Biological Neuron Model>https://en.wikipedia.org/wiki...
*Memory [#t554edd1]
-http://science.howstuffworks.com/life/inside-the-mind/hu...
*ANN Classification [#hfed3f7f]
CENTER:[[&ref(Classification-of-ANN.jpg,,80%);>https://dr...
*Neuromorphic [#m434927c]
- Originally, the term ??neuromorphic?? (coined by Carver...
--Paper: [[Mead C 1990 Neuromorphic electronic systems Pr...
*SNN [#t2063fe0]
[[Spiking neural networks (SNN) are a set of neurons that...
popular since they mimic the spiking nature of biological...
plausible and more powerful than non-spiking ones [20] [2...
spiking neurons. It clearly describes the subcellular lev...
of details, the Hodgkin-Huxley model is too complex to be...
model that is simple, has good performance both on comput...
For large scale hardware implementations, simplified mode...
and same is the case for this thesis. Such simpler models...
comparatively low level [22]. In this thesis, the neuron ...
would lead us to a more low power implementation. Details...
-SNN consists of spiking neurons that do not generate out...
its membrane potential (Vm) reaches a specific value. Th...
-Spiking neural network implementation using CPU and CUDA...
--Introduction https://www.youtube.com/watch?v=Oe1ldwEEwsI
--Code https://github.com/jirihybek/cuda-nnet
-Ref. 5 Z. Wang, L. Guo, and M. Adjouadi, A biological pl...
Integrate-and-Fire neuron model??, in 2014 36th Annual In...
of the IEEE Engineering in Medicine and Biology Society, ...
*CNN [#q76763f8]
-[[Lec 01>https://www.youtube.com/watch?v=FmpDIaiMIeA]] -...
-[[Lec 2>https://www.youtube.com/watch?v=s716QXfApa0]]
-[[Lec 3>https://www.youtube.com/watch?v=3iCifD8gZ0Q]]
-[[Lec 4>https://www.youtube.com/watch?v=SQ67NBCLV98]]
-[[Lec 5 CNN with Mathlab>https://www.youtube.com/watch?v...
*RNN [#qcef5bdb]
-[[Lec 01>https://www.youtube.com/watch?v=AqEF2HIMjYA]]
*[[Learning>learning]] [#ie6daeb6]
CENTER:&ref(STDP.jpg,,80%);
Learning in spiking neural networks is devised based on s...
The main principle of STDP is that synaptic plasticity is...
There are many variations of STDP, but all of them follow...
Offline training: weights are pre-defined by software tra...
Online training: weights are updated during run-time; Spe...
CENTER:[[&ref(List_of_Neuron_models.jpg,,80%);>https://dr...
-References:
--1.G.-Q. Bi and M.-M. Poo, \Synaptic modi cations in cul...
--2.[[Adaptive Neural Algorithms: the What, Why, and How,...
*Simulation [#z253d7c8]
-[[Spike Simulator>http://www.lloydwatts.com/spike2.html]...
-[[NES3>https://sourcesup.renater.fr/wiki/n2s3]]
*Applications [#tf665c60]
- [[2014 Neuromorphic Electronic Circuits for Building Au...
-[[2001G. Indiveri, ?ơ?A neuromorphic VLSI device for imp...
-[[2000. G. Indiveri and R. Douglas, ?ơ?Robotic vision: N...
*Memristor, others [#b8608ba8]
Definition: COLOR(red){According to the characterizing ma...
- [[2012 ''Why Are Memristor and Memistor Different Devic...
-[[2013.Integration of nanoscale memristor synapses in ne...
Note:
-L. O. Chua, ??Memristor-the missing circuit element,?? I...
- L. O. Chua, ??Resistance switching memories are memrist...
*Conductive-bridge random access memory (CBRAM) [#oed41ee9]
-2016. [[Scalable Neuron Circuit Using Conductive-Bridge ...
*References/Projects [#jc744550]
***Singapore http://www3.ntu.edu.sg/home/arindam.basu/wr...
-[[A Low-Voltage, Low Power STDP Synapse Implementation U...
***Swiss - EPFL Lauzanne [#m937b092]
-https://infoscience.epfl.ch/search?ln=en&p=Neural+Networ...
--[[2015 These H. Zhang, J. d. R. Millán Ruiz (Dir.)...
--[[2015. E. Fischi Gomez, J.-P. Thiran (Dir.). Connectom...
--[[F. Zenke, W. Gerstner (Dir.). Memory formation and re...
--http://robogen.org/
---Paper: https://infoscience.epfl.ch/record/200995/files...
--[[A Comprehensive Workflow for General-Purpose Neural M...
--[[PhD Thesis: Supernumerary Robotic Arm for Three-Hande...
***Neuromorphic Computing at Tennessee [#q9ca8abd]
-[[DANA on FPGA>http://neuromorphic.eecs.utk.edu/pages/re...
--[[2016 An Application Development Platform for Neuromor...
---[[Slides :Dynamic Adaptive Neural Network Arrays: A Ne...
---[[more slides from MLHPC2015 conference.html>http://or...
***Europe [#g572315b]
-[[NeuRAM Cube: NEUral computing aRchitectures in Advance...
---[[ESSDERC 2016 Workshop Presentations>http://www.neura...
***Japan [#k672528c]
-Tohoko Univ.: Soft Computing Integrated Systems Lab, Yos...
-UEC: The University of Electro-Communications, Brain Sci...
--Project Professor Shigeru TANAKA http://tanaka-lab.net/
--http://kjk.office.uec.ac.jp/Profiles/63/0006220/prof_e....
*Multicast Routing [#t995dafc]
-[41]Joshi, S.; Deiss, S.; Arnold, M.; Jongkil Park; Yu, ...
-[42] Zamarreno-Ramos, C.; Linares-Barranco, A.; Serrano-...
-[43] A. K. Mishra, N. Vijaykrishnan, Chita R. Das, [["A ...
-[44] Matos, D.; Concatto, C.; Carro, L.; Kastensmidt, F....
-[45] N. E. Jerger, L. S. Peh, and M. Lipasti, [[??Virtua...
-[46]. J. Wu, and S. Furber, ??[[A Multicast Routing Sche...
*How to Generate Artificial Spike train [#gede1c61]
...Theinput stimuli are a series of Poisson spike trains,...
-[[Poisson Model of Spike Generation>http://www.cns.nyu.e...
*LTP and LTD [#tec17953]
-[[LTP Video>https://www.youtube.com/watch?v=vso9jgfpI_c]...
***AMPA and NMDA Receptors [#q05f12aa]
&ref(SAMPA and NMDA Receptors.jpg,,40%);
-[[AMPA and NMDA Receptors>https://www.youtube.com/watch?...
[[Long Term Potentiation and Memory Formation, Animation>...
&ref(signals-to-hypocupsu.jpg,,40%);
&ref(wired-back-to-the-cortex.jpg,,60%);
&ref(brain-uses-synapse-for-communication.jpg,,60%);
&ref(weak-and-strong-synapses.jpg,,60%);
***Glutamate receptors [#w97556c2]
They are responsible for the glutamate-mediated postsynap...
----
----
*Tools and [#pdfaf4fd]
-http://openvibe.inria.fr/downloads/ Look at MindWave mob...
*Workshops [#q99ce29d]
-[[NICE 2017>https://www.src.org/calendar/e006125/]]
-[[NICE 2016>https://www.youtube.com/watch?v=skLG-MBj0OI&...
-[[Neuromorphic2016>http://ornlcda.github.io/neuromorphic...
-[[ESSDERC 2016 Workshop Presentations>http://www.neuram3...
----
-?ե????ɥե???ɥ˥塼???ͥåȥ?? (Feed-forward
Neural Networks)
- ?ꥫ???ȥ˥塼???ͥåȥ?? (Recurrent Neural
Networks; RNNs)
- ???߹??ߥ˥塼???ͥåȥ?? (Convolutional Neural
Networks; CNNs)
- ?Ƶ??˥塼???ͥåȥ?? (Recursive Neural Networks)
*Funds [#m9967c1c]
-https://docs.google.com/spreadsheets/d/1Fz4B4e1miLOm-7sM...
-----
*Tools [#ead6d8fe]
-http://image.online-convert.com/convert-to-eps
*KTH [#n6e4893d]
http://kth.diva-portal.org/smash/search.jsf?dswid=-6128
*Existing Deep Learning Frameworks [#ledb3c1b]
*** Caffee [#kc7f59e9]
Caffee is a framework developed by the Berkley Vision and...
community contributors [JSD+14]. As examples demonstrate,...
used to train a state of the art neural networks using th...
utilizes only the available CPUs, or, if compatible, also...
nVidia Tegra K1 GPU, the support was recently added6
.
*** Torch [#hebfd329]
Torch is another computing framework, which supports deep...
[CBM02]. It can use GPUs to seed up computation. Recent p...
to run on mobile devices like iOS, Android and FPGAs.
*** Theano [#fa48b6e8]
Theano also supports deep learning algorithms with effici...
arrays [BLP+12]. The python library includes GPU support ...
symbolic differentiation. Support for mobile devices has ...
the software yet.
*** Deeplearning4j [#h741c4f4]
Deeplearning4j tries to solve some issues of the other fr...
a more robust and portable language and providing commerc...
. This
enables the framework to run on any platform with Java su...
strong support to scale over many parallel GPUs or CPUs i...
***Tensorflow [#pd0acb25]
Tensorflow is an open-source framework for numerical comp...
recently released by Google [AAB+]. It facilitates large-...
distributed systems. Without changing code, it can run on...
in a server or mobile device.
*Actication funciton [#p5da14a2]
-What makes neural networks a nonlinear classification mo...
--https://stats.stackexchange.com/questions/222639/what-m...
--[[Tutorial>http://www2.econ.iastate.edu/tesfatsi/Neural...
*WWW Labs [#p20c4539]
-Neuromorphic - Architectures, Learning, Applicaiotns (Un...
--http://neuromorphic.eecs.utk.edu/pages/research-projects/
-Neuromorphic Laboratory (Boston University)
-- http://nl.bu.edu/
-Neuromorphic and Cognitive Integrated Circuits
-- http://www.lumerink.com/pages/neuromorphic.html
-Neuromorphic Machine Intelligence Lab Cognition, Neurosc...
--http://nmi-lab.org/
-Comutaional Evolutionnary Intelligence Lab, USA
--http://cei.pratt.duke.edu/research/neuromorphic-computing
-Departmnet bof Humnan Intelligence System, Japan
--http://www.brain.kyutech.ac.jp/people/people_e.html
-http://www.brain.kyutech.ac.jp/coe21/english/sub_ishii.h...
_Neuro-computer, Japan
-- Workshop: http://www.airc.aist.go.jp/info_details/2017...
-The 3rd Workshop on Bio-Inspired Energy-Efficient Inform...
in the University of Tokyo on March 12th, 2018.
--http://park.itc.u-tokyo.ac.jp/EEIP-SCP/workshop20180312...
--http://park.itc.u-tokyo.ac.jp/EEIP-SCP/workshop20160302...
-The 2nd Neuromorphic Research Retreat in AIST
-The 4th brainware seminar (H29), (Research Institute of ...
--http://www.riec.tohoku.ac.jp/ja/events/others/2018/01/p...
*[[Spike Computing]] [#x176dca1]
ページ名:
![[PukiWiki]](image/pukiwiki.png "[PukiWiki]")
