Publication:
Recognition of partially occluded and rotated images with a network of spiking neurons

Research Projects
Organizational Units
Journal Issue
Abstract
In this paper, we introduce a novel system for recognition of partially occluded and rotated images. The system is based on a hierarchical network of integrate-and-fire spiking neurons with random synaptic connections and a novel organization process. The network generates integrated output sequences that are used for image classification. The proposed network is shown to provide satisfactory predictive performance given that the number of the recognition neurons and synaptic connections are adjusted to the size of the input image. Comparison of synaptic plasticity activity rule (SAPR) and spike timing dependant plasticity rules, which are used to learn connections between the spiking neurons, indicates that the former gives better results and thus the SAPR rule is used. Test results show that the proposed network performs better than a recognition system based on support vector machines.
Description
Keywords
Citation
A. Amine , S. Ghouzali , M. Rziza and D. Aboutajdine "An improved method for face recognition based on SVM in frequency domain", Mach. Graph. Vision, vol. 18, no. 2, pp.187 -199 2009 P. F. Baldi and K. Hornik "Learning in linear neural networks: A survey", IEEE Trans. Neural Netw., vol. 6, no. 4, pp.837 -858 1995 G. Barrionuevo and T. H. Brown "Associative long-term potentiation in hippocampal slices", Proc. Natl. Acad. Sci., vol. 80, no. 23, pp.7347 -7351 1983 G. Bi and M. Poo "Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type", J. Neurosci., vol. 18, no. 24, pp.10464 -10472 1998 R. Chellappa , C. L. Wilson and S. Sirohey "Human and machine recognition of faces: A survey", Proc. IEEE, vol. 83, pp.705 -741 1995 K. J. Cios , W. Pedrycz , R. W. Swiniarski and L. A. Kurgan Data Mining: A Knowledge Discovery Approach, 2007 :Springer K. J. Cios and I. Shin "Image recognition neural network: IRNN", Neurocomputing, vol. 7, no. 2, pp.159 -185 1995 K. J. Cios , W. Swiercz and W. Jackson "Networks of spiking neurons in modeling and problem solving", Neurocomputing, vol. 61, pp.99 -119 2004 K. J. Cios and L. M. Sztandera "Ontogenic neuro-fuzzy algorithm: F-CID3", Neurocomputing, vol. 14, no. 4, pp.383 -402 1997 G. Deco and E. Rolls "A neurodynamical cortical model of visual attention and invariant object recognition", Vision Res., vol. 44, no. 6, pp.621 -642 2004 A. Delorme and S. J. Thorpe "Face identification using one spike per neuron: Resistance to image degradations", Neural Netw., vol. 14, no. 6–7, pp.795 -803 2001 O. Déniz , M. Castrillón and M. Hernández "Face recognition using independent component analysis and support vector machines", Pattern Recognit. Lett., vol. 24, no. 13, pp.2153 -2157 2003 G. M. Edelman Neural Darwinism: The Theory of Neuronal Group Selection, 1987 :Basic Books E. Fiesler and K. J. Cios E. Fiesler and R. Beale Handbook on Neural Computation: Supplement 1, 1997 :Taylor and Francis S. Fusi "Hebbian spike-driven synaptic plasticity for learning patterns of mean firing rates", Biol. Cybernet., vol. 87, no. 5–6, pp.459 -470 2002 S. Fusi , M. Annunziato , D. Badoni , A. Salamon and D. J. Amit "Spike-driven synaptic plasticity: Theory, simulation, VLSI implementation", Neural Comput., vol. 12, no. 10, pp.2227 -2258 2000 W. Gerstner and W. M. Kistler Spiking Neuron Models: Single Neurons, Populations, Plasticity, 2002 :Cambridge Univ. Press D. B. Graham and N. M. Allinson H. Wechsler , P. J. Phillips , V. Bruce , F. Fogelman-Soulie and T. S. Huang NATO ASI Series F, Computer and Systems Sciences, 1998 :Springer-Verlag B. Heisele , P. Ho , J. Wu and T. Poggio "Face recognition: Component-based versus global approaches", Comput. Vision Image Understand., vol. 91, no. 1–2, pp.6 -21 2003 A. L. Hodgkin and A. F. Huxley "A quantitative description of membrane current and its application to conduction and excitation in nerve", J. Physiol., vol. 117, no. 4, pp.500 -544 1952 E. M. Izhikevich "Polychronization: Computation with spikes", Neural Comput., vol. 18, no. 2, pp.245 -282 2006 H. R. Kanan , K. Faez and Y. Gao "Face recognition using adaptively weighted patch PZM array from a single exemplar image per person", Pattern Recognit., vol. 41, no. 12, pp.3799 -3812 2008 E. R. Kandel , J. H. Schwartz and T. M. Jessell Essentials of Neural Science and Behavior, 1996 :McGraw-Hill J. Konorski Conditioned Reflexes and Neuron Organization, 1948 :Cambridge Univ. Press M. Lengyel , J. Kwag , O. Paulsen and P. Dayan "Matching storage and recall: Hippocampal spike timing-dependent plasticity and phase response curves", Nature Neurosci., vol. 8, no. 12, pp.1677 -1683 2005 J. Lisman and N. Spruston "Postsynaptic depolarization requirements for LTP and LTD: A critique of spike timing-dependent plasticity", Nature Neurosci., vol. 8, no. 7, pp.839 -841 2005 J. Lovelace and K. J. Cios "A very simple spiking neuron model that allows for modeling of large, complex systems", Neural Comput., vol. 20, no. 1, pp.65 -90 2008 M. J. Lyons , S. Akamatsu , M. Kamachi and J. Gyoba "Coding facial expressions with gabor wavelets", Proc. 3rd IEEE Int. Conf. Autom. Face Gesture Recognit., pp.14 -16 1998 R. J. MacGregor Theoretical Mechanics of Biological Neural Networks, 1993 :Academic T. Masquelier and S. J. Thorpe "Unsupervised learning of visual features through spike timing dependent plasticity", PLoS Comput. Biol., vol. 3, no. 2, pp.247 -257 2007 W. S. McCulloch and W. H. Pitts "A logical calculus of the ideas immanent in nervous activity", Bull. Math. Biophys., vol. 5, no. 4, pp.115 -133 1943 B. W. Mel "SEEMORE: Combining color, shape, and texture histogramming in a neurally inspired approach to visual object recognition", Neural Comput., vol. 9, no. 4, pp.777 -804 1997 T. Mitchell Machine Learning, 1997 :McGraw-Hill J. Mutch and D. Lowe "Multiclass object recognition with sparse, localized features", Proc. 2006 IEEE Comput. Soc. Conf, Comput. Vision Pattern Recognitk, pp.11 -18 2006 Abstract | Full Text: PDF (688KB) | Full Text: HTML T. Ohno-Shosaku , T. Maejima and M. Kano "Endogenous cannabinoids mediate retrograde signals from depolarized postsynaptic neurons to presynaptic terminals", Neuron, vol. 29, no. 3, pp.729 -738 2001 B. A. Olshausen , C. H. Anderson and D. C. Van Essen "A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information", J. Neurosci., vol. 13, no. 11, pp.4700 -4719 1993 M. Riesenhuber and T. Poggio "Hierarchical models of object recognition in cortex", Nature Neurosci., vol. 2, no. 11, pp.1019 -1025 1999 M. Riesenhuber and T. Poggio "Models of object recognition", Nature Neurosci., vol. 3, no. 11, pp.1199 -1204 2000 F. Rosenblatt "The perceptron: A probabilistic model for information storage and organization in the brain", Psychol. Rev., vol. 65, no. 6, pp.386 -408 1958 D. M. Sala and K. J. Cios "Self-organization in networks of spiking neurons", Aust. J. Intell. Inform. Process. Syst., vol. 5, no. 3, pp.161 -170 1998 D. M. Sala and K. J. Cios "Solving graph algorithms with networks of spiking neurons", IEEE Trans. Neural Netw., vol. 10, no. 4, pp.953 -957 1999 A. Samal and P. A. Lyengar "Automatic recognition and analysis of human faces and facial expressions: A survey", Pattern Recognit., vol. 25, no. 1, pp.65 -77 1992 F. S. Samaria and A. C. Harter "Parameterization of a stochastic model for human face identification", Proc. 2nd IEEE Workshop Applicat. Comput. Vision, pp.138 -142 1994 T. Serre , L. Wolf , S. Bileschi , M. Riesenhuber and T. Poggio "Robust object recognition with cortex-like mechanisms", IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 3, pp.411 -426 2007 F. Y. Shih , C.-F. Chuang and P. S. P. Wang "Performance comparisons of facial expression recognition in JAFFE database", Int. J. Pattern Recognit. Artif. Intell., vol. 22, no. 3, pp.445 -459 2008 S. Song , K. D. Miller and L. F. Abbot "Competitive Hebbian learning through spike-timing-dependent synaptic plasticity", Nature Neurosci., vol. 3, no. 9, pp.919 -926 2000 W. Swiercz , K. J. Cios , J. Hellier , A. Yee and K. Staley "Effects of synaptic depression and recovery on synchronous network activity", J. Clin. Neurophysiol., vol. 24, no. 2, pp.165 -174 2007 W. Swiercz , K. J. Cios , K. Staley , L. Kurgan , F. Accurso and S. Sagel "New synaptic plasticity rule for networks of spiking neurons", IEEE Trans. Neural Netw., vol. 17, no. 1, pp.94 -105 2006 X. Tan , S. Chen , Z.-H. Zhou and F. Zhang "Recognizing partially occluded, expression variant faces from single training image per person with SOM and soft $k$-NN ensemble", IEEE Trans. Neural Netw., vol. 16, no. 4, pp.875 -886 2005 R. D. Traub and R. Miles Neuronal Networks of the Hippocampus, 1991 :Cambridge Univ. Press M. Tsodyks and C. Gilbert "Neural networks and perceptual learning", Nature, vol. 431, pp.775 -781 2004 X. J. Wang "Probabilistic decision making by slow reverberation in cortical circuits", Neuron, vol. 36, no. 5, pp.955 -968 2002 R. I. Wilson and R. A. Nicoll "Endogenous cannabinoids mediate retrograde signalling at hippocampal synapses", Nature, vol. 410, pp.588 -592 2001 M. Yanike , S. Wirth and W. A. Suzuki "Representation of well-learned information in the monkey hippocampus", Neuron, vol. 42, no. 3, pp.477 -487 2004 C.-Y. Yen and K. J. Cios "Image recognition system based on novel measures of image similarity and cluster validity", Neurocomputing, vol. 72, no. 1–3, pp.401 -412 2008 G. P. Zhang "Neural networks for classification: A survey", IEEE Trans. Syst., Man, and Cybernet. C: Applicat. Rev., vol. 30, no. 4, pp.451 -462 2000
Collections