Modal Learning in a Neural Network

Conference paper


Lee, S. and Palmer-Brown, Dominic 2006. Modal Learning in a Neural Network. Proceedings of the AC&T, pp. 42-47
AuthorsLee, S. and Palmer-Brown, Dominic
TypeConference paper
Abstract

This paper presents an application of the snap-drift modal learning algorithm developed in
recent years by Lee and Palmer-Brown (Lee, 2004a). The application involves phrase recognition
using a set of phrases from the Lancaster Parsed Corpus (LPC) (Garside, 1987). The learning
algorithm is the classifier version of snap-drift. The twin modes of minimalist learning (snap) and
slow drift towards the input pattern are applied alternately. Each neuron of the Snap-Drift Neural
Network (SDNN) swaps between snap and drift modes when declining performance is indicated on
that particular node, so that each node has its learning mode toggled independently of the other nodes.
Learning on each node is also reinforced by enabling learning with a probability that decreases with
increasing performance. The simulations demonstrate that learning is stable, and the results have
consistently shown similar classification performance and advantages in terms of speed in comparison
with a Multilayer Perceptron (MLP) and back-propagation neural networks applied to the same
problem.

Keywordssnap-drift; Snap-Drift Neural Network (SDNN); Multilayer Perceptron (MLP); learning algorithm
Year2006
ConferenceProceedings of the AC&T, pp
Publisher's version
License
CC BY-ND
Publication dates
Print2006
Publication process dates
Deposited09 Jun 2010
Web address (URL)http://www.uel.ac.uk/act/proceedings/documents/ACT06Proceeding.pdf
http://hdl.handle.net/10552/792
Additional information

Citation:
Lee, S.W; Palmer-Brown, D. (2006) ‘Modal Learning in a Neural Network’ Proceedings of the AC&T, pp.42-47..

Permalink -

https://repository.uel.ac.uk/item/86780

Download files


Publisher's version
  • 118
    total views
  • 60
    total downloads
  • 0
    views this month
  • 1
    downloads this month

Export as

Related outputs

Cyber Threat Predictive Analytics for Improving Cyber Supply Chain Security
Yeboah-Ofori, A., Islam, S., Lee, S. W., Shamszaman, Z. U., Muhammad, K., Altaf, M. and Al-Rakhami, M. S. 2021. Cyber Threat Predictive Analytics for Improving Cyber Supply Chain Security. IEEE Access. 9, pp. 94318-94337. https://doi.org/10.1109/ACCESS.2021.3087109
Activities of daily life recognition using process representation modelling to support intention analysis
Naeem, U., Bashroush, R., Anthony, Richard, Azam, Muhammad Awais, Tawil, Abdel Rahman, Lee, S. and Mou-Ling, Dennis 2015. Activities of daily life recognition using process representation modelling to support intention analysis. International Journal of Pervasive Computing and Communications. 11 (3), pp. 347-371. https://doi.org/10.1108/IJPCC-01-2015-0002
Intelligent diagnostic feedback for online multiple-choice questions
Guo, R., Palmer-Brown, D., Lee, S. and Cai, F. F. 2013. Intelligent diagnostic feedback for online multiple-choice questions. Artificial Intelligence Review. 42, p. 369–383. https://doi.org/10.1007/s10462-013-9419-6
Direct state feedback optimal control of a double integrator plant implemented by an artificial neural network
Matieni, Xavier, Dodds, Stephen J. and Lee, S. 2011. Direct state feedback optimal control of a double integrator plant implemented by an artificial neural network. Advances in Computing and Technology. University of East London, London Jan 2011 London University of East London, School of Architecture Computing and Engineering.
Closed-loop control using a backpropagation algorithm: a practicable approach for energy loss minimisation in electrical drives.
Matieni, Xavier, Dodds, Stephen J. and Lee, S. 2010. Closed-loop control using a backpropagation algorithm: a practicable approach for energy loss minimisation in electrical drives. Proceedings of Advances in Computing and Technology, (AC&T) The School of Computing and Technology 5th Annual Conference, University of East London, pp. 72-78
Question response grouping for online diagnostic feedback
Lee, S., Palmer-Brown, Dominic, Draganova, Chrisina, Preston, David and Kretsis, Mike 2009. Question response grouping for online diagnostic feedback. Proceedings of Advances in Computing and Technology. (AC&T) The School of Computing and Technology 4th Annual Conference University of East London pp. 68-76
Automated updating of road network databases: road segment grouping using snap-drift neural network
Ekpenyong, Frank, Brimicombe, Allan J., Palmer-Brown, Dominic, Li, Yang and Lee, S. 2007. Automated updating of road network databases: road segment grouping using snap-drift neural network. Proceedings of Advances in Computing and Technology. (AC&T) The School of Computing and Technology 2nd Annual Conference University of East London pp. 160-167
An assessment of neural network algorithms that could aid SME survival
Walcott, Terry H., Palmer-Brown, Dominic, Williams, Godfried, Mouratidis, Haralambos and Lee, S. 2007. An assessment of neural network algorithms that could aid SME survival. Proceedings of Advances in Computing and Technology. (AC&T) The School of Computing and Technology 2nd Annual Conference University of East London pp. 120-127
Feature discovery using snap-drift neural networks
Lee, S. and Palmer-Brown, Dominic 2007. Feature discovery using snap-drift neural networks. Proceedings of Advances in Computing and Technology. (AC&T) The School of Computing and Technology 2nd Annual Conference University of East London pp. 61-70
Performance-guided Neural Network for Self-Organising Network Management
Lee, S., Palmer-Brown, Dominic, Tepper, Jonathan and Roadknight, Christopher 2002. Performance-guided Neural Network for Self-Organising Network Management. Proceedings of London Communication Symposium (LCS'2002) University College London, London, UK, 9th – 10th September, pp. 269 - 272
Fast Learning Neural Nets with Adaptive Learning Styles
Palmer-Brown, Dominic, Lee, S., Tepper, Jonathan and Roadknight, Chris 2003. Fast Learning Neural Nets with Adaptive Learning Styles.
Snap-Drift: Real-time, Performance-guided Learning
Lee, S., Palmer-Brown, Dominic, Tepper, Jonathan and Roadknight, Christopher 2003. Snap-Drift: Real-time, Performance-guided Learning.
Continuous Reinforced Snap-Drift Learning in a Neural Architecture for Proxylet Selection in Active Computer Networks
Palmer-Brown, Dominic and Lee, S. 2005. Continuous Reinforced Snap-Drift Learning in a Neural Architecture for Proxylet Selection in Active Computer Networks. International Journal on Simulation: Systems, Science and Technology. 6 (9), pp. 11-21.
The Analysis of Network Manager’s Behaviour using a Self-Organising Neural Networks
Palmer-Brown, Dominic and Lee, S. 2005. The Analysis of Network Manager’s Behaviour using a Self-Organising Neural Networks. International Journal on Simulation: Systems, Science and Technology. 6 (9), pp. 22-32.
Phonetic Feature Discovery in Speech using Snap-Drift
Lee, S. and Palmer-Brown, Dominic 2006. Phonetic Feature Discovery in Speech using Snap-Drift.
Early SME Market Prediction using USDNN
Walcott, Terry H., Palmer-Brown, Dominic and Lee, S. 2008. Early SME Market Prediction using USDNN. in: Proceedings of the International Conference of Computational Intelligence and Intelligent Systems (ICCIIS'2008) International Association of Engineers.
A Neural Network Approach for Intrusion Detection Systems
Beqiri, Elidon, Lee, S. and Draganova, Chrisina 2010. A Neural Network Approach for Intrusion Detection Systems. 5th Conference in Advances in Computing and Technology (London, United Kingdom, 27th Jan), pp. 209 -217
Diagnostic Feedback by Snap-drift Question Response Grouping
Lee, S., Palmer-Brown, Dominic and Draganova, Chrisina 2008. Diagnostic Feedback by Snap-drift Question Response Grouping. in: Proceedings of 9th WSEAS International Conference on Neural Networks (NN'08) Stevens Point (WI), USA World Scientific and Engineering Academy and Society. pp. 208-214
Modal Learning Neural Networks
Palmer-Brown, Dominic, Lee, S., Draganova, Chrisina and Kang, Miao 2009. Modal Learning Neural Networks.
Snap-Drift Neural Network for Selecting Student Feedback
Palmer-Brown, Dominic, Draganova, Chrisina and Lee, S. 2009. Snap-Drift Neural Network for Selecting Student Feedback. International Joint Conference on Neural Networks, IJCNN 2009. Atlanta, Georgia, USA 14 - 19 Jun 2009 IEEE.