This three-part monograph addresses topics in the areas of control systems, signal processing and neural networks. Procedures and results are determined which constitute the first successful synthesis procedure for associative memories by means of artificial neural networks with arbitrarily pre-specified full or partial interconnecting structure and with or without symmetry constraints for the connection matrix.

The problem of designing a cost-efficient network that survives the failure of one or more nodes or edges of the network is critical to modern telecommunications engineering. The method developed in this book is designed to solve such problems to optimality. In particular, a cutting plane approach is described, based on polyhedral combinatorics, that is ableto solve real-world problems of this type in short computation time. These results are of interest for practitioners in the area of communication network design. The book is addressed especially to the combinatorial optimization community, but also to those who want to learn polyhedral methods. In addition, interesting new research problemsare formulated.

This book contains the proceedings of the International Confer ence on Artificial Neural Networks which was held between September 13 and 16 in Amsterdam. It is the third in a series which started two years ago in Helsinki and which last year took place in Brighton. Thanks to the European Neural Network Society, ICANN has emerged as the leading conference on neural networks in Europe. Neural networks is a field of research which has enjoyed a rapid expansion and great popularity in both the academic and industrial research communities. The field is motivated by the commonly held belief that applications in the fields of artificial intelligence and robotics will benefit from a good understanding of the neural information processing properties that underlie human intelligence. Essential aspects of neural information processing are highly parallel execution of com putation, integration of memory and process, and robustness against fluctuations. It is believed that intelligent skills, such as perception, motion and cognition, can be easier realized in neuro-computers than in a conventional computing paradigm. This requires active research in neurobiology to extract com putational principles from experimental neurobiological find ings, in physics and mathematics to study the relation between architecture and function in neural networks, and in cognitive science to study higher brain functions, such as language and reasoning. Neural networks technology has already lead to practical methods that solve real problems in a wide area of industrial applications. The clusters on robotics and applications contain sessions on various sub-topics in these fields."

Neural network technology encompasses a class of methods which attempt to mimic the basic structures used in the brain for information processing. Thetechnology is aimed at problems such as pattern recognition which are difficult for traditional computational methods. Neural networks have potential applications in many industrial areas such as advanced robotics, operations research, and process engineering. This book is concerned with the application of neural network technology to real industrial problems. It summarizes a three-year collaborative international project called ANNIE (Applications of Neural Networks for Industry in Europe) which was jointly funded by industry and the European Commission within the ESPRIT programme. As a record of a working project, the book gives an insight into the real problems faced in taking a new technology from the workbench into a live industrial application, and shows just how it can be achieved. It stresses the comparison between neural networks and conventional approaches. Even the non-specialist reader will benefit from understanding the limitations as well as the advantages of the new technology.

Neural Network Dynamics is the latest volume in the "Perspectives in Neural Computing" series. It contains papers presented at the 1991 Workshop on Complex Dynamics in Neural Networks, held at IIASS in Vietri, Italy. The workshop encompassed a wide range of topics in which neural networks play a fundamental role, and aimed to bridge the gap between neural computation and computational neuroscience. The papers - which have been updated where necessary to include new results - are divided into four sections, covering the foundations of neural network dynamics, oscillatory neural networks, as well as scientific and biological applications of neural networks. Among the topics discussed are: A general analysis of neural network activity; Descriptions of various network architectures and nodes; Correlated neuronal firing; A theoretical framework for analyzing the behaviour of real and simulated neuronal networks; The structural properties of proteins; Nuclear phenomenology; Resonance searches in high energy physics; The investigation of information storage; Visual cortical architecture; Visual processing. Neural Network Dynamics is the first volume to cover neural networks and computational neuroscience in such detail. Although it is primarily aimed at researchers and postgraduate students in the above disciplines, it will also be of interest to researchers in electrical engineering, medicine, psychology and philosophy.

The purpose of this book is to develop neural nets as a strong theory for both brains and machines. The theory is developed in close correlation with the biology of the neuron and the properties of human reasoning. This approach implies the following: - Updating the biology of the artificialneuron. The neurosciences have experienced a tremendous development in the last 50 years. One of the main purposes of the present work is toincorporate this knowledge into a strong model of the artificial neuron. Particular attention is devoted to formalizing the complex chemical processes at the synaptic level. This formal language supports both symbolicreasoning and uncertainty processing. - Investigating the properties of expert reasoning. This kind of reasoning is approximate, partial and non-monotonic, and therefore requires special mathematical tools for its formalization, such as fuzzy set theory and fuzzy logic. Three different intelligent systems developed with this technology are presented and discussed.

Neural Network Applications contains the 12 papers presented at the second British Neural Network Society Meeting (NCM '91) held at King's College London on 1st October 1991. The meeting was sponsored by the Centre for Neural Networks, King's College, and the British Neural Network Society, and was also part of the DEANNA ESPRIT programme. The papers reflect the wide spectrum of neural network applications that are currently being attempted in industry and medicine. They cover medical diagnosis, robotics, plant control, machine learning, and visual inspection, as well as more general discussions on net learning and knowledge representation. The breadth and depth of coverage is a sign of the health of the subject, as well as indicating the importance of neural network developments in industry and the manner in which the applications are progressing. Among the actual topics covered are: Learning algorithms - theory and practice; A review of medical diagnostic applications of neural networks; Simulated ultrasound tomographic imaging of defects; Linear quadtrees for neural network based position invariant pattern recognition; The pRTAM as a hardware-realisable neuron; The cognitive modalities ("CM") system of knowledge representation - the DNA of neural networks? This volume provides valuable reading for all those attempting to apply neural networks, as well as those entering the field, including researchers and postgraduate students in computational neuroscience, neurobiology, electrical engineering, computer science, mathematics, and medicine.

Neural computation arises from the capacity of nervous tissue to process information and accumulate knowledge in an intelligent manner. Conventional computational machines have encountered enormous difficulties in duplicatingsuch functionalities. This has given rise to the development of Artificial Neural Networks where computation is distributed over a great number of local processing elements with a high degree of connectivityand in which external programming is replaced with supervised and unsupervised learning. The papers presented in this volume are carefully reviewed versions of the talks delivered at the International Workshop on Artificial Neural Networks (IWANN '93) organized by the Universities of Catalonia and the Spanish Open University at Madrid and held at Barcelona, Spain, in June 1993. The 111 papers are organized in seven sections: biological perspectives, mathematical models, learning, self-organizing networks, neural software, hardware implementation, and applications (in five subsections: signal processing and pattern recognition, communications, artificial vision, control and robotics, and other applications).

This book is the product of a 15-month intensive investigation of the European artificial network scene, together with a view of the broader framework of the subject in a world context. It could not have been completed in such a remarkably short time, and so effectively, without the dedicated efforts of Louise Turner, the DEANNA secretary, and Geoff Chappell, the DEANNA researcher, at the Centre for Neural Networks, King's College, London. I would like to take this opportunity to thank them for their heroic efforts. I would also like to thank my colleagues in the Centre and in the Mathematics Department, especially Mark Plumbley, Michael Reiss and Trevor Clarkson for all their help and encouragement, Denise Gorse of University College London, for allowing use of her lecture notes as a basis for the tutorial and the DEANNA partners for the part they played. Finally I would like to acknowledge the European Community support, and especially Mike Coyle for his trenchant comments during the carrying out of the work. March 1993 J. G. Taylor CONTENTS PART I: SETTING THE SCENE Chapter 1: DEANNA. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 1 . 1 Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 . 2 The Geographical Dimension. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 1 1. 3 The Industrial Dimension. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 1 . 4 The Plan for Neural Networks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 Chapter 2: Neural Net Demonstrators. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 2. 1 The Status of Neural Networks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 2. 2 Reasons for the Employment of Neural Networks . . . . . . . . . . . . . . . . . . . 9 2. 3 Neural Network Models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 2. 4 Areas of Application . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2. 5 Typical Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

This volume consists of proceedings of the one-day conference on "Coupled Oscillating Neurons" held at King's College, London on December 13th, 1990. The subject is currently of increasing interest to neurophysiologists, neural network researchers, applied mathematicians and physicists. The papers attempt to cover the major areas of the subject, as the titles indicate. It is hoped that the appearance of the papers (some of which have been updated since their original presentation) indicates why the subject is becoming of great excitement. A better understanding of coupled oscillating neurons may well hold the key to a clearer appreciation of the manner in which neural networks composed of such elements can control complex behaviour from the heart to consciousness. December 1991 J.G. Taylor King's College, London C.L.T. Mannion CONTENTS Contributors....... ..................... .......... .......................... .................... ix Introduction to Nonlinear Oscillators I. Stewart ....................................................................................... . Identical Oscillator Networks with Symmetry P.B. Ashwin .................................................................................... 21 Bifurcating Neurones AV. Holden, J. Hyde, M.A Muhamad, H.G. Zhang....................... 41 A Model for Low Threshold Oscillations in Neurons J.L. Hindmarsh, R.M. Rose ............................................................ 81 Information Processing by Oscillating Neurons C.L. T. Mannion, J.G. Taylor ........................................................... 100 Gamma Oscillations, Association and Consciousness R.M.J. Cotterill, C. Nielsen ............................................................. 117 Modelling of Cardiac Rhythm: From Single Celis to Massive Networks D. Noble, J. C. Denyer, H.F. Brown, R. Winslow, A Kimball .......... 1 32 CONTRIBUTORS Ashwin, P.B. Mathematics Institute, University of Warwick, Coventry, CV4 7 AL, UK Brown, H.F.

The Central Nervous System can be considered as an aggregate of neurons specialized in both the transmission and transformation of information. Information can be used for many purposes, but probably the most important one is to generate a representation of the "external" world that allows the organism to react properly to changes in its external environment. These functions range from such basic ones as detection of changes that may lead to tissue damage and eventual destruction of the organism and the implementation of avoidance reactions, to more elaborate representations of the external world implying recognition of shapes, sounds and textures as the basis of planned action or even reflection. Some of these functions confer a clear survival advantage to the organism (prey or mate recognition, escape reactions, etc. ). Others can be considered as an essential part of cognitive processes that contribute, to varying degrees, to the development of individuality and self-consciousness. How can we hope to understand the complexity inherent in this range of functionalities? One of the distinguishing features of the last two decades has been the availability of computational power that has impacted many areas of science. In neurophysiology, computation is used for experiment control, data analysis and for the construction of models that simulate particular systems. Analysis of the behavior of neuronal networks has transcended the limits of neuroscience and is now a discipline in itself, with potential applications both in the neural sciences and in computing sciences.

Artificial neural networks and genetic algorithms both are areas of research which have their origins in mathematical models constructed in order to gain understanding of important natural processes. By focussing on the process models rather than the processes themselves, significant new computational techniques have evolved which have found application in a large number of diverse fields. This diversity is reflected in the topics which are the subjects of contributions to this volume. There are contributions reporting theoretical developments in the design of neural networks, and in the management of their learning. In a number of contributions, applications to speech recognition tasks, control of industrial processes as well as to credit scoring, and so on, are reflected. Regarding genetic algorithms, several methodological papers consider how genetic algorithms can be improved using an experimental approach, as well as by hybridizing with other useful techniques such as tabu search. The closely related area of classifier systems also receives a significant amount of coverage, aiming at better ways for their implementation. Further, while there are many contributions which explore ways in which genetic algorithms can be applied to real problems, nearly all involve some understanding of the context in order to apply the genetic algorithm paradigm more successfully. That this can indeed be done is evidenced by the range of applications covered in this volume.

With the appearance of massively parallel computers, increased attention has been paid to algorithms which rely upon analogies to natural processes. This development defines the scope of the PPSN conference at Dortmund in 1990 whose proceedings are presented in this volume. The subjects treated include: - Darwinian methods such as evolution strategies and genetic algorithms; - Boltzmann methods such as simulated annealing; - Classifier systems and neural networks; - Transfer of natural metaphors to artificial problem solving. The main objectives of the conference were: - To gather theoretical results about and experimental comparisons between these algorithms, - To discuss various implementations on different parallel computer architectures, - To summarize the state of the art in the field, which was previously scattered widely both among disciplines and geographically.

The 1990 Grainger Lectures delivered at the University of Illinois, Urbana-Champaign, September 28 - October 1, 1990 were devoted to a critical reexamination of the foundations of adaptive control. In this volume the lectures are expanded by most recent developments and solutions for some long-standing open problems. Concepts and approaches presented are both novel and of fundamental importance for adaptive control research in the 1990s. The papers in Part I present unifications, reappraisals and new results on tunability, convergence and robustness of adaptive linear control, whereas the papers in Part II formulate new problems in adaptive control of nonlinear systems and solve them without any linear constraints imposed on the nonlinearities.

This textbook gives details of recent developments in the field of image processing, machine vision and analysis. Based on the original book published in Czech, this English edition has been expanded to include 3D vision, neural networks and invariants.

This volume contains the papers from the first British Neural Network Society meeting held at Queen Elizabeth Hall, King's College, London on 18--20 April 1990. The meeting was sponsored by the London Mathemati cal Society. The papers include introductory tutorial lectures, invited, and contributed papers. The invited contributions were given by experts from the United States, Finland, Denmark, Germany and the United Kingdom. The majority of the contributed papers came from workers in the United Kingdom. The first day was devoted to tutorials. Professor Stephen Grossberg was a guest speaker on the first day giving a thorough introduction to his Adaptive Resonance Theory of neural networks. Subsequent tutorials on the first day covered dynamical systems and neural networks, realistic neural modelling, pattern recognition using neural networks, and a review of hardware for neural network simulations. The contributed papers, given on the second day, demonstrated the breadth of interests of workers in the field. They covered topics in pattern recognition, multi-layer feedforward neural networks, network dynamics, memory and learning. The ordering of the papers in this volume is as they were given at the meeting. On the final day talks were given by Professor Kohonen (on self organising maps), Professor Kurten (on the dynamics of random and structured nets) and Professor Cotterill (on modelling the visual cortex). Dr A. Mayes presented a paper on various models for amnesia. The editors have taken the opportunity to include a paper of their own which was not presented at the meeting."

In this book a global shape model is developed and applied to the analysis of real pictures acquired with a visible light camera under varying conditions of optical degradation. Computational feasibility of the algorithms derived from this model is achieved by analytical means. The aim is to develop methods for image understanding based on structured restoration, for example automatic detection of abnormalities. We also want to find the limits of applicability of the algorithms. This is done by making the optical degradations more and more severe until the algorithms no longer succeed in their task. This computer experiment in pattern theory is one of several. The others, LEAVES, X-RAYS, and RANGE are described elsewhere. This book is suitable for an advanced undergraduate or graduate seminar in pattern theory, or as an accompanying book for applied probability, computer vision, or pattern recognition.

The soft cover study edition now available is a revised reprint of the successful first edition of 1988. It collects invited presentations of an Advanced Research Workshop on "Neural Computers," held in Neuss, Federal Republic of Germany, September 28 - October 2, 1987. The objectives of the workshop were - to promote international collaboration among scientists from the fields of Neuroscience, Computational Neuroscience, Cellular Automata, Artificial Intelligence, and Computer Design; and - to review our present knowledge of brain research and novel computers with neural network architecture. The workshop assembled some fifty invited experts from Europe, America and Japan representing the relevant fields. The book describes the transfer of concepts of brain function and brain architecture to the design of self-organizing computers with neural network architecture. The contributions cover a wide range of topics, including Neural Network Architecture, Learning and Memory, Fault Tolerance, Pattern Recognition, and Motor Control in Brains Versus Neural Computers. Twelve of the contributions are review papers. In addition, group reports summarize the discussions regarding four specific topics relevant to the state of the art in neural computers. With its extensive reference list as well as its subject and name indexes this volume will serve as a reference book for future research in the field of Neural Computers.

1. 1 The problem and the approach The model developed here, which is actually more a collection of com ponents than a single monolithic structure, traces a path from relatively low-level neural/connectionistic structures and processes to relatively high-level animal/artificial intelligence behaviors. Incremental extension of this initial path permits increasingly sophisticated representation and processing strategies, and consequently increasingly sophisticated behavior. The initial chapters develop the basic components of the sys tem at the node and network level, with the general goal of efficient category learning and representation. The later chapters are more con cerned with the problems of assembling sequences of actions in order to achieve a given goal state. The model is referred to as connectionistic rather than neural, be cause, while the basic components are neuron-like, there is only limited commitment to physiological realism. Consequently the neuron-like ele ments are referred to as "nodes" rather than "neurons." The model is directed more at the behavioral level, and at that level, numerous con cepts from animal learning theory are directly applicable to connectionis tic modeling. An attempt to actually implement these behavioral theories in a computer simulation can be quite informative, as most are only partially specified, and the gaps may be apparent only when actual ly building a functioning system. In addition, a computer implementa tion provides an improved capability to explore the strengths and limita tions of the different approaches as well as their various interactions."

This book is a comprehensive introduction to the neural network models currently under intensive study for computational applications. It is a detailed, logically-developed treatment that covers the theory and uses of collective computational networks, including associative memory, feed forward networks, and unsupervised learning. It also provides coverage of neural network applications in a variety of problems of both theoretical and practical interest.

This is an exciting time. The study of neural networks is enjoying a great renaissance, both in computational neuroscience - the development of information processing models of living brains - and in neural computing - the use of neurally inspired concepts in the construction of "intelligent" machines. Thus the title of this volume, Dynamic Interactions in Neural Networks: Models and Data can be given two interpretations. We present models and data on the dynamic interactions occurring in the brain, and we also exhibit the dynamic interactions between research in computational neuroscience and in neural computing, as scientists seek to find common principles that may guide us in the understanding of our own brains and in the design of artificial neural networks. In fact, the book title has yet a third interpretation. It is based on the U. S. -Japan Seminar on "Competition and Cooperation in Neural Nets" which we organized at the University of Southern California, Los Angeles, May 18-22, 1987, and is thus the record of interaction of scientists on both sides of the Pacific in advancing the frontiers of this dynamic, re-born field. The book focuses on three major aspects of neural network function: learning, perception, and action. More specifically, the chapters are grouped under three headings: "Development and Learning in Adaptive Networks," "Visual Function," and "Motor Control and the Cerebellum.

This book describes how to use expert knowledge-which is often formulated by using imprecise (fuzzy) words from a natural language. In the 1960s, Zadeh designed special "fuzzy" techniques for such use. In the 1980s, fuzzy techniques started controlling trains, elevators, video cameras, rice cookers, car transmissions, etc. Now, combining fuzzy with neural, genetic, and other intelligent methods leads to new state-of-the-art results: in aerospace industry (from drones to space flights), in mobile robotics, in finances (predicting the value of crypto-currencies), and even in law enforcement (detecting counterfeit banknotes, detecting online child predators and in creating explainable AI systems). The book describes these (and other) applications-as well as foundations and logistics of fuzzy techniques. This book can be recommended to specialists-both in fuzzy and in various application areas-who will learn latest techniques and their applications, and to students interested in innovative ideas.

This unique compendium presents a comprehensive and self-contained theory of material development under imperfect information and its applications. The book describes new approaches to synthesis and selection of materials with desirable characteristics. Such approaches provide the ability of systematic and computationally effective analysis in order to predict composition, structure and related properties of new materials.The volume will be a useful advanced textbook for graduate students. It is also suitable for academicians and practitioners who wish to have fundamental models in new material synthesis and selection.

This book contains the proceedings of the 22nd EANN "Engineering Applications of Neural Networks" 2021 that comprise of research papers on both theoretical foundations and cutting-edge applications of artificial intelligence. Based on the discussed research areas, emphasis is given in advances of machine learning (ML) focusing on the following algorithms-approaches: Augmented ML, autoencoders, adversarial neural networks, blockchain-adaptive methods, convolutional neural networks, deep learning, ensemble methods, learning-federated learning, neural networks, recurrent - long short-term memory. The application domains are related to: Anomaly detection, bio-medical AI, cyber-security, data fusion, e-learning, emotion recognition, environment, hyperspectral imaging, fraud detection, image analysis, inverse kinematics, machine vision, natural language, recommendation systems, robotics, sentiment analysis, simulation, stock market prediction.

Cognitive computing simulates human thought processes with self-learning algorithms that utilize data mining, pattern recognition, and natural language processing. The integration of deep learning improves the performance of Cognitive computing systems in many applications, helping in utilizing heterogeneous data sets and generating meaningful insights.