In reinforcement learning (RL) problems, learning agents sequentially execute actions with the goal of maximizing a reward signal. The RL framework has gained popularity with the development of algorithms capable of mastering increasingly complex problems, but learning difficult tasks is often slow or infeasible when RL agents begin with no prior knowledge. The key insight behind "transfer learning" is that generalization may occur not only within tasks, but also across tasks. While transfer has been studied in the psychological literature for many years, the RL community has only recently begun to investigate the benefits of transferring knowledge. This book provides an introduction to the RL transfer problem and discusses methods which demonstrate the promise of this exciting area of research.

The key contributions of this book are:

By way of the research presented in this book, the author has established himself as the pre-eminent worldwide expert on transfer learning in sequential decision making tasks. A particular strength of the research is its very thorough and methodical empirical evaluation, which Matthew presents, motivates, and analyzes clearly in prose throughout the book. Whether this is your initial introduction to the concept of transfer learning, or whether you are a practitioner in the field looking for nuanced details, I trust that you will find this book to be an enjoyable and enlightening read.

Peter Stone, Associate Professor of Computer Science

This quite simply superb book focuses on various techniques of computational intelligence, both single ones and those which form hybrid methods. These techniques are today commonly applied to issues of artificial intelligence. The book presents methods of knowledge representation using different techniques, namely the rough sets, type-1 fuzzy sets and type-2 fuzzy sets. Next up, various neural network architectures are presented and their learning algorithms are derived. Then, the family of evolutionary algorithms is discussed, including connections between these techniques and neural networks and fuzzy systems. Finally, various methods of data partitioning and algorithms of automatic data clustering are given and new neuro-fuzzy architectures are studied and compared.

The series "Studies in Computational Intelligence" (SCI) publishes new developments and advances in the various areas of computational intelligence quickly and with a high quality. The intent is to cover the theory, applications, and design methods of computational intelligence, as embedded in the fields of engineering, computer science, physics and life science, as well as the methodologies behind them. The series contains monographs, lecture notes and edited volumes in computational intelligence spanning the areas of neural networks, connectionist systems, genetic algorithms, evolutionary computation, artificial intelligence, cellular automata, self-organizing systems, soft computing, fuzzy systems, and hybrid intelligent systems. Critical to both contributors and readers are the short publication time and world-wide distribution - this permits a rapid and broad dissemination of research results.

The purpose of the first ACIS International Symposium on Software and Network Engineering held on December 19-20, 2012 on the Seoul National University campus, Seoul, Korea is to bring together scientist, engineers, computer users, students to share their experiences and exchange new ideas, and research results about all aspects (theory, applications and tools) of software & network engineering, and to discuss the practical challenges encountered along the way and the solutions adopted to solve them

The symposium organizers selected the best 12 papers from those papers accepted for presentation at the symposium in order to publish them in this volume. The papers were chosen based on review scores submitted by members of the program committee, and underwent further rigorous rounds of review.

The symposium organizers selected the best 12 papers from those papers accepted for presentation at the symposium in order to publish them in this volume. The papers were chosen based on review scores submitted by members of the program committee, and underwent further rigorous rounds of review."

This book describes models of the neuron and multilayer neural structures, with a particular focus on mathematical models. It also discusses electronic circuits used as models of the neuron and the synapse, and analyses the relations between the circuits and mathematical models in detail. The first part describes the biological foundations and provides a comprehensive overview of the artificial neural networks. The second part then presents mathematical foundations, reviewing elementary topics, as well as lesser-known problems such as topological conjugacy of dynamical systems and the shadowing property. The final two parts describe the models of the neuron, and the mathematical analysis of the properties of artificial multilayer neural networks. Combining biological, mathematical and electronic approaches, this multidisciplinary book it useful for the mathematicians interested in artificial neural networks and models of the neuron, for computer scientists interested in formal foundations of artificial neural networks, and for the biologists interested in mathematical and electronic models of neural structures and processes.

The volume "Genres on the Web" has been designed for a wide audience, from the expert to the novice. It is a required book for scholars, researchers and students who want to become acquainted with the latest theoretical, empirical and computational advances in the expanding field of web genre research. The study of web genre is an overarching and interdisciplinary novel area of research that spans from corpus linguistics, computational linguistics, NLP, and text-technology, to web mining, webometrics, social network analysis and information studies. This book gives readers a thorough grounding in the latest research on web genres and emerging document types.

The book covers a wide range of web-genre focused subjects, such as:
The identification of the sources of web genres
Automatic web genre identification
The presentation of structure-oriented models
Empirical case studies

One of the driving forces behind genre research is the idea of a genre-sensitive information system, which incorporates genre cues complementing the current keyword-based search and retrieval applications."

Vehicular communication is a key technology in intelligent transportation systems. For many years now, the academic and industrial research communities have been investigating these communications in order to improve efficiency and safety of future transportation. Vehicular networking offers a wide variety of applications, including safety applications as well as infotainment applications. This book highlights the recent developments in vehicular networking technologies and their interaction with future smart cities in order to promote further research activities and challenges. SAADI BOUDJIT, University of Paris 13, France HAKIMA CHAOUCHI, Telecom SudParis, France YACINE GHAMRI, University La Rochelle, France HALABI HASBULLAH, Universiti Teknologi Petronas, Malaysia ANIS LAOUITI, Telecom SudParis, France SAOUCENE MAHFOUDH, Jeddah, Saudi Arabia PAUL MUHLETHALER, INRIA, France AMIR QAYYUM, Mohamad Ali Jinnah University, Pakistan NAUFAL SAAD, Universiti Teknologi Petronas, Malaysia AHMED SOUA, NIST, USA HAJIME TAZAKI, University of Tokyo, Japan APINUN TUNPAN, Aintec, Thailand WEI WEI, Xi'an University, China RACHID ZAGROUBA, ENSI, Tunisia.

The field of Soft Computing in Humanities and Social Sciences is at a turning point. The strong distinction between "science" and "humanities" has been criticized from many fronts and, at the same time, an increasing cooperation between the so-called "hard sciences" and "soft sciences" is taking place in a wide range of scientific projects dealing with very complex and interdisciplinary topics. In the last fifteen years the area of Soft Computing has also experienced a gradual rapprochement to disciplines in the Humanities and Social Sciences, and also in the field of Medicine, Biology and even the Arts, a phenomenon that did not occur much in the previous years. The collection of this book presents a generous sampling of the new and burgeoning field of Soft Computing in Humanities and Social Sciences, bringing together a wide array of authors and subject matters from different disciplines. Some of the contributors of the book belong to the scientific and technical areas of Soft Computing while others come from various fields in the humanities and social sciences such as Philosophy, History, Sociology or Economics. Rudolf Seising received a Ph.D. degree in philosophy of science and a postdoctoral lecture qualification (PD) in history of science from the Ludwig Maximilians University of Munich. He is an Adjoint Researcher at the European Centre for Soft Computing in Mieres (Asturias), Spain. Veronica Sanz earned a Ph.D. in Philosophy at the University Complutense of Madrid (Spain). At the moment she is a Postdoctoral Researcher at the Science, Technology and Society Center in the University of California at Berkeley. Veronica Sanz earned a Ph.D. in Philosophy at the University Complutense of Madrid (Spain). At the moment she is a Postdoctoral Researcher at the Science, Technology and Society Center in the University of California at Berkeley.

This volume draws mostly on papers presented at the TRENTO 2009 international workshop on Preferences and Decisions, jointly organized by the University of Trento and the University of Sannio at Benevento (Italy). Since its first edition in 1997, the renowned international workshop series TRENTO aims at providing an informal but effective opportunity for sharing and discussing the recent research developments in the field of preference modeling and decision theory, bringing together some of the world's leading experts in this active interdisciplinary area of research. In particular, the scope of the international workshop TRENTO 2009 covered a wide range of topics, such as preference representation and rationality, machine intelligence and automation in decision making, uncertainty modeling, probabilistic and possibilistic decision models, cooperative game theory and coalition formation, aggregation functions and multicriteria decision making, fuzzy set theory and fuzzy logic for decision making, algebraic structures, quantum dynamics, complex network models and negotiation, interactive dynamics and consensus reaching in multiagent decisions, optimization and operational research for decision making. The contributes have been proposed by authors that are among the most recognized scientists in the respective research domains. This volume also provides an opportunity, to colleagues and friends of Mario Fedrizzi, Benedetto Matarazzo, and Aldo Ventre, for celebrating and thanking them for their continuing and stimulating scientific work.

This book will give the reader a perspective into the core theory and practice of data mining and knowledge discovery (DM&KD). Its chapters combine many theoretical foundations for various DM&KD methods, and they present a rich array of examples - many of which are drawn from real-life applications. Most of the theoretical developments discussed are accompanied by an extensive empirical analysis, which should give the reader both a deep theoretical and practical insight into the subjects covered. The book presents the combined research experiences of its 40 authors gathered during a long search in gleaning new knowledge from data. The last page of each chapter has a brief biographical statement of its contributors, who are world-renowned experts.

This book presents a study of the use of optimization algorithms in complex image processing problems. The problems selected explore areas ranging from the theory of image segmentation to the detection of complex objects in medical images. Furthermore, the concepts of machine learning and optimization are analyzed to provide an overview of the application of these tools in image processing. The material has been compiled from a teaching perspective. Accordingly, the book is primarily intended for undergraduate and postgraduate students of Science, Engineering, and Computational Mathematics, and can be used for courses on Artificial Intelligence, Advanced Image Processing, Computational Intelligence, etc. Likewise, the material can be useful for research from the evolutionary computation, artificial intelligence and image processing communities.

This book introduces time-stretch quantitative phase imaging (TS-QPI), a high-throughput label-free imaging flow cytometer developed for big data acquisition and analysis in phenotypic screening. TS-QPI is able to capture quantitative optical phase and intensity images simultaneously, enabling high-content cell analysis, cancer diagnostics, personalized genomics, and drug development. The authors also demonstrate a complete machine learning pipeline that performs optical phase measurement, image processing, feature extraction, and classification, enabling high-throughput quantitative imaging that achieves record high accuracy in label -free cellular phenotypic screening and opens up a new path to data-driven diagnosis.

Biological and natural processes have been a continuous source of inspiration for the sciences and engineering. For instance, the work of Wiener in cybernetics was influenced by feedback control processes observable in biological systems; McCulloch and Pitts description of the artificial neuron was instigated by biological observations of neural mechanisms; the idea of survival of the fittest inspired the field of evolutionary algorithms and similarly, artificial immune systems, ant colony optimisation, automated self-assembling programming, membrane computing, etc. also have their roots in natural phenomena.

The second International Workshop on Nature Inspired Cooperative Strategies for Optimization (NICSO), was held in Acireale, Italy, during November 8-10, 2007. The aim for NICSO 2007 was to provide a forum were the latest ideas and state of the art research related to cooperative strategies for problem solving arising from Nature could be discussed. The contributions collected in this book were strictly peer reviewed by at least three members of the international programme committee, to whom we are indebted for their support and assistance. The topics covered by the contributions include several well established nature inspired techniques like Genetic Algorithms, Ant Colonies, Artificial Immune Systems, Evolutionary Robotics, Evolvable Systems, Membrane Computing, Quantum Computing, Software Self Assembly, Swarm Intelligence, etc.

In this book, a generic model in as far as possible mathematical closed-formis developed that predicts the behavior of large self-organizing robot groups (robot swarms) based on their control algorithm. In addition, an extensive subsumption of the relatively young and distinctive interdisciplinary research field of swarm robotics is emphasized. The connection to many related fields is highlighted and the concepts and methods borrowed from these fields are described shortly.

I3E 2009 was held in Nancy, France, during September 23-25, hosted by Nancy University and INRIA Grand-Est at LORIA. The conference provided scientists andpractitionersofacademia, industryandgovernmentwithaforumwherethey presented their latest ?ndings concerning application of e-business, e-services and e-society, and the underlying technology to support these applications. The 9th IFIP Conference on e-Business, e-Services and e-Society, sponsored by IFIP WG 6.1. of Technical Committees TC6 in cooperation with TC11, and TC8 represents the continuation of previous events held in Zurich (Switzerland) in 2001, Lisbon (Portugal) in 2002, Sao Paulo (Brazil) in 2003, Toulouse (France) in 2004, Poznan (Poland) in 2005, Turku (Finland) in 2006, Wuhan (China) in 2007 and Tokyo (Japan) in 2008. The call for papers attracted papers from 31 countries from the ?ve con- nents. As a result, the I3E 2009 programo?ered 12 sessions of full-paper pres- tations. The 31 selected papers cover a wide and important variety of issues in e-Business, e-servicesande-society, including security, trust, andprivacy, ethical and societal issues, business organization, provision of services as software and software as services, and others. Extended versions of selected papers submitted to I3E 2009 will be published in the International Journal of e-Adoption and in AIS Transactions on Enterprise Systems. In addition, a 500-euros prize was awarded to the authors of the best paper selected by the Program Comm- tee. We thank all authors who submitted their papers, the Program Committee members and external reviewers for their excellent

Evolutionary Computation (EC) includes a number of techniques such as Genetic Algorithms which have been used in a diverse range of highly successful applications. This book brings together some of these EC applications in fields including electronics, telecommunications, health, bioinformatics, supply chain and other engineering domains, to give the audience, including both EC researchers and practitioners, a glimpse of this exciting and rapidly-evolving field.

This book explores recent developments in the theoretical foundations and novel applications of general and interval type-2 fuzzy sets and systems, including: algebraic properties of type-2 fuzzy sets, geometric-based definition of type-2 fuzzy set operators, generalizations of the continuous KM algorithm, adaptiveness and novelty of interval type-2 fuzzy logic controllers, relations between conceptual spaces and type-2 fuzzy sets, type-2 fuzzy logic systems versus perceptual computers; modeling human perception of real world concepts with type-2 fuzzy sets, different methods for generating membership functions of interval and general type-2 fuzzy sets, and applications of interval type-2 fuzzy sets to control, machine tooling, image processing and diet. The applications demonstrate the appropriateness of using type-2 fuzzy sets and systems in real world problems that are characterized by different degrees of uncertainty.

This book presents different methods for analyzing the body language (movement, position, use of personal space, silences, pauses and tone, the eyes, pupil dilation or constriction, smiles, body temperature and the like) for better understanding people's needs and actions, including biometric data gathering and reading. Different studies described in this book indicate that sufficiently much data, information and knowledge can be gained by utilizing biometric technologies. This is the first, wide-ranging book that is devoted completely to the area of intelligent decision support systems, biometrics technologies and their integrations. This book is designated for scholars, practitioners and doctoral and master's degree students in various areas and those who are interested in the latest biometric and intelligent decision making support problems and means for their resolutions, biometric and intelligent decision making support systems and the theory and practice of their integration and the opportunities for the practical use of biometric and intelligent decision making support.

This book is dedicated to Prof. Dr. Heinz Gerhauser on the occasion of his retirement both from the position of Executive Director of the Fraunhofer Institute for Integrated Circuits IIS and from the Endowed Chair of Information Technologies with a Focus on Communication Electronics (LIKE) at the Friedrich-Alexander-Universitat Erlangen-Nurnberg. Heinz Gerhauser's vision and entrepreneurial spirit have made the Fraunhofer IIS one of the most successful and renowned German research institutions. He has been Director of the Fraunhofer IIS since 1993, and under his leadership it has grown to become the largest of Germany's 60 Fraunhofer Institutes, a position it retains to this day, currently employing over 730 staff. Likely his most important scientific as well as application-related contribution was his pivotal role in the development of the mp3 format, which would later become a worldwide success. The contributions to this Festschrift were written by both Fraunhofer IIS staff and external project team members in appreciation of Prof. Dr. Gerhauser's lifetime academic achievements and his inspiring leadership at the Fraunhofer IIS. The papers reflect the broad spectrum of the institute's research activities and are grouped into sections on circuits, information systems, visual computing, and audio and multimedia. They provide academic and industrial researchers in fields like signal processing, sensor networks, microelectronics, and integrated circuits with an up-to-date overview of research results that have a huge potential for cutting-edge industrial applications.

This book is about the formulations, theoretical investigations, and practical applications of new stochastic models for fundamental concepts and operations of the discipline of risk management. It also examines how these models can be useful in the descriptions, measurements, evaluations, and treatments of risks threatening various modern organizations. Moreover, the book makes clear that such stochastic models constitute very strong analytical tools which substantially facilitate strategic thinking and strategic decision making in many significant areas of risk management. In particular the incorporation of fundamental probabilistic concepts such as the sum, minimum, and maximum of a random number of continuous, positive, independent, and identically distributed random variables in the mathematical structure of stochastic models significantly supports the suitability of these models in the developments, investigations, selections, and implementations of proactive and reactive risk management operations. The book makes extensive use of integral and differential equations of characteristic functions, mainly corresponding to important classes of mixtures of probability distributions, as powerful analytical tools for investigating the behavior of new stochastic models suitable for the descriptions and implementations of fundamental risk control and risk financing operations. These risk treatment operations very often arise in a wide variety of scientific disciplines of extreme practical importance.

In this book, the following three approaches to data analysis are presented:

- Test Theory, founded by Sergei V. Yablonskii (1924-1998); the first publications appeared in 1955 and 1958,

- Rough Sets, founded by Zdzis aw I. Pawlak (1926-2006); the first publications appeared in 1981 and 1982,

- Logical Analysis of Data, founded by Peter L. Hammer (1936-2006); the first publications appeared in 1986 and 1988.

These three approaches have much in common, but researchers active in one of these areas often have a limited knowledge about the results and methods developed in the other two. On the other hand, each of the approaches shows some originality and we believe that the exchange of knowledge can stimulate further development of each of them. This can lead to new theoretical results and real-life applications and, in particular, new results based on combination of these three data analysis approaches can be expected.

- Logical Analysis of Data, founded by Peter L. Hammer (1936-2006); the first publications appeared in 1986 and 1988.

These three approaches have much in common, but researchers active in one of these areas often have a limited knowledge about the results and methods developed in the other two. On the other hand, each of the approaches shows some originality and we believe that the exchange of knowledge can stimulate further development of each of them. This can lead to new theoretical results and real-life applications and, in particular, new results based on combination of these three data analysis approaches can be expected.

These three approaches have much in common, but researchers active in one of these areas often have a limited knowledge about the results and methods developed in the other two. On the other hand, each of the approaches shows some originality and we believe that the exchange of knowledge can stimulate further development of each of them. This can lead to new theoretical results and real-life applications and, in particular, new results based on combination of these three data analysis approaches can be expected."

This book is devoted to the state-of-the-art in all aspects of fireworks algorithm (FWA), with particular emphasis on the efficient improved versions of FWA. It describes the most substantial theoretical analysis including basic principle and implementation of FWA and modeling and theoretical analysis of FWA. It covers exhaustively the key recent significant research into the improvements of FWA so far. In addition, the book describes a few advanced topics in the research of FWA, including multi-objective optimization (MOO), discrete FWA (DFWA) for combinatorial optimization, and GPU-based FWA for parallel implementation. In sequels, several successful applications of FWA on non-negative matrix factorization (NMF), text clustering, pattern recognition, and seismic inversion problem, and swarm robotics, are illustrated in details, which might shed new light on more real-world applications in future. Addressing a multidisciplinary topic, it will appeal to researchers and professionals in the areas of metahuristics, swarm intelligence, evolutionary computation, complex optimization solving, etc.

Knowledge existing in modern information systems usually comes from many sources and is mapped in many ways. There is a real need for representing "knowledge pieces" as rather universal objects that should fit to multi-purpose a- ing systems. According to great number of information system's tasks, knowledge representation is more or less detailed (e.g. some level of its granularity is - sumed). The main goal of this paper is to present chosen aspects of expressing granularity of knowledge implemented in intelligent systems. One of the main r- sons of granularity phenomena is diversification of knowledge sources, therefore the next section is devoted to this issue. 2. Heterogeneous Knowledge as a Source for Intelligent Systems Knowledge, the main element of so-called intelligent applications and systems, is very often heterogeneous. This heterogeneity concerns the origin of knowledge, its sources as well as its final forms of presentation. In this section the selected c- teria of knowledge differentiation will be presented, in the context of potential sources of knowledge acquisition. In Fig. 1 an environment of intelligent systems is shown, divided into different knowledge sources for the system. Fig. 1. Potential knowledge sources for intelligent information/reasoning system. Source: own elaboration based on (Mach, 2007) p. 24.

Many problems in decision making, monitoring, fault detection, and control require the knowledge of state variables and time-varying parameters that are not directly measured by sensors. In such situations, observers, or estimators, can be employed that use the measured input and output signals along with a dynamic model of the system in order to estimate the unknown states or parameters. An essential requirement in designing an observer is to guarantee the convergence of the estimates to the true values or at least to a small neighborhood around the true values. However, for nonlinear, large-scale, or time-varying systems, the design and tuning of an observer is generally complicated and involves large computational costs. This book provides a range of methods and tools to design observers for nonlinear systems represented by a special type of a dynamic nonlinear model -- the Takagi--Sugeno (TS) fuzzy model. The TS model is a convex combination of affine linear models, which facilitates its stability analysis and observer design by using effective algorithms based on Lyapunov functions and linear matrix inequalities. Takagi--Sugeno models are known to be universal approximators and, in addition, a broad class of nonlinear systems can be exactly represented as a TS system. Three particular structures of large-scale TS models are considered: cascaded systems, distributed systems, and systems affected by unknown disturbances. The reader will find in-depth theoretic analysis accompanied by illustrative examples and simulations of real-world systems. Stability analysis of TS fuzzy systems is addressed in detail. The intended audience are graduate students and researchers both from academia and industry. For newcomers to the field, the book provides a concise introduction dynamic TS fuzzy models along with two methods to construct TS models for a given nonlinear system

Psychophysics and Experimental Phenomenology of Pattern Cognition examines the cognitive transformations that underly this cognitive system and the specialized subsystems for processing these transformations. Sections cover symmetry cognition, contour perception and geometric illusion. Weight sensation is also discussed, as are repetitive and dot patterns. By incorporating elements of both psychophysics and experimental phenomenology, pattern cognition is examined from both the physical and mental sensory perspective, thus providing a comprehensive view of this cognitive system.