Strength or Accuracy: Credit Assignment in Learning Classifier Systems (Paperback, Softcover reprint of the original 1st ed. 2004)

Classifier systems are an intriguing approach to a broad range of machine learning problems, based on automated generation and evaluation of condi tion/action rules. Inreinforcement learning tasks they simultaneously address the two major problems of learning a policy and generalising over it (and re lated objects, such as value functions). Despite over 20 years of research, however, classifier systems have met with mixed success, for reasons which were often unclear. Finally, in 1995 Stewart Wilson claimed a long-awaited breakthrough with his XCS system, which differs from earlier classifier sys tems in a number of respects, the most significant of which is the way in which it calculates the value of rules for use by the rule generation system. Specifically, XCS (like most classifiersystems) employs a genetic algorithm for rule generation, and the way in whichit calculates rule fitness differsfrom earlier systems. Wilson described XCS as an accuracy-based classifiersystem and earlier systems as strength-based. The two differin that in strength-based systems the fitness of a rule is proportional to the return (reward/payoff) it receives, whereas in XCS it is a function of the accuracy with which return is predicted. The difference is thus one of credit assignment, that is, of how a rule's contribution to the system's performance is estimated. XCS is a Q learning system; in fact, it is a proper generalisation of tabular Q-learning, in which rules aggregate states and actions. In XCS, as in other Q-learners, Q-valuesare used to weightaction selection."

General

Imprint:	Springer London
Country of origin:	United Kingdom
Series:	Distinguished Dissertations
Release date:	December 2012
First published:	2004
Authors:	Tim Kovacs
Dimensions:	235 x 155 x 17mm (L x W x T)
Format:	Paperback
Pages:	307
Edition:	Softcover reprint of the original 1st ed. 2004
ISBN-13:	978-1-4471-1058-3
Categories:	Books > Social sciences > Politics & government > Public administration Books > Computing & IT > General theory of computing > Data structures Books > Computing & IT > Computer programming > Algorithms & procedures Books > Computing & IT > Applications of computing > Artificial intelligence > General Promotions
LSN:	1-4471-1058-7
Barcode:	9781447110583

Is the information for this product incomplete, wrong or inappropriate? Let us know about it.

Does this product have an incorrect or missing image? Send us a new image.

Is this product missing categories? Add more categories.

Review This Product

No reviews yet - be the first to create one!