Model-Based Reinforcement Learning Explore a comprehensive and practical approach to reinforcement learning Reinforcement learning is an essential paradigm of machine learning, wherein an intelligent agent performs actions that ensure optimal behavior from devices. While this paradigm of machine learning has gained tremendous success and popularity in recent years, previous scholarship has focused either on theory--optimal control and dynamic programming - or on algorithms--most of which are simulation-based. Model-Based Reinforcement Learning provides a model-based framework to bridge these two aspects, thereby creating a holistic treatment of the topic of model-based online learning control. In doing so, the authors seek to develop a model-based framework for data-driven control that bridges the topics of systems identification from data, model-based reinforcement learning, and optimal control, as well as the applications of each. This new technique for assessing classical results will allow for a more efficient reinforcement learning system. At its heart, this book is focused on providing an end-to-end framework--from design to application--of a more tractable model-based reinforcement learning technique. Model-Based Reinforcement Learning readers will also find: A useful textbook to use in graduate courses on data-driven and learning-based control that emphasizes modeling and control of dynamical systems from data Detailed comparisons of the impact of different techniques, such as basic linear quadratic controller, learning-based model predictive control, model-free reinforcement learning, and structured online learning Applications and case studies on ground vehicles with nonholonomic dynamics and another on quadrator helicopters An online, Python-based toolbox that accompanies the contents covered in the book, as well as the necessary code and data Model-Based Reinforcement Learning is a useful reference for senior undergraduate students, graduate students, research assistants, professors, process control engineers, and roboticists.

Self-Cleaning of Surfaces and Water Droplet Mobility deals with the self-cleaning of hydrophobic surfaces. Chapters cover the basics of wetting states of fluids and surface characteristics in terms of texture topology and free energy. The self-cleaning aspects of surfaces, such as various synthesizing and fabrication processes are then introduced and discussed, along with environmental dust properties, including elemental compositions, particle sizes and shapes, and their chemo-mechanics characteristics. In addition, mud formation in humid air, as well as ambient and dry mud adhesion on optically transparent surfaces is explored, as is water droplet dynamics on hydrophilic and hydrophobic surfaces, amongst other topics. The book fills the gap between the physical fundamentals of surface energy and texture characteristics for practical applications of surface cleaning and provides a basic understanding of the self-cleaning of surfaces that will be idea for academics, researchers and students.

Biocompatible Hybrid Oxide Nanoparticles for Human Health: From Synthesis to Applications explores the synthesis, structure, properties and applications of functionalized oxide nanoparticles. The books shows the applications of materials depending on their composition and structure, with a focus on silicon, titanium and iron oxides, each of which was chosen because of their unique features, including silica because it is chemically resistant to most organic solvents, harmless to living organisms, can thicken flowable formulations, and increase the strength of materials, titania for its unique chemical, optical, electrophysical and bactericidal properties, and iron-containing materials because they possess important magnetic properties.

Ultra-wide Bandgap Semiconductors (UWBG) covers the most recent progress in UWBG materials, including sections on high-Al-content AlGaN, diamond, B-Ga2O3, and boron nitrides. The coverage of these materials is comprehensive, addressing materials growth, physics properties, doping, device design, fabrication and performance. The most relevant and important applications are covered, including power electronics, RF electronics and DUV optoelectronics. There is also a chapter on novel structures based on UWBG, such as the heterojunctions, the low-dimensional structures, and their devices. This book is ideal for materials scientists and engineers in academia and R&D searching for materials superior to silicon carbide and gallium nitride.

Nanomedicine is a developing field, which includes different disciplines such as material science, chemistry, engineering and medicine devoted to the design, synthesis and construction of high-tech nanostructures. The ability of these structures to have their chemical and physical properties tuned by structural modification, has allowed their use in drug delivery systems, gene therapy delivery, and various types of theranostic approaches. Colloidal noble metal nanoparticles and other nanostructures have many therapeutic and diagnostic applications. The concept of drug targeting as a magic bullet has led to much research in chemical modification to design and optimize the binding to targeted receptors. It is important to understand the precise relationship between the drug and the carrier and its ability to target specific tissues, and pathogens to make an efficient drug delivery system. This book covers advances based on different drug delivery systems: polymeric and hyper branched nanomaterials, carbon-based nanomaterials, nature-inspired nanomaterials, and pathogen-based carriers.

New Trends in Natural Dyes for Textiles addresses 20 natural dyes that are finding innovative uses in industry and academia. It comprehensively addresses issues relating to natural dyes and dyeing problems, including efficient extraction and standardization of dyes, dyes structure, dyes characterization and identification. Readers working in the dyeing of textiles will learn how to improve practices to minimize environmental pollution, avoid bad dyeing, and select the best mordants to fix colorant compounds. Key benefits of natural dyes over synthetic are examined in detail, providing readers with an understanding of the importance of natural dyes and the proper methods for applying them.

Materials for Biomedical Engineering: Bioactive Materials for Antimicrobial, Anticancer, and Gene Therapy offers an up-to-date perspective on recent research findings regarding the application and use of these materials for disease treatment and prevention. Various types of currently investigated bioactive materials, including therapeutic nanostructures and antimicrobial hydrogels are discussed, as are their properties, impact and future role in therapeutic applications. The book will be extremely useful for new researchers who want to explore more information on the use of bioactive materials or for more experienced researchers who are interested in new trends and specific applications.

Biobased Polymers: Properties and Applications in Packaging looks at how biopolymers may be used in packaging as a potential green solution. The book addresses bio-based feedstocks, production processes, packaging types, recent trends in packaging, the environmental impact of bio-based polymers, and legislative demands for food contact packaging materials. Chapters explore opportunities for biopolymers in key end-use sectors, the penetration of biopolymer based concepts in the packaging market, and barriers to widespread commercialization. As the development of bio-based material is an important factor for sustainably growing the packaging industry, these recent trends in consumer markets are extremely important as we move towards greener packaging. Hence, this resource is an invaluable addition on the topic.

Solution Methods for Metal Oxide Nanostructures reviews solution processes that are used for synthesizing 1D, 2D and 3D metal oxide nanostructures in either thin film or in powder form for various applications. Wet-chemical synthesis methods deal with chemical reactions in the solution phase using precursors at proper experimental conditions. Wet-chemical synthesis routes offer a high degree of controllability and reproducibility for 2D nanomaterial fabrication. Solvothermal synthesis, template synthesis, self-assembly, oriented attachment, hot-injection, and interface-mediated synthesis are the main wet-chemical synthesis routes for 2D nanomaterials. Solution Methods for Metal Oxide Nanostructures also addresses the thin film deposition metal oxides nanostructures, which plays a very important role in many areas of chemistry, physics and materials science. Each chapter includes information on a key solution method and their application in the design of metal oxide nanostructured materials with optimized properties for important applications. The pros and cons of the solution method and their significance and future scope is also discussed in each chapter. Readers are provided with the fundamental understanding of the key concepts of solution synthesis methods for fabricating materials and the information needed to help them select the appropriate method for the desired application.

Pultrusion: State-of-the-Art Process Models with Applications, Second Edition is a detailed guide to pultrusion, providing methodical coverage of process models and computation simulation, governing principles and science, and key challenges to help readers enable process optimization and scale-up. This new edition has been revised and expanded to include the latest advances, state-of-the-art process models, and governing principles. The main challenges in pultrusion, such as the process induced residual stresses, shape distortions, thermal history, species conversion, phase changes, impregnation of the reinforcements and pulling force are described, with related examples are provided. Moreover, strategies for having a reliable and optimized process using probabilistic approaches and optimization algorithms are summarized. Another focus of this book is on the thermo-chemical and mechanical analyses of the pultrusion process for industrial profiles.

An Introduction to Nuclear Waste Immobilisation, Third Edition examines nuclear waste issues, including natural levels of radionuclides in the environment, the geological disposal of waste-forms, and their long-term behavior. It covers all-important aspects of processing and immobilization, including nuclear decay, regulations, new technologies and methods. The book has been updated to include a discussion of the disposal of nuclear waste from non-energy sources, also adding a chapter on the nuclear fuel cycle. Significant focus is given to the analysis of the various matrices used, especially cement and glass, with further discussion of other matrices, such as bitumen. The book's final chapter concentrates on the performance assessment of immobilizing materials and safety of disposal, providing a full range of resources needed to understand and correctly immobilize nuclear waste.

Welding the Inconel 718 Superalloy: Reduction of Micro-segregation and Laves Phases explores the day-to-day welding business in Alloy 718 and presents solutions to avoid or minimize micro-segregation. It considers the limitations of changing from lab scale models to actual production models and presents new technologies with proven experimental background. Various case studies are presented within the text, as well as proposed solutions backed by experimental evidence. Items previewed in this edition include enhanced cooling rates in the GTA welding process with cryogenic cooling and enhanced dendrite refinement using modified pulse waveform. This work will be useful to researchers from the aerospace, space, power generation, nuclear, and chemical industries, as well as students interested in superalloys and welding.

Functional Nanostructured Interfaces for Environmental and Biomedical Applications provides an overview on the characteristics of nanostructured interfaces and their processing technologies for a wide range of applications in the sensing, photocatalytic and bioengineering areas. The book focuses on the fundamentals of multifunctional nanostructured interfaces and their associated technologies, including versatile technologies, such as colloidal lithography, scanning probe techniques and laser nanostructuring, which can be used to obtain multifunctional 2D and 3D nanotextured interfaces. The book provides multidisciplinary chapters, summarizes the current status of the field, and covers important scientific and technological developments made over past decades. As such, it is an invaluable reference to those working in the design of novel nanostructured materials.

Metals for Biomedical Devices, Second Edition, has been fully updated and builds upon the success of its first edition, discussing the latest techniques in metal processing methods and the behavior of this important material. Initial chapters review the current status and selection of metals for biomedical devices. Subsequent chapters cover mechanical behavior, degradation and testing, corrosion, wear testing and biocompatibility, the processing of metals for biomedical applications, including topics such as forging metals and alloys, surface treatment, coatings and sterilization. Chapters in the final section discuss the clinical applications of metals, such as cardiovascular, orthopedic and new generation biomaterials. With its distinguished editor and team of expert contributors, this book is a standard reference for materials scientists, researchers and engineers working in the medical devices industry and academia.

Semiconductors and Modern Electronics is a brief introduction to the physics behind semiconductor technologies. Chuck Winrich, a physics professor at Babson College, explores the topic of semiconductors from a qualitative approach to understanding the theories and models used to explain semiconductor devices. Applications of semiconductors are explored and understood through the models developed in the book. The qualitative approach in this book is intended to bring the advanced ideas behind semiconductors to the broader audience of students who will not major in physics. Much of the inspiration for this book comes from Dr. Winrich's experience teaching a general electronics course to students majoring in business. The goal of that class, and this book, is to bring forward the science behind semiconductors, and then to look at how that science affects the lives of people.

Graphene: Important Results and Applications provides an overview on the latest research in graphene production and applications. The most advanced methods of production, including chemical vapor deposition, reduction of graphene oxide, and detonation reaction are explored, as is current research results on the unique nature of graphene and its types, including morphology and thickness, mechanical properties, electrical conductivity, elastic properties of 2D and 3D structures, and more. Chapters covering the dispersion of graphene into the polymer matrix and chemical modifications and their potential applications are also featured. The book concludes with sections focusing on current and future applications.

Size Effects in Plasticity: From Macro to Nano provides concise explanations of all available methods in this area, from atomistic simulation, to non-local continuum models to capture size effects. It then compares their applicability to a wide range of research scenarios. This essential guide addresses basic principles, numerical issues and computation, applications and provides code which readers can use in their own modeling projects. Researchers in the fields of computational mechanics, materials science and engineering will find this to be an ideal resource when they address the size effects observed in deformation mechanisms and strengths of various materials.