Overview and Goals This book is dedicated to scheduling for parallel processing. Presenting a research ?eld as broad as this one poses considerable dif?culties. Scheduling for parallel computing is an interdisciplinary subject joining many ?elds of science and te- nology. Thus, to understand the scheduling problems and the methods of solving them it is necessary to know the limitations in related areas. Another dif?culty is that the subject of scheduling parallel computations is immense. Even simple search in bibliographical databases reveals thousands of publications on this topic. The - versity in understanding scheduling problems is so great that it seems impossible to juxtapose them in one scheduling taxonomy. Therefore, most of the papers on scheduling for parallel processing refer to one scheduling problem resulting from one way of perceiving the reality. Only a few publications attempt to arrange this ?eld of knowledge systematically. In this book we will follow two guidelines. One guideline is a distinction - tween scheduling models which comprise a set of scheduling problems solved by dedicated algorithms. Thus, the aim of this book is to present scheduling models for parallel processing, problems de?ned on the grounds of certain scheduling models, and algorithms solving the scheduling problems. Most of the scheduling problems are combinatorial in nature. Therefore, the second guideline is the methodology of computational complexity theory. Inthisbookwepresentfourexamplesofschedulingmodels. Wewillgodeepinto the models, problems, and algorithms so that after acquiring some understanding of them we will attempt to draw conclusions on their mutual relationships.

This book constitutes the refereed proceedings of the International conference on Parallel and Distributed Computing and Networks, PDCN 2011, held in Chongqing, China, in December 2010. The 19 revised full papers presented were carefully reviewed and selected from numerous submissions. The conference provided a forum for participants from industry, academic, and non-profit organizations to exchange innovative ideas on Parallel and Distributed Computing and Networks related technologies. The papers address current issues in distributed, parallel, ubiquitous, and cloud computing with special focus on systems security, healthcare, and sports economics.

CUDA for Engineers gives you direct, hands-on engagement with personal, high-performance parallel computing, enabling you to do computations on a gaming-level PC that would have required a supercomputer just a few years ago. The authors introduce the essentials of CUDA C programming clearly and concisely, quickly guiding you from running sample programs to building your own code. Throughout, you'll learn from complete examples you can build, run, and modify, complemented by additional projects that deepen your understanding. All projects are fully developed, with detailed building instructions for all major platforms. Ideal for any scientist, engineer, or student with at least introductory programming experience, this guide assumes no specialized background in GPU-based or parallel computing. In an appendix, the authors also present a refresher on C programming for those who need it. Coverage includes Preparing your computer to run CUDA programs Understanding CUDA's parallelism model and C extensions Transferring data between CPU and GPU Managing timing, profiling, error handling, and debugging Creating 2D grids Interoperating with OpenGL to provide real-time user interactivity Performing basic simulations with differential equations Using stencils to manage related computations across threads Exploiting CUDA's shared memory capability to enhance performance Interacting with 3D data: slicing, volume rendering, and ray casting Using CUDA libraries Finding more CUDA resources and code Realistic example applications include Visualizing functions in 2D and 3D Solving differential equations while changing initial or boundary conditions Viewing/processing images or image stacks Computing inner products and centroids Solving systems of linear algebraic equations Monte-Carlo computations

It is our great pleasure to welcome you to the proceedings of the 10th annual event of the International Conference on Algorithms and Architectures for Parallel Processing (ICA3PP). ICA3PP is recognized as the main regular event covering the many dimensions of parallel algorithms and architectures, encompassing fundamental theoretical - proaches, practical experimental projects, and commercial components and systems. As applications of computing systems have permeated every aspect of daily life, the power of computing systems has become increasingly critical. Therefore, ICA3PP 2010 aimed to permit researchers and practitioners from industry to exchange inf- mation regarding advancements in the state of the art and practice of IT-driven s- vices and applications, as well as to identify emerging research topics and define the future directions of parallel processing. We received a total of 157 submissions this year, showing by both quantity and quality that ICA3PP is a premier conference on parallel processing. In the first stage, all papers submitted were screened for their relevance and general submission - quirements. These manuscripts then underwent a rigorous peer-review process with at least three reviewers per paper. In the end, 47 papers were accepted for presentation and included in the main proceedings, comprising a 30% acceptance rate.

Euro-Par is an annual series of international conferences dedicated to the p- motion and the advancement of all aspects of parallel computing. In Euro-Par, the ?eld of parallel computing is divided into the four broad categories of t- ory, high performance, cluster and grid, and distributed and mobile computing. These categories are further subdivided into 14 topics that focus on particular areas in parallel computing. The objective of Euro-Par is to provide a forum for promoting the development of parallel computing both as an industrial te- nique and as an academic discipline, extending the frontier of both the state of the art and the state of the practice. The target audience of Euro-Par c- sists of researchers in parallel computing in academic departments, government laboratories, and industrial organizations. Euro-Par 2009 was the 15th conference in the Euro-Par series, and was - ganized by the Parallel and Distributed Systems Group of Delft University of Technology in Delft, The Netherlands. The previous Euro-Par conferences took placeinStockholm,Lyon,Passau,Southampton,Toulouse,Munich,Manchester, Paderborn,Klagenfurt,Pisa,Lisbon, Dresden, Rennes, and Las Palmasde Gran Canaria. Next year, the conference will be held in Sorrento, Italy. More inf- mation on the Euro-Par conference series and organization is available on its website athttp://www.europar.org.

This book constitutes the refereed proceedings of the 16th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface, EuroPVM/MPI 2009, held in Espoo, Finland, September 7-10, 2009.

The 27 papers presented were carefully reviewed and selected from 48 submissions. The volume also includes 6 invited talks, one tutorial, 5 poster abstracts and 4 papers from the special session on current trends in numerical simulation for parallel engineering environments. The main topics of the meeting were Message Passing Interface (MPI)performance issues in very large systems, MPI program verification and MPI on multi-core architectures.

This book offers a unique pathway to methods of parallel optimization by introducing parallel computing ideas and techniques into both optimization theory, and into some numerical algorithms for large-scale optimization problems. The presentation is based on the recent understanding that rigorous mathematical analysis of algorithms, parallel computing techniques, and "hands-on" experimental work on real-world problems must go hand in hand in order to achieve the greatest advantage from novel parallel computing architectures. The three parts of the book thus bring together relevant theory, careful study of algorithms, and modelling of significant real world problems. The problem domains include: image reconstruction, radiation therapy treatment planning, transportation problems, portfolilo management, and matrix estimation. This text can be used both as a reference for researchers and as a text for advanced graduate courses.

Modern information systems rely increasingly on combining concurrent, d- tributed, real-time, recon?gurable and heterogeneous components. New models, architectures, languages, and veri?cation techniques are necessary to cope with thecomplexityinducedbythedemandsoftoday'ssoftwaredevelopment. COOR- DINATIONaimstoexplorethespectrumoflanguages, middleware, services, and algorithms that separate behavior from interaction, therefore increasing mo- larity, simplifying reasoning, and ultimately enhancing software development. This volume contains the proceedings of the 10th International Conference on Coordination Models and Languages, COORDINATION 2008, held in Oslo, Norway in June 2008, as part of the federated DisCoTec conference. COORDI- NATIONitselfispartofaserieswhoseproceedingshavebeenpublishedinLNCS volumes 1061, 1282, 1594, 1906, 2315, 2949, 3454, 4038, and 4467. From the 61 submissions received from around the world, the Program Committee selected 21 papers for presentation and publication in this volume on the basis of or- inality, quality, and relevance to the topics of the conference. Each submission received at least three reviews. As with previous editions, the paper submission and selection processes were managed entirely electronically. This was acc- plished using EasyChair, a free Web-based conference management system. In addition to the technical paper presentations, COORDINATION 2008 hosted an invited presentation by Matt Welsh from Harvard University. We are grateful to all the Program Committee members who devoted much e?ort and time to read and discuss the papers. Moreover, we acknowledge the help of additional external reviewers who evaluated submissions in their area of expertise. Finally, wewouldliketothanktheauthorsofallthesubmittedpapersandthe conferenceattendees, for keeping this researchcommunity lively and interactive, and ultimately ensuring the success of this conference series.

OpenMP is a widely accepted, standard application programming interface (API) for high-level shared-memory parallel programming in Fortran, C, and C++. Since its introduction in 1997, OpenMP has gained support from most high-performance compiler and hardware vendors. Under the direction of the OpenMP Architecture Review Board (ARB), the OpenMP speci?cation has evolved, including the - cent release of Speci?cation 3. 0. Active research in OpenMP compilers, runtime systems, tools, and environments drives its evolution, including new features such as tasking. The community of OpenMP researchers and developers in academia and - dustry is united under cOMPunity (www. compunity. org). This organaization has held workshops on OpenMP around the world since 1999: the European Wo- shop on OpenMP (EWOMP), the North American Workshop on OpenMP App- cations and Tools (WOMPAT), and the Asian Workshop on OpenMP Experiences and Implementation (WOMPEI) attracted annual audiences from academia and industry. The International Workshop on OpenMP (IWOMP) consolidated these three workshop series into a single annual international event that rotates across the previous workshop sites. The ?rst IWOMP meeting was held in 2005, in - gene, Oregon, USA. IWOMP 2006 took place in Reims, France, and IWOMP 2007 in Beijing, China. Each workshop drew over 60 participants from research and - dustry throughout the world. IWOMP 2008 continued the series with technical papers, panels, tutorials, and OpenMP status reports. The ?rst IWOMP wo- shop was organized under the auspices of cOMPunity.

th Thisvolumecontainsthepaperspresentedatthe13 workshoponJobSched- ing Strategies for Parallel Processing. The workshop was held in Seattle, WA, USA, on June 17, 2007, in conjunction with ICS 2007. All submitted papers went through a complete review process, with the full versionbeingreadandevaluatedbyanaverageof?vereviewers.Wewouldliketo thanktheProgramCommittee membersandadditionalrefereesfortheirwilli- ness to participate in this e?ort and their excellent, detailed reviews: Nazareno Andrade, Su-Hui Chiang, Walfredo Cirne, Alvaro Coelho, Lauro Costa, Dror Feitelson, Allan Gottlieb, Andrew Grimshaw, Moe Jette, Richard Lagerstrom, Virginia Lo, Reagan Moore, Bill Nitzberg, Mark Squillante, John Towns, Jon Weissman, and Ramin Yahyapour. The accepted workshop papers in recent years show a departure from the supercomputer-centric viewpoint of parallel job scheduling. On the one hand, the ?eld of supercomputer scheduling is showing some signs of maturity, exh- ited in many widely accepted practices for job scheduling. On the other hand, many nontraditionalhigh-performancecomputing andparallelenvironments are emerging as viable solutions to many users and uses that cannot or need not - cess a traditional supercomputer, such as Grids, Web services, and commodity parallelcomputers.With the growingubiquity ofthese technologies, the requi- ment to schedule parallel jobs well on these various architectures also grows

This book constitutes the refereed proceedings of the 5th International Symposium on Parallel and Distributed Processing and Applications, ISPA 2007, held in Niagara Falls, Canada, in August 2007.

The 83 revised full papers presented together with 3 keynote speeches were carefully reviewed and selected from 244 submissions. The papers are organized in topical sections on algorithms and applications, architectures and systems, datamining and databases, fault tolerance and security, middleware and cooperative computing, networks, as well as software and languages.

This book constitutes the refereed proceedings of the 9th International Conference on Parallel Computing Technologies, PaCT 2007, held in Pereslavl-Zalessky, Russia in September 2007 - in conjunction with the the Russian-Taiwan symposium on Methods and Tools of Parallel Programming of Multicomputers.

The 37 revised full papers and 24 revised poster papers presented together with 2 invited paper were carefully reviewed and selected from 98 submissions. The papers are organized in topical sections on models and languages, applications, techniques for parallel programming supporting, cellular automata, as well as methods and tools of parallel programming of multicomputers.

This volume constitutes the refereed proceedings of the 17th International Conference on Concurrency Theory. Thirty full papers are presented along with three important invited papers. Each of these papers was carefully reviewed by the editors. Topics include model checking, process calculi, minimization and equivalence checking, types, semantics, probability, bisimulation and simulation, real time, and formal languages.

This book constitutes the refereed proceedings of the 13th International Conference on Parallel Computing, Euro-Par 2007, held in Dresden, Rennes, France, August 28-31, 2007.

The 89 revised papers presented were carefully reviewed and selected from 333 submissions. The papers are organized in topical sections on support tools and environments; performance prediction and evaluation; scheduling and load balancing; compilers for high performance; parallel and distributed databases; grid and cluster computing; peer-to-peer computing; distributed systems and algorithms; parallel and distributed programming; parallel numerical algorithms; distributed and high-performance multimedia; theory and algorithms for parallel computation; high performance networks; mobile and ubiquitous computing.

This book constitutes the refereed proceedings of the 7th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2007, held in Hangzhou, China in June 2007.

The 39 revised full papers presented together with 1 keynote talk and 3 invited lectures were carefully reviewed and selected from 176 submissions. Focussing on two broad areas of parallel and distributed computing, i.e., architectures, algorithms and networks, and systems and applications, the papers are organized in topical sections on parallel algorithms, parallel architecture, grid computing, peer-to-peer technologies, and advanced network technologies.

This book constitutes the thoroughly refereed post-proceedings of the 7th International Conference on High Performance Computing for Computational Science, VECPAR 2006, held in Rio de Janeiro, Brazil, in June 2006.

The 44 revised full papers presented together with 1 invited paper and 12 revised workshop papers were carefully selected during two rounds of reviewing and improvement for inclusion in the book. The papers are organized in topical sections on Grid computing, cluster computing, numerical methods, large-scale simulations in Physics, and computing in Biosciences. Finally this book includes some of the presentations at the two associated workshops on Computational Grids and Clusters, and on High Performance Data Management in Grid Environments.

This book constitutes the refereed proceedings of the 4th International Symposium on Parallel and Distributed Processing and Applications, ISPA 2006, held in Sorrento, Italy in November 2006. The 79 revised full papers presented together with five keynote speeches cover architectures, networks, languages, algorithms, middleware, cooperative computing, software, and applications.

This book constitutes the refereed proceedings of the 14th European PVM/MPI Users' Group Meeting held in Paris, France, September 30 - October 3, 2007.

The 40 revised full papers presented together with abstracts of 6 invited contributions, 3 tutorial papers and 6 poster papers were carefully reviewed and selected from 68 submissions. The papers are organized in topical sections on collective communication, communication protocols, debugging and verification, fault tolerance, metacomputing and grid, parallel I/O, implementation issues, object-oriented message passing, limitations and extensions, performance, and are completed with 6 contributions to the special ParSim session on current trends in numerical simulation for parallel engineering environments.

This book constitutes the refereed proceedings of the 9th International Conference on Parallel Problem Solving from Nature, PPSN 2006, held in Reykjavik, Iceland in September 2006.

The 106 revised full papers presented were carefully reviewed and selected from 255 submissions. The papers cover a wide range of topics, from evolutionary computation to swarm intelligence and from bio-inspired computing to real-world applications; they are organized in topical sections on theory, new algorithms, applications, multi-objective optimization, evolutionary learning, as well as representations, operators, and empirical evaluation.

This book constitutes the refereed proceedings of the 13th European PVM/MPI Users' Group Meeting, held in September 2006. The book presents 38 revised full papers together with abstracts of 6 invited contributions, 4 tutorial papers and 6 poster papers. The papers are organized in topical sections on collective communication, communication protocols, debugging and verification, fault tolerance, metacomputing and grid, parallel I/O, implementation issues, object-oriented message passing, limitations and extensions and performance.

This book constitutes the refereed proceedings of the 9th International Conference on Coordination Models and Languages, COORDINATION 2007, held in Paphos, Cyprus, June 2007, as one of the federated conferences on Distributed Computing Techniques. It examines how to increase modularity, simplify reasoning, and ultimately enhance today's software development by exploring the spectrum of languages, middleware, services, and algorithms.

This book constitutes the refereed proceedings of the 8th International Conference on Coordination Models and Languages, COORDINATION 2006, held in Bologna, Italy, June 2006. The 17 revised full papers presented were carefully reviewed and selected from 50 submissions. Among the topics addressed are component connectors, negotiation in service-oriented computing, process algebraic specification, workflow patterns, reactive XML, ubiquitous coordination, type systems, ad-hoc network coordination, choreography, communication coordination, and distributed embedded systems.

This book constitutes the thoroughly refereed post-proceedings of the 6th International Conference on Parallel Processing and Applied Mathematics, PPAM 2005. The book presents 135 papers organized in topical sections on parallel and distributed architectures, parallel and distributed non-numerical algorithms, performance analysis, prediction and optimization, grid programming, tools and environments for clusters and grids, applications of parallel/distributed/grid computing, evolutionary computing with applications, parallel data mining, parallel numerics, and mathematical and computing methods.

This book constitutes the thoroughly refereed postproceedings of the 12th International Workshop on Job Scheduling Strategies for Parallel Processing, JSSPP 2006, held in Saint-Malo, France, in June 2006 in conjunction with the Joint International Conference on Measurement and Modeling of Computer Systems SIGMETRICS/Performance 2006.

The 12 revised full research papers presented went through two rounds of reviewing and improvement. The papers cover all current issues of job scheduling strategies for parallel processing such as workflow problems, scheduling performance, job migration issues, performance degradation by resource sharing, and job modeling issues in grid computing.

This book constitutes the refereed proceedings of the 7th International Conference on Applied Parallel Computing, PARA 2004, held in June 2004. The 118 revised full papers presented together with five invited lectures and 15 contributed talks were carefully reviewed and selected for inclusion in the proceedings. The papers are organized in topical sections.