Parallel and Distributed Computing
Last update: 21 Apr 2025 21:17First version:
Yet Another Inadequate Placeholder, last seriously updated in the early 2000s Cellular automata are parallel, interacting finite state machines; some of them are Turing-equivalent, that is, can compute any computable function.
Complexity classes --- in space (memory), time, other resources?
What would analog parallel computing look like? (A partial differential equation, presumably.)
Uses: data mining, simulations.
See also: Computation, Automata, Languages; Computer Networks; Multi-Agent Systems; Neural Coding; Synchronization; Topology and Synchronization
- Recommended:
- David Gelernter, Mirror Worlds
- Metropolis and Rota (eds.), A New Era in Computation
- Mitchel Resnick, Turtles, Termites, and Traffic Jams: Explorations in Massively Parallel Microworlds [Review: Turtles Up the *]
- Nancy A. Lynch, Distributed Algorithms [Laudatory review by Danny Yee]
- Bruce Sterling, "Pervasive Computing," Viridian Note 00113
- To read:
- Andrews, Fundamentals of Multithreaded, Parallel, and Distributed Programming
- Jon Barwise and Jerry Seligman, Information Flow: The Logic of Distributed Systems
- Ron Bekkerman, Mikhail Bilenko and John Langford (eds.), Scaling up Machine Learning: Parallel and Distributed Approaches
- Albert Benveniste, Eric Fabre and Stefan Haar, "Markov Nets: Probabilistic Models for Distributed and Concurrent Systems", IEEE Transactions on Automatic Control 48 (2003): 1936--1950
- George F. Coulouris, Jean Dollimore, and Tim Kindberg, Distributed Systems: Concepts and Design
- Shlomi Dolev, Self-Stabilization
- Wan Fokkink, Introduction to Process Algebra
- Neil Gershenfeld, When Things Start to Think
- Raymond Greenlaw, H. James Hoover, Walter L. Ruzzo, Limits to Parallel Computation: P-Completeness Theory
- Peter J. Haas, Stochastic Petri Nets: Modelling, Stability, Simulation
- Holger Hermanns, Interactive Markov Chains [Markov models for distributed system analysis and design]
- Jane Hillston, A Compositional Approach to Performance Modelling
- Huberman, Ecology of Computation
- Unmesh Joshi, Patterns of Distributed Systems [via]
- Zohar Manna and Amir Pnueli, The Temporal Logic of Reactive and Concurrent Systems
- Robin Milner, Communicating and Mobile Systems: The Pi-calculus
- Peter Pacheco, MPI
- Wolfgang Reisig, Elements of Distributed Algorithms: Modeling and Analysis with Petri Nets
- L. Ridgway Scott, Terry Clark, and Babak Bagheri, Scientific Parallel Computing
- Sterling et al., How to Build a Beowulf
- R. E. Tarjan, Data Structures and Network Algorithms
- Gerard Tel, Introduction to Distributed Algorithms
