This textbook provides an introduction to the fundamental models of massively parallel computation, the most important technique for high-performance computing. It presents a coherent exposition of analytic methods and results for the exploration and understanding of cellular automata and discrete neural networks as computational and dynamical systems. The book will be useful also as a reference manual to the scattered literature in the field. Each chapter includes a separate bibliography, as well as pointers to historically relevant papers, and gives exercise problems for the reader.