Neural networks provide powerful technology to model and control nonlinear and complex systems. This book presents a detailed formulation of neural networks from the information-theoretic viewpoint, showing how this perspective provides insights into the design theory of neural networks.