Introduction.- Preliminaries on System Theory and Optimization Algorithms.- Interaction Topology of Multiagent Systems and Consensus Protocols.- Emergent Behavior Detection in Multiagent Systems.- Distributed Task Coordination of Multiagent Systems.- Multiagent Task Coordination Using Approximate Dynamic Programming.- Distributed Gradient Estimation for Multiagent Task Optimization.- Case Studies and Experiments.