This monograph is intended to teach parallel architecture and parallel algorithms to non-specialists. It is self-contained and includes both introductory and advanced material. It emphasizes the interaction between parallel architectures and parallel algorithms. It is intended for researchers, advanced undergraduate students or graduate students in the fields of parallel computing, machine vision.