Preface 1 Introduction 1.1 Notion of Algorithm Exercises 1.1 1.2 Fundamentals of Algorithmic Problem Solving Understanding the Problem Ascertaining the Capabilities of a Computational Device Choosing between Exact and Approximate Problem Solving Deciding on Appropriate Data Structures Algorithm Design Techniques Methods of Specifying an Algorithm Proving an Algorithm's Correctness Analyzing an Algorithm Coding an Algorithm Exercises 1.2 1.3 Important Problem Types Sorting Searching String Processing Graph Problems Combinatorial Problems Geometric Problems Numerical Problems Exercises 1.3 1.4 Fundamental Data Structures Linear Data Structures Graphs Trees Sets and Dictionaries Exercises 1.4 Summary 2 Fundamentals of the Analysis of Algorithm Efficiency 2.1 Analysis Framework Measuring an Input's Size Units for Measuring Running Time Orders of Growth Worst-Case, Best-Case, and Average-Case Efficiencies Recapitulation of the Analysis Framework Exercises 2.1 2.2 Asymptotic Notations and Basic Efficiency Classes Informal Introduction O-notation -notation O-notation Useful Property Involving the Asymptotic Notations Using Limits for Comparing Orders of Growth Basic Efficiency Classes Exercises 2.2 2.3 Mathematical Analysis of Nonrecursive Algorithms Exercises 2.3 2.4 Mathematical Analysis of Recursive Algorithms Exercises 2.4 2.5 Example: Fibonacci Numbers Explicit Formula for the nth Fibonacci Number Algorithms for Computing Fibonacci Numbers Exercises 2.5 2.6 Empirical Analysis of Algorithms Exercises 2.6 2.7 Algorithm Visualization Summary 3 Brute Force 3.1 Selection Sort and Bubble Sort Selection Sort Bubble Sort Exercises 3.1 3.2 Sequential Search and Brute-Force String Matching Sequential Search Brute-Force String Matching Exercises 3.2 3.3 Closest-Pair and Convex-Hull Problems by Brute Force Closest-Pair Problem Convex-Hull Problem Exercises 3.3 3.4 Exhaustive Search Traveling Salesman Problem Knapsack Problem Assignment Problem Exercises 3.4 Summary 4 Divide-and-Conquer 4.1 Mergesort Exercises 4.1 4.2 Quicksort Exercises 4.2 4.3 Binary Search Exercises 4.3 4.4 Binary Tree Traversals and Related Properties Exercises 4.4 4.5 Multiplication of Large Integers and Strassen's Matrix Multiplication Multiplication of Large Integers Strassen's Matrix Multiplication Exercises 4.5 4.6 Closest-Pair and Convex-Hull Problems by Divide-and-Conquer Closest-Pair Problem Convex-Hull Problem Exercises 4.6 Summary 5 Decrease-and-Conquer 5.1 Insertion Sort Exercises 5.1 5.2 Depth-First Search and Breadth-First Search Depth-First Search Breadth-First Search Exercises 5.2 5.3 Topological Sorting Exercises 5.3 5.4 Algorithms for Generating Combinatorial Objects Generating Permutations Generating Subsets Exercises 5.4 5.5 Decrease-by-a-Constant-Factor Algorithms Fake-Coin Problem Multiplication a la Russe Josephus Problem Exercises 5,5 5.6 Variable-Size-Decrease Algorithms Computing e Median and the Selection Problem Interpolation Search Searching and Insertion in a Binary Search Tree Exercises 5.6 Summary 6 Transform-and-Conquer 6.1 Presorting Exercises 6.1 6.2 Gaussian Elimination LU Decomposition and Other Applications Computing a Matrix Inverse Computing a Determinant Exercises 6.2 6.3 Balanced Search Trees AVL Trees 2-3 Trees Exercises 6.3 6.4 Heaps and Heapsort Notion of the Heap Heapsort Exercises 6,4 6.5 Horner's Rule and Binary Exponentiation Horner's Rule Binary Exponentiation Exercises 6.5 6.6 Problem Reduction Computing the Least Common Multiple Counting Paths in a Graph Reduction of Optimization Problems Linear Programming Reduction to Graph Problems Exercises 6.6 Summary 7 Space and lime Tradeoffs 7.1 Sorting by Counting Exercises 7.1 7.2 Input Enhancement in String Matching Horspool's Algorithm Boyer-Moore Algorithm Exercises 7,2 7,3 Hashing Open Hashing (Separate Chaining) Closed Hashing (Open Addressing) Exercises 7.3 7.4 B-Trees Exercises 7.4 Summary 8 Dynamic Programming 8.1 Computing a Binomial Coefficient Exercises 8.1 8.2 Warshall's and Floyd's Algorithms Warshall's Algorithm Floyd's Algorithm for the Ali-Pairs Shortest-Paths Problem Exercises 8.2 8.3 Optimal Binary Search Trees Exercises 8.3 8.4 The Knapsack Problem and Memory Functions Memory Functions Exercises 8.4 Summary 9 Greedy Technique 9.1 Prim's Algorithm Exercises 9.1 9.2 Kruskal's Algorithm Disjoint Subsets and Union-Find Algorithms Exercises 9.2 9.3 Dijkstra's Algorithm Exercises 9.3 9.4 Huffman Trees Exercises 9.4 Summary 10 Limitations of Algorithm Power 10.1 Lower-Bound Arguments Trivial Lower Bounds Information-Theoretic Arguments Adversary Arguments Problem Reduction Exercises 10.1 10.2 Decision Trees Decision Trees for Sorting Algorithms Decision Trees for Searching a Sorted Array Exercises 10.2 10.3 P, NP, and NP-complete Problems P and NP Problems NP-complete Problems Exercises 10.3 10.4 Challenges of Numerical Algorithms Exercises 10.4 Summary 44 11 Coping with the Limitations of Algorithm Power 11.1 Backtracking n-Queens Problem Hamiltonian Circuit Problem Subset-Sum Problem General Remarks Exercises 11,1 11.2 Branch-and-Bound Assignment Problem Knapsack Problem Traveling Salesman Problem Exercises 11,2 11.3 Approximation Algorithms for NP-hard Problems Approximation Algorithms for the Traveling Salesman Problem Approximation Algorithms for the Knapsack Problem Exercises 11.3 11.4 Algorithms for Solving Nonlinear Equations Bisection Method Method of False Position Newton's Method Exercises 11.4 Summary Epilogue APPENDIX A Useful Formulas for the Analysis of Algorithms Properties of Logarithms Combinatorics Important Summation Formulas Sum Manipulation Rules Approximation of a Sum by a Definite Integral Floor and Ceiling Formulas Miscellaneous APPENDIX B Short Tutorial on Recurrence Relations Sequences arid Recurrence Relations Methods for Solving Recurrence Relations Common Recurrence Types in Algorithm Analysis Bibliography Hints to Exercises Index