Scribd
Upload
139 views11 pages

Algorithms & Dynamic Programming

This document provides a review of dynamic programming and its application to finding the longest common subsequence (LCS) between two sequences. It discusses how the LCS problem exhibits optimal substructure and can be solved using dynamic programming by defining a 2D array c where c[i,j] represents the length of the LCS between the prefixes x[1..i] and y[1..j]. The value of c[i,j] is either c[i-1,j-1]+1 if the characters match or the maximum of c[i,j-1] and c[i-1,j] otherwise, allowing the full LCS length to be found in O(mn) time rather

Uploaded by

Anonymous niE5VQOH
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
139 views11 pages

Algorithms & Dynamic Programming

This document provides a review of dynamic programming and its application to finding the longest common subsequence (LCS) between two sequences. It discusses how the LCS problem exhibits optimal substructure and can be solved using dynamic programming by defining a 2D array c where c[i,j] represents the length of the LCS between the prefixes x[1..i] and y[1..j]. The value of c[i,j] is either c[i-1,j-1]+1 if the characters match or the maximum of c[i,j-1] and c[i-1,j] otherwise, allowing the full LCS length to be found in O(mn) time rather

Uploaded by

Anonymous niE5VQOH
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd

CS 332: Algorithms

Dynamic Programming

Review: Amortized Analysis


To illustrate amortized analysis we examined

dynamic tables
1. Init table size m = 1
2. Insert elements until number n > m
3. Generate new table of size 2m
4. Reinsert old elements into new table
5. (back to step 2)
What is the worst-case cost of an insert?
What is the amortized cost of an insert?

Review:
Analysis Of Dynamic Tables
Let ci = cost of ith insert
ci = i if i-1 is exact power of 2, 1 otherwise
Example:
Operation
Insert(1)
Insert(2)
Insert(3)
Insert(4)
Insert(5)
Insert(6)
Insert(7)
Insert(8)
Insert(9)

Table Size
1
2
4
4
8
8
8
8
16

Cost
1
1
1
1
1
1
1
1
1

+ 1
+ 2
+ 4

+ 8

1
2
3
4
5
6
7
1
8
2
9

Review: Aggregate Analysis


n Insert() operations cost
n

c
i 1

lg n

n 2 n (2n 1) 3n
j

j 0

Average cost of operation

= (total cost)/(# operations) < 3


Asymptotically, then, a dynamic table costs the
same as a fixed-size table
Both O(1) per Insert operation

Review: Accounting Analysis


Charge each operation $3 amortized cost
Use $1 to perform immediate Insert()
Store $2

When table doubles


$1 reinserts old item, $1 reinserts another old item
Weve paid these costs up front with the last n/2

Insert()s
Upshot: O(1) amortized cost per operation

Review: Accounting Analysis


Suppose must support insert & delete, table should

contract as well as expand


Table overflows double it (as before)
Table < 1/4 full halve it
Charge $3 for Insert (as before)
Charge $2 for Delete
Store extra $1 in emptied slot
Use later to pay to copy remaining items to new table when
shrinking table

What if we halve size when table < 1/8 full?

Dynamic Programming
Another strategy for designing algorithms is

dynamic programming
A metatechnique, not an algorithm

(like divide & conquer)


The word programming is historical and
predates computer programming
Use when problem breaks down into recurring

small subproblems

Dynamic Programming Example:


Longest Common Subsequence
Longest common subsequence (LCS) problem:
Given two sequences x[1..m] and y[1..n], find the longest

subsequence which occurs in both


Ex: x = {A B C B D A B }, y = {B D C A B A}
{B C} and {A A} are both subsequences of both
What is the LCS?

Brute-force algorithm: For every subsequence of x, check

if its a subsequence of y
How many subsequences of x are there?
What will be the running time of the brute-force alg?

LCS Algorithm
Brute-force algorithm: 2m subsequences of x to

check against n elements of y: O(n 2m)


We can do better: for now, lets only worry
about the problem of finding the length of LCS
When finished we will see how to backtrack from

this solution back to the actual LCS


Notice LCS problem has optimal substructure
Subproblems: LCS of pairs of prefixes of x and y

Finding LCS Length


Define c[i,j] to be the length of the LCS of

x[1..i] and y[1..j]


What is the length of LCS of x and y?

Theorem:
if x[i ] y[ j ],
c[i 1, j 1] 1
c[i, j ]
max(c[i, j 1], c[i 1, j ]) otherwise
What is this really saying?

The End

You might also like