Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
courses:cs211:winter2011:journals:chen:chapter_6 [2011/03/30 12:56] – zhongc | courses:cs211:winter2011:journals:chen:chapter_6 [2011/04/06 16:41] (current) – [6.9 Shortest Paths and Distance Vector Protocols] zhongc | ||
---|---|---|---|
Line 200: | Line 200: | ||
+ | ====== 6.6-6.7 SEQUENCE ALIGNMENT ====== | ||
+ | Some general context of the problem: | ||
+ | |||
+ | Google search and dictionaries have functions that recognizes what the user probably mean when typing in a word | ||
+ | that does not exist in the dataset. | ||
+ | In order to do | ||
+ | **How should we define similarity between two words or strings?** | ||
+ | |||
+ | Dissimilar by gaps and mismatches. | ||
+ | |||
+ | |||
+ | Formalized: | ||
+ | |||
+ | Sequence Alignment | ||
+ | • Goal: Given two strings X = x1 x2 . . . xm and | ||
+ | Y = y1 y2 . . . yn find alignment of minimum | ||
+ | cost | ||
+ | • An alignment M is a set of ordered pairs xi-yj | ||
+ | such that each item occurs in at most one | ||
+ | pair and no crossings | ||
+ | • The pair xi-yj and xi' | ||
+ | |||
+ | |||
+ | different cases | ||
+ | |||
+ | Case 1: xM and yN are aligned | ||
+ | • Pay mismatch for xM-yN + min cost of aligning rest of | ||
+ | strings | ||
+ | • OPT(M, N) = αXmYn + OPT(M-1, N-1) | ||
+ | Case 2: xM is not matched | ||
+ | • Pay gap for xM + min cost of aligning rest of strings | ||
+ | • OPT(M, N) = δ + OPT(M-1, N) | ||
+ | Case 3: yN is not matched | ||
+ | • Pay gap for yN + min cost of aligning rest of strings | ||
+ | • OPT(M, N) = δ + OPT(M, N-1) | ||
+ | |||
+ | |||
+ | Similar to KnapSack problem in the data structure. | ||
+ | |||
+ | space O(mn) | ||
+ | |||
+ | Can do this in linear space: | ||
+ | Collapse into an m x 2 array | ||
+ | M[i,0] represents previous row; M[i,1] -- current | ||
+ | |||
+ | |||
+ | T(m, n) <= cmn + T(q, n/2) + T(m - q, n/2) | ||
+ | = cmn + kqn/2 + k(m - q)n/2 | ||
+ | = cmn + kqn/2 + kmn/2 - kqn/2 | ||
+ | = (c + k/2)mn. | ||
+ | |||
+ | combination of divide-and-conquer and dynamic programming | ||
+ | |||
+ | we can map the problem to shortest path problem on a weighted graph. | ||
+ | |||
+ | |||
+ | Divide: find index q that minimizes f(q, n/2) + g(q, n/2) using DP | ||
+ | Conquer: recursively compute optimal alignment in each piece. | ||
+ | |||
+ | Interesting/ | ||
+ | |||
+ | |||
+ | |||
+ | ====== 6.8 Shortest Paths in a Graph ====== | ||
+ | |||
+ | Negative weights would change everything that made the Greedy appropriate. Thus we cannot | ||
+ | make decision only relying on local inforamtion at each step b/c a big negative edge that | ||
+ | come later may drastically change the picture. | ||
+ | |||
+ | Some constraints: | ||
+ | No negative weight cycle | ||
+ | If some path from s to t contains a negative | ||
+ | cost cycle, there does not exist a shortest s-t | ||
+ | path. | ||
+ | we can loop forever and get ever smaller. | ||
+ | |||
+ | |||
+ | Reccurence: | ||
+ | |||
+ | OPT(i,v): minimum cost of a v-t path P using | ||
+ | at most i edges | ||
+ | This formulation eases later discussion | ||
+ | • Original problem is OPT(n-1, s) | ||
+ | |||
+ | |||
+ | DP | ||
+ | |||
+ | Case 1: P uses at most i-1 edges | ||
+ | • OPT(i, v) = OPT(i-1, v) | ||
+ | Case 2: P uses exactly i edges | ||
+ | • if (v, w) is first edge, then OPT uses (v, w), and | ||
+ | then selects best w-t path using at most i-1 edges | ||
+ | • Cost: cost of chosen edge | ||
+ | |||
+ | Implementation | ||
+ | for every edge number, | ||
+ | for possible node v | ||
+ | for each edge incident to v | ||
+ | find out foreach edge (v, w) ∈ E | ||
+ | M[i, v] = min(M[i, v], M[i-1, w] + cvw ) | ||
+ | |||
+ | |||
+ | O(mn) space. | ||
+ | |||
+ | General process of DP | ||
+ | |||
+ | Review: Dynamic Programming Process | ||
+ | 1. Determine the optimal substructure of the | ||
+ | problem define the recurrence relation | ||
+ | 2. Define the algorithm to find the value of the | ||
+ | optimal solution | ||
+ | 3. Optionally, change the algorithm to an | ||
+ | iterative rather than recursive solution | ||
+ | 4. Define algorithm to find the optimal | ||
+ | solution | ||
+ | 5. Analyze running time of algorithms | ||
+ | |||
+ | |||
+ | Interesting/ | ||
+ | |||
+ | |||
+ | |||
+ | ====== 6.9 Shortest Paths and Distance Vector Protocols ====== | ||
+ | |||
+ | Problem Motivation: | ||
+ | One important application of the Shortest-Path Problem is for routers in a | ||
+ | communication network to determine the most efficient path to a destination. | ||
+ | |||
+ | |||
+ | attempt: | ||
+ | Dijkstra' | ||
+ | we need to work with only local information. | ||
+ | |||
+ | |||
+ | Bellman-Ford uses only local knowledge of | ||
+ | neighboring nodes | ||
+ | Distribute algorithm: each node v maintains its | ||
+ | value M[v] | ||
+ | Updates its value after getting neighbor’s values | ||
+ | |||
+ | |||
+ | Problems with the Distance Vector Protocol | ||
+ | One of the major problems with the distributed implementation of Bellman- | ||
+ | Ford on routers (the protocol we have been discussing above) is that it’s derived | ||
+ | from an initial dynamic programming algorithm that assumes edge costs will | ||
+ | remain constant during the execution of the algorithm. | ||
+ | That is, we might get into a situation where there is infinite looping of mutual dependancy. | ||
+ | |||
+ | could fail if the other node is deleted. | ||
+ | |||
+ | |||
+ | Solution: | ||
+ | |||
+ | Each router stores entire path Not just the distance and the first hop | ||
+ | Based on Dijkstra' | ||
+ | Avoids " | ||
+ | difficulties | ||
+ | Tradeoff: requires significantly more storage | ||
+ | |||
+ | Interesting/ | ||