Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
courses:cs211:winter2011:journals:chen:chapter_6 [2011/03/30 12:56] zhongccourses:cs211:winter2011:journals:chen:chapter_6 [2011/04/06 16:41] (current) – [6.9 Shortest Paths and Distance Vector Protocols] zhongc
Line 200: Line 200:
  
  
 +====== 6.6-6.7 SEQUENCE ALIGNMENT ======
 +Some general context of the problem:
 +
 +Google search and dictionaries have functions that recognizes what the user probably mean when typing in a word
 +that does not exist in the dataset.
 +In order to do 
 +**How should we define similarity between two words or strings?**
 +
 +Dissimilar by gaps and mismatches.
 +
 +
 +Formalized:
 +
 +Sequence Alignment
 +• Goal: Given two strings X = x1 x2 . . . xm and
 +Y = y1 y2 . . . yn find alignment of minimum
 +cost
 +• An alignment M is a set of ordered pairs xi-yj
 +such that each item occurs in at most one
 +pair and no crossings
 +• The pair xi-yj and xi'-yj' cross if i < i', but j > j’.
 +
 +
 +different cases 
 +
 +Case 1: xM and yN are aligned
 +• Pay mismatch for xM-yN + min cost of aligning rest of
 +strings
 +• OPT(M, N) = αXmYn + OPT(M-1, N-1)
 + Case 2: xM is not matched
 +• Pay gap for xM + min cost of aligning rest of strings
 +• OPT(M, N) = δ + OPT(M-1, N)
 + Case 3: yN is not matched
 +• Pay gap for yN + min cost of aligning rest of strings
 +• OPT(M, N) = δ + OPT(M, N-1)
 +
 +
 +Similar to KnapSack problem in the data structure.
 +
 +space O(mn)
 +
 +Can do this in linear space:
 +Collapse into an m x 2 array
 + M[i,0] represents previous row; M[i,1] -- current
 +
 +
 +T(m, n) <= cmn + T(q, n/2) + T(m - q, n/2)
 += cmn + kqn/2 + k(m - q)n/2
 += cmn + kqn/2 + kmn/2 - kqn/2
 += (c + k/2)mn.
 +
 +combination of divide-and-conquer and dynamic programming
 +
 +we can map the problem to shortest path problem on a weighted graph.
 +
 +
 +Divide: find index q that minimizes f(q, n/2) + g(q, n/2) using DP
 +Conquer: recursively compute optimal alignment in each piece.
 +
 +Interesting/readable:7/7
 +
 +
 +
 +====== 6.8 Shortest Paths in a Graph ======
 +
 +Negative weights would change everything that made the Greedy appropriate. Thus we cannot 
 +make decision only relying on local inforamtion at each step b/c a big negative edge that 
 +come later may drastically change the picture.
 +
 +Some constraints:
 +No negative weight cycle
 +If some path from s to t contains a negative
 +cost cycle, there does not exist a shortest s-t
 +path.
 +we can loop forever and get ever smaller.
 +
 +
 +Reccurence:
 +
 +OPT(i,v): minimum cost of a v-t path P using
 +at most i edges
 + This formulation eases later discussion
 +• Original problem is OPT(n-1, s)
 +
 +
 +DP
 +
 + Case 1: P uses at most i-1 edges
 +• OPT(i, v) = OPT(i-1, v)
 + Case 2: P uses exactly i edges
 +• if (v, w) is first edge, then OPT uses (v, w), and
 +then selects best w-t path using at most i-1 edges
 +• Cost: cost of chosen edge
 +
 +Implementation
 +for every edge number,
 +for possible node v
 +for each edge incident to v 
 +find out foreach edge (v, w) ∈ E
 +M[i, v] = min(M[i, v], M[i-1, w] + cvw )
 +
 +
 +O(mn) space.
 +
 +General process of DP
 +
 +Review: Dynamic Programming Process
 +1. Determine the optimal substructure of the
 +problem  define the recurrence relation
 +2. Define the algorithm to find the value of the
 +optimal solution
 +3. Optionally, change the algorithm to an
 +iterative rather than recursive solution
 +4. Define algorithm to find the optimal
 +solution
 +5. Analyze running time of algorithms
 +
 +
 +Interesting/readable: 8/8
 +
 +
 +
 +====== 6.9 Shortest Paths and Distance Vector Protocols ======
 +
 +Problem Motivation:
 +One important application of the Shortest-Path Problem is for routers in a
 +communication network to determine the most efficient path to a destination.
 +
 +
 +attempt:
 +Dijkstra's algorithm requires global information of network- unrealistic
 +we need to work with only local information.
 +
 +
 +Bellman-Ford uses only local knowledge of
 +neighboring nodes
 + Distribute algorithm: each node v maintains its
 +value M[v]
 + Updates its value after getting neighbor’s values
 +
 +
 +Problems with the Distance Vector Protocol
 +One of the major problems with the distributed implementation of Bellman-
 +Ford on routers (the protocol we have been discussing above) is that it’s derived
 +from an initial dynamic programming algorithm that assumes edge costs will
 +remain constant during the execution of the algorithm.
 +That is, we might get into a situation where there is infinite looping of mutual dependancy.
 +
 +could fail if the other node is deleted.
 +
 +
 +Solution:
 +
 + Each router stores entire path Not just the distance and the first hop
 + Based on Dijkstra's algorithm
 + Avoids "counting-to-infinity" problem and related
 +difficulties
 + Tradeoff: requires significantly more storage
 +
 +Interesting/readable: 5/5
  
  
courses/cs211/winter2011/journals/chen/chapter_6.1301489784.txt.gz · Last modified: 2011/03/30 12:56 by zhongc
CC Attribution-Noncommercial-Share Alike 4.0 International
Driven by DokuWiki Recent changes RSS feed Valid CSS Valid XHTML 1.0