Linear Programming Flashcards

1
Q

True or false? If an LP is feasible and bounded, the optimum is achieved at a vertex of the feasible region?

A

True.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

When is there no optimal solution to an LP?

A
  • The LP is infeasible. That is, the constraints are so tight that it is impossible to satisfy all of them. For example: x<=1, x>=2. This depends on the constraints.
  • The LP is unbounded. This happens when the constraints are so loose that the feasible region is unbounded and so it is possible to achieve arbitrarily high objective values. This depends on the objective function.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Describe the standard form of an LP

A

n variables, m constraints

n variables: x = x1, x2, …, xn
objective function: max c1 x1 + c2 x2 + … + cn xn
constraints:

Ax <= b:
a11 x1 + … + a1n xn <= b1
a21 x1 + … + a2n xn <= b2
.
.
.
am1 x1 + …. + amn xn <= bm

x >= 0

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Describe the feasible region of an LP with n variables and m constraints

A

The feasible region is the intersection of n+m half-spaces, which is a convex polyhedron.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Describe the simplex algorithm

A

Simplex is a walk on corners:

  1. Start at x=0. If this doesn’t satisfy any m-constrains, this LP is not feasible.
  2. Look for a neighbor vertex with a higher objective value and move there. Repeat until no such neighbor can be found.
  3. Return current location. This is an optimum because the feasible region is convex.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

How can you check if an LP is feasible?

A

Add a z to the constraints (Ax <= b) and solve for a maximum to see if a solution exists:
Ax + z <= b

If z>=0, the LP is feasible. If z<0, it’s not.

If an LP is not feasible, the problem is not solvable.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is the standard form of a dual LP?

A

Given an LP with c, A, x, b with n variables and m constraints:

m variables and n constraints:

m variables (one for each constraint in LP): y1, y2, ..., ym 
objective function: minimize b1 y1 + ... + bm ym 
constraints: 

A^T y >= c:
a11 y1 + a21 y2 + … + am1 ym >= c1
.
.
.
a1n y1 + a2n y2 + … + a mn ym >= cn

y>=0

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Weak duality theorem

A

Take feasible x for primal LP and feasible y for dual LP:
c^T x <= b^T y

**The dual LP solution with y is an upper bound for the primal LP objective function

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

If we find a feasible x for an LP and a feasible y for a dual LP where c^T x = b^T y, what does this imply about x and y? What does it imply about the LP and dual LP?

A

This implies x and y are optimal. It also implies that the primal and dual LPs are feasible and bounded.

This is a corollary of the weak duality theorem.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

True or false? If the primal LP is unbounded, the dual is infeasible?

A

True. This is a corollary of the weak duality theorem. Consider that if the Primal LP can go to infinity, there is no upper bound and so the Dual LP is infeasible.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

True or false? If the dual LP is unbounded, the primal LP is infeasible?

A

True. This is a corollary of the weak duality theorem. Consider that if the Dual LP can go to negative infinity, there is no lower bound and the Primal LP is infeasible.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the strong duality theorem?

A

Primal LP is feasible and bounded IFF the dual LP is feasible and bounded.

Primal LP has an optimal x* IFF dual LP has an optimal y* and c^T x* = b^T y*

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What can you determine from checking whether or not the Dual LP is feasible or not?

A

If the dual LP is infeasible, than the primal LP is either:

  • Infeasible (which can be checked directly using a z)
  • Unbounded (has no optimum)

If the dual LP is feasible, then the primal LP is:
- Bounded (has an optimal)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

We saw three algorithms that we can use to approximate the solution to Max-SAT. What are they called, and what fraction-approximation do they achieve?

A
  1. Simple: 1/2 approximation algorithm.
  2. LP-based: (1-1/e) approximation algorithm.
  3. Best of 2: 3/4 approximation algorithm
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What does it mean to produce a fraction-approximation algorithm to Max-SAT?

A

1/2 approx. algorithm means the algorithm returns l-number of satisfied clauses and l >= m*/2

m* is the maximum number of satisfiable clauses in a given formula f. If #-clauses in f is m, m* <= m.

Generally:
fraction-approximation means l >= fraction x m*

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

True or false? If the primal is infeasible the dual is unbounded.

A

False - we cannot make a statement regarding boundedness only given information about feasibility. The weak duality theorem only implies feasibility of one (dual or optimal) given boundedness of the other.

17
Q

True or false? If the dual is infeasible the primal is unbounded.

A

False - we cannot make a statement regarding boundedness only given information about feasibility. The weak duality theorem only implies feasibility of one (dual or optimal) given boundedness of the other.

18
Q

True or false? If the primal is bounded, the dual is bounded and feasible.

A

True. If the primal is bounded, it must be feasible. If the primal is both bounded and feasible the dual is bounded and feasbile.

19
Q

If the dual is infeasible, and the primal is feasible, what does this imply about the primal?

A

It is unbounded. We know this because the dual is infeasible.

20
Q

True or false? The Halting Problem is NP-Hard?

A

True

21
Q

What does it mean for a problem to be undecidable?

A

This means it is computationally impossible. There is no algorithm that solves a problem on every input even with unlimited time and space.

22
Q

True or False? Integer linear programming is NP-Hard?

A

True

23
Q

True or False? Linear programming (LP) lies in the class P?

A

True.

24
Q

Describe how you can use ILP to approximate a solution to an NP-Hard Problem.

A
  1. Reduce the NP-Hard problem to ILP
  2. Relax to LP and solve
  3. Use randomized rounding to get a solution (a feasible point) to the ILP
25
Q

What is the expected performance of the Best of 2 Alogrithm? What is it on Max-SAT?

A

It’s at least 3/4 of the optimal value. For Max-Sat it gives a 3/4 approximation algorithm, regardless of clause length.

26
Q

If the primal is feasible and the dual is infeasible, what does this imply about the solution to the primal LP?

A

There is no optimal solution.