Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all...

158
Completely positive and copositive matrices and optimization Bob 0 s birthday conference The Chinese University of Hong Kong November 17, 2013 CP, COP matrices & Optimization 2013 1 / 45

Transcript of Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all...

Page 1: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Completely positive and copositive matricesand optimization

Bob′s birthday conference

The Chinese University of Hong KongNovember 17, 2013

CP, COP matrices & Optimization 2013 1 / 45

Page 2: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Why CP matrices?

Completely positive matrices (and the related copositive matrices) areof interest in mathematical optimization:

Every nonconvex quadratic optimization problem over the simplex,

max{xT Qx |eT x = 1, xi ≥ 0 ∀i},

has an equivalent completely positive formulation (with J = eeT ):

max{〈Q,X 〉 | 〈J,X 〉 = 1,X is CP}.

Thus a nonconvex NP-hard optimization problem is transformed into alinear problem in matrix variables over a convex cone of matrices,shifting the difficulty of the problem entirely into the cone constraint.This makes understanding the cone crucial for tackling the problem.

CP, COP matrices & Optimization 2013 2 / 45

Page 3: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Why CP matrices?

Completely positive matrices (and the related copositive matrices) areof interest in mathematical optimization:

Every nonconvex quadratic optimization problem over the simplex,

max{xT Qx |eT x = 1, xi ≥ 0 ∀i},

has an equivalent completely positive formulation (with J = eeT ):

max{〈Q,X 〉 | 〈J,X 〉 = 1,X is CP}.

Thus a nonconvex NP-hard optimization problem is transformed into alinear problem in matrix variables over a convex cone of matrices,shifting the difficulty of the problem entirely into the cone constraint.This makes understanding the cone crucial for tackling the problem.

CP, COP matrices & Optimization 2013 2 / 45

Page 4: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Why CP matrices?

Completely positive matrices (and the related copositive matrices) areof interest in mathematical optimization:

Every nonconvex quadratic optimization problem over the simplex,

max{xT Qx |eT x = 1, xi ≥ 0 ∀i},

has an equivalent completely positive formulation (with J = eeT ):

max{〈Q,X 〉 | 〈J,X 〉 = 1,X is CP}.

Thus a nonconvex NP-hard optimization problem is transformed into alinear problem in matrix variables over a convex cone of matrices,shifting the difficulty of the problem entirely into the cone constraint.This makes understanding the cone crucial for tackling the problem.

CP, COP matrices & Optimization 2013 2 / 45

Page 5: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

CP matrices & the cp-rank

DefinitionsA matrix A ∈ Rn×n is completely positive (CP) if ∃B ∈ Rn×k s.t.

A = BBT , B ≥ 0. (*)

The minimal number of columns of a B in (*) is cp-rankA.

Notation: CPn is the set of all n × n completely positive matrices.

CPn is a closed convex cone.

Every CP matrix is positive semidefinite and nonnegative (=doublynonnegative (DNN)).The converse holds only for n ≤ 4.

CP, COP matrices & Optimization 2013 3 / 45

Page 6: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

CP matrices & the cp-rank

DefinitionsA matrix A ∈ Rn×n is completely positive (CP) if ∃B ∈ Rn×k s.t.

A = BBT , B ≥ 0. (*)

The minimal number of columns of a B in (*) is cp-rankA.

Notation: CPn is the set of all n × n completely positive matrices.

CPn is a closed convex cone.

Every CP matrix is positive semidefinite and nonnegative (=doublynonnegative (DNN)).The converse holds only for n ≤ 4.

CP, COP matrices & Optimization 2013 3 / 45

Page 7: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

CP matrices & the cp-rank

DefinitionsA matrix A ∈ Rn×n is completely positive (CP) if ∃B ∈ Rn×k s.t.

A = BBT , B ≥ 0. (*)

The minimal number of columns of a B in (*) is cp-rankA.

Notation: CPn is the set of all n × n completely positive matrices.

CPn is a closed convex cone.

Every CP matrix is positive semidefinite and nonnegative (=doublynonnegative (DNN)).The converse holds only for n ≤ 4.

CP, COP matrices & Optimization 2013 3 / 45

Page 8: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

CP matrices & the cp-rank

DefinitionsA matrix A ∈ Rn×n is completely positive (CP) if ∃B ∈ Rn×k s.t.

A = BBT , B ≥ 0. (*)

The minimal number of columns of a B in (*) is cp-rankA.

Notation: CPn is the set of all n × n completely positive matrices.

CPn is a closed convex cone.

Every CP matrix is positive semidefinite and nonnegative (=doublynonnegative (DNN)).The converse holds only for n ≤ 4.

CP, COP matrices & Optimization 2013 3 / 45

Page 9: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

CP matrices & the cp-rank

DefinitionsA matrix A ∈ Rn×n is completely positive (CP) if ∃B ∈ Rn×k s.t.

A = BBT , B ≥ 0. (*)

The minimal number of columns of a B in (*) is cp-rankA.

Notation: CPn is the set of all n × n completely positive matrices.

CPn is a closed convex cone.

Every CP matrix is positive semidefinite and nonnegative (=doublynonnegative (DNN)).The converse holds only for n ≤ 4.

CP, COP matrices & Optimization 2013 3 / 45

Page 10: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

CP matrices & the cp-rank

DefinitionsA matrix A ∈ Rn×n is completely positive (CP) if ∃B ∈ Rn×k s.t.

A = BBT , B ≥ 0. (*)

The minimal number of columns of a B in (*) is cp-rankA.

Notation: CPn is the set of all n × n completely positive matrices.

CPn is a closed convex cone.

Every CP matrix is positive semidefinite and nonnegative (=doublynonnegative (DNN)).

The converse holds only for n ≤ 4.

CP, COP matrices & Optimization 2013 3 / 45

Page 11: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

CP matrices & the cp-rank

DefinitionsA matrix A ∈ Rn×n is completely positive (CP) if ∃B ∈ Rn×k s.t.

A = BBT , B ≥ 0. (*)

The minimal number of columns of a B in (*) is cp-rankA.

Notation: CPn is the set of all n × n completely positive matrices.

CPn is a closed convex cone.

Every CP matrix is positive semidefinite and nonnegative (=doublynonnegative (DNN)).The converse holds only for n ≤ 4.

CP, COP matrices & Optimization 2013 3 / 45

Page 12: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

CP problems

Basic ProblemsIdentify / characterize CP matrices.

Compute / estimate cp-ranks.

Both are open and hard.

CP, COP matrices & Optimization 2013 4 / 45

Page 13: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

CP problems

Basic Problems

Identify / characterize CP matrices.

Compute / estimate cp-ranks.

Both are open and hard.

CP, COP matrices & Optimization 2013 4 / 45

Page 14: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

CP problems

Basic ProblemsIdentify / characterize CP matrices.

Compute / estimate cp-ranks.

Both are open and hard.

CP, COP matrices & Optimization 2013 4 / 45

Page 15: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

CP problems

Basic ProblemsIdentify / characterize CP matrices.

Compute / estimate cp-ranks.

Both are open and hard.

CP, COP matrices & Optimization 2013 4 / 45

Page 16: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

CP problems

Basic ProblemsIdentify / characterize CP matrices.

Compute / estimate cp-ranks.

Both are open and hard.

CP, COP matrices & Optimization 2013 4 / 45

Page 17: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Geometric interpretation

A is PSD ⇔ A =

vT

1

vT2...

vTn

[

v1 v2 · · · vn]

=[〈vi , vj〉

],

where v1, . . . , vn are vectors in an m-dimensional Euclidean space(m = rank A).

A ≥ 0 ⇔ 〈vi , vj〉 ≥ 0 ∀i , j , i.e., the angle between vi and vj is ≤ π2 .

A is CP ⇔ v1, . . . , vn can be isometrically embedded in thenonnegative orthant of some k -dimensional Euclidean space.cp-rank A = minimal such k .

CP, COP matrices & Optimization 2013 5 / 45

Page 18: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Geometric interpretation

A is PSD ⇔ A =

vT

1

vT2...

vTn

[

v1 v2 · · · vn]

=[〈vi , vj〉

],

where v1, . . . , vn are vectors in an m-dimensional Euclidean space(m = rank A).

A ≥ 0 ⇔ 〈vi , vj〉 ≥ 0 ∀i , j , i.e., the angle between vi and vj is ≤ π2 .

A is CP ⇔ v1, . . . , vn can be isometrically embedded in thenonnegative orthant of some k -dimensional Euclidean space.cp-rank A = minimal such k .

CP, COP matrices & Optimization 2013 5 / 45

Page 19: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Geometric interpretation

A is PSD ⇔ A =

vT

1

vT2...

vTn

[

v1 v2 · · · vn]

=[〈vi , vj〉

],

where v1, . . . , vn are vectors in an m-dimensional Euclidean space(m = rank A).

A ≥ 0 ⇔ 〈vi , vj〉 ≥ 0 ∀i , j , i.e., the angle between vi and vj is ≤ π2 .

A is CP ⇔ v1, . . . , vn can be isometrically embedded in thenonnegative orthant of some k -dimensional Euclidean space.cp-rank A = minimal such k .

CP, COP matrices & Optimization 2013 5 / 45

Page 20: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Geometric interpretation

A is PSD ⇔ A =

vT

1

vT2...

vTn

[

v1 v2 · · · vn]

=[〈vi , vj〉

],

where v1, . . . , vn are vectors in an m-dimensional Euclidean space(m = rank A).

A ≥ 0 ⇔ 〈vi , vj〉 ≥ 0 ∀i , j , i.e., the angle between vi and vj is ≤ π2 .

A is CP ⇔ v1, . . . , vn can be isometrically embedded in thenonnegative orthant of some k -dimensional Euclidean space.cp-rank A = minimal such k .

CP, COP matrices & Optimization 2013 5 / 45

Page 21: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Using the geometric approach

yyy

Proves:

TheoremA is DNN and rank A = 2 ⇒ A is CP and cp-rank A = 2.

CP, COP matrices & Optimization 2013 6 / 45

Page 22: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Using the geometric approach

yyy

Proves:

TheoremA is DNN and rank A = 2 ⇒ A is CP and cp-rank A = 2.

CP, COP matrices & Optimization 2013 6 / 45

Page 23: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Using the geometric approach

yyy

Proves:

TheoremA is DNN and rank A = 2 ⇒ A is CP and cp-rank A = 2.

CP, COP matrices & Optimization 2013 6 / 45

Page 24: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Using the geometric approach

yyy

Proves:

TheoremA is DNN and rank A = 2 ⇒ A is CP and cp-rank A = 2.

CP, COP matrices & Optimization 2013 6 / 45

Page 25: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Using the geometric approach

yyy

Proves:

TheoremA is DNN and rank A = 2 ⇒ A is CP and cp-rank A = 2.

CP, COP matrices & Optimization 2013 6 / 45

Page 26: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Using the geometric approach

yyy

Proves:

TheoremA is DNN and rank A = 2 ⇒ A is CP and cp-rank A = 2.

CP, COP matrices & Optimization 2013 6 / 45

Page 27: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Geometric visualisation

4 unit vectors in R3:

Pippal (2013)

CP, COP matrices & Optimization 2013 7 / 45

Page 28: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Geometric visualisation

4 unit vectors in R3:

Pippal (2013)

CP, COP matrices & Optimization 2013 7 / 45

Page 29: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Geometric visualisation

4 unit vectors in R3:

Pippal (2013)

CP, COP matrices & Optimization 2013 7 / 45

Page 30: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Geometric visualisation

4 unit vectors in R3:

Pippal (2013)

CP, COP matrices & Optimization 2013 7 / 45

Page 31: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The combinatorial approach

Many of the known results on CP matrices and the cp-rank aregraph-based.

Definition∀ A ∈ Rn×n symmetric, the graph of A, G(A), is the simple undirectedgraph with vertices {1, . . . ,n}, where ij is an edge if and only ifaji = aij 6= 0.

A = BBT , B = [b1 . . . bm] ⇔ A =∑

bibTi .

B ≥ 0 ⇒ no cancellations in the sum⇒ ∀i , supp bi is a clique in G(A).

CP, COP matrices & Optimization 2013 8 / 45

Page 32: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The combinatorial approach

Many of the known results on CP matrices and the cp-rank aregraph-based.

Definition∀ A ∈ Rn×n symmetric, the graph of A, G(A), is the simple undirectedgraph with vertices {1, . . . ,n}, where ij is an edge if and only ifaji = aij 6= 0.

A = BBT , B = [b1 . . . bm] ⇔ A =∑

bibTi .

B ≥ 0 ⇒ no cancellations in the sum⇒ ∀i , supp bi is a clique in G(A).

CP, COP matrices & Optimization 2013 8 / 45

Page 33: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The combinatorial approach

Many of the known results on CP matrices and the cp-rank aregraph-based.

Definition∀ A ∈ Rn×n symmetric, the graph of A, G(A), is the simple undirectedgraph with vertices {1, . . . ,n}, where ij is an edge if and only ifaji = aij 6= 0.

A = BBT , B = [b1 . . . bm] ⇔ A =∑

bibTi .

B ≥ 0 ⇒ no cancellations in the sum⇒ ∀i , supp bi is a clique in G(A).

CP, COP matrices & Optimization 2013 8 / 45

Page 34: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The combinatorial approach

Many of the known results on CP matrices and the cp-rank aregraph-based.

Definition∀ A ∈ Rn×n symmetric, the graph of A, G(A), is the simple undirectedgraph with vertices {1, . . . ,n}, where ij is an edge if and only ifaji = aij 6= 0.

A = BBT , B = [b1 . . . bm] ⇔ A =∑

bibTi .

B ≥ 0 ⇒ no cancellations in the sum⇒ ∀i , supp bi is a clique in G(A).

CP, COP matrices & Optimization 2013 8 / 45

Page 35: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The combinatorial approach

Many of the known results on CP matrices and the cp-rank aregraph-based.

Definition∀ A ∈ Rn×n symmetric, the graph of A, G(A), is the simple undirectedgraph with vertices {1, . . . ,n}, where ij is an edge if and only ifaji = aij 6= 0.

A = BBT , B = [b1 . . . bm] ⇔ A =∑

bibTi .

B ≥ 0 ⇒ no cancellations in the sum

⇒ ∀i , supp bi is a clique in G(A).

CP, COP matrices & Optimization 2013 8 / 45

Page 36: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The combinatorial approach

Many of the known results on CP matrices and the cp-rank aregraph-based.

Definition∀ A ∈ Rn×n symmetric, the graph of A, G(A), is the simple undirectedgraph with vertices {1, . . . ,n}, where ij is an edge if and only ifaji = aij 6= 0.

A = BBT , B = [b1 . . . bm] ⇔ A =∑

bibTi .

B ≥ 0 ⇒ no cancellations in the sum⇒ ∀i , supp bi is a clique in G(A).

CP, COP matrices & Optimization 2013 8 / 45

Page 37: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Using the combinatorial approach

DefinitionsA graph G is completely positive (CP) ifA is DNN & G(A) = G ⇒ A is CP.

TheoremA graph G is CP ⇔ G contains no long (length ≥ 5) odd cycle.

Berman & Kogan (1993), Ando (1991). Also: Drew & Johnson (1996)Used in proof: Berman & Hershkowitz (1987), Berman & Grone (1988)

The key: A No Long Odd Cycle graph looks like that:

CP, COP matrices & Optimization 2013 9 / 45

Page 38: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Using the combinatorial approach

Definitions

A graph G is completely positive (CP) ifA is DNN & G(A) = G ⇒ A is CP.

TheoremA graph G is CP ⇔ G contains no long (length ≥ 5) odd cycle.

Berman & Kogan (1993), Ando (1991). Also: Drew & Johnson (1996)Used in proof: Berman & Hershkowitz (1987), Berman & Grone (1988)

The key: A No Long Odd Cycle graph looks like that:

CP, COP matrices & Optimization 2013 9 / 45

Page 39: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Using the combinatorial approach

DefinitionsA graph G is completely positive (CP) ifA is DNN & G(A) = G ⇒ A is CP.

TheoremA graph G is CP ⇔ G contains no long (length ≥ 5) odd cycle.

Berman & Kogan (1993), Ando (1991). Also: Drew & Johnson (1996)Used in proof: Berman & Hershkowitz (1987), Berman & Grone (1988)

The key: A No Long Odd Cycle graph looks like that:

CP, COP matrices & Optimization 2013 9 / 45

Page 40: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Using the combinatorial approach

DefinitionsA graph G is completely positive (CP) ifA is DNN & G(A) = G ⇒ A is CP.

TheoremA graph G is CP ⇔ G contains no long (length ≥ 5) odd cycle.

Berman & Kogan (1993), Ando (1991). Also: Drew & Johnson (1996)Used in proof: Berman & Hershkowitz (1987), Berman & Grone (1988)

The key: A No Long Odd Cycle graph looks like that:

CP, COP matrices & Optimization 2013 9 / 45

Page 41: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Using the combinatorial approach

DefinitionsA graph G is completely positive (CP) ifA is DNN & G(A) = G ⇒ A is CP.

TheoremA graph G is CP ⇔ G contains no long (length ≥ 5) odd cycle.

Berman & Kogan (1993), Ando (1991). Also: Drew & Johnson (1996)Used in proof: Berman & Hershkowitz (1987), Berman & Grone (1988)

The key: A No Long Odd Cycle graph looks like that:

CP, COP matrices & Optimization 2013 9 / 45

Page 42: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Each block is bipartite / has at most 4 vertices / consists of triangleswith a common base.

CP, COP matrices & Optimization 2013 10 / 45

Page 43: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Each block is bipartite

/ has at most 4 vertices / consists of triangleswith a common base.

CP, COP matrices & Optimization 2013 10 / 45

Page 44: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Each block is bipartite / has at most 4 vertices

/ consists of triangleswith a common base.

CP, COP matrices & Optimization 2013 10 / 45

Page 45: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Each block is bipartite / has at most 4 vertices / consists of triangleswith a common base.

CP, COP matrices & Optimization 2013 10 / 45

Page 46: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Each block is bipartite / has at most 4 vertices / consists of triangleswith a common base.

CP, COP matrices & Optimization 2013 10 / 45

Page 47: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Using the combinatorial approach (2)

Note: For every CP matrix, cp-rank A ≥ rank A.

TheoremEvery CP matrix A with G(A) = G satisfies cp-rank A = rank A if andonly if G contains no even cycle, and no triangle-free graph with moreedges than vertices.

Shaked-Monderer (2001)

The key: Such a graph looks like that:

CP, COP matrices & Optimization 2013 11 / 45

Page 48: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Using the combinatorial approach (2)

Note: For every CP matrix, cp-rank A ≥ rank A.

TheoremEvery CP matrix A with G(A) = G satisfies cp-rank A = rank A if andonly if G contains no even cycle, and no triangle-free graph with moreedges than vertices.

Shaked-Monderer (2001)

The key: Such a graph looks like that:

CP, COP matrices & Optimization 2013 11 / 45

Page 49: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Using the combinatorial approach (2)

Note: For every CP matrix, cp-rank A ≥ rank A.

TheoremEvery CP matrix A with G(A) = G satisfies cp-rank A = rank A if andonly if G contains no even cycle, and no triangle-free graph with moreedges than vertices.

Shaked-Monderer (2001)

The key: Such a graph looks like that:

CP, COP matrices & Optimization 2013 11 / 45

Page 50: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Using the combinatorial approach (2)

Note: For every CP matrix, cp-rank A ≥ rank A.

TheoremEvery CP matrix A with G(A) = G satisfies cp-rank A = rank A if andonly if G contains no even cycle, and no triangle-free graph with moreedges than vertices.

Shaked-Monderer (2001)

The key: Such a graph looks like that:

CP, COP matrices & Optimization 2013 11 / 45

Page 51: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Each block is an edge / an odd cycle; at most one odd cycle is long.

CP, COP matrices & Optimization 2013 12 / 45

Page 52: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Each block is an edge

/ an odd cycle; at most one odd cycle is long.

CP, COP matrices & Optimization 2013 12 / 45

Page 53: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Each block is an edge / an odd cycle;

at most one odd cycle is long.

CP, COP matrices & Optimization 2013 12 / 45

Page 54: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Each block is an edge / an odd cycle; at most one odd cycle is long.

CP, COP matrices & Optimization 2013 12 / 45

Page 55: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Upper bounds on the cp-rank

ProblemFind a (sharp) upper bound on the cp-ranks of matrices in CPn.

Known upper boundsFor n ≤ 4: A ∈ CPn ⇒ cp-rank A ≤ n.

Maxfield & Minc (1962)Sharp! Since cp-rank A ≥ rank A.∀n ≥ 2: A ∈ CPn ⇒ cp-rank A ≤

(n+12

)− 1.

Hannah & Laffey (1983); Barioli & Berman (2003)Sharp? Not for 3 ≤ n ≤ 4. Maybe for n ≥ 5?

The case n ≥ 5 is a totally different:

Difficulty in identifying CP matrices;

Bound definitely > n: ∀n ≥ 5, ∃A ∈ CPn with cp-rank A = bn2/4c.

CP, COP matrices & Optimization 2013 13 / 45

Page 56: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Upper bounds on the cp-rank

ProblemFind a (sharp) upper bound on the cp-ranks of matrices in CPn.

Known upper boundsFor n ≤ 4: A ∈ CPn ⇒ cp-rank A ≤ n.

Maxfield & Minc (1962)Sharp! Since cp-rank A ≥ rank A.∀n ≥ 2: A ∈ CPn ⇒ cp-rank A ≤

(n+12

)− 1.

Hannah & Laffey (1983); Barioli & Berman (2003)Sharp? Not for 3 ≤ n ≤ 4. Maybe for n ≥ 5?

The case n ≥ 5 is a totally different:

Difficulty in identifying CP matrices;

Bound definitely > n: ∀n ≥ 5, ∃A ∈ CPn with cp-rank A = bn2/4c.

CP, COP matrices & Optimization 2013 13 / 45

Page 57: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Upper bounds on the cp-rank

ProblemFind a (sharp) upper bound on the cp-ranks of matrices in CPn.

Known upper bounds

For n ≤ 4: A ∈ CPn ⇒ cp-rank A ≤ n.Maxfield & Minc (1962)

Sharp! Since cp-rank A ≥ rank A.∀n ≥ 2: A ∈ CPn ⇒ cp-rank A ≤

(n+12

)− 1.

Hannah & Laffey (1983); Barioli & Berman (2003)Sharp? Not for 3 ≤ n ≤ 4. Maybe for n ≥ 5?

The case n ≥ 5 is a totally different:

Difficulty in identifying CP matrices;

Bound definitely > n: ∀n ≥ 5, ∃A ∈ CPn with cp-rank A = bn2/4c.

CP, COP matrices & Optimization 2013 13 / 45

Page 58: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Upper bounds on the cp-rank

ProblemFind a (sharp) upper bound on the cp-ranks of matrices in CPn.

Known upper boundsFor n ≤ 4: A ∈ CPn ⇒ cp-rank A ≤ n.

Maxfield & Minc (1962)

Sharp! Since cp-rank A ≥ rank A.∀n ≥ 2: A ∈ CPn ⇒ cp-rank A ≤

(n+12

)− 1.

Hannah & Laffey (1983); Barioli & Berman (2003)Sharp? Not for 3 ≤ n ≤ 4. Maybe for n ≥ 5?

The case n ≥ 5 is a totally different:

Difficulty in identifying CP matrices;

Bound definitely > n: ∀n ≥ 5, ∃A ∈ CPn with cp-rank A = bn2/4c.

CP, COP matrices & Optimization 2013 13 / 45

Page 59: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Upper bounds on the cp-rank

ProblemFind a (sharp) upper bound on the cp-ranks of matrices in CPn.

Known upper boundsFor n ≤ 4: A ∈ CPn ⇒ cp-rank A ≤ n.

Maxfield & Minc (1962)Sharp!

Since cp-rank A ≥ rank A.∀n ≥ 2: A ∈ CPn ⇒ cp-rank A ≤

(n+12

)− 1.

Hannah & Laffey (1983); Barioli & Berman (2003)Sharp? Not for 3 ≤ n ≤ 4. Maybe for n ≥ 5?

The case n ≥ 5 is a totally different:

Difficulty in identifying CP matrices;

Bound definitely > n: ∀n ≥ 5, ∃A ∈ CPn with cp-rank A = bn2/4c.

CP, COP matrices & Optimization 2013 13 / 45

Page 60: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Upper bounds on the cp-rank

ProblemFind a (sharp) upper bound on the cp-ranks of matrices in CPn.

Known upper boundsFor n ≤ 4: A ∈ CPn ⇒ cp-rank A ≤ n.

Maxfield & Minc (1962)Sharp! Since cp-rank A ≥ rank A.

∀n ≥ 2: A ∈ CPn ⇒ cp-rank A ≤(n+1

2

)− 1.

Hannah & Laffey (1983); Barioli & Berman (2003)Sharp? Not for 3 ≤ n ≤ 4. Maybe for n ≥ 5?

The case n ≥ 5 is a totally different:

Difficulty in identifying CP matrices;

Bound definitely > n: ∀n ≥ 5, ∃A ∈ CPn with cp-rank A = bn2/4c.

CP, COP matrices & Optimization 2013 13 / 45

Page 61: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Upper bounds on the cp-rank

ProblemFind a (sharp) upper bound on the cp-ranks of matrices in CPn.

Known upper boundsFor n ≤ 4: A ∈ CPn ⇒ cp-rank A ≤ n.

Maxfield & Minc (1962)Sharp! Since cp-rank A ≥ rank A.∀n ≥ 2: A ∈ CPn ⇒ cp-rank A ≤

(n+12

)− 1.

Hannah & Laffey (1983); Barioli & Berman (2003)

Sharp? Not for 3 ≤ n ≤ 4. Maybe for n ≥ 5?

The case n ≥ 5 is a totally different:

Difficulty in identifying CP matrices;

Bound definitely > n: ∀n ≥ 5, ∃A ∈ CPn with cp-rank A = bn2/4c.

CP, COP matrices & Optimization 2013 13 / 45

Page 62: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Upper bounds on the cp-rank

ProblemFind a (sharp) upper bound on the cp-ranks of matrices in CPn.

Known upper boundsFor n ≤ 4: A ∈ CPn ⇒ cp-rank A ≤ n.

Maxfield & Minc (1962)Sharp! Since cp-rank A ≥ rank A.∀n ≥ 2: A ∈ CPn ⇒ cp-rank A ≤

(n+12

)− 1.

Hannah & Laffey (1983); Barioli & Berman (2003)Sharp?

Not for 3 ≤ n ≤ 4. Maybe for n ≥ 5?

The case n ≥ 5 is a totally different:

Difficulty in identifying CP matrices;

Bound definitely > n: ∀n ≥ 5, ∃A ∈ CPn with cp-rank A = bn2/4c.

CP, COP matrices & Optimization 2013 13 / 45

Page 63: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Upper bounds on the cp-rank

ProblemFind a (sharp) upper bound on the cp-ranks of matrices in CPn.

Known upper boundsFor n ≤ 4: A ∈ CPn ⇒ cp-rank A ≤ n.

Maxfield & Minc (1962)Sharp! Since cp-rank A ≥ rank A.∀n ≥ 2: A ∈ CPn ⇒ cp-rank A ≤

(n+12

)− 1.

Hannah & Laffey (1983); Barioli & Berman (2003)Sharp? Not for 3 ≤ n ≤ 4. Maybe for n ≥ 5?

The case n ≥ 5 is a totally different:

Difficulty in identifying CP matrices;

Bound definitely > n: ∀n ≥ 5, ∃A ∈ CPn with cp-rank A = bn2/4c.

CP, COP matrices & Optimization 2013 13 / 45

Page 64: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Upper bounds on the cp-rank

ProblemFind a (sharp) upper bound on the cp-ranks of matrices in CPn.

Known upper boundsFor n ≤ 4: A ∈ CPn ⇒ cp-rank A ≤ n.

Maxfield & Minc (1962)Sharp! Since cp-rank A ≥ rank A.∀n ≥ 2: A ∈ CPn ⇒ cp-rank A ≤

(n+12

)− 1.

Hannah & Laffey (1983); Barioli & Berman (2003)Sharp? Not for 3 ≤ n ≤ 4. Maybe for n ≥ 5?

The case n ≥ 5 is a totally different:

Difficulty in identifying CP matrices;

Bound definitely > n: ∀n ≥ 5, ∃A ∈ CPn with cp-rank A = bn2/4c.

CP, COP matrices & Optimization 2013 13 / 45

Page 65: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Upper bounds on the cp-rank

ProblemFind a (sharp) upper bound on the cp-ranks of matrices in CPn.

Known upper boundsFor n ≤ 4: A ∈ CPn ⇒ cp-rank A ≤ n.

Maxfield & Minc (1962)Sharp! Since cp-rank A ≥ rank A.∀n ≥ 2: A ∈ CPn ⇒ cp-rank A ≤

(n+12

)− 1.

Hannah & Laffey (1983); Barioli & Berman (2003)Sharp? Not for 3 ≤ n ≤ 4. Maybe for n ≥ 5?

The case n ≥ 5 is a totally different:

Difficulty in identifying CP matrices;

Bound definitely > n: ∀n ≥ 5, ∃A ∈ CPn with cp-rank A = bn2/4c.

CP, COP matrices & Optimization 2013 13 / 45

Page 66: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Upper bounds on the cp-rank

ProblemFind a (sharp) upper bound on the cp-ranks of matrices in CPn.

Known upper boundsFor n ≤ 4: A ∈ CPn ⇒ cp-rank A ≤ n.

Maxfield & Minc (1962)Sharp! Since cp-rank A ≥ rank A.∀n ≥ 2: A ∈ CPn ⇒ cp-rank A ≤

(n+12

)− 1.

Hannah & Laffey (1983); Barioli & Berman (2003)Sharp? Not for 3 ≤ n ≤ 4. Maybe for n ≥ 5?

The case n ≥ 5 is a totally different:

Difficulty in identifying CP matrices;

Bound definitely > n: ∀n ≥ 5, ∃A ∈ CPn with cp-rank A = bn2/4c.

CP, COP matrices & Optimization 2013 13 / 45

Page 67: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The DJL conjecture∀n ≥ 4: A ∈ CPn ⇒ cp-rank A ≤ bn2/4c.

Drew, Johnson & Loewy (1994)

The DJL bound holds for A ∈ CPn

when G(A) is triangle free, or Drew, Johnson & Loewy (1994)

when G(A) has no long odd cycle, or Drew & Johnson (1996)

when M(A) is positive semidefinite, or Berman & S-M (1998)

when n = 5, and A has at least one zero. Loewy & Tam (2003)

(Here G(A) is the graph of the matrix A, M(A) is the comparison matrixof A).

Common thread in most results: deal with matrices on ∂CPn.

CP, COP matrices & Optimization 2013 14 / 45

Page 68: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The DJL conjecture∀n ≥ 4: A ∈ CPn ⇒ cp-rank A ≤ bn2/4c.

Drew, Johnson & Loewy (1994)

The DJL bound holds for A ∈ CPn

when G(A) is triangle free, or Drew, Johnson & Loewy (1994)

when G(A) has no long odd cycle, or Drew & Johnson (1996)

when M(A) is positive semidefinite, or Berman & S-M (1998)

when n = 5, and A has at least one zero. Loewy & Tam (2003)

(Here G(A) is the graph of the matrix A, M(A) is the comparison matrixof A).

Common thread in most results: deal with matrices on ∂CPn.

CP, COP matrices & Optimization 2013 14 / 45

Page 69: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The DJL conjecture∀n ≥ 4: A ∈ CPn ⇒ cp-rank A ≤ bn2/4c.

Drew, Johnson & Loewy (1994)

The DJL bound holds for A ∈ CPn

when G(A) is triangle free, or Drew, Johnson & Loewy (1994)

when G(A) has no long odd cycle, or Drew & Johnson (1996)

when M(A) is positive semidefinite, or Berman & S-M (1998)

when n = 5, and A has at least one zero. Loewy & Tam (2003)

(Here G(A) is the graph of the matrix A, M(A) is the comparison matrixof A).

Common thread in most results: deal with matrices on ∂CPn.

CP, COP matrices & Optimization 2013 14 / 45

Page 70: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The DJL conjecture∀n ≥ 4: A ∈ CPn ⇒ cp-rank A ≤ bn2/4c.

Drew, Johnson & Loewy (1994)

The DJL bound holds for A ∈ CPn

when G(A) is triangle free, or Drew, Johnson & Loewy (1994)

when G(A) has no long odd cycle, or Drew & Johnson (1996)

when M(A) is positive semidefinite, or Berman & S-M (1998)

when n = 5, and A has at least one zero. Loewy & Tam (2003)

(Here G(A) is the graph of the matrix A, M(A) is the comparison matrixof A).

Common thread in most results: deal with matrices on ∂CPn.

CP, COP matrices & Optimization 2013 14 / 45

Page 71: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The DJL conjecture∀n ≥ 4: A ∈ CPn ⇒ cp-rank A ≤ bn2/4c.

Drew, Johnson & Loewy (1994)

The DJL bound holds for A ∈ CPn

when G(A) is triangle free, or Drew, Johnson & Loewy (1994)

when G(A) has no long odd cycle, or Drew & Johnson (1996)

when M(A) is positive semidefinite, or Berman & S-M (1998)

when n = 5, and A has at least one zero. Loewy & Tam (2003)

(Here G(A) is the graph of the matrix A, M(A) is the comparison matrixof A).

Common thread in most results: deal with matrices on ∂CPn.

CP, COP matrices & Optimization 2013 14 / 45

Page 72: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The DJL conjecture∀n ≥ 4: A ∈ CPn ⇒ cp-rank A ≤ bn2/4c.

Drew, Johnson & Loewy (1994)

The DJL bound holds for A ∈ CPn

when G(A) is triangle free, or Drew, Johnson & Loewy (1994)

when G(A) has no long odd cycle, or Drew & Johnson (1996)

when M(A) is positive semidefinite, or Berman & S-M (1998)

when n = 5, and A has at least one zero. Loewy & Tam (2003)

(Here G(A) is the graph of the matrix A, M(A) is the comparison matrixof A).

Common thread in most results: deal with matrices on ∂CPn.

CP, COP matrices & Optimization 2013 14 / 45

Page 73: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The DJL conjecture∀n ≥ 4: A ∈ CPn ⇒ cp-rank A ≤ bn2/4c.

Drew, Johnson & Loewy (1994)

The DJL bound holds for A ∈ CPn

when G(A) is triangle free, or Drew, Johnson & Loewy (1994)

when G(A) has no long odd cycle, or Drew & Johnson (1996)

when M(A) is positive semidefinite, or Berman & S-M (1998)

when n = 5, and A has at least one zero. Loewy & Tam (2003)

(Here G(A) is the graph of the matrix A, M(A) is the comparison matrixof A).

Common thread in most results: deal with matrices on ∂CPn.

CP, COP matrices & Optimization 2013 14 / 45

Page 74: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The DJL conjecture∀n ≥ 4: A ∈ CPn ⇒ cp-rank A ≤ bn2/4c.

Drew, Johnson & Loewy (1994)

The DJL bound holds for A ∈ CPn

when G(A) is triangle free, or Drew, Johnson & Loewy (1994)

when G(A) has no long odd cycle, or Drew & Johnson (1996)

when M(A) is positive semidefinite, or Berman & S-M (1998)

when n = 5, and A has at least one zero. Loewy & Tam (2003)

(Here G(A) is the graph of the matrix A, M(A) is the comparison matrixof A).

Common thread in most results: deal with matrices on ∂CPn.

CP, COP matrices & Optimization 2013 14 / 45

Page 75: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Are we looking under the lamp-post?

Long known resultThe maximum cp-rank on CPn is attained on int CPn.

Proof:Am → A & ∀m Am ∈ CPn, cp-rank Am ≤ k =⇒ cp-rank A ≤ k .

A ∈ ∂CPn =⇒ ∃ (Am)∞m=1 ⊆ int CPn s.t. Am → A.

Long asked questionIs the maximum also attained on the boundary?

CP, COP matrices & Optimization 2013 15 / 45

Page 76: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Are we looking under the lamp-post?

Long known resultThe maximum cp-rank on CPn is attained on int CPn.

Proof:Am → A & ∀m Am ∈ CPn, cp-rank Am ≤ k =⇒ cp-rank A ≤ k .

A ∈ ∂CPn =⇒ ∃ (Am)∞m=1 ⊆ int CPn s.t. Am → A.

Long asked questionIs the maximum also attained on the boundary?

CP, COP matrices & Optimization 2013 15 / 45

Page 77: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Are we looking under the lamp-post?

Long known resultThe maximum cp-rank on CPn is attained on int CPn.

Proof:

Am → A & ∀m Am ∈ CPn, cp-rank Am ≤ k =⇒ cp-rank A ≤ k .

A ∈ ∂CPn =⇒ ∃ (Am)∞m=1 ⊆ int CPn s.t. Am → A.

Long asked questionIs the maximum also attained on the boundary?

CP, COP matrices & Optimization 2013 15 / 45

Page 78: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Are we looking under the lamp-post?

Long known resultThe maximum cp-rank on CPn is attained on int CPn.

Proof:Am → A & ∀m Am ∈ CPn, cp-rank Am ≤ k =⇒ cp-rank A ≤ k .

A ∈ ∂CPn =⇒ ∃ (Am)∞m=1 ⊆ int CPn s.t. Am → A.

Long asked questionIs the maximum also attained on the boundary?

CP, COP matrices & Optimization 2013 15 / 45

Page 79: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Are we looking under the lamp-post?

Long known resultThe maximum cp-rank on CPn is attained on int CPn.

Proof:Am → A & ∀m Am ∈ CPn, cp-rank Am ≤ k =⇒ cp-rank A ≤ k .

A ∈ ∂CPn =⇒ ∃ (Am)∞m=1 ⊆ int CPn s.t. Am → A.

Long asked questionIs the maximum also attained on the boundary?

CP, COP matrices & Optimization 2013 15 / 45

Page 80: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Are we looking under the lamp-post?

Long known resultThe maximum cp-rank on CPn is attained on int CPn.

Proof:Am → A & ∀m Am ∈ CPn, cp-rank Am ≤ k =⇒ cp-rank A ≤ k .

A ∈ ∂CPn =⇒ ∃ (Am)∞m=1 ⊆ int CPn s.t. Am → A.

Long asked questionIs the maximum also attained on the boundary?

CP, COP matrices & Optimization 2013 15 / 45

Page 81: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Recent Results

Theorem 1∀n ≥ 2, the maximum of the cp-rank on CPn is attained at anonsingular matrix on ∂CPn.

Shaked-Monderer, Bomze, Jarre & Schachinger (2013)

So, considering matrices on the boundary is OK. But who are they?

intCPn and ∂CPn

A ∈ int CPn ⇐⇒ A = BBT , B ≥ 0 has rank n & a positive column.Dür & Still (2008), Dickinson (2010)

A ∈ ∂CPn ⇐⇒ A⊥X for a copositive X .(w.r.t. 〈A,X 〉 = trace(AX T ).)

CP, COP matrices & Optimization 2013 16 / 45

Page 82: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Recent Results

Theorem 1∀n ≥ 2, the maximum of the cp-rank on CPn is attained at anonsingular matrix on ∂CPn.

Shaked-Monderer, Bomze, Jarre & Schachinger (2013)

So, considering matrices on the boundary is OK. But who are they?

intCPn and ∂CPn

A ∈ int CPn ⇐⇒ A = BBT , B ≥ 0 has rank n & a positive column.Dür & Still (2008), Dickinson (2010)

A ∈ ∂CPn ⇐⇒ A⊥X for a copositive X .(w.r.t. 〈A,X 〉 = trace(AX T ).)

CP, COP matrices & Optimization 2013 16 / 45

Page 83: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Recent Results

Theorem 1∀n ≥ 2, the maximum of the cp-rank on CPn is attained at anonsingular matrix on ∂CPn.

Shaked-Monderer, Bomze, Jarre & Schachinger (2013)

So, considering matrices on the boundary is OK. But who are they?

intCPn and ∂CPn

A ∈ int CPn ⇐⇒ A = BBT , B ≥ 0 has rank n & a positive column.Dür & Still (2008), Dickinson (2010)

A ∈ ∂CPn ⇐⇒ A⊥X for a copositive X .(w.r.t. 〈A,X 〉 = trace(AX T ).)

CP, COP matrices & Optimization 2013 16 / 45

Page 84: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Recent Results

Theorem 1∀n ≥ 2, the maximum of the cp-rank on CPn is attained at anonsingular matrix on ∂CPn.

Shaked-Monderer, Bomze, Jarre & Schachinger (2013)

So, considering matrices on the boundary is OK. But who are they?

intCPn and ∂CPn

A ∈ int CPn ⇐⇒ A = BBT , B ≥ 0 has rank n & a positive column.Dür & Still (2008), Dickinson (2010)

A ∈ ∂CPn ⇐⇒ A⊥X for a copositive X .(w.r.t. 〈A,X 〉 = trace(AX T ).)

CP, COP matrices & Optimization 2013 16 / 45

Page 85: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Recent Results

Theorem 1∀n ≥ 2, the maximum of the cp-rank on CPn is attained at anonsingular matrix on ∂CPn.

Shaked-Monderer, Bomze, Jarre & Schachinger (2013)

So, considering matrices on the boundary is OK. But who are they?

intCPn and ∂CPn

A ∈ int CPn ⇐⇒ A = BBT , B ≥ 0 has rank n & a positive column.Dür & Still (2008), Dickinson (2010)

A ∈ ∂CPn ⇐⇒ A⊥X for a copositive X .(w.r.t. 〈A,X 〉 = trace(AX T ).)

CP, COP matrices & Optimization 2013 16 / 45

Page 86: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Recent Results

Theorem 1∀n ≥ 2, the maximum of the cp-rank on CPn is attained at anonsingular matrix on ∂CPn.

Shaked-Monderer, Bomze, Jarre & Schachinger (2013)

So, considering matrices on the boundary is OK. But who are they?

intCPn and ∂CPn

A ∈ int CPn ⇐⇒ A = BBT , B ≥ 0 has rank n & a positive column.Dür & Still (2008), Dickinson (2010)

A ∈ ∂CPn ⇐⇒ A⊥X for a copositive X .(w.r.t. 〈A,X 〉 = trace(AX T ).)

CP, COP matrices & Optimization 2013 16 / 45

Page 87: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Recent Results

Theorem 1∀n ≥ 2, the maximum of the cp-rank on CPn is attained at anonsingular matrix on ∂CPn.

Shaked-Monderer, Bomze, Jarre & Schachinger (2013)

So, considering matrices on the boundary is OK. But who are they?

intCPn and ∂CPn

A ∈ int CPn ⇐⇒ A = BBT , B ≥ 0 has rank n & a positive column.Dür & Still (2008), Dickinson (2010)

A ∈ ∂CPn ⇐⇒ A⊥X for a copositive X .

(w.r.t. 〈A,X 〉 = trace(AX T ).)

CP, COP matrices & Optimization 2013 16 / 45

Page 88: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Recent Results

Theorem 1∀n ≥ 2, the maximum of the cp-rank on CPn is attained at anonsingular matrix on ∂CPn.

Shaked-Monderer, Bomze, Jarre & Schachinger (2013)

So, considering matrices on the boundary is OK. But who are they?

intCPn and ∂CPn

A ∈ int CPn ⇐⇒ A = BBT , B ≥ 0 has rank n & a positive column.Dür & Still (2008), Dickinson (2010)

A ∈ ∂CPn ⇐⇒ A⊥X for a copositive X .(w.r.t. 〈A,X 〉 = trace(AX T ).)

CP, COP matrices & Optimization 2013 16 / 45

Page 89: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

COP matrices

DefinitionsA symmetric A ∈ Rn×n is copositive (COP) if xT Ax ≥ 0 ∀x ∈ Rn

+.

Notation: COPn is the set of all n × n copositive matrices.

Every Positive semidefinite matrix, and every nonnegative matrix, isCOP. Sums of such matrices also.For n ≥ 5 there are also others. Example: the Horn matrix

H =

1 −1 1 1 −1−1 1 −1 1 1

1 −1 1 −1 11 1 −1 1 −1−1 1 1 −1 1

and more.

COPn is a closed convex cone.

CP, COP matrices & Optimization 2013 17 / 45

Page 90: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

COP matrices

Definitions

A symmetric A ∈ Rn×n is copositive (COP) if xT Ax ≥ 0 ∀x ∈ Rn+.

Notation: COPn is the set of all n × n copositive matrices.

Every Positive semidefinite matrix, and every nonnegative matrix, isCOP. Sums of such matrices also.For n ≥ 5 there are also others. Example: the Horn matrix

H =

1 −1 1 1 −1−1 1 −1 1 1

1 −1 1 −1 11 1 −1 1 −1−1 1 1 −1 1

and more.

COPn is a closed convex cone.

CP, COP matrices & Optimization 2013 17 / 45

Page 91: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

COP matrices

DefinitionsA symmetric A ∈ Rn×n is copositive (COP) if xT Ax ≥ 0 ∀x ∈ Rn

+.

Notation: COPn is the set of all n × n copositive matrices.

Every Positive semidefinite matrix, and every nonnegative matrix, isCOP. Sums of such matrices also.For n ≥ 5 there are also others. Example: the Horn matrix

H =

1 −1 1 1 −1−1 1 −1 1 1

1 −1 1 −1 11 1 −1 1 −1−1 1 1 −1 1

and more.

COPn is a closed convex cone.

CP, COP matrices & Optimization 2013 17 / 45

Page 92: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

COP matrices

DefinitionsA symmetric A ∈ Rn×n is copositive (COP) if xT Ax ≥ 0 ∀x ∈ Rn

+.

Notation: COPn is the set of all n × n copositive matrices.

Every Positive semidefinite matrix, and every nonnegative matrix, isCOP. Sums of such matrices also.For n ≥ 5 there are also others. Example: the Horn matrix

H =

1 −1 1 1 −1−1 1 −1 1 1

1 −1 1 −1 11 1 −1 1 −1−1 1 1 −1 1

and more.

COPn is a closed convex cone.

CP, COP matrices & Optimization 2013 17 / 45

Page 93: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

COP matrices

DefinitionsA symmetric A ∈ Rn×n is copositive (COP) if xT Ax ≥ 0 ∀x ∈ Rn

+.

Notation: COPn is the set of all n × n copositive matrices.

Every Positive semidefinite matrix, and every nonnegative matrix, isCOP. Sums of such matrices also.

For n ≥ 5 there are also others. Example: the Horn matrix

H =

1 −1 1 1 −1−1 1 −1 1 1

1 −1 1 −1 11 1 −1 1 −1−1 1 1 −1 1

and more.

COPn is a closed convex cone.

CP, COP matrices & Optimization 2013 17 / 45

Page 94: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

COP matrices

DefinitionsA symmetric A ∈ Rn×n is copositive (COP) if xT Ax ≥ 0 ∀x ∈ Rn

+.

Notation: COPn is the set of all n × n copositive matrices.

Every Positive semidefinite matrix, and every nonnegative matrix, isCOP. Sums of such matrices also.For n ≥ 5 there are also others. Example: the Horn matrix

H =

1 −1 1 1 −1−1 1 −1 1 1

1 −1 1 −1 11 1 −1 1 −1−1 1 1 −1 1

and more.

COPn is a closed convex cone.

CP, COP matrices & Optimization 2013 17 / 45

Page 95: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

COP matrices

DefinitionsA symmetric A ∈ Rn×n is copositive (COP) if xT Ax ≥ 0 ∀x ∈ Rn

+.

Notation: COPn is the set of all n × n copositive matrices.

Every Positive semidefinite matrix, and every nonnegative matrix, isCOP. Sums of such matrices also.For n ≥ 5 there are also others. Example: the Horn matrix

H =

1 −1 1 1 −1−1 1 −1 1 1

1 −1 1 −1 11 1 −1 1 −1−1 1 1 −1 1

and more.

COPn is a closed convex cone.

CP, COP matrices & Optimization 2013 17 / 45

Page 96: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The cones CPn and COPn

CPn, COPn

CPn & COPn are convex cones with non-empty interiors.

CPn = {A |A = AT & 〈A,X 〉 ≥ 0 ∀X ∈ COPn}, and vice versa.(CPn and COPn are dual cones).

For A ∈ CPn: A ∈ ∂CPn ⇔ 〈A,X 〉 = 0 for some X ∈ ext(COPn).

CP, COP matrices & Optimization 2013 18 / 45

Page 97: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The cones CPn and COPn

CPn, COPn

CPn & COPn are convex cones with non-empty interiors.

CPn = {A |A = AT & 〈A,X 〉 ≥ 0 ∀X ∈ COPn}, and vice versa.(CPn and COPn are dual cones).

For A ∈ CPn: A ∈ ∂CPn ⇔ 〈A,X 〉 = 0 for some X ∈ ext(COPn).

CP, COP matrices & Optimization 2013 18 / 45

Page 98: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The cones CPn and COPn

CPn, COPn

CPn & COPn are convex cones with non-empty interiors.

CPn = {A |A = AT & 〈A,X 〉 ≥ 0 ∀X ∈ COPn}, and vice versa.(CPn and COPn are dual cones).

For A ∈ CPn: A ∈ ∂CPn ⇔ 〈A,X 〉 = 0 for some X ∈ ext(COPn).

CP, COP matrices & Optimization 2013 18 / 45

Page 99: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The cones CPn and COPn

CPn, COPn

CPn & COPn are convex cones with non-empty interiors.

CPn = {A |A = AT & 〈A,X 〉 ≥ 0 ∀X ∈ COPn},

and vice versa.(CPn and COPn are dual cones).

For A ∈ CPn: A ∈ ∂CPn ⇔ 〈A,X 〉 = 0 for some X ∈ ext(COPn).

CP, COP matrices & Optimization 2013 18 / 45

Page 100: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The cones CPn and COPn

CPn, COPn

CPn & COPn are convex cones with non-empty interiors.

CPn = {A |A = AT & 〈A,X 〉 ≥ 0 ∀X ∈ COPn}, and vice versa.

(CPn and COPn are dual cones).

For A ∈ CPn: A ∈ ∂CPn ⇔ 〈A,X 〉 = 0 for some X ∈ ext(COPn).

CP, COP matrices & Optimization 2013 18 / 45

Page 101: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The cones CPn and COPn

CPn, COPn

CPn & COPn are convex cones with non-empty interiors.

CPn = {A |A = AT & 〈A,X 〉 ≥ 0 ∀X ∈ COPn}, and vice versa.(CPn and COPn are dual cones).

For A ∈ CPn: A ∈ ∂CPn ⇔ 〈A,X 〉 = 0 for some X ∈ ext(COPn).

CP, COP matrices & Optimization 2013 18 / 45

Page 102: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The cones CPn and COPn

CPn, COPn

CPn & COPn are convex cones with non-empty interiors.

CPn = {A |A = AT & 〈A,X 〉 ≥ 0 ∀X ∈ COPn}, and vice versa.(CPn and COPn are dual cones).

For A ∈ CPn: A ∈ ∂CPn ⇔ 〈A,X 〉 = 0 for some X ∈ ext(COPn).

CP, COP matrices & Optimization 2013 18 / 45

Page 103: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The cones CPn and COPn

CPn, COPn

CPn & COPn are convex cones with non-empty interiors.

CPn = {A |A = AT & 〈A,X 〉 ≥ 0 ∀X ∈ COPn}, and vice versa.(CPn and COPn are dual cones).

For A ∈ CPn: A ∈ ∂CPn ⇔ 〈A,X 〉 = 0 for some X ∈ ext(COPn).

CP, COP matrices & Optimization 2013 18 / 45

Page 104: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

The cones CPn and COPn, n = 2

Dickinson (2011)

CP, COP matrices & Optimization 2013 19 / 45

Page 105: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

COP problemsBasic Problems

Identify / characterize COP matrices.

Charachterize extreme rays of COPn.

Both are open and hard.

Known extreme rays of COPn

PSD matrices of rank 1,

"elementary" symmetric (0,1)-matrices,

n = 5: the Horn matrix, Hall & Newman (1963)∀n: certain (1,−1)- and (1,0,−1)-matrices,

Haynsworth & Hoffman (1969), Hoffman & Pereira (1973)n = 5: Hildebrand matrices Hildebrand (2012)

CP, COP matrices & Optimization 2013 20 / 45

Page 106: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

COP problemsBasic Problems

Identify / characterize COP matrices.

Charachterize extreme rays of COPn.

Both are open and hard.

Known extreme rays of COPn

PSD matrices of rank 1,

"elementary" symmetric (0,1)-matrices,

n = 5: the Horn matrix, Hall & Newman (1963)∀n: certain (1,−1)- and (1,0,−1)-matrices,

Haynsworth & Hoffman (1969), Hoffman & Pereira (1973)n = 5: Hildebrand matrices Hildebrand (2012)

CP, COP matrices & Optimization 2013 20 / 45

Page 107: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

COP problemsBasic Problems

Identify / characterize COP matrices.

Charachterize extreme rays of COPn.

Both are open and hard.

Known extreme rays of COPn

PSD matrices of rank 1,

"elementary" symmetric (0,1)-matrices,

n = 5: the Horn matrix, Hall & Newman (1963)∀n: certain (1,−1)- and (1,0,−1)-matrices,

Haynsworth & Hoffman (1969), Hoffman & Pereira (1973)n = 5: Hildebrand matrices Hildebrand (2012)

CP, COP matrices & Optimization 2013 20 / 45

Page 108: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

COP problemsBasic Problems

Identify / characterize COP matrices.

Charachterize extreme rays of COPn.

Both are open and hard.

Known extreme rays of COPn

PSD matrices of rank 1,

"elementary" symmetric (0,1)-matrices,

n = 5: the Horn matrix, Hall & Newman (1963)∀n: certain (1,−1)- and (1,0,−1)-matrices,

Haynsworth & Hoffman (1969), Hoffman & Pereira (1973)n = 5: Hildebrand matrices Hildebrand (2012)

CP, COP matrices & Optimization 2013 20 / 45

Page 109: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

COP problemsBasic Problems

Identify / characterize COP matrices.

Charachterize extreme rays of COPn.

Both are open and hard.

Known extreme rays of COPn

PSD matrices of rank 1,

"elementary" symmetric (0,1)-matrices,

n = 5: the Horn matrix, Hall & Newman (1963)∀n: certain (1,−1)- and (1,0,−1)-matrices,

Haynsworth & Hoffman (1969), Hoffman & Pereira (1973)n = 5: Hildebrand matrices Hildebrand (2012)

CP, COP matrices & Optimization 2013 20 / 45

Page 110: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

COP problemsBasic Problems

Identify / characterize COP matrices.

Charachterize extreme rays of COPn.

Both are open and hard.

Known extreme rays of COPn

PSD matrices of rank 1,

"elementary" symmetric (0,1)-matrices,

n = 5: the Horn matrix, Hall & Newman (1963)∀n: certain (1,−1)- and (1,0,−1)-matrices,

Haynsworth & Hoffman (1969), Hoffman & Pereira (1973)n = 5: Hildebrand matrices Hildebrand (2012)

CP, COP matrices & Optimization 2013 20 / 45

Page 111: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

COP problemsBasic Problems

Identify / characterize COP matrices.

Charachterize extreme rays of COPn.

Both are open and hard.

Known extreme rays of COPn

PSD matrices of rank 1,

"elementary" symmetric (0,1)-matrices,

n = 5: the Horn matrix, Hall & Newman (1963)∀n: certain (1,−1)- and (1,0,−1)-matrices,

Haynsworth & Hoffman (1969), Hoffman & Pereira (1973)n = 5: Hildebrand matrices Hildebrand (2012)

CP, COP matrices & Optimization 2013 20 / 45

Page 112: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

COP problemsBasic Problems

Identify / characterize COP matrices.

Charachterize extreme rays of COPn.

Both are open and hard.

Known extreme rays of COPn

PSD matrices of rank 1,

"elementary" symmetric (0,1)-matrices,

n = 5: the Horn matrix, Hall & Newman (1963)

∀n: certain (1,−1)- and (1,0,−1)-matrices,Haynsworth & Hoffman (1969), Hoffman & Pereira (1973)

n = 5: Hildebrand matrices Hildebrand (2012)

CP, COP matrices & Optimization 2013 20 / 45

Page 113: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

COP problemsBasic Problems

Identify / characterize COP matrices.

Charachterize extreme rays of COPn.

Both are open and hard.

Known extreme rays of COPn

PSD matrices of rank 1,

"elementary" symmetric (0,1)-matrices,

n = 5: the Horn matrix, Hall & Newman (1963)∀n: certain (1,−1)- and (1,0,−1)-matrices,

Haynsworth & Hoffman (1969), Hoffman & Pereira (1973)

n = 5: Hildebrand matrices Hildebrand (2012)

CP, COP matrices & Optimization 2013 20 / 45

Page 114: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

COP problemsBasic Problems

Identify / characterize COP matrices.

Charachterize extreme rays of COPn.

Both are open and hard.

Known extreme rays of COPn

PSD matrices of rank 1,

"elementary" symmetric (0,1)-matrices,

n = 5: the Horn matrix, Hall & Newman (1963)∀n: certain (1,−1)- and (1,0,−1)-matrices,

Haynsworth & Hoffman (1969), Hoffman & Pereira (1973)n = 5: Hildebrand matrices Hildebrand (2012)

CP, COP matrices & Optimization 2013 20 / 45

Page 115: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

New upper bounds

The DJL conjecture holds for n = 5:

Theorem 2∀A ∈ CP5, cp-rank A ≤ b52/4c = 6 (sharp).

Shaked-Monderer, Bomze, Jarre & Schachinger (2013)

Used in the proof: Theorem 1, Loewy & Tam’s result, Hildebrand’scharacterization; Also: graph theoretic result on the cp-rank.

CP, COP matrices & Optimization 2013 21 / 45

Page 116: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

New upper bounds

The DJL conjecture holds for n = 5:

Theorem 2∀A ∈ CP5, cp-rank A ≤ b52/4c = 6 (sharp).

Shaked-Monderer, Bomze, Jarre & Schachinger (2013)

Used in the proof: Theorem 1, Loewy & Tam’s result, Hildebrand’scharacterization; Also: graph theoretic result on the cp-rank.

CP, COP matrices & Optimization 2013 21 / 45

Page 117: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

New upper bounds

The DJL conjecture holds for n = 5:

Theorem 2∀A ∈ CP5, cp-rank A ≤ b52/4c = 6 (sharp).

Shaked-Monderer, Bomze, Jarre & Schachinger (2013)

Used in the proof: Theorem 1, Loewy & Tam’s result, Hildebrand’scharacterization; Also: graph theoretic result on the cp-rank.

CP, COP matrices & Optimization 2013 21 / 45

Page 118: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

New upper bounds

The DJL conjecture holds for n = 5:

Theorem 2∀A ∈ CP5, cp-rank A ≤ b52/4c = 6 (sharp).

Shaked-Monderer, Bomze, Jarre & Schachinger (2013)

Used in the proof:

Theorem 1, Loewy & Tam’s result, Hildebrand’scharacterization; Also: graph theoretic result on the cp-rank.

CP, COP matrices & Optimization 2013 21 / 45

Page 119: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

New upper bounds

The DJL conjecture holds for n = 5:

Theorem 2∀A ∈ CP5, cp-rank A ≤ b52/4c = 6 (sharp).

Shaked-Monderer, Bomze, Jarre & Schachinger (2013)

Used in the proof: Theorem 1,

Loewy & Tam’s result, Hildebrand’scharacterization; Also: graph theoretic result on the cp-rank.

CP, COP matrices & Optimization 2013 21 / 45

Page 120: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

New upper bounds

The DJL conjecture holds for n = 5:

Theorem 2∀A ∈ CP5, cp-rank A ≤ b52/4c = 6 (sharp).

Shaked-Monderer, Bomze, Jarre & Schachinger (2013)

Used in the proof: Theorem 1, Loewy & Tam’s result,

Hildebrand’scharacterization; Also: graph theoretic result on the cp-rank.

CP, COP matrices & Optimization 2013 21 / 45

Page 121: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

New upper bounds

The DJL conjecture holds for n = 5:

Theorem 2∀A ∈ CP5, cp-rank A ≤ b52/4c = 6 (sharp).

Shaked-Monderer, Bomze, Jarre & Schachinger (2013)

Used in the proof: Theorem 1, Loewy & Tam’s result, Hildebrand’scharacterization;

Also: graph theoretic result on the cp-rank.

CP, COP matrices & Optimization 2013 21 / 45

Page 122: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

New upper bounds

The DJL conjecture holds for n = 5:

Theorem 2∀A ∈ CP5, cp-rank A ≤ b52/4c = 6 (sharp).

Shaked-Monderer, Bomze, Jarre & Schachinger (2013)

Used in the proof: Theorem 1, Loewy & Tam’s result, Hildebrand’scharacterization; Also: graph theoretic result on the cp-rank.

CP, COP matrices & Optimization 2013 21 / 45

Page 123: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

New upper bounds contd.

The Barioli-Berman bound is not sharp for n ≥ 5:

Theorem 3∀A ∈ CPn, n ≥ 5, cp-rank A ≤

(n+12

)− 4.

Shaked-Monderer, Berman, Bomze, Jarre & Schachinger (201?)

Used in the proof:

Theorem 4∀A ∈ CPn,B ∈ COPn s.t. A⊥B, every column of A is orthogonal to thecorresponding column of B.

Shaked-Monderer, Berman, Bomze, Jarre & Schachinger (201?)

CP, COP matrices & Optimization 2013 22 / 45

Page 124: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

New upper bounds contd.

The Barioli-Berman bound is not sharp for n ≥ 5:

Theorem 3∀A ∈ CPn, n ≥ 5, cp-rank A ≤

(n+12

)− 4.

Shaked-Monderer, Berman, Bomze, Jarre & Schachinger (201?)

Used in the proof:

Theorem 4∀A ∈ CPn,B ∈ COPn s.t. A⊥B, every column of A is orthogonal to thecorresponding column of B.

Shaked-Monderer, Berman, Bomze, Jarre & Schachinger (201?)

CP, COP matrices & Optimization 2013 22 / 45

Page 125: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

New upper bounds contd.

The Barioli-Berman bound is not sharp for n ≥ 5:

Theorem 3∀A ∈ CPn, n ≥ 5, cp-rank A ≤

(n+12

)− 4.

Shaked-Monderer, Berman, Bomze, Jarre & Schachinger (201?)

Used in the proof:

Theorem 4∀A ∈ CPn,B ∈ COPn s.t. A⊥B, every column of A is orthogonal to thecorresponding column of B.

Shaked-Monderer, Berman, Bomze, Jarre & Schachinger (201?)

CP, COP matrices & Optimization 2013 22 / 45

Page 126: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

New upper bounds contd.

The Barioli-Berman bound is not sharp for n ≥ 5:

Theorem 3∀A ∈ CPn, n ≥ 5, cp-rank A ≤

(n+12

)− 4.

Shaked-Monderer, Berman, Bomze, Jarre & Schachinger (201?)

Used in the proof:

Theorem 4∀A ∈ CPn,B ∈ COPn s.t. A⊥B, every column of A is orthogonal to thecorresponding column of B.

Shaked-Monderer, Berman, Bomze, Jarre & Schachinger (201?)

CP, COP matrices & Optimization 2013 22 / 45

Page 127: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

New upper bounds contd.

The Barioli-Berman bound is not sharp for n ≥ 5:

Theorem 3∀A ∈ CPn, n ≥ 5, cp-rank A ≤

(n+12

)− 4.

Shaked-Monderer, Berman, Bomze, Jarre & Schachinger (201?)

Used in the proof:

Theorem 4∀A ∈ CPn,B ∈ COPn s.t. A⊥B, every column of A is orthogonal to thecorresponding column of B.

Shaked-Monderer, Berman, Bomze, Jarre & Schachinger (201?)

CP, COP matrices & Optimization 2013 22 / 45

Page 128: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

New upper bounds contd.

The Barioli-Berman bound is not sharp for n ≥ 5:

Theorem 3∀A ∈ CPn, n ≥ 5, cp-rank A ≤

(n+12

)− 4.

Shaked-Monderer, Berman, Bomze, Jarre & Schachinger (201?)

Used in the proof:

Theorem 4∀A ∈ CPn,B ∈ COPn s.t. A⊥B, every column of A is orthogonal to thecorresponding column of B.

Shaked-Monderer, Berman, Bomze, Jarre & Schachinger (201?)

CP, COP matrices & Optimization 2013 22 / 45

Page 129: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

New upper bounds contd.

Slight improvement for n = 6:

Theorem 5∀A ∈ CP6, cp-rank A ≤ 15 =

(62

).

Shaked-Monderer, Berman, Bomze, Jarre & Schachinger (201?)

CP, COP matrices & Optimization 2013 23 / 45

Page 130: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

New upper bounds contd.

Slight improvement for n = 6:

Theorem 5∀A ∈ CP6, cp-rank A ≤ 15 =

(62

).

Shaked-Monderer, Berman, Bomze, Jarre & Schachinger (201?)

CP, COP matrices & Optimization 2013 23 / 45

Page 131: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

New upper bounds contd.

Slight improvement for n = 6:

Theorem 5∀A ∈ CP6, cp-rank A ≤ 15 =

(62

).

Shaked-Monderer, Berman, Bomze, Jarre & Schachinger (201?)

CP, COP matrices & Optimization 2013 23 / 45

Page 132: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

New upper bounds contd.

Slight improvement for n = 6:

Theorem 5∀A ∈ CP6, cp-rank A ≤ 15 =

(62

).

Shaked-Monderer, Berman, Bomze, Jarre & Schachinger (201?)

CP, COP matrices & Optimization 2013 23 / 45

Page 133: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Comments

Theorem 3 bound definitely not sharp for n = 5,6, most probably notsharp for n > 6.

Theorem 5 bound may not be sharp.

CP, COP matrices & Optimization 2013 24 / 45

Page 134: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Comments

Theorem 3 bound definitely not sharp for n = 5,6, most probably notsharp for n > 6.

Theorem 5 bound may not be sharp.

CP, COP matrices & Optimization 2013 24 / 45

Page 135: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Comments

Theorem 3 bound definitely not sharp for n = 5,6, most probably notsharp for n > 6.

Theorem 5 bound may not be sharp.

CP, COP matrices & Optimization 2013 24 / 45

Page 136: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Copositive optimization

Burer has shown that every optimization problem with quadraticobjective function, linear constraints, and binary variables can beequivalently written as a linear problem over the completely positivecone. This includes many NP-hard combinatorial problems. Thecomplexity of these problems is then shifted entirely into the coneconstraint. In fact, even checking whether a given matrix is completelypositive is an NP-hard problem.

Replacing the completely positive cone by a tractable cone like thecone of doubly nonnegative matrices results in a relaxation of theproblem providing a bound on its optimal value. For matrices of ordern ≤ 4, the doubly nonnegative cone equals the completely positivewhich means that the relaxation is exact. For order n ≥ 5, however,there are doubly nonnegative matrices that are not completely positive.

CP, COP matrices & Optimization 2013 25 / 45

Page 137: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Copositive cuts

Thus, in general, an optimal solution of the doubly nonnegativerelaxation is not completely positive. Therefore, it is desirable to add acut, i.e., a linear constraint that separates the obtained solution fromthe completely positive cone, in order to get a tighter relaxationyielding a better bound.

In [B, Duer, Shaked-Monderer and Witzel] we construct cutting planesto separate doubly nonnegative matrices which are not completelypositive from the completely positive cone. In other words,given X ∈ DNN n \ CPn, we aim to find a K ∈ COPn such that〈K ,X 〉 < 0.

CP, COP matrices & Optimization 2013 26 / 45

Page 138: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Copositive cuts contd.

CP, COP matrices & Optimization 2013 27 / 45

Page 139: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Copositive cuts contd.

CP, COP matrices & Optimization 2013 27 / 45

Page 140: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Generating copositive cuts

The basic idea of our approach is stated in the following theorems:

TheoremX ∈ CPn ⇔ ∃K ∈ COPn such that K ◦ X /∈ COPn.

TheoremLet X ∈ DNN n \ CPn, and let K ∈ COPn be such that K ◦ X /∈ COPn.Then for every nonnegative u ∈ Rn such that uT (K ◦ X )u < 0, thecopositive matrix K ◦ uuT is a cut separating X from CPn.

Proof.

〈K ◦ uuT ,X 〉 = uT (K ◦ X )u < 0.

CP, COP matrices & Optimization 2013 28 / 45

Page 141: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Generating copositive cuts contd.

If K ◦ X /∈ COPn, as assumed in the theorem, then by Kaplan’scopositivity characterization, K ◦ X has a principal submatrix having apositive eigenvector corresponding to a negative eigenvalue. Thisshows that such u can be chosen as this eigenvector with zeros addedto get a vector in Rn.

The following property is obvious but useful, since it allows to constructcutting planes based on submatrices instead of the entire matrix.

LemmaAssume that K ∈ COPn is a copositive matrix that separates amatrix X from CPn. If A ∈ Rn×p and B ∈ Rn×p are arbitrary matriceswith B symmetric, then the copositive matrix[

K 00 0

]is a cut that separates

[X AAT B

]from CPn+p.

CP, COP matrices & Optimization 2013 29 / 45

Page 142: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Generating copositive cuts contd.

We assume that the matrices that we want to separate from thecompletely positive cone are irreducible, since any reduciblesymmetric matrix can be written as a block diagonal matrix and thenthe problem can be split into subproblems of smaller dimension whereeach of the diagonal blocks is considered separately.

Note that for a cut it is desirable to have an extreme copositivematrix K rather than just a copositive K , since an extremal matrix willprovide a supporting hyperplane and therefore a better (deeper) cut.

CP, COP matrices & Optimization 2013 30 / 45

Page 143: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Separating a triangle-free doubly nonnegative matrix

We assume that our matrix X ∈ DNN n has Xii 6= 0, otherwise thecorresponding row and column would be zero, and we can base ourcut on a submatrix with no zero diagonal elements. Furthermore, byapplying a suitable scaling if necessary we can assume thatdiag (X ) = e.

Now suppose that an irreducible X ∈ DNN n has a triangle-free graphG(X ).Then we have

X = I + C, diag (X ) = e, G(X ) is connected and triangle-free. (1)

The matrix C has zero diagonal and G(C) = G(X ).

CP, COP matrices & Optimization 2013 31 / 45

Page 144: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Separating a triangle-free doubly nonnegative matrix

We now characterize complete positivity of X in terms of the spectralradius of C.

LemmaA matrix X ∈ DNN n of the form (1) is completely positive if and only ifthe spectral radius ρ of C fulfills ρ ≤ 1.

Proof.Since G(X ) is triangle-free, X ∈ COPn if and only if its comparisonmatrix M(X ) is an M-matrix, which means that M(X ) can be written asM(X ) = αI − P with P ≥ 0 and α ≥ ρ(P). In our case, we have

M(X ) = I − C,

which immediately gives the result.

CP, COP matrices & Optimization 2013 32 / 45

Page 145: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Separating a triangle-free doubly nonnegative matrix

For the separation of a doubly nonnegative matrix in the form (1) whichis not completely positive from CPn, we will use a {−1,0,1}-matrix:Given a triangle-free graph G, let A be defined by:

Aij =

−1 if {i , j} is an edge of G,+1 if the distance between i and j in G is 2,0 otherwise.

(2)

We call this matrix the Hoffman-Pereira matrix corresponding to G. By[Hoffman and Pereira (1973)] the matrix A is copositive whenever G istriangle-free. If the diameter of G is 2, then the Hoffman-Pereira matrixdoes not have zero entries, and is extreme. This is the case for n = 5,and A is then the Horn matrix.

CP, COP matrices & Optimization 2013 33 / 45

Page 146: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Separating a triangle-free doubly nonnegative matrix

TheoremLet X ∈ DNN n \ CPn be of the form (1), let u be the Perron vector ofC, and let A be the Hoffman-Pereira matrix corresponding to G(X ).Then(a) u > 0 and uT M(X )u < 0,(b) M(X ) = X ◦ A and

K := A ◦ uuT

is a copositive matrix separating X from CPn.

CP, COP matrices & Optimization 2013 34 / 45

Page 147: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Separating a triangle-free doubly nonnegative matrixProof.(a) The assumption that G(X ) is connected means that X , and

therefore C, is irreducible, which implies that u > 0 by thePerron-Frobenius Theorem. Also,

uT M(X )u = uT u − uT Cu = uT u(1− ρ) < 0.

(b) It is easy to see that M(X ) = X ◦ A, and we have

〈X ,A ◦ uuT 〉 = 〈X ◦ A,uuT 〉 = uT (X ◦ A)u = uT M(X )u < 0.

Since u > 0 and A is copositive, the matrix K := A ◦ uuT iscopositive, which by the above is a cut that separates X from CPn.

Note that since u > 0, the cut matrix K is extreme if and only if theHoffman-Pereira matrix A is extreme. This happens, e.g., when thegraph G(X ) is an odd cycle.

CP, COP matrices & Optimization 2013 35 / 45

Page 148: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Application to the stable set problemWe illustrate the separation procedure by applying it to some instancesof the stable set problem.

As shown in [de Klerk and Pasechnik (2002)], the problem ofcomputing the stability number α of a graph G can be stated as acompletely positive optimization problem:

α = max{〈E ,X 〉 : 〈I,X 〉 = 1, 〈AG,X 〉 = 0, X ∈ CPn} (3)

where AG denotes the adjacency matrix of G. Replacing CPn byDNN n results in a relaxation of the problem providing a bound on α.This bound ϑ′ is called Lovász-Schrijver bound:

ϑ′ = max{〈E ,X 〉 : 〈I,X 〉 = 1, 〈AG,X 〉 = 0, X ∈ DNN n}. (4)

We consider some instances for which ϑ′ 6= α and aim to get betterbounds by adding cuts to the doubly nonnegative relaxation, using ourapproach.

CP, COP matrices & Optimization 2013 36 / 45

Page 149: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Application to the stable set problem contd.

Let X̄ denote the optimal solution we get by solving (4). If ϑ′ 6= α,then X̄ ∈ DNN n \ CPn. We want to find cuts that separate X̄ from thefeasible set of (3). If G(X̄ ) is triangle-free, we can separate X̄ fromCPn. Otherwise, we look for a principal submatrix whose graph istriangle-free and its comparison matrix is not positive semidefinite,construct a cut for this submatrix.

CP, COP matrices & Optimization 2013 37 / 45

Page 150: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Application to the stable set problem contd.

Let Y denote such a submatrix. In general, diag (Y ) 6= e as in (1).Therefore, we consider the scaled matrix DYD, where D is a diagonalmatrix with Dii = 1√

Yii. Since Y is a doubly nonnegative matrix having

a triangle-free graph, the same holds for DYD. Furthermore, DYD canbe written as DYD = I + C, where C is a matrix with zero diagonaland G(C) a triangle-free graph. Let ρ denote the spectral radius of Cand let u be the eigenvector of C corresponding to the eigenvalue ρ.Furthermore, let A be If ρ > 1, then we have

0 > 〈A ◦ uuT ,DYD〉 = 〈D(A ◦ uuT )D,Y 〉.

Therefore, D(A ◦ uuT )D defines a cut that separates Y from thecompletely positive cone.

CP, COP matrices & Optimization 2013 38 / 45

Page 151: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Numerical results for some stable set problems

As test instances, we consider the 5-cycle C5 and the graphs G8, G11,G14 and G17 from [ Pena, Vera and Zuluaga (2007)].In each case we determine all submatrices as described above. Itturns out that for these instances the biggest order of such a submatrixis 5× 5. The matrix A we use is therefore the Horn matrix. We thensolve the doubly nonnegative relaxation after adding each of thesecuts and after adding all computed cuts. The results are shown in theTable below. We denote by ϑK

min and ϑKmax the minimal respectively

maximal bound we get by adding a single cut to the doublynonnegative relaxation (4), and ϑK

all denotes the bound we get afteradding all computed cuts. The last column indicates the reduction ofthe optimality gap ϑ′ − α when all cuts are added.

CP, COP matrices & Optimization 2013 39 / 45

Page 152: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Numerical results for some stable set problems

Graph α ϑ′ ϑKmin ϑK

max ϑKall # cuts reduction

C5 2 2.236 2.0000 2.0000 2.0000 1 100%G8 3 3.468 3.3992 3.3992 3.2163 4 54%G11 4 4.694 4.6273 4.6672 4.4307 10 38%G14 5 5.916 5.8533 5.8977 5.6460 20 29%G17 6 7.134 7.0745 7.1227 6.8615 35 24%

Table : Results on different stable set problems

CP, COP matrices & Optimization 2013 40 / 45

Page 153: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Happy Birthday Bob!

Based on:

N. Shaked-Monderer, I. M. Bomze, F. Jarre and W. Schachinger,On the cp-rank and the minimal cp factorization. SIAM Journal onMatrix Analysis and Applications, 34(2) (2013), pp. 355-368.

N. Shaked-Monderer, A. Berman, I. M. Bomze, F. Jarre and W.Schachinger, New results on the cp rank and related properties ofco(mpletely )positive matrices.http://arxiv.org/abs/1305.0737

A. Berman, M. Dür, N. Shaked-Monderer and J. Witzel, Cuttingplanes for semidefinite relaxations based on triangle-freesubgraphs.

CP, COP matrices & Optimization 2013 41 / 45

Page 154: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

Happy Birthday Bob!

Based on:

N. Shaked-Monderer, I. M. Bomze, F. Jarre and W. Schachinger,On the cp-rank and the minimal cp factorization. SIAM Journal onMatrix Analysis and Applications, 34(2) (2013), pp. 355-368.

N. Shaked-Monderer, A. Berman, I. M. Bomze, F. Jarre and W.Schachinger, New results on the cp rank and related properties ofco(mpletely )positive matrices.http://arxiv.org/abs/1305.0737

A. Berman, M. Dür, N. Shaked-Monderer and J. Witzel, Cuttingplanes for semidefinite relaxations based on triangle-freesubgraphs.

CP, COP matrices & Optimization 2013 41 / 45

Page 155: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

ReferencesAbraham Berman and Robert J. Plemmons, Nonnegative Matricesin the Mathematical Sciences. SIAM Classics in AppliedMathematics, SIAM 1994.

Abraham Berman and Naomi Shaked-Monderer, Completelypositive matrices. World Scientific Publishing, 2003.

Immanuel M. Bomze, Florian Frommlet, and Marco Locatelli,Copositivity cuts for improving SDP bounds on the clique number.Mathematical Programming 124 (2010), 13–32.

Immanuel M. Bomze, Marco Locatelli, and Fabio Tardella, Newand old bounds for standard quadratic optimization: dominance,equivalence and incomparability. Mathematical Programming 115(2008), 31–64.

Samuel Burer, On the copositive representation of binary andcontinuous nonconvex quadratic programs. MathematicalProgramming 120 (2009), 479–495.

CP, COP matrices & Optimization 2013 42 / 45

Page 156: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

References

Samuel Burer, Kurt Anstreicher, and Mirjam Dür, The differencebetween 5× 5 doubly nonnegative and completely positivematrices. Linear Algebra and its Applications 431 (2009),1539–1552.

Samuel Burer and Hongbo Dong, Separation and relaxation forcones of quadratic forms. Mathematical Programming 137 (2013),343–370.

Richard W. Cottle, George J. Habetler and Carlton E. Lemke, Onclasses of copositive matrices, Linear Algebra and itsApplications 3 (1970), 295–310.

Peter J.C. Dickinson and Luuk Gijben, On the computationalcomplexity of membership problems for the completely positivecone and its dual. Preprint. Online athttp://www.optimization-online.org/DB_HTML/2011/05/3041.html.

CP, COP matrices & Optimization 2013 43 / 45

Page 157: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

ReferencesHongbo Dong and Kurt Anstreicher, Separating doublynonnegative and completely positive matrices. MathematicalProgramming 137 (2013), 131–153.

John H. Drew, Charles R. Johnson and Raphael Loewy,Completely positive matrices associated with M-matrices. Linearand Multilinear Algebra 37 (1994), 303–310.

Karl-Peter Hadeler, On copositive matrices. Linear Algebra and itsApplications 49 (1983), 79–89.

Emily Haynsworth and Alan J. Hoffman, Two remarks on copositivematrices. Linear Algebra and its Applications 2 (1969), 387–392.

Roland Hildebrand, The extreme rays of the 5× 5 copositive cone.Linear Algebra and its Applications 437 (2012), 1538–1547.

Alan J. Hoffman and Francisco Pereira, On copositive matriceswith −1,0,1 entries. Journal of Combinatorial Theory (A) 14(1973), 302–309.

CP, COP matrices & Optimization 2013 44 / 45

Page 158: Completely positive and copositive matrices and optimization … · Notation: CPn is the set of all n n completely positive matrices. CPn is a closed convex cone. Every CP matrix

References

Wilfred Kaplan, A test for copositive matrices. Linear Algebra andits Applications 313 (2000), 203–206.

Etienne de Klerk and Dmitrii V. Pasechnik, Approximation of thestability number of a graph via copositive programming. SIAMJournal on Optimization 12 (2002), 875–892.

Javier Peña, Juan Vera and Luis F. Zuluaga, Computing thestability number of a graph via linear and semidefiniteprogramming. SIAM Journal on Optimization 18 (2007), 87–105.

Julia Sponsel and Mirjam Dür, Factorization and cutting planes forcompletely positive matrices by copositive projection. MathematicalProgramming, in print. DOI: 10.1007/s10107-012-0601-4.

Hannu Väliaho, Criteria for copositive matrices. Linear Algebra andits Applications 81 (1986), 19–34.

CP, COP matrices & Optimization 2013 45 / 45