Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke...

52
Relation between Neighborhood Size and MOEA/D Performance on Many-Objective Problems Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN

Transcript of Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke...

Page 1: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Relation between Neighborhood Size and MOEA/D Performance

on Many-Objective Problems

Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN

Page 2: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Content of This Presentation 1. Motivation We briefly explain our motivation. 2. MOEA/D and Its Modified Version We explain MOEA/D and its slightly modified version with two neighborhood structures. 3. Experimental Results We report some interesting observations on the behavior of MOEA/D with various settings of neighborhood size.

Page 3: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Motivation Performance of MOEA/D In a series of our studies on MOEA/D, its performance was almost always high. [1] Ishibuchi et al.: “Adaptation of Scalarizing Functions in

MOEA/D”. EMO 2009. [2] Ishibuchi et al.: “Evolutionary Many-Objective Optimization

by NSGA-II and MOEA/D with Large Populations”. SMC 2009. [3] Ishibuchi et al.: “Simultaneous Use of Different Scalarizing

Functions in MOEA/D”. GECCO 2010. [4] Ishibuchi et al. “Effects of the Existence of Highly Correlated

Objectives on the Behavior of MOEA/D”. EMO 2011. [5] Ishibuchi et al.: “A Study on the Specification of a Scalarizing

Function in MOEA/D for Many-Objective Knapsack Problems”. LION 2013.

Page 4: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

However, in other authors’ studies, the performance of MOEA/D was sometimes surprisingly bad when it was used for performance comparison with their EMO algorithms. Question: Why was the performance of MOEA/D poor in their computational experiments (whereas its performance was high in our own studies)?

Motivation Performance of MOEA/D

Page 5: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Question: Why was the performance of MOEA/D poor in their computational experiments (whereas its performance was high in our own studies)? Possibilities: (0) Use of different test problems. (1) Use of inappropriate scalarizing functions: In MOEA/D, each solution is evaluated by a scalarizing

function with a different weight vector. (2) Use of inappropriate neighborhood specifications: - Parents are selected from neighbors (Local Mating). - Generated offspring are compared with neighbors

(Local Replacement).

Motivation Performance of MOEA/D

Page 6: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Question: Why was the performance of MOEA/D poor in their computational experiments (whereas its performance was high in our own studies)? Possibilities: (0) Use of different test problems. (1) Use of inappropriate scalarizing functions: In MOEA/D. each solution is evaluated by a scalarizing

function with a different weight vector. ==> LION 2013 (2) Use of inappropriate neighborhood specifications: - Parents are selected from neighbors (Local Mating). - Generated offspring are compared with neighbors

(Local Replacement).

Motivation Performance of MOEA/D

Page 7: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

M i i f ( )

Max

imiz

e f 2(

x)Final GenerationPareto Front

16000 17000 18000 19000 20000 2100

16000

17000

18000

19000

20000

21000Maximize f1(x)

Max

imiz

e f 2(

x)

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Final GenerationPareto Front

Results on Two-Objective Knapsack Problem (LION 2013) Performance of MOEA/D depends on Scalarizing Function

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Maximize f1(x)

Max

imiz

e f 2(

x)

Final GenerationPareto Front

Weighted Sum Weighted Tchebycheff

16000 17000 18000 19000 20000 2100

16000

17000

18000

19000

20000

21000PBI (θ = 0.1)

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

i i f ( )

Max

imiz

e f 2(

x)

Final GenerationPareto Front

PBI (θ = 5)

i i f ( )

Max

imiz

e f 2(

x)

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Final GenerationPareto Front

PBI (θ = 1) NSGA-II

Final GenerationPareto Front

Page 8: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

M i i f ( )

Max

imiz

e f 2(

x)Final GenerationPareto Front

16000 17000 18000 19000 20000 2100

16000

17000

18000

19000

20000

21000Maximize f1(x)

Max

imiz

e f 2(

x)

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Final GenerationPareto Front

Average Hypervolume on Two-Objective Problem (100 runs) Performance of MOEA/D depends on Scalarizing Function

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Maximize f1(x)

Max

imiz

e f 2(

x)

Final GenerationPareto Front

Weighted Sum Weighted Tchebycheff

16000 17000 18000 19000 20000 2100

16000

17000

18000

19000

20000

21000PBI (θ = 0.1)

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

i i f ( )

Max

imiz

e f 2(

x)

Final GenerationPareto Front

PBI (θ = 5)

i i f ( )

Max

imiz

e f 2(

x)

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Final GenerationPareto Front

PBI (θ = 1) NSGA-II

Final GenerationPareto Front

HV on Two-Objective: 1.00

HV on Two-Objective: 1.01

HV on Two-Objective: 0.99

HV on Two-Objective: 0.97

HV on Two-Objective: 1.02

HV on Two-Objective: 0.96

Page 9: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

M i i f ( )

Max

imiz

e f 2(

x)Final GenerationPareto Front

16000 17000 18000 19000 20000 2100

16000

17000

18000

19000

20000

21000Maximize f1(x)

Max

imiz

e f 2(

x)

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Final GenerationPareto Front

Best Specification for Two-Objective Problem PBI Function with θ = 5

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Maximize f1(x)

Max

imiz

e f 2(

x)

Final GenerationPareto Front

Weighted Sum Weighted Tchebycheff

16000 17000 18000 19000 20000 2100

16000

17000

18000

19000

20000

21000PBI (θ = 0.1)

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

i i f ( )

Max

imiz

e f 2(

x)

Final GenerationPareto Front

PBI (θ = 5)

i i f ( )

Max

imiz

e f 2(

x)

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Final GenerationPareto Front

PBI (θ = 1) NSGA-II

Final GenerationPareto Front

HV on Two-Objective: 1.00

HV on Two-Objective: 1.01

HV on Two-Objective: 0.99

HV on Two-Objective: 0.97

HV on Two-Objective: 1.02

HV on Two-Objective: 0.96

Page 10: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

M i i f ( )

Max

imiz

e f 2(

x)Final GenerationPareto Front

16000 17000 18000 19000 20000 2100

16000

17000

18000

19000

20000

21000Maximize f1(x)

Max

imiz

e f 2(

x)

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Final GenerationPareto Front

Average Hypervolume on Ten-Objective Problem

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Maximize f1(x)

Max

imiz

e f 2(

x)

Final GenerationPareto Front

Weighted Sum Weighted Tchebycheff

16000 17000 18000 19000 20000 2100

16000

17000

18000

19000

20000

21000PBI (θ = 0.1)

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

i i f ( )

Max

imiz

e f 2(

x)

Final GenerationPareto Front

PBI (θ = 5)

i i f ( )

Max

imiz

e f 2(

x)

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Final GenerationPareto Front

PBI (θ = 1) NSGA-II

Final GenerationPareto Front

HV on Ten-Objective: 1.00

HV on Ten-Objective: 0.87

HV on Ten-Objective: 0.95

HV on Ten-Objective: 0.63

HV on Ten-Objective: 0.62

HV on Ten-Objective: 0.66

Page 11: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

M i i f ( )

Max

imiz

e f 2(

x)Final GenerationPareto Front

16000 17000 18000 19000 20000 2100

16000

17000

18000

19000

20000

21000Maximize f1(x)

Max

imiz

e f 2(

x)

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Final GenerationPareto Front

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Maximize f1(x)

Max

imiz

e f 2(

x)

Final GenerationPareto Front

Weighted Sum Weighted Tchebycheff

16000 17000 18000 19000 20000 2100

16000

17000

18000

19000

20000

21000PBI (θ = 0.1)

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

i i f ( )

Max

imiz

e f 2(

x)

Final GenerationPareto Front

PBI (θ = 5)

i i f ( )

Max

imiz

e f 2(

x)

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Final GenerationPareto Front

PBI (θ = 1) NSGA-II

Final GenerationPareto Front

HV on Ten-Objective: 1.00

HV on Ten-Objective: 0.87

HV on Ten-Objective: 0.95

HV on Ten-Objective: 0.63

HV on Ten-Objective: 0.62

HV on Ten-Objective: 0.66

The best specification for the two-objective problem is the worst for the ten-objective problem

Page 12: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

M i i f ( )

Max

imiz

e f 2(

x)Final GenerationPareto Front

16000 17000 18000 19000 20000 2100

16000

17000

18000

19000

20000

21000

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

i i f ( )

Max

imiz

e f 2(

x)

Final GenerationPareto Front

PBI (θ = 5)

i i f ( )

Max

imiz

e f 2(

x)

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Final GenerationPareto Front

PBI (θ = 1) NSGA-II

HV on Ten-Objective: 0.63

HV on Ten-Objective: 0.62

HV on Ten-Objective: 0.66

The best specification for the two-objective problem is the worst for the ten-objective problem

Observation (when PBI (θ = 5) was used): MOEA/D is outperformed by NSGA-II in their applications to the 10-objective problem.

Page 13: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

M i i f ( )

Max

imiz

e f 2(

x)Final GenerationPareto Front

16000 17000 18000 19000 20000 2100

16000

17000

18000

19000

20000

21000Maximize f1(x)

Max

imiz

e f 2(

x)

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Final GenerationPareto Front

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Maximize f1(x)

Max

imiz

e f 2(

x)

Final GenerationPareto Front

Weighted Sum Weighted Tchebycheff

16000 17000 18000 19000 20000 2100

16000

17000

18000

19000

20000

21000PBI (θ = 0.1)

NSGA-II

Final GenerationPareto Front

HV on Ten-Objective: 1.00

HV on Ten-Objective: 0.87

HV on Ten-Objective: 0.95

HV on Ten-Objective: 0.66

The best specification for the two-objective problem is the worst for the ten-objective problem

Observation from the weighted sum: MOEA/D is much better than NSGA-II in their applications to the 10-objective problem.

Page 14: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Question: Why was the performance of MOEA/D poor in their computational experiments (whereas its performance was high in our own studies). Possibilities: (1) Use of inappropriate scalarizing functions: In MOEA/D. each solution is evaluated by a scalarizing

function with a different weight vector. ==> LION 2013 (2) Use of inappropriate neighborhood specifications: - Parents are selected from neighbors (Local Mating). - Generated offspring are compared with neighbors

(Local Replacement). In EMO 2013, we examine the effect of neighborhood size.

Motivation Performance of MOEA/D

Page 15: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Content of This Presentation 1. Motivation We briefly explain our motivation. 2. MOEA/D and Its Modified Version We explain MOEA/D and its slightly modified version with two neighborhood structures. 3. Experimental Results We report some interesting observations on the behavior of MOEA/D with various settings of neighborhood size.

Page 16: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Decomposition: A multi-objective problem is handled as a set of scalarizing function optimization problems with different weight vectors. Uniformly distributed weight vectors were used in the original study (2007).

Basic Idea of MOEA/D Q. Zhang and H. Li (IEEE TEVC 2007)

Weight vectors (2-objective case) Weight vectors (3-objective case)

Single-objective problem to optimize a scalarizing function with a different weight vector

Page 17: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Decomposition: A multi-objective problem is handled as a set of scalarizing function optimization problems with different weight vectors. Uniformly distributed weight vectors were used in the original study (2007).

Basic Idea of MOEA/D Q. Zhang and H. Li (IEEE TEVC 2007)

Weighted Sum

f(x) = f2(x)

f(x) = 0.25 f1(x) + 0.75 f2(x)c

f(x) = 0.5 f1(x) + 0.5 f2(x)

f(x) = 0.75 f1(x) + 0.25 f2(x)

f(x) = f1(x)

Page 18: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Characteristic Features of MOEA/D Local Mating in Parent Selection

(0.25, 0.25, 0.5)

(0.25, 0.5, 0.25)

(0, 0, 1)(0.25, 0, 0.75)

(0.5, 0, 0.5)(0.75, 0, 0.25)

(1, 0, 0)

(0, 1, 0)

(0.25, 0.75, 0)

(0.5, 0.5, 0)

(0.75, 0.25, 0)

(0, 0.75, 0.25)

(0, 0.5, 0.5)

(0, 0.25, 0.75)w1

w3

w2

(0.5, 0.25, 0.25)

To generate a new offspring for the current solution , a pair of parents are selected from its neighbors . Then crossover and mutation are used.

Page 19: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

(0.25, 0.25, 0.5)

(0.25, 0.5, 0.25)

(0, 0, 1)(0.25, 0, 0.75)

(0.5, 0, 0.5)(0.75, 0, 0.25)

(1, 0, 0)

(0, 1, 0)

(0.25, 0.75, 0)

(0.5, 0.5, 0)

(0.75, 0.25, 0)

(0, 0.75, 0.25)

(0, 0.5, 0.5)

(0, 0.25, 0.75)w1

w3

w2

(0.5, 0.25, 0.25)

A newly generated offspring is compared with the current solution and its neighbors . (If better then replace).

Characteristic Features of MOEA/D Local Replacement in Solution Update

Page 20: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Our Model: Slightly Modified Version Local Mating and Local Replacement

(0.25, 0.25, 0.5)

(0.25, 0.5, 0.25)

(0, 0, 1)(0.25, 0, 0.75)

(0.5, 0, 0.5)(0.75, 0, 0.25)

(1, 0, 0)

(0, 1, 0)

(0.25, 0.75, 0)

(0.5, 0.5, 0)

(0.75, 0.25, 0)

(0, 0.75, 0.25)

(0, 0.5, 0.5)

(0, 0.25, 0.75)w1

w3

w2

(0.5, 0.25, 0.25)

In MOEA/D, the same neighborhood structure was used for both the local mating and the local replacement.

Our Implementation: We use different neighborhood structures for local mating and local replacement.

Mating

Page 21: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Our Model: Slightly Modified Version Local Mating and Local Replacement

(0.25, 0.25, 0.5)

(0.25, 0.5, 0.25)

(0, 0, 1)(0.25, 0, 0.75)

(0.5, 0, 0.5)(0.75, 0, 0.25)

(1, 0, 0)

(0, 1, 0)

(0.25, 0.75, 0)

(0.5, 0.5, 0)

(0.75, 0.25, 0)

(0, 0.75, 0.25)

(0, 0.5, 0.5)

(0, 0.25, 0.75)w1

w3

w2

(0.5, 0.25, 0.25)

In MOEA/D, the same neighborhood structure was used for both the local mating and the local replacement.

Our Implementation: We use different neighborhood structures for local mating and local replacement.

Mating Replacement

Page 22: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

(0.25, 0.25, 0.5)

(0.25, 0.5, 0.25)

(0, 0, 1)(0.25, 0, 0.75)

(0.5, 0, 0.5)(0.75, 0, 0.25)

(1, 0, 0)

(0, 1, 0)

(0.25, 0.75, 0)

(0.5, 0.5, 0)

(0.75, 0.25, 0)

(0, 0.75, 0.25)

(0, 0.5, 0.5)

(0, 0.25, 0.75)w1

w3

w2

(0.5, 0.25, 0.25)

In MOEA/D, the same neighborhood structure was used for both the local mating and the local replacement.

Our Implementation: We use different neighborhood structures for local mating and local replacement.

Mating Replacement

This modification is to examine the effects of local mating and local replacement separately.

Our Model: Slightly Modified Version Local Mating and Local Replacement

Page 23: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Scalarizing Functions

1. Weighted Sum:

2. Weighted Tchebycheff:

∑=

⋅=m

iii

WS fg1

)(xλ

|)(|max *

...,,2,1xkiimi

TE fzg −⋅==

λ

We used the following scalarizing functions:

)(|)(max1.1* tfz ii Ω∈⋅= xx

Six- and Eight-Objective Knapsack Problems

Two- and Four-Objective Knapsack Problems

Page 24: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Scalarizing Functions Their Contour Lines

Maximize f1(x)

Max

imiz

e f 2

(x)

Reference PointWeighted Sum

Contour line of each scalarizing function for the weighted vector λ = (0.5, 0.5)

Maximize f1(x)

Max

imiz

e f 2

(x)

Reference PointWeighted Tchebycheff

∑=

⋅=m

iii

WS fg1

)(xλ |)(|max *

...,,2,1xkiimi

TE fzg −⋅==

λ

*iz

Good Bad

Page 25: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Content of This Presentation 1. Motivation We briefly explain our motivation. 2. MOEA/D and Its Modified Version We explain MOEA/D and its slightly modified version with two neighborhood structures. 3. Experimental Results We report some interesting observations on the behavior of MOEA/D with various settings of neighborhood size.

Page 26: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Content of This Presentation 1. Motivation We briefly explain our motivation. 2. MOEA/D and Its Modified Version We explain MOEA/D and its slightly modified version with two neighborhood structures. 3. Experimental Results We report some interesting observations on the behavior of MOEA/D with various settings of neighborhood size. (1) Mating neighborhood: α % of the population size (2) Replacement neighborhood: β % of the population size α = 1, 2, 4, 6, 8, 10, 20, 40, 60, 80, 100 β = 1, 2, 4, 6, 8, 10, 20, 40, 60, 80, 100

Page 27: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Computational Experiments Original 2-500 Knapsack Problem Two-objective 500-item knapsack problem in Zitzler & Thiele (IEEE TECV 1999) with randomly generated two objectives.

Maximize ,)(1

∑=

=n

jjiji xpf x i = 1, 2

Subject to ,1

i

n

jjij cxw ≤∑

=

i = 1, 2

pij : Profit of item j according to knapsack i wij : Weight of item j according to knapsack i cij : Capacity of knapsack i

Value of pij and wij were randomly specified in [10, 100], and wij is 50% of the sum of wij .

Page 28: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Computational Experiments Settings of Computational Experiments

EMO Algorithms: MOEA/D Coding: Binary string of length 500 Crossover: Uniform crossover with the probability 0.8 Mutation: Bit-flip mutation with the probability 1/500 Constraint Handling: Greedy repair in Zitzler & Thiele (1999) Termination: 400,000 solution evaluations Neighborhood Size in MOEA/D: Mating Neighborhood: α % of the population size

α = 1, 2, 4, 6, 8, 10, 20, 40, 60, 80, 100 Replacement Neighborhood: β % of the population size

β = 1, 2, 4, 6, 8, 10, 20, 40, 60, 80, 100 Scalarizing Function in MOEA/D: Weighted Tchebycheff Population Size: 200

Page 29: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

1

1008060402010 8 6 4 2

100

4020

1086

42

8060

Hypervolume(x108)

4.054.003.953.903.853.803.753.70

2-500 Problem

Two-Objective 500-Item Problem Average Hypervolume over 100 runs

Good Results: Mating Neighborhood: 2%-10% of Pop size Replacement: Any size is OK. Pop size: 200 2 4 6 8 10

Page 30: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Two-Objective 500-Item Problem Results of a Single Run

Maximize f1(x)

Max

imiz

e f 2(

x)

Final GenerationPareto Front

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Maximize f1(x)

Max

imiz

e f 2(

x)

Final GenerationPareto Front

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Maximize f1(x)

Max

imiz

e f 2(

x)

Final GenerationPareto Front

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Maximize f1(x)

Max

imiz

e f 2(

x)

Final GenerationPareto Front

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Mating: 1% Replacement: 1%

Mating: 10% Replacement: 10%

Mating: 1% Replacement: 100%

Mating: 100% Replacement: 1%

Page 31: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Knapsack Problems with 4-10 Objectives (4-500, 6-500, 8-500, 10-500)

Many-Objective Knapsack Problems (n-500 Problems) Randomly generated objectives were added to the original 2-500 problems (n = 4, 6, 8)

Maximize ,)(1

∑=

=n

jjiji xpf x i = 1, 2, ..., n

Subject to ,1

i

n

jjij cxw ≤∑

=

i = 1, 2

pij : Profit of item j according to knapsack i wij : Weight of item j according to knapsack i cij : Capacity of knapsack i

Values of pij were randomly specified in [10, 100].

Page 32: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Computational Experiments Settings of Computational Experiments

EMO Algorithms: MOEA/D Coding: Binary string of length 500 Crossover: Uniform crossover with the probability 0.8 Mutation: Bit-flip mutation with the probability 1/500 Constraint Handling: Greedy repair in Zitzler & Thiele (1999) Termination: 400,000 solution evaluations Mating Neighborhood: α % of the population size

α = 1, 2, 4, 6, 8, 10, 20, 40, 60, 80, 100 Replacement Neighborhood: β % of the populations size

β = 1, 2, 4, 6, 8, 10, 20, 40, 60, 80, 100 Scalarizing Function in MOEA/D:

Tchebycheff (4-500), Weighted Sum (6-500, 8-500) Population Size: 220 (4-500), 252 (6-500), 120 (8-500)

Page 33: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

1

1008060402010 8 6 4 2

100

4020

1086

42

8060

Hypervolume(x1017)

1.451.401.351.301.251.201.15

4-500 Problem

Four-Objective 500-Item Problem Average Hypervolume over 100 runs

Good Results: Mating Neighborhood: 2%-10% of Pop size Replacement: 4%-100% of Pop size Pop size: 220 4 6 8 10

4

2

Page 34: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

1

1008060402010 8 6 4 2

100

4020

1086

42

8060

Hypervolume(x1025)

4.954.704.454.203.953.703.453.20

6-500 Problem

Six-Objective 500-Item Problem Average Hypervolume over 100 runs

Good Results: Mating Neighborhood: 2%-6% of Pop size Replacement: 4%-100% of Pop size Pop size: 252

2 4 6 4

Page 35: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

1

1008060402010 8 6 4 2

100

4020

1086

42

8060

Hypervolume(x1034)

1.551.451.351.251.151.05

0.75

0.950.85

8-500 Problem

Eight-Objective 500-Item Problem Population Size: 120

Good Results: Mating Neighborhood: 6%-8% of Pop size Replacement: 6%-100% of Pop size Pop size: 120

6 8

1.10 NSGA-II

6

Page 36: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Eight-Objective 500-Item Problem Projection onto the f1-f2 Subspace

Mating: 1% Replacement: 1%

Mating: 10% Replacement: 10%

Mating: 1% Replacement: 100%

Mating: 100% Replacement: 1%

Maximize f1(x)

Max

imiz

e f 2(

x)

Final GenerationPareto Front

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Maximize f1(x)

Max

imiz

e f 2(

x)

Final GenerationPareto Front

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Maximize f1(x)

Max

imiz

e f 2(

x)

Final GenerationPareto Front

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Maximize f1(x)

Max

imiz

e f 2(

x)

16000 17000 18000 19000 20000 21000

16000

17000

18000

19000

20000

21000

Final GenerationPareto Front

Page 37: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

1

1008060402010 8 6 4 2

100

4020

1086

42

8060

Hypervolume(x1034)

1.551.451.351.251.151.05

0.75

0.950.85

8-500 Problem1

1008060402010 8 6 4 2

100

4020

1086

42

8060

Hypervolume(x108)

4.054.003.953.903.853.803.753.70

2-500 Problem

1

1008060402010 8 6 4 2

100

4020

1086

42

8060

Hypervolume(x1025)

4.954.704.454.203.953.703.453.20

6-500 Problem

1

1008060402010 8 6 4 2

100

4020

1086

42

8060

Hypervolume(x1017)

1.451.401.351.301.251.201.15

4-500 Problem

Knapsack Problems with 2-8 Objectives Average Hypervolume

Pop size: 200

Pop size: 220

Pop size: 256

Pop size: 120

Page 38: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

0 20 40 60 80 100

20

40

60

80

100

x1

x2

Other Test Problem Six-Objective Distance Minimization Problem

f1(x) = d(x, A) f2(x) = d(x, B) f3(x) = d(x, C) f4(x) = d(x, D) f5(x) = d(x, E) f6(x) = d(x, F)

Minimize f(x) = ( f1(x), f2(x), f3(x), f4(x), f5(x), f6(x))

A

D

F

E

B

C

Page 39: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

x1

x2

0 20 40 60 80 100

20

40

60

80

100

x1

x2

0 20 40 60 80 100

20

40

60

80

100

x1

x2

0 20 40 60 80 100

20

40

60

80

100

x1

x2

0 20 40 60 80 100

20

40

60

80

100

Other Test Problem Six-Objective Distance Minimization Problem

Mating: 1% Replacement: 1%

Mating: 10% Replacement: 10%

Mating: 1% Replacement: 100%

Mating: 100% Replacement: 1%

Page 40: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

0 20 40 60 80 100

20

40

60

80

100

x1

x2

Six-Objective Problem with Four Equivalent Pareto Regions

f1: mind(x, A1), d(x, A2), d(x, A3), d(x, A4)

Minimize f(x) = ( f1(x), f2(x), f3(x), f4(x), f5(x), f6(x))

f2: mind(x, B1), d(x, B2), d(x, B3), d(x, B4) f3: mind(x, C1), d(x, C2), d(x, C3), d(x, C4) f4: mind(x, D1), d(x, D2), d(x, D3), d(x, D4) f5: mind(x, E1), d(x, E2), d(x, E3), d(x, E4) f6: mind(x, F1), d(x, F2), d(x, F3), d(x, F4)

A4

B4

C4

D4

F4

E4

A3

B3

C3

D3

F3

E3

A1

B1

C1

D1

F1

E1

A2

B2

C2

D2

F2

E2

Page 41: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

x1

x2

0 20 40 60 80 100

20

40

60

80

100x1

x2

0 20 40 60 80 100

20

40

60

80

100

Other Test Problem Six-Objective Distance Minimization Problem

Mating: 1% Replacement: 1%

Mating: 10% Replacement: 10%

Mating: 1% Replacement: 100%

Mating: 100% Replacement: 1%

x1

x2

0 20 40 60 80 100

20

40

60

80

100

x1

x2

0 20 40 60 80 100

20

40

60

80

100

Page 42: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Conclusions

We examined the relation between the performance of MOEA/D and the size of the two neighborhoods. For many-objective knapsack problems, we obtained the following observations:

Page 43: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

1

1008060402010 8 6 4 2

100

4020

1086

42

8060

Hypervolume(x1034)

1.551.451.351.251.151.05

0.75

0.950.85

8-500 Problem

Conclusions

We examined the relation between the performance of MOEA/D and the size of the two neighborhoods. For many-objective knapsack problems, we obtained the following observations: (1) Good results were obtained from the combination of

a small (but not too small) mating neighborhood and a large replacement neighborhood.

Page 44: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Conclusions

We examined the relation between the performance of MOEA/D and the size of the two neighborhoods. For many-objective knapsack problems, we obtained the following observations: (1) Good results were obtained from the combination of

a small (but not too small) mating neighborhood and a large replacement neighborhood.

(2) Careful specifications of the two neighborhoods are needed for many-objective problems.

Page 45: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Conclusions

We examined the relation between the performance of MOEA/D and the size of the two neighborhoods. For many-objective knapsack problems, we obtained the following observations: (1) Good results were obtained from the combination of

a small (but not too small) mating neighborhood and a large replacement neighborhood.

(2) Careful specifications of the two neighborhoods are needed for many-objective problems.

(3) When the mating neighborhood was large, good results were not obtained.

Page 46: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Conclusions

We examined the relation between the performance of MOEA/D and the size of the two neighborhoods. For many-objective knapsack problems, we obtained the following observations: (1) Good results were obtained from the combination of

a small (but not too small) mating neighborhood and a large replacement neighborhood.

(2) Careful specifications of the two neighborhoods are needed for many-objective problems.

(3) When the mating neighborhood was large, good results were not obtained.

(4) When the replacement neighborhood was large, good results were obtained.

Page 47: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Conclusions

Thank you very much !

Page 48: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

1

1008060402010 8 6 4 2

100

4020

1086

42

8060

Hypervolume(x1025)

4.954.704.454.203.953.703.453.20

6-500 Problem

Average Computation Time Six-Objective Knapsack Problem

1

1008060402010 8 6 4 2

100

4020

1086

42

8060

6-500 ProbTime (Sec.)

40

35

30

25

20

Page 49: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

1

1008060402010 8 6 4 2

100

4020

1086

42

8060

8-500 ProblemHypervolume

(x1034)1.551.451.351.251.151.05

0.75

0.950.85

1

1008060402010 8 6 4 2

100

4020

1086

42

8060

Hypervolume(x1025)

4.954.704.454.203.953.703.453.20

6-500 Problem

1

1008060402010 8 6 4 2

100

4020

1086

42

8060

Hypervolume(x1025)

4.954.704.454.203.953.703.453.20

6-500 Problem

1

1008060402010 8 6 4 2

100

4020

1086

42

8060

Hypervolume(x1034)

1.551.451.351.251.151.05

0.75

0.950.85

8-500 Problem

Weighted Tchebycheff and Weighted Sum

Weighted Sum

Weighted Sum

Tchebycheff

Tchebycheff

Page 50: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

1

1008060402010 8 6 4 2

100

4020

1086

42

8060

Hypervolume(x1034)

1.651.501.351.201.05

0.750.90

8-500 Problem1

1008060402010 8 6 4 2

100

4020

1086

42

8060

Hypervolume(x108)

4.054.003.953.903.853.803.753.70

2-500 Problem

1

1008060402010 8 6 4 2

100

4020

1086

42

8060

Hypervolume(x1025)

4.954.704.454.203.953.703.453.20

6-500 Problem

1

1008060402010 8 6 4 2

100

4020

1086

42

8060

Hypervolume(x1017)

1.451.401.351.301.251.201.15

4-500 Problem

Knapsack Problems with 2-8 Objectives Average Hypervolume

Pop size: 200

Pop size: 220

Pop size: 256

Pop size: 330

Page 51: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

1

1008060402010 8 6 4 2

100

4020

1086

42

8060

Hypervolume(x1034)

1.651.501.351.201.05

0.750.90

8-500 Problem

Eight-Objective 500-Item Problem Population Size: 330

Good Results: Mating Neighborhood: 2-6% of Pop size Replacement: 4-100% of Pop size

Page 52: Relation between Neighborhood Size and MOEA/D .../file/...Hisao Ishibuchi, Naoya Akedo, Yusuke Nojima Osaka Prefecture University, JAPAN Content of This Presentation 1. Motivation

Average Computation Time

1

1008060402010 8 6 4 2

100

4020

1086

42

8060

6-500 ProblemTime (Sec.)

40

35

30

25

20

1

1008060402010 8 6 4 2

100

4020

1086

42

8060

Hypervolume(x1025)

4.954.704.454.203.953.703.453.20

6-500 Problem