1533.pdf

6
Robust Nonlinear Model Predictive Control with Reduction of Uncertainty via Robust Optimal Experiment Design Sergio Lucia Radoslav Paulen Chair of Process Dynamics and Operations, Technische Universit¨ at Dortmund, Germany E-mail: {sergio.lucia, radoslav.paulen}@bci.tu-dortmund.de Abstract: This paper studies the reduction of the conservativeness of robust nonlinear model predictive control (NMPC) via the reduction of the uncertainty range using guaranteed parameter estimation. Optimal dynamic experiment design is formulated in the framework of robust NMPC in order to obtain probing inputs that maximize the information content of the feedback and simultaneously to guarantee the satisfaction of the process constraints. We propose a criterion for optimal experiment design which provides a minimization of parameter uncertainty in the direction of improved performance of the process under robust economic NMPC. A case study from the chemical engineering domain is studied to show the benefits of the proposed approach. Keywords: Nonlinear model predictive control, Robust control, Optimal experiment design, Guaranteed parameter estimation 1. INTRODUCTION Many studies have been devoted to the problem of real- time optimal process control. The most challenging prob- lems involve handling of nonlinearities and uncertainties of the processes. This paper is focused on the reduction of the parametric uncertainties of the processes for per- formance improvement of nonlinear model-based control approaches. We consider a model of the process described by a set of nonlinear ordinary differential equations (ODEs) and output equations in sampled form as x k+1 = f (x k , u k , d k ), (1a) y k = g(x k ), (1b) where k stands for the sampling instant, x denotes the n x - dimensional vector of process states, u represents the n u - dimensional vector of process control variables (inputs), d is the n d -dimensional vector of uncertain parameters of the process model with a priori known bounds D k := [d L k , d U k ], and y denotes the n y -dimensional vector of model outputs (predictions of measurable state combinations). The superscripts L and U representing the lower and upper bounds of an interval box are understood component-wise throughout the paper. We want to control the process, i.e. determine the control inputs for (1), such that J (y k+1 , u k ) := Np1 k=0 L(y k+1 , u k ), (2) 1 The authors thank Professor Sebastian Engell for fruitful dis- cussions and useful suggestions. This research was funded by the European Commission under grant agreement number 248940 (EM- BOCON), 291458 (MOBOCON) and from the Deutsche Forschungs- gemeinschaft under grant agreement number EN 152/39-1. representing the chosen economic performance criterion, is minimized on a finite prediction horizon of a length N p subject to the set of constraints of the form h(y k+1 , x k+1 , u k , d k ) 0, k ∈{0,...,N p 1}, (3) being satisfied. Optimal trajectories of control inputs can be found by means of mathematical optimization. Given the efficiency of modern optimization tools that provide fast and reliable resolutions to many of the arising problems of nonlinear constrained optimization (Houska et al., 2011), the handling of uncertainties, here present by parametric uncertainties d k , remains the most challenging problem of real-life applications of the optimizing control schemes. One of the possible approaches to optimizing control, in the presence of uncertain parameters in (1), is the utilization of robust control. Various schemes have been presented in this framework (Nagy and Braatz, 2004) while different levels of conservativeness of the resulting robust optimizing control scheme were observed. The use of multi-stage robust nonlinear model predictive control (NMPC), suggested in Lucia et al. (2013), repre- sents a recent approach that was shown to achieve a low degree of conservativeness compared to other state-of-the- art robust approaches. The strength of this approach lies in exploiting the future information that becomes available via feedback (measured outputs) at each sampling time of the process run. A scenario tree of possible realizations of uncertainties is considered to represent possible deviations of the process from nominal predictions. The robustly optimizing control is then found by recursive resolution of the NMPC problem over the set of generated scenarios with (2) as an objective evaluated on the prediction hori- zon subject to (3) where each scenario is assigned with the different probability of occurrence. The key here is Preprints of the 19th World Congress The International Federation of Automatic Control Cape Town, South Africa. August 24-29, 2014 Copyright © 2014 IFAC 1904

Transcript of 1533.pdf

Page 1: 1533.pdf

Robust Nonlinear Model Predictive

Control with Reduction of Uncertainty via

Robust Optimal Experiment Design

Sergio Lucia ∗ Radoslav Paulen ∗

∗ Chair of Process Dynamics and Operations, Technische UniversitatDortmund, Germany

E-mail: {sergio.lucia, radoslav.paulen}@bci.tu-dortmund.de

Abstract: This paper studies the reduction of the conservativeness of robust nonlinearmodel predictive control (NMPC) via the reduction of the uncertainty range using guaranteedparameter estimation. Optimal dynamic experiment design is formulated in the framework ofrobust NMPC in order to obtain probing inputs that maximize the information content ofthe feedback and simultaneously to guarantee the satisfaction of the process constraints. Wepropose a criterion for optimal experiment design which provides a minimization of parameteruncertainty in the direction of improved performance of the process under robust economicNMPC. A case study from the chemical engineering domain is studied to show the benefits ofthe proposed approach.

Keywords: Nonlinear model predictive control, Robust control, Optimal experiment design,Guaranteed parameter estimation

1. INTRODUCTION

Many studies have been devoted to the problem of real-time optimal process control. The most challenging prob-lems involve handling of nonlinearities and uncertaintiesof the processes. This paper is focused on the reductionof the parametric uncertainties of the processes for per-formance improvement of nonlinear model-based controlapproaches.

We consider a model of the process described by a setof nonlinear ordinary differential equations (ODEs) andoutput equations in sampled form as

xk+1 = f(xk,uk,dk), (1a)

yk = g(xk), (1b)

where k stands for the sampling instant, x denotes the nx-dimensional vector of process states, u represents the nu-dimensional vector of process control variables (inputs),d is the nd-dimensional vector of uncertain parametersof the process model with a priori known bounds Dk :=[dL

k ,dUk ], and y denotes the ny-dimensional vector of model

outputs (predictions of measurable state combinations).The superscripts L and U representing the lower and upperbounds of an interval box are understood component-wisethroughout the paper. We want to control the process,i.e. determine the control inputs for (1), such that

J (yk+1,uk) :=

Np−1∑

k=0

L(yk+1,uk), (2)

1 The authors thank Professor Sebastian Engell for fruitful dis-cussions and useful suggestions. This research was funded by theEuropean Commission under grant agreement number 248940 (EM-BOCON), 291458 (MOBOCON) and from the Deutsche Forschungs-gemeinschaft under grant agreement number EN 152/39-1.

representing the chosen economic performance criterion,is minimized on a finite prediction horizon of a length Np

subject to the set of constraints of the form

h(yk+1,xk+1,uk,dk) ≤ 0, ∀k ∈ {0, . . . , Np − 1}, (3)

being satisfied. Optimal trajectories of control inputs canbe found by means of mathematical optimization.

Given the efficiency of modern optimization tools thatprovide fast and reliable resolutions to many of the arisingproblems of nonlinear constrained optimization (Houskaet al., 2011), the handling of uncertainties, here present byparametric uncertainties dk, remains the most challengingproblem of real-life applications of the optimizing controlschemes. One of the possible approaches to optimizingcontrol, in the presence of uncertain parameters in (1),is the utilization of robust control. Various schemes havebeen presented in this framework (Nagy and Braatz, 2004)while different levels of conservativeness of the resultingrobust optimizing control scheme were observed.

The use of multi-stage robust nonlinear model predictivecontrol (NMPC), suggested in Lucia et al. (2013), repre-sents a recent approach that was shown to achieve a lowdegree of conservativeness compared to other state-of-the-art robust approaches. The strength of this approach liesin exploiting the future information that becomes availablevia feedback (measured outputs) at each sampling time ofthe process run. A scenario tree of possible realizations ofuncertainties is considered to represent possible deviationsof the process from nominal predictions. The robustlyoptimizing control is then found by recursive resolutionof the NMPC problem over the set of generated scenarioswith (2) as an objective evaluated on the prediction hori-zon subject to (3) where each scenario is assigned withthe different probability of occurrence. The key here is

Preprints of the 19th World CongressThe International Federation of Automatic ControlCape Town, South Africa. August 24-29, 2014

Copyright © 2014 IFAC 1904

Page 2: 1533.pdf

the use of recourse, i.e. future control inputs along thescenario tree are adapted to the observations, reducing theconservativeness of the approach.

It is an obvious fact that by reducing the range of paramet-ric uncertainty Dk, i.e. narrowing the employed scenariotree, a dramatical improvement can be achieved in terms ofthe conservativeness of the resulting robustly optimal con-trol input. Dual control, originally proposed in Feldbaum(1960) and also studied in Astrom andWittenmark (1971),tackles this problem. The aim of dual control is to strikethe balance between finding the optimizing inputs for thecriterion (2) and inputs that excite the process sufficientlyto reduce the (a posteriori estimated) bounds on the pa-rameter values Dk thanks to information incorporated infeedback. The dynamic programming formulation of theproblem (Bertsekas, 2000) is often found computationallyintractable for nonlinear systems, but the minimizationof the uncertainty (the range of possible dk) can also beachieved via means of optimal design of dynamic experi-ments.

The aim of this paper is to study possible improvements ofthe on-line robust NMPC scheme via a combination of in-puts optimizing the chosen criterion of optimal experimentdesign and the inputs optimizing the economic criterion inthe framework of multi-stage NMPC.

2. MULTI-STAGE NONLINEAR MODELPREDICTIVE CONTROL

Multi-stage NMPC (Lucia et al., 2013) represents a robustNMPC approach that is based on modeling the uncertaintyby a tree of discrete scenarios (see Fig. 1). The treestructure makes it possible to take into account futurecontrol inputs and disturbances explicitly. In this way,future control inputs depend on the value of the previousrealization of the uncertainty, acting as recourse variablesthat counteract the effect of the uncertainty. Therefore,multi-stage NMPC is a closed-loop NMPC approach (Leeand Yu, 1997) in contrast to typical open-loop min-maxapproaches that optimize over a sequence of control inputschecking the constraints for all the cases of the uncertainty.This reduces the conservativeness of the approach consid-erably (Scokaert and Mayne, 1998).

The main assumption of the approach is that the uncer-tainty can be described by a set of discrete scenarios. In thecase of discrete-valued uncertainties, multi-stage NMPCcomputes the exact optimal feedback policy and it is there-fore the best solution possible of the robust NMPC prob-lem within a finite horizon guaranteeing the constraintsatisfaction as well. For the real-valued realizations of theuncertainty, the multi-stage NMPC computes approximaterobust feedback when a suitable scenario tree is chosen asshown in different simulation studies (Lucia et al., 2012,2013; Lucia and Engell, 2013). While for a general non-linear system, constraint satisfaction is not guaranteed forthe values of uncertainty that are not explicitly consideredin the scenario tree, the values of parameters that producethe worst-case scenario are found on the boundaries ofthe parameter interval box very often (Srinivasan et al.,2003a). Therefore, a suitable scenario tree should includescenarios with extreme values of all the parameters. Itis then clear that the main challenge of the approach is

that the size of the resulting optimization problem growsexponentially with the number of uncertainties and withthe length of the prediction horizon. Given a certain choiceof Np, a simple strategy to avoid the exponential growthof problem size is to consider the uncertainty to remainconstant after a certain point in time (called robust hori-zon) as illustrated in Fig. 1. See Lucia et al. (2013) for amore detailed explanation of this concept.

The scenario tree setting assumes a discrete-time formula-tion of an uncertain nonlinear system that can be writtenas:

xjk+1 = f(x

p(j)k ,uj

k,dr(j)k ), (4a)

yjk = g(xj

k), (4b)

where each state vector xjk+1 at stage k + 1 and position

j in the scenario tree depends on the parent state xp(j)k

at stage k, the control inputs ujk and the corresponding

realization r of the uncertainty dr(j)k (for example in Fig. 1,

x62 = f (x2

1,u61,d

31)). The uncertainty at the stage k is

defined by dr(j)k ∈ {d1

k,d2k, . . . ,d

sk} ⊂ Dk for s different

possible combinations of values of the uncertainty. Wedefine the set of occurring indices (j, k) in the scenariotree as I.

The optimization problem that has to be solved at eachsampling instant can be written as:

miny

j

k+1,x

j

k+1,u

j

k,∀(j,k)∈I

J (yjk+1,u

jk) (5a)

subject to:

xjk+1 = f(x

p(j)k ,uj

k,dr(j)k ), ∀ (j, k + 1) ∈ I, (5b)

yjk = g(xj

k), ∀ (j, k) ∈ I, (5c)

0 ≥ h(yjk+1,x

jk+1,u

jk,d

r(j)k ), ∀ (j, k) ∈ I, (5d)

ujk = ul

k if xp(j)k = x

p(l)k , ∀ (j, k), (l, k) ∈ I, (5e)

where J (yjk+1,u

jk) :=

∑N

i=1 ωiJi(yjk+1,u

jk). Here we as-

sign the probability ωi for the scenario Si, i ∈ {1, . . . , N}to occur. A scenario is defined as the path in the scenariotree from the root node x0 until each one of the leaf nodes.The cost of each scenario reads as:

Ji(yjk+1,u

jk) :=

Np−1∑

k=0

L(yjk+1,u

jk), ∀yj

k+1,ujk ∈ Si. (6)

In order to represent the real-time decision problem cor-rectly, the control inputs cannot anticipate the realizationof the uncertainty at the instant k. This is modeled by thenon-anticipativity constraints (5e) that force all the control

inputs ujk that branch at the same parent node x

p(j)k to be

equal. The definition of problem (5) allows the uncertaintyto vary over the time. In this study we will assume thatthe uncertain parameters are constant for simplicity, hencethe notation d0 ∈ D0 := [dL

0 ,dU0 ].

3. ROBUST OPTIMAL DYNAMIC EXPERIMENTDESIGN

Optimal dynamic experiment design has been widely usedsince the seventies of the last century, especially in thefield of system identification (see Gevers et al. (2011) fora review). In general, it can be formulated as the problem

19th IFAC World CongressCape Town, South Africa. August 24-29, 2014

1905

Page 3: 1533.pdf

Prediction horizon = 4

Robust horizon = 2

11x

31x

21x

10u

20u

30u

10d

20d

30d

12x

22x

32x

11u 1

1d2

1d21u

31d3

1u

42x

52x

62x

41u 1

1d2

1d51u

31d6

1u

72x

82x

92x

71u 1

1d2

1d81u

31d9

1u

0x

13x

23x

33x

14x

24x

34x

43x

53x

63x

44x

54x

64x

73x

83x

93x

74x

84x

94x

12u 1

2d

22d2

2u

32d3

2u

42u 1

2d

52u 2

2d

62u 3

2d

72u 1

2d

82u 2

2d

92u 3

2d

13u 1

3d

23u 2

3d

33u 3

3d

43u 1

3d

53u 2

3d

63u 3

3d

73u 1

3d

83u 2

3d

93u 3

3d

Fig. 1. Scenario tree representation of the uncertaintyevolution for multi-stage NMPC.

of designing the input trajectories to the system (1) thatgenerate measurements outputs from which parameterscan be identified with maximal possible certainty.

Such a problem can be defined via minimization of anappropriate measure, φ(F), of the Fisher informationmatrix defined as:

F :=

Ne−1∑

k=0

sTy,k+1Qsy,k+1, (7)

where Ne stands for the horizon where the optimal ex-periment is realized, Q is the inverse of the covariancematrix of the measurement noise, and sy,k+1 representsthe matrix of parametric output sensitivities, here definedin the fully relative form suggested by Munack (1991):

sx,k+1 = f s(sx,k,xk,uk,d), (8a)

sy,k = gs(sx,k,xk), (8b)

where the sensitivity of the ith state w.r.t. the jth param-eter obeys the dynamics

f si,j =

djxj,k

(

∂fi∂xT

{sx,k}j +∂fi∂dj

)

, (9)

where {·}j represents the jth column of a matrix. Thefunction gs is derived analogously respecting (1b).

Among the several different possible experiment designcriteria (Munack, 1991), we choose a modified E-designcriterion:

φmE(F) =(

maxi

λi(F))

/(

mini

λi(F))

, (10)

where λi represents ith eigenvalue of F. This choice ismotivated by the minimization of the most uncertainparameter while achieving uncorrelated parameter esti-mates and it represents one of the generally recommendedchoices (Franceschini and Macchietto, 2008).

As we aim primarily at the minimization of the economicalcriterion (2) under uncertainty we propose a new optimalexperiment design criterion. This uses the modified E-design with a scaled Fisher matrix such that:

φ(F) = φmE

(

diag−1

[

∂J ∗

∂w(D)

]

F diag−1

[

∂J ∗

∂w(D)

])

,

(11)

where the scaling matrix contains the sensitivities of theoptimal value of the robust economic objective w.r.t. thewidth of the range of parametric uncertainty.

A similar scaling was proposed in Recker et al. (2013)where the sensitivity of the economic cost is consideredw.r.t. the parametric uncertainty. In contrast to that ap-proach, we directly take into account the fact that ifparametric uncertainty is present, a robust operation willbe needed. As mentioned above, the conservativeness ofthe robust operation directly depends on the range of theuncertainty. Therefore we use as scaling factor the poten-tial gain in the robust economic operation w.r.t. reductionin the parameter uncertainty range. Note that modernnonlinear programming solvers are capable of providingparametric sensitivity information w.r.t. the calculatedoptimum and thus, gathering of the scaling matrix can beautomated when solving the problem (5) for some D. Inthis work, the problem of optimal dynamic experiment de-sign is formulated in the framework of multi-stage NMPC,hence Eq. (11) is reformulated as (6), in order to strikefor the uncertainty in the objective and in the processconstraints which are formulated accordingly.

4. GUARANTEED PARAMETER ESTIMATION

Given a set of output measurements ym at Ne time points1, . . . , Ne, classical parameter estimation seeks for one par-ticular instance de of the parameters for which the (pos-sibly weighted) normed difference between measurementsand the corresponding model outputs y is minimized.This optimization problem, for instance in the least-squaresense, is given by:

de ∈ arg mind∈D0

Ne∑

i=1

‖ymk − yk‖

22, (12a)

s.t. model (1), (12b)

The confidence of the parameter estimates subject to mea-surement noise can then be approximated via ellipsoidalset whose shaping matrix (variance-covariance matrix ofthe estimates) can be approximated as an inverse of (7).

In contrast, guaranteed (bounded-error) parameter estima-tion accounts explicitly for the fact that the actual processoutputs, yp, are only known to be corrupted by somebounded measurement errors e ∈ E := [eL, eU ], so that

ypk ∈ ym

k + [eL, eU ] =: Y k. (13)

Here, the main objective is to estimate the set De of allpossible parameter values d such that yk ∈ Y k for everyk = 1, . . . , Ne; that is,

De :=

d ∈ D0

∃x,y :xk+1 = f(xk,uk,d),yk = g(xk),yk ∈ Y k, ∀k ∈ {1, . . . , Ne}

. (14)

Depicted in red in Fig. 2 is the set of parameters De

projected in the (d1, d2) space that generate trajectoriessatisfying yk ∈ Y k, k = 1, . . . , Ne.

Obtaining an exact characterization of the set De is notpossible in general, and one has to resort to approxi-mation techniques to make the problem computationallytractable. We use a variant of the Set Inversion Via IntervalAnalysis (SIVIA) algorithm by Jaulin and Walter (1993)

19th IFAC World CongressCape Town, South Africa. August 24-29, 2014

1906

Page 4: 1533.pdf

d1

d2D ∈ Dint

D ∈ Dout

De

D ∈ Dbnd

D0

Fig. 2. Illustration of guaranteed parameter estimationconcepts in the parameter space.

in order to approximate the solution set De as closely aspossible. More concretely, the set De is approximated us-ing the union of parameter sub-boxes that approximate itsinterior (Dint) and over-approximate its boundary (Dbnd).An illustration of such parameter sub-boxes is shown inFig. 2 where Dout stands for the partition of parameterspace guaranteed to have empty intersection with De.Upon termination, this algorithm returns partitions Dint

and Dbnd such that

D∈Pint

D ⊆ De ⊆

(

D∈Dint

D

)

(

D∈Dbnd

D

)

=: DNe.

(15)Further details on possible implementation variants ofthe described procedure can be found in Paulen et al.(2013a,b).

5. PROPOSED ALGORITHM

The main contribution of this paper is the presentationof a novel algorithm for the reduction of the uncertaintypresent in the model by applying robust optimal design ofexperiments and thus reducing the conservativeness intro-duced by a robust NMPC approach. The main motivationfor proposing the novel OED criterion (11) is to estimatebetter the parameters that have a higher impact on therobust economic operation of the system. Since the Fisherinformation matrix provides only an approximation of thevariance-covariance matrix of the estimated parameters,we propose the use of guaranteed parameter estimationto ensure more accurate approximation of the possibleparameter values taking into account the measurementnoise. We propose to apply the inputs generated via robustOED for a fixed number of steps Ne, then the maximumand minimum values of the estimated parameters obtainedvia guaranteed parameter estimation (set DNe

) are usedto build a new scenario tree for multi-stage NMPC which issolved until the end of the control problem. The completealgorithm can be seen in Algorithm 1.

All the optimization problems reported in this workare solved using IPOPT (Wachter and Biegler, 2006)via CasADi (Andersson et al., 2012). The sensitivitiesentering in (11) are calculated using sIPOPT (Pirnayet al., 2012) and the guaranteed parameter estimation isimplemented using GOLIB (http://www3.imperial.ac.

Algorithm 1 Robust NMPC with uncertainty reduction

Input: k = 0;Ne > 0;x0;D0

1. while k < Ne do

1.1 Calculate∂J ∗

∂w(D)with D = D0.

1.2 Solve the robust OED problem by minimiz-ing (11) formulated as (6) in the framework of (5)with the prediction horizon Ne − k.

1.3 Increment k, k := k + 1.end of while

2. Run guaranteed parameter estimation using the ob-tained measurements, getting DNe

as a result.3. Generate a new scenario tree using the guaranteed

maximum and minimum values of the parametersfrom DNe

.4. Run multi-stage NMPC by solving (5) with an eco-

nomic cost function until the end of the control task.

uk/environmentenergyoptimisation/software) and li-brary MC++ (http://projects.coin-or.org/MCpp).

6. CASE STUDY

We consider one of the traditional problems of optimalcontrol of a chemical reactor. An exothermic chemical reac-tion A+B→C is run in a fed-batch reactor equipped witha cooling jacket. We use the setup of the experiment beingclosely similar to Srinivasan et al. (2003b) and Ubrich et al.(1999).

The reaction system is described by the following set ofODEs:

dcAdt

= −kcAcB −u

VcA, cA(0) = cA,0, (16)

dcBdt

= −kcAcB +u

V(cB,in − cB), cB(0) = cB,0, (17)

dcCdt

= kcAcB −u

V− cC, cC(0) = 0, (18)

dV

dt= u, V (0) = V0, (19)

where ci represents concentration of the substance i, kstands for the reaction rate, V is the volume of the re-actor, and u represents the feed flowrate of reactant Bwith concentration cB,in=10molL−1. The considered ini-tial conditions cA,0, cB,0 and V0 take values of 2molL−1,0.46mol L−1 and 0.7 L respectively.

The reaction is run under isothermal conditions where theinlet cooling jacket temperature is assumed to be adjustedto maintain the temperature in the reactor at T = 70◦C.The respective evolution of the temperature of coolingmedium inside the jacket obeys:

Tj(t) = T −(−∆H)kcA(t)cB(t)V (t)

αA(t), (20)

where ∆H is the reaction enthalpy, α is a heat transfercoefficient and and A is the contact area between the jacketand the reactor.

In order to prevent an uncontrollable behavior of thereaction under a cooling failure (thermal runaway), themaximum attainable temperature is restricted to:

Tcf = T (t) + mini∈{A,B}

ci(−∆H)

ρcp≤ Tmax, (21)

19th IFAC World CongressCape Town, South Africa. August 24-29, 2014

1907

Page 5: 1533.pdf

0 0.2 0.4 0.6 0.8 10

0.05

0.1

c C [m

ol]

EconomicModified EProposed

0 0.2 0.4 0.6 0.8 176

78

80

Tcf

[° C

]

0 0.2 0.4 0.6 0.8 10

0.05

0.1

Time [h]

u [l/

h]

Fig. 3. Concentration cC, temperature Tcf and controlinput u obtained from running robust optimal OEDfor different design criteria.

where ρ denotes the density and cp the heat capacity of thereaction mixture. Additionally, the volume of the reactor isbounded by its maximum value, V ≤ Vmax and the controlinput is bounded (umin ≤ u ≤ umax) as well.

The control task is to achieve a desired mass of theproduct C as fast as possible, nC = cCV ≥ nC,des. In thiswork we approximate the minimum time problem by amaximization of the mass of product C (nC) over a finiteprediction horizon, since simulation studies showed thatthe results obtained are almost equivalent. All the valuesof parameters present in the model and constraints aretaken from Srinivasan et al. (2003b). It is considered thatthe parameters k and ∆H are uncertain and have constantbut unknown values in the range ±30% with respect totheir nominal values. The measured quantities (cA, cBand Tj) are subject to the noise Eci = [−0.05, 0.05] andETj

= [−0.5, 0.5] which is simulated using the appropriaterounding of the value of simulated outputs for the purposeof reproducibility of the results obtained here.

In the remainder of the paper, we show the results ofapplying Algorithm 1 to the presented case study. Thefirst step is the robust optimal dynamic experiment design.In order to achieve robust performance and satisfaction ofthe constraints for all the possible values of the uncertainty(±30%), the OED problem is formulated as in (5) usinga scenario tree that contains the maximum, minimumand nominal value of the uncertain parameters with arobust horizon equal to 1. The OED problem is solved in ashrinking horizon fashion forNe = 10 steps and a samplingtime Ts = 0.1 h. The results for three different OEDcriteria are shown in Fig. 3. The economic design uses asobjective function the maximization of the concentrationof product C (nC), the Modified E design minimizes theOED criterion defined in (10) and the proposed algorithmminimizes the criterion (11).

After Ne = 10 steps, guaranteed parameter estimationis run where the obtained sets of guaranteed parameterestimates are shown in Fig. 4. We are interested in theprojections of the resulting set on the parameter axes,

0.056 0.057 0.058 0.059 0.06−8

−7.8

−7.6

−7.4

−7.2

−7

−6.8

−6.6

−6.4

−6.2x 10

4

k [l/mol h]

∆ H

[J/m

ol]

EconomicModified EProposedReal value

Fig. 4. Sets of guaranteed parameter estimates resultingfrom the measurements and control inputs obtainedfrom optimal OED for different design criteria.

because these determine the generation of the (new) sce-nario tree for the solution of problem (5). As expected,the robust OED with an economic cost yields the biggestranges of the parameters which justifies the utilization ofdual control for this case study. The modified E designgives smaller ranges and the proposed OED criterion (11)yields a smaller range for ∆H and a bigger range for theparameter k. As expected, all the sets contain the ’true’values of the parameters that in this case were assumed tobe 20% bigger than the nominal value.

Due to the novel scaling of the Fisher matrix introducedin (11), ∆H can be estimated with a higher accuracy andthis results in a superior performance compared to theOED using other criteria (see Fig. 5) when multi-stageNMPC is run with the new scenario tree based on theparameter estimates and with an economic cost function(maximization of nC). The reason for this is that ∆Hhas a higher impact on the robust economic operation ofthe plant, since it influences directly the constraint on thetemperature Tcf . As can be seen in Fig. 5, the economicoptimal operation of the plant consists in driving the sys-tem as close as possible to the temperature constraint Tcf .Multi-stage NMPC calculates automatically a back-off toensure that the constraint is not violated for any valueof the uncertainty. If the range of the uncertainty thathas to be taken into account is wider, then the necessaryback-off is bigger and the resulting economic performancedecreases. In this case, the lower bound on the uncertainparameter ∆H is the most important factor for the back-off. Therefore the dual control-like procedure that usesthe OED with modified E design criterion gives a perfor-mance similar to the performance achieved by sole robusteconomic cost optimization despite yielding a narrowerrange of parameter uncertainty. The algorithm proposedin this paper achieves a batch time reduction by 1.5 hourswhich stands for a 7.5% improvement over running robustNMPC with economical cost and the same procedure forestimation of the uncertainty.

7. CONCLUSION

A novel strategy for robust NMPC with improved per-formance via uncertainty reduction was presented. A new

19th IFAC World CongressCape Town, South Africa. August 24-29, 2014

1908

Page 6: 1533.pdf

0 5 10 15 20 250

0.5

1

c C [m

ol]

EconomicModified EProposed

0 5 10 15 20 2576

78

80

Tcf

[° C

]

0 5 10 15 20 250

0.05

0.1

Time [h]

u [l/

h]

Fig. 5. Concentration cC , temperature Tcf and controlinput u obtained from running multi-stage NMPCwith a scenario tree generated with parameter boundsobtained by the guaranteed parameter estimation fordifferent OED design criteria.

criterion for optimal OED is proposed in order to prioritizethe more accurate estimation of the parameters that havea higher influence on the robust economic operation of thesystem. In order to avoid the unreliable approximationon the parameter ranges associated with typical OEDapproaches, a guaranteed parameter estimation approachis used to obtain the bounds of the uncertain parameters.The obtained bounds are used to build a new scenariotree with reduced uncertainty and a better economic per-formance is achieved. Simulation results of a chemicalreactor show the potential of the approach and the possibleimprovements compared to a typical OED design and toa standard robust economic operation of the plant.

REFERENCES

Andersson, J., Akesson, J., and Diehl, M. (2012). CasADi– A symbolic package for automatic differentiation andoptimal control. In Recent Advances in AlgorithmicDifferentiation, Lecture Notes in Computational Scienceand Engineering, 297–307. Springer, Berlin.

Astrom, K. and Wittenmark, B. (1971). Problems ofidentification and control. Journal of MathematicalAnalysis and Applications, 34, 90–113.

Bertsekas, D.P. (2000). Dynamic Programming and Opti-mal Control. Athena Scientific, 2nd edition.

Feldbaum, A.A. (1960). Dual control theory I. AutomationRemote Control, 21, 874–880.

Franceschini, G. and Macchietto, S. (2008). Model-baseddesign of experiments for parameter precision: State ofthe art. Chem. Eng. Sci., 63(19), 4846–4872.

Gevers, M., Bombois, X., Hildebrand, R., and Solari,G. (2011). Optimal experiment design for open andclosed-loop system identification. Communications inInformation and Systems, 11, 197–224.

Houska, B., Ferreau, H.J., and Diehl, M. (2011). An auto-generated real-time iteration algorithm for nonlinearMPC in the microsecond range. Automatica, 47(10),2279–2285.

Jaulin, L. and Walter, E. (1993). Set inversion viainterval analysis for nonlinear bounded-error estimation.Automatica, 29(4), 1053–1064.

Lee, J.H. and Yu, Z.H. (1997). Worst-case formulationsof model predictive control for systems with boundedparameters. Automatica, 33(5), 763–781.

Lucia, S. and Engell, S. (2013). Robust nonlinear modelpredictive control of a batch bioreactor using multi-stagestochastic programming. In Proc. of the 12th EuropeanControl Conference, Zurich, 4124–4129.

Lucia, S., Finkler, T., Basak, D., and Engell, S. (2012). Anew robust NMPC scheme and its application to a semi-batch reactor example. In Proc. of the InternationalSymposium on Advanced Control of Chemical Processes,69–74.

Lucia, S., Finkler, T., and Engell, S. (2013). Multi-stagenonlinear model predictive control applied to a semi-batch polymerization reactor under uncertainty. Journalof Process Control, 23(9), 1306–1319.

Munack, A. (1991). Optimization of sampling. Measuring,Modelling and Control, Biotechnology, 4, 252–264.

Nagy, Z.K. and Braatz, R.D. (2004). Open-loop andclosed-loop robust optimal control of batch processesusing distributional and worst-case analysis. Journalof Process Control, 14(4), 411–422.

Paulen, R., Villanueva, M., and Chachuat, B. (2013a).Optimization-based domain reduction in guaranteed pa-rameter estimation of nonlinear dynamic systems. In 9thIFAC Symposium on Nonlinear Control Systems, 564–569.

Paulen, R., Villanueva, M., Fikar, M., and Chachuat, B.(2013b). Guaranteed parameter estimation in nonlineardynamic systems using improved bounding techniques.In European Control Conference, Zurich, Switzerland,4514–4519.

Pirnay, H., Lopez-Negrete, R., and Biegler, L. (2012).Optimal sensitivity based on IPOPT. MathematicalProgramming Computation, 4, 307–331.

Recker, S., Kerimoglu, N., Harwardt, A., Tkacheva, O.,and Marquardt, W. (2013). On the integration of modelidentification and process optimization. In Proc. of the23rd European Symposium on Computer Aided ProcessEngineering, 1021–1026.

Scokaert, P. and Mayne, D. (1998). Min-max feedbackmodel predictive control for constrained linear systems.IEEE Trans. on Automatic Control, 43(8), 1136–1142.

Srinivasan, B., Bonvin, D., Visser, E., and Palanki, S.(2003a). Dynamic optimization of batch processes: II.role of measurements in handling uncertainty. Comput-ers & Chemical Engineering, 27(1), 27–44.

Srinivasan, B., Palanki, S., and Bonvin, D. (2003b). Dy-namic optimization of batch processes: I. Characteriza-tion of the nominal solution. Computers & ChemicalEngineering, 27(1), 1–26.

Ubrich, O., Srinivasan, B., Stoessel, F., and Bonvin, D.(1999). Optimization of a semi-batch reaction systemunder safety constraints. In European Control Confer-ence, Karlsruhe, Germany, F306.1–F306.6.

Wachter, A. and Biegler, L. (2006). On the implemen-tation of a primal-dual interior point filter line searchalgorithm for large-scale nonlinear programming. Math-ematical Programming, 106, 25–57.

19th IFAC World CongressCape Town, South Africa. August 24-29, 2014

1909