Author's personal copy - Ruđer Bošković Institute · Author's personal copy dental materials 24...

11
This article was published in an Elsevier journal. The attached copy is furnished to the author for non-commercial research and education use, including for instruction at the author’s institution, sharing with colleagues and providing to institution administration. Other uses, including reproduction and distribution, or selling or licensing copies, or posting to personal, institutional or third party websites are prohibited. In most cases authors are permitted to post their version of the article (e.g. in Word or Tex form) to their personal website or institutional repository. Authors requiring further information regarding Elsevier’s archiving and manuscript policies are encouraged to visit: http://www.elsevier.com/copyright

Transcript of Author's personal copy - Ruđer Bošković Institute · Author's personal copy dental materials 24...

This article was published in an Elsevier journal. The attached copyis furnished to the author for non-commercial research and

education use, including for instruction at the author’s institution,sharing with colleagues and providing to institution administration.

Other uses, including reproduction and distribution, or selling orlicensing copies, or posting to personal, institutional or third party

websites are prohibited.

In most cases authors are permitted to post their version of thearticle (e.g. in Word or Tex form) to their personal website orinstitutional repository. Authors requiring further information

regarding Elsevier’s archiving and manuscript policies areencouraged to visit:

http://www.elsevier.com/copyright

Author's personal copy

d e n t a l m a t e r i a l s 2 4 ( 2 0 0 8 ) 18–27

avai lab le at www.sc iencedi rec t .com

journa l homepage: www. int l .e lsev ierhea l th .com/ journa ls /dema

Estimation of chemical resistance of dental ceramics byneural network

Jasenka Zivko-Babic a, Dragutin Lisjakb, Lidija Curkovic b, Marko Jakovaca,∗

a Department of Prosthodontics, School of Dental Medicine, University of Zagreb, Gunduliceva 5, 10000 Zagreb, Croatiab Department of Materials, Faculty of Mechanical Engineering and Naval Architecture, University of Zagreb,Ivana Lucica 5, 10000 Zagreb, Croatia

a r t i c l e i n f o

Article history:

Received 23 January 2006

Received in revised form

11 January 2007

Accepted 19 January 2007

Keywords:

Dental ceramics

Neural network

Chemical resistance

a b s t r a c t

Objectives. The purpose of this research was to determine the mass concentrations of ions

eluted from dental ceramic after an exposure to hydrochloric acid and, drawing on those

results, to develop a feedforward backpropagation neural network (NN).

Materials and methods. Four dental ceramics were selected for this study. The experimental

measurement was conducted after 1, 2, 3, 6 and 12 months of exposure to hydrochloric acid.

The results of the 1, 2, 6 and 12 months of immersion were used for training a 13-13-5 model

of NN. For evaluating NN efficiency, the regression analysis of input variables obtained by

the experiment and output variables provided by the trained network was used.

Results. The measured data from the 3-month acid exposure and data obtained by the neural

network estimation were compared.

High correlation coefficient (R) and low normalized root mean square error (NRMSE) between

the measured and estimated output values were observed.

Conclusions. It could be concluded that the artificial neural network has a great potential as

an additional method in investigating the properties of dental materials.

© 2007 Academy of Dental Materials. Published by Elsevier Ltd. All rights reserved.

1. Introduction

Dental materials have to satisfy strict criteria because of theirlong therapeutic durability in the oral cavity. One of the mostimportant properties of all restorative dental materials is theirchemical resistance. Chemical resistance or chemical durabil-ity depends on the structure and composition of the material,laboratory conditions, and environment, which is in this casethe oral cavity.

There are several methods for testing the chemical resis-tance of restorative materials. ISO [1] and ADA [2] standardsare usually recommended. Both methods use a 4% aceticacid as a solution medium for faster degradation of dentalceramics. The goal of these methods is to find out the weight

∗ Corresponding author. Tel.: +385 14802135; fax: +385 14802159.E-mail address: [email protected] (M. Jakovac).

loss of ceramic samples after an exposure to the mentionedacid. There are also methods that test chemical resistance ofceramic in more detail, in different media, for a longer period,etc. [3–11]. However, technical literature does not mention anymethod which could predict the amount of chemical degrada-tion of ceramic material after the measuring interval and at allpoints during the interval. For this reason a neural network isdeveloped. A neural network is a computer simulation of thebehavior of a material based on the experimental research ofits properties. This method has been used for testing materi-als in mechanical engineering [12]. However, neural networksare rarely used for testing dental materials and never for eval-uating the chemical resistance of dental ceramics [13,14]. Thepurpose of this research was to determine the mass concen-

0109-5641/$ – see front matter © 2007 Academy of Dental Materials. Published by Elsevier Ltd. All rights reserved.doi:10.1016/j.dental.2007.01.008

Author's personal copy

d e n t a l m a t e r i a l s 2 4 ( 2 0 0 8 ) 18–27 19

Fig. 1 – Principle of the feedforward backpropagation trainingalgorithm.

trations of ions eluted from a dental ceramic after an exposureto hydrochloric acid and, drawing on those results, to developa feedforward backpropagation neural network.

2. Artificial neural network

Artificial neural networks (ANN) are inspired by the biologicalneural system and its ability to learn through example. Insteadof following a group of well-defined rules specified by theuser, neural networks learn through intrinsic rules obtainedfrom presented samples. The most commonly used ANNarchitecture is the multilayer backpropagation neural network.Backpropagation was created by generalizing the Widrow-Hoff learning rule to multiple-layer networks and nonlineardifferentiable transfer functions [15]. Input vectors and thecorresponding target vectors are used to train the networkuntil it can approximate a function, associate input vectorswith specific output vectors. Standard backpropagation is agradient descent algorithm, as is the Widrow-Hoff learningrule, in which the network weights are moved along the neg-ative of the gradient of the performance function. The termbackpropagation refers to the manner in which the gradient iscomputed for nonlinear multilayer networks. Backpropagationneural networks often have one or more hidden layers of sig-moid neurons followed by an output layer of linear neurons.Multiple layers of neurons with nonlinear transfer functionsallow the network to learn nonlinear and linear relationshipsbetween input and output vectors. There are numerous varia-tions of the basic algorithm that are based on other standardoptimization techniques, such as conjugate gradient and New-ton methods [15]. The one used in this paper is the feedforwardbackpropagation training algorithm designed to minimize themean square error (MSE) between the actual (estimation) out-put (a, A) and the desired (target) output (d, T). Fig. 1 shows theprinciple of the feedforward backpropagation training algorithm.The basic learning algorithm can be summarized as follows:

Step 1. Set the initial values of weights Vij and Wjk.

Step 2. Compute the outputs of all neurons layer-by-layer,starting with the input layer as shown below:

netj =I∑

i=1

VijXi, j = 1, 2, . . . , J − 1, i = 1, 2 . . . , I (1)

Yj = f (netj) (2)

netk =J∑

j=1

WjkYj, j = 1, 2, . . . , J − 1, k = 1, 2, . . . , K

(3)

Yk = f (netk) (4)

where Vij is the weight between the input layer andthe hidden layer, Wjk the weight between the hiddenlayer and the output layer, Xi the input signals (value ofchemical composition), i the number of neurons of theinput layer, I the number of inputs of neuron j in thehidden layer, Yj the output of the hidden neurons, j thenumber of neurons of the hidden layer, J the numberof inputs of neuron k in the output layer. Yk the outputsignals (mass of eluted ions per gram of samples), andk is the number of neurons of the output layer. In thecase of sigmoidal transfer function of the hidden layer,the following equation applies:

f (x) = 21 + e−x

− 1 (5)

Step 3. Compute system error E:

E = 12

K∑k=1

(dk − ak)2 (6)

where K represents the total number of patterns, dk

the desired outputs (experimental values) and ak theactual outputs.

Step 4. If E is small enough or learning iteration is too big, stoplearning.

Step 5. Compute learning errors for every neuron layer-by-layer:

ık = (dk − ak)f ′(netk), k = 1, 2, . . . , K (7)

ık =K∑

k=1

Wjkıkf ′(netj), j = 1, 2, . . . , J − 1, k = 1, 2, . . . , K

(8)

Step 6. Update weights along negative gradient of E:

Wjk(n + 1) = Wjk(n) + lrıkYj + ˛(Wij(n) − Wij(n − 1)) (9)

Vji(n + 1) = Vji(n) + lrıjXi + ˛(Vji(n) − Vji(n − 1)) (10)

where lr is the learning rate, ˛ the momentum, and nis the current iteration step.

Step 7. Repeat from Step 2.

Author's personal copy

20 d e n t a l m a t e r i a l s 2 4 ( 2 0 0 8 ) 18–27

Fig. 2 – Schematic drawing of the model of the used neural network.

3. Material and methods

Four dental ceramics were selected for this study: feldspathicceramic (IPS-Classic, Ivoclar-Vivadent, Schaan, Liechtenstein),hydrothermal ceramic (Duceragold, Ducere Dental, Rosbach,Germany) and two glass ceramics with different composition(IPS-Empress for staining and layering technique, Ivoclar-Vivadent, Schaan, Liechtenstein). The selection of the ceramicmaterials was based on their mutual compositional differ-ences. One specimen of each ceramic material was fabricatedusing a Plexiglas mold (10 mm × 10 mm × 2 mm). The ceramicmaterials were prepared strictly following their producers’instructions. A creamy mixture of feldspathic ceramic orhydrothermal ceramic was put in the mold and thoroughlycondensed. Then the mold was removed and the specimensleft on top of a platinum foil and baked. Wax patterns wereused for heat-pressed ceramics. The surfaces were groundusing 500- and 1000-grit (18 �m) SiC-paper on a disc rotatingat 150 rpm, and then glazed.

The samples were cleaned in an ultrasonic bath (Ultra SonicBath Model 1510 DTH, Electron Microscopy Sciences) and leftto dry for 4 h at 150 ± 5 ◦C (Sterilizer, Instrumentaria, Zagreb,Croatia). The samples were then placed in a plastic flask (PP,25.0 ml) filled with 10−3 mol dm−3 HCl at 50 ◦C. The mass con-centrations of eluted Na+, K+ and Ca2+ ions were determinedusing the ATOMIC ABSORPTION SPECTROPHOTOMETER (AAS,AA-6800, SHIMADZU, Kyoto, Japan) and the mass concentra-tions of Si4+ and Al3+ ions using the SPECTROPHOTOMETER

UV/VIS (COLEMAN 55, PERKIN ELMER, Norwalk, USA). Themeasurements were conducted after 1, 2, 3, 6 and 12 monthsof immersion.

4. Model of the neural network

The work included experimenting with a two-layer (13-13-5)feedforward backpropagation neural network, whose simplifiedmodel is shown in Fig. 2. The input layer is made up by thedata on the chemical composition of a dental ceramic (SiO2,Al2O3, K2O, Na2O, CaO, MgO, BaO, B2O3, CeO2, pigment, LiO2,TiO2) and on the time of exposure (time), and the output layer

Table 1 – Training parameters of neural network

Parameter Value

Performance goal 0.0001Learning rate 0.01Ratio to increase learning rate 1.05Ratio to decrease learning rate 0.5Maximum performance increase 1.04Minimum performance gradient 1e−10Momentum constant 0.9Number of layers 2Number of neurons 13-13-5Transfer functions Tansig & purelinTraining function TraingdxNumber of epochs to train 15,000

Author's personal copy

d e n t a l m a t e r i a l s 2 4 ( 2 0 0 8 ) 18–27 21

Table 2 – Data sets for training (non-shaded) and testing (shaded) of the neural network

Key: sample 1, feldspathic ceramic; sample 2, hydrothermal ceramic; sample 3, glass ceramic for staining; sample 4, glass ceramic for layering.

Table 3 – Comparison of the measured data (ME) and data estimated by the neural network (NN)

Key: ME, values obtained by measure; NN, values obtained by neural network; � = NN − ME; � (%) = ((NN − ME)/NN) × 100; shaded rows, data setsfor testing of the neural network.

Author's personal copy

22 d e n t a l m a t e r i a l s 2 4 ( 2 0 0 8 ) 18–27

Fig. 3 – Comparison of the measured data (ME) and data estimated by the neural network (NN) for Al3+ for the completeimmersion period.

is made up by the data on mass concentrations of ions (Al3+,Si4+, Na+, K+, Ca2+) eluted from dental ceramics. The chosenmodel with 13 input neurons, 13 neurons in the hidden layer,and 5 output neurons is the result of the author’s experiment-ing and practical experiences obtained during work [12,16].For modelling, MathWorks, Neural Network Toolbox, Release4.0.1 was used [17] according to whose rules hidden layersof the network were marked. As the transfer function of thefirst hidden layer, the function of sigmoidal type (tansig) wasapplied, and of the second hidden layer – the function oflinear type (purelin). As a training function, traingdx – gradi-ent descent with momentum and the adaptive learning ratebackpropagation function was applied. Training parametersof the network are shown in Table 1. Because of relativelysmall numbers of input training data, it was not possible todefine a separate group for validation of the network dur-ing the training process and to apply some of the methods(e.g. early stopping) for improving generalization of the net-work. Input–output data for training the network are shownin Table 2. Data obtained during 1, 2, 6, and 12 months ofthe experiment were included in the network training pro-cess. Data obtained during the 3rd month of the experimentwere excluded from the training process, and used for networktesting.

For the estimation of performance of the learning algo-rithm in solving the specified task, performance index wasdefined. Performance index enabled comparison of theapplied neural network algorithm with the other learning

algorithms. The most frequent performance index is the nor-malized root mean square error—NRMSE [15]:

NRMSE =

√∑N

n=1(dn − an)2/N

�dn(11)

�dn=

√√√√ 1N

N∑n=1

(dn − d)2

(12)

d = 1N

N∑n=1

dn (13)

where N is the total number of patterns, dn the desired (target,T) outputs, an the actual (estimation, A) outputs and �dn

is thestandard deviation.

5. Results

Using experimental data, the feedforward backpropagation neu-ral network for estimation of the wear resistance of dentalceramics was modelled (Fig. 2).

The results of the 1, 2, 6 and 12 months of immersion wereused for training a 13-13-5 model of neural network and theresults of the 3-month immersion period were used for itstesting (Table 2).

Author's personal copy

d e n t a l m a t e r i a l s 2 4 ( 2 0 0 8 ) 18–27 23

Fig. 4 – Comparison of the measured data (ME) and data estimated by the neural network (NN) for Si4+ for the completeimmersion period.

Fig. 5 – Comparison of the measured data (ME) and data estimated by the neural network (NN) for Na+ for the completeimmersion period.

Author's personal copy

24 d e n t a l m a t e r i a l s 2 4 ( 2 0 0 8 ) 18–27

Fig. 6 – Comparison of the measured data (ME) and data estimated by the neural network (NN) for K+ for the completeimmersion period.

Fig. 7 – Comparison of the measured data (ME) and data estimated by the neural network (NN) for Ca2+ for the completeimmersion period.

Author's personal copy

d e n t a l m a t e r i a l s 2 4 ( 2 0 0 8 ) 18–27 25

Fig. 8 – Correlation coefficient (R) and normalized root mean square error (NRMSE) of the measured data (ME) and dataestimated by the neural network (NN) for Al3+ for the complete immersion period and the 3-month immersion period.

Fig. 9 – Correlation coefficient (R) and normalized root mean square error (NRMSE) of the measured data (ME) and dataestimated by the neural network (NN) for Si4+ for the complete immersion period and the 3-month immersion period.

Fig. 10 – Correlation coefficient (R) and normalized root mean square error (NRMSE) of the measured data (ME) and dataestimated by the neural network (NN) for Na+ for the complete immersion period and the 3-month immersion period.

Author's personal copy

26 d e n t a l m a t e r i a l s 2 4 ( 2 0 0 8 ) 18–27

Fig. 11 – Correlation coefficient (R) and normalized root mean square error (NRMSE) of the measured data (ME) and dataestimated by the neural network (NN) for K+ for the complete immersion period and the 3-month immersion period.

Numerical comparisons of measured values (ME), mass ofeluted ions per gram of samples and the values obtained byestimation of the neural network are shown in Table 3.

Figs. 3–7 show the graphic comparison of the measureddata (ME) and data estimated by the neural network (NN), bothfor all ions and for the 3-month immersion period.

The correlation coefficient (R) and normalized root meansquare error (NRMSE) of the measured data (ME) and data esti-mated by the neural network (NN) for eluted ions for thecomplete immersion period and for the 3-month immersionperiod are shown in Figs. 8–12.

6. Discussion

Hydrochloric acid was used for testing the chemical durabilityof dental ceramics. This departs from the standard ISO method[1] which uses acetic acid for testing the chemical durabilityof dental ceramic because of its frequent use in households.The authors find hydrochloric acid suitable since there are

patients with gastric disorders, who have lower pH-values inthe oral cavity due to the presence of hydrochloric acid (gastricreflux, regurgitation, and bulimia), similar to Grossman et al.[8]. The duration and the temperature of the experiment alsodiffer from the ISO-Standard. It was desirable to include inthis research the longest possible elution of ions from dentalceramics in order to test the long-term predicting possibilitiesof this method.

The artificial neural network method presented in thisstudy is currently being used in different fields of engineer-ing for testing different materials [12]. The dental ceramic wasused because of its chemical inertness [4,5]. The only purposeof experimental data in this study was to train the neural net-work and to determine its efficiency and limits. The chemicalstability of dental ceramic was not evaluated. The results ofprevious studies [3,18] of the same group of authors allowed apresumption that the ions’ elution from dental ceramic in anacid solution was very low. The number of measuring inter-vals was relatively low. Even then the method of the artificialneural network showed a very accurate prediction of the wear

Fig. 12 – Correlation coefficient (R) and normalized root mean square error (NRMSE) of the measured data (ME) and dataestimated by the neural network (NN) for Ca2+ for the complete immersion period and the 3-month immersion period.

Author's personal copy

d e n t a l m a t e r i a l s 2 4 ( 2 0 0 8 ) 18–27 27

behavior of dental ceramics. A high correlation coefficient (R)and a low normalized root mean square error (NRMSE) betweenmeasured and estimated output values were observed. Thesingle problem was an underfitting within the process of neu-ral network training. It was caused by the insufficiency ofinput data sets for training network. The reason for a smallnumber of input data sets is that the results of investigatingthe ceramics corrosion were to be used for another investiga-tion which did not require further measurements. However,even that number of measurements showed only minimal dif-ferences obtained between measured and estimated mass ofeluted ions per gram of dental ceramic sample.

Artificial neural network has a great potential for investi-gating not only the chemical stability of materials, but alsoother properties, such as wear resistance, flexural strength,etc., which are changing under the influence of one or moreparameters. The value of this method is also in the possibilityof predicting future events in correlation with the number ofexperimental data. The higher number of experimental dataallows for more accurate prediction.

It could be concluded that the artificial neural network hasgreat potential as an additional method for investigating theproperties of dental materials.

Acknowledgements

This study was supported by the Croatian Ministry of Science,Education and Sports.

r e f e r e n c e s

[1] ISO 6872. International standards for dental ceramics.Geneva, Switzerland: International Organization forStandardization; 1995.

[2] American National Standard/American Dental Association.Specification No. 69. Dental ceramics. Chicago: Council onDental Materials, Instruments and Equipment; 1991.

[3] Zivko-Babic J, Curkovic L, Ivanis T, Panduric J, Boric D.Chemical stability of feldspathic and hydrothermalceramics. In: Proceeding of the 24th annual conference onEPA. 2000. p. 93.

[4] Milleding P, Wennerberg A, Alaeddin S, Karlsson S, Simon E.Surface corrosion of dental ceramics in vitro. Biomaterials1999;20:733–46.

[5] Anusavice KJ. Degradability of dental ceramics. Adv DentRes 1992;6:82–9.

[6] De Rijk WG, Jennings KA, Menis DL. A comparison ofchemical durability of test solutions for dental porcelains.In: Proceedings of the southern biomedical engineeringconference. 1985. p. 152–5.

[7] Esquivel-Upshaw JF, Chai J, Sansano S, Shonberg D.Resistance to staining, flexural strength, and chemicalsolubility of core porcelains for all-ceramic crowns. Int JProsthodont 2001;14:284–8.

[8] Grossman DG, Walters HV. The chemical durability of dentalceramics. J Dent Res 1984;63:234.

[9] Anusavice KJ, Zhang NZ. Chemical durability of dicor andlithia-based glass-ceramics. Dent Mater 1997;13:13–9.

[10] Zivko-Babic J, Curkovic L, Jakovac M. Chemical durability ofalumina dental ceramic. In: Proceedings of the 17thinternational research/expert conference. 2003. p. 257–9.

[11] Jakovac M, Zivko-Babic J, Curkovic L, Aurer A. Measurementof ions release from dental ceramics. In: Proceedings of the28th annual conference of EPA. 2004. p. 102.

[12] Lisjak D, Curkovic L, Rastovcan-Mioc A. Selection of optimalBackpropagation neural network algorithms for estimationof eliminating of metal ions by electric furnace slag. In:Proceedings of the seventh international research/expertconference: trends in the development of machining andassociated technology. 2003. p. 1121–4.

[13] Gou D, Wang YL, Xia JT. Investigation of BaTiO3 formulation:an artificial neural network method. J Eur Ceram Soc2002;22:1867–72.

[14] Gou D, Li L, Nan C, Xia J, Gui Z. Modelling and analysis of theelectrical properties of PZT through neural networks. J EurCeram Soc 2003;23:2177–81.

[15] Golden RM. Mathematical methods for neural networksanalysis and design. In: A Bradford book. The MIT Press;1996.

[16] Lisjak D. Application of the artificial intelligence methods inselection of materials, Dissertation. Zagreb: University ofZagreb, Faculty of Mechanical Engineering and NavalArchitecture; 2004.

[17] The MathWorks, Neural Network Toolbox, Release 4.0.1,http://www.mathworks.com, Inc. 2003.

[18] Jakovac M, Zivko-Babic J, Curkovic L, Panduric J, Jerolimov V.Application of ion chromatography for monitoring thechemical stability of dental ceramics in an acid solution.Acta Stomatol Croat 2002;36:93–6.