6. EXPERIMENTAL RESULT ANALYSIS - …shodhganga.inflibnet.ac.in/bitstream/10603/23384/12/12_chapter...
Transcript of 6. EXPERIMENTAL RESULT ANALYSIS - …shodhganga.inflibnet.ac.in/bitstream/10603/23384/12/12_chapter...
127
6. EXPERIMENTAL RESULT ANALYSIS
6.1 INTRODUCTION
Replica Management in the proposed DUDDI system is all about proposing
a proper methodology to maintain consistency in Services information across all
nodes of the DUDDI system, wherever the replicas are placed. Chapter 3 elaborated
the experimentation methodology wherein the Distributed UDDI Architecture has
been well defined along with its components. Based on the proposed Distributed
UDDI Architecture a detailed experimentation framework has also been proposed
in Chapter 3. Various challenging factors that are to be considered for replica
placement and replica consistency have been identified. The performance attribute
layer of the proposed experimentation framework listed out a set of performance
attributes to be considered for evaluating the effectiveness of the proposed
methodology for replica placement and replica consistency. Based on the
discussions, the proposed methodology is to be evaluated with respect to the
number of message passes, the message density, the processing and the success
ratio. This evaluation is to be carried out between a Traditional P2P based DUDDI
system and the DST structured P2P DUDDI system. Also, it has been proposed to
optimize the DST structured P2P DUDDI system using Ant Colony Optimization.
There is a separate set of evaluation to be carried out between the DST structured
P2P DUDDI and the ACO optimized DST structured P2P DUDDI. The evaluation
has been proposed to be Service Consistency based, Availability based and Cost
based assessments.
Chapter 4 elaborated the way how the proposed Distributed UDDI system
has been modeled and simulated in OMNET++. Using OMNET++, a P2P DUDDI,
DST structured P2P DUDDI and ACO optimized DST structured P2P DUDDI
128
system have been simulated. Based on the identified assessment criteria for the
given set of performance attributes and using the simulated DUDDI environments
as the test bed, experimentation was conducted as discussed in Chapter 5.
By using the experimental setup and based on the identified attributes and
assessment methodologies, the simulated environment has been used as the test bed
for conducting set of experimental simulations and the results are analyzed in this
Chapter. Chapter 6.2 is devoted for a theoretical analysis which will set a base to
analyze and realize the performance of the results of the experimental simulation.
6.2 THEORETICAL ANALYSIS
The perceived Replica Management in the proposed P2P based DUDDI
system is to be performed in a way that a DUDDI node holding the latest replica of
the Service information acts as the server for all the purposes of the replica update
and Read requests. On receiving the Read requests from other nodes, latest replica
is to be communicated to the requesting node of the DUDDI system. All Write
operations assume higher priority over Read operations in the proposed Replica
Management Methodology. This ensures that the Read requests are always serviced
with the latest replicas. Also, it has been one of the prime objectives of this
research, from the communication perspective, that the proposed DUDDI system
should be able to deliver the requested replica in a highly reduced number message
passes across the nodes of the DUDDI system. The following Theoretical analysis
creates the base for this objective.
In the P2P based DUDDI System, a Read operation is defined as the process
of getting the latest version of the Service information or its replica from a SRL
node. On the other hand, the Write operation is defined as the process of publishing
a new Service information or updating the latest version of the Service information
129
on a node and updating the Service information and version. In DST structured P2P
based DUDDI System, Read operation is the process of getting the Service
information or its replica from the Head Node which holds it and a Write operation
is the process of publishing or updating the Service information in each Head Node
of the DUDDI system. In the proposed Replica Management methodology, let
„N‟ be the number of message passes between the Head Node and the
node which is having the latest replica of the Service information.
„R‟ be the number of message passes between one Head Node to another
Head Node.
„M‟ be the number of message passes between a Head Node and a Leaf
Node.
„S‟ be the number of nodes in the DUDDI system.
„P‟ be the number of Leaf Nodes under each Head Node (it is considered
that the number of Leaf Nodes under every Head Node is almost the
same).
„U‟ be the number of nodes forming the DSTj dynamically from time t0 to
t1.
„V‟ be the number of nodes deleted/removed in DSTj dynamically from
time t0 to t1.
where, 1 ≤ M ≤ N ≤ S and 1 ≤ P ≤ S.
With this background, the total number of message passes required for a single
Read operation in a P2P based DUDDI system can be estimated as,
n (P2P DUDDI Readmsgpass) =(N+M)+(S*(N+M))+(N+M)+(S*(N+M))
= (2N + 2M + 2SN + 2SM) - (6.1)
130
When the value of „S‟ is high, then 2N and 2M are negligible when compared to SN
and SM. So, the Equation 6.1 can be rewritten as,
n(P2P DUDDI Readmsgpass) ≥ 2 S (N+M) - (6.2)
Thus the total number of message passes required for a single Read
operation in a P2P based DUDDI system is directly proportional to the number of
nodes in the DUDDI system. Whereas, in a DST structured P2P DUDDI, the total
number of message passes required for a single Read operation at time t0 is
estimated to be,
n(DST structured P2P DUDDI Readmsgpass) at t0 = (M)+(M)+(M)+(M * P)
- (6.3)
Equation 6.3 can be rewritten as,
n(DST structured P2P DUDDI Readmsgpass) at t0 ≥ 3M+(M * P)
- (6.4)
The total number of message passes required to insert a node into any
Distributed Spanning Tree is estimated as,
n(DST structured P2P DUDDI insert Nodemsgpass) = 1+1+(M+1)
= M + 3 - (6.5)
Total number of message passes required to remove a node from any
Distributed Spanning Tree is estimated as,
131
n(DST structured P2P DUDDI removeNodemsgpass) = M - (6.6)
The total number of message passes required for single Read operation in
DST structured P2P based DUDDI at time t1 with „U‟ being the number of nodes
inserted and „V‟ being the number of nodes removed from the Distributed Spanning
Tree is defined as,
n(DST structured P2P DUDDI Readmsgpass) at t1
= (M+3)+(M+U)+(M+U)+(M+U)+((M+U)*P)+(M*V)
- (6.7)
After neglecting (M+3), the Equation 6.7 can be rewritten as,
n(DST structured P2P DUDDI Readmsgpass) at t1 ≥ 3(M+U)+((M+U)*P)+(M*V)
- (6.8)
The total number of message passes required for a Read operation in the
DST structured P2P based DUDDI system increases proportionally with the value
of „U‟. Also, the Equation 6.4 and Equation 6.8 can be considered as the Best and
the Worst cases for the Read operation in the DST structure P2PDUDDI system
respectively.
Similarly, an analysis of the Write operation can also be described. The total
number of message passes required for single Write operation in P2P based
DUDDI system is,
n(P2P DUDDI Writemsgpass) = (N+M)+(S*(N+M))+(N+M)+(S*(N+M))
= (2N+2M+2SN+2SM) - (6.9)
132
Since 2N and 2M are negligible, Equation 6.9 can be re-written as
n(P2P DUDDI Writemsgpass) ≥ 2S(N+M) - (6.10)
Thus the total number of message passes required for a single Write
operation in a P2P based DUDDI system is directly proportional to the number of
nodes in the DUDDI system. The total number of message passes required for
single Write operation in DST structured P2PDUDDI is given by,
n(DST structured P2P DUDDI Writemsgpass) at t0
= M+(S/(P+1))*R+(S/(P+1))*R+M+(S/(P+1))*R - (6.11)
Since 2M is negligible and S/(P+1) equals the total number of Head Nodes
formed in the DUDDI System, which is n(HN). Equation 6.11 can be rewritten as,
≥ 3(R*S/(P+1))
n(DST structured P2P DUDDI Writemsgpass) at t0 ≥ 3*n(HN)*R - (6.12)
Now, the total number of message passes required for a single Write
operation in the DST structured P2P DUDDI system at time t1 with „U‟ being the
number of nodes inserted and „V‟ being the number of nodes removed from the
DST structure can be defined as,
n(DST structured P2P DUDDI Writemsgpass) at t1
=(M+3)+(M+U)+(S/(P+1))*(R+U-V)+(S/(P+1))*(R+U-V)+(M+U)+(S/P(P+1))*(R+U-V)+(M*V)
- (6.13)
Since (M+U), (M+V) and (M+3) are much smaller when considering large
values of „R‟ and S/(P+1), it equals the total number of Head Nodes formed in the
system, n(HN). Equation 6.13 can be rewritten as,
133
n(DST structured P2P DUDDI Writemsgpass) at t1 ≥ 3((R+U-V)*S/(P+1))+(M*V)
- 6.14
From Equation 6.14, it is understood that the total number of message passes
required for a Write operation in the DST structured P2P DUDDI increases with
the value of „U‟. Also, Equation 6.12 and Equation 6.14 can be considered as the
Best and the Worst cases for Write operation in DST structured P2P DUDDI
system respectively.
Comparison between the message passes of the Read and Write operations is
shown in Table 6.1. The values recorded in the Table 6.1 clearly demonstrates the
reduction in the total number of message passes required for each Read and Write
operation in a DST structured P2P DUDDI compared to the same in the P2P
DUDDI system. Though the Write operation looks complex in the DST structured
P2P DUDDI, it has its own unique features such as dynamic self-organisation,
replica consistency, less response time, etc... Since the Read operation is only
concerned with a particular DST structure on which the Read operation request has
been initiated, concurrent Read operations are made easily possible. Thus using
DST as the interconnection structure, it is proved that the Replica Management can
be effectively done in the P2P based DUDDI system with reduced number of
message passes and in least possible time, which are considered to be the critical
QoS parameters for the proposed system.
134
Table 6.1 Performance Comparison for Read/Write Operations Between
P2P DUDDI System and DST Structured P2P DUDDI System
S.
No.
READ OPERATION WRITE OPERATION
Operation Message passes
in P2PDUDDI
Message passes in
DST Structured
P2P DUDDI
Operation Message passes in
P2PDUDDI
Message passes in
DST Structured
P2P DUDDI
1 Read Request N+M M Write Request N+M M
2 Lock Message S*(N+M) Not Applicable Lock Message S*(N+M) (S/(P+1)) * R
3 Lock
Acknowledge Not Applicable Not Applicable
Lock
Acknowledge Not Applicable (S/(P+1)) * R
4 Read Reply N+M M Write Reply N+M M
5 Unlock Message S*(N+M) M Unlock Message S*(N+M) (S/(P+1)) * R
6 Wait Message Not Applicable ≤ M * P Wait Message Not Applicable ≤ M * P
135
6.3 EXPERIMENTAL ANALYSIS
This section describes the experimental setup, basically the simulation
using OMNET++, developed for investigating the proposed research work.
OMNeT++, an object-oriented, modular, discrete, event network simulator has
been used for the simulation of the proposed DUDDI system. A P2P based
DUDDI is simulated (comp1, comp2, comp3 …comp100) and all the nodes are
interconnected in a random fashion. Unit propagation delay of the transmission
medium has been assumed as 10 ms. The experimentation and analysis has been
carried out in two different phases which are as shown below.
Phase 1: Simple P2P DUDDI Vs DST Structured P2P DUDDI
Phase 2: Simple P2P DUDDI Vs DST structured P2P DUDDI Vs
ACO optimized DST structured P2P DUDDI.
6.3.1 P2P DUDDI Vs DST Structured P2P DUDDI
In this phase, the proposed model has been examined in two different
methods. Experiments of Method 1 have been designed such that to prove the role
of DST in improving the performance by reducing the number of message passes
for Replica Management (i.e. in reducing the number of message passes) in a P2P
based DUDDI and the experimentation was carried out in two different
environments, which are P2P DUDDI and the DST Structured P2P DUDDI.
Method 2 is aimed at assessing the contribution of DST in improving the
scalability of the overall environment, particularly from the Replica Management
perspective. Method 2 assessment has been carried out in four different
environments, which are Sparse P2P DUDDI, Sparse DST Structured P2P
DUDDI, Dense P2P DUDDI and Dense DST Structured P2P DUDDI.
136
6.3.1.1 Service Read/Write Based Assessments
Method 1: It has been designed such that to prove the role of DST in
improving the performance of Replica Management by reducing the number of
message passes in two different environments, which are P2P DUDDI and
DST structured P2P DUDDI. Method-1 examines the scalability of the system for
Read and Write operations. This experiment is to assess the scalability in terms of
accommodating more number of Read and Write operations. In accordance to this
experimental setup, Equation 6.1 is rewritten as,
- (6.15)
Where, the node numbers are to be preceded by the term ―comp‖. For
example, the DST1 should be interpreted as DST1 = (comp04, comp01…comp95),
in which the first node ―comp04‖ is the Head Node of DST1 and all other nodes
are Leaf Nodes of DST1 as given in the Equation 6.1.
In the simulated system, the Head Nodes of the DSTs are comp04, comp18,
comp36, comp54 and comp93. Obviously the other nodes act as Leaf Nodes under
the appropriate Head Nodes. The total number of Leaf Nodes under DST1, DST2,
DST3, DST4 and DST5 in the simulated system is 22, 16, 26, 17 and 14
respectively. These values show that the Leaf Nodes are not uniformly distributed
among the Head Nodes, which implies that the number of Leaf Nodes under the
corresponding Head Node depends on various criteria like the distance between
=
DST1
DST2
DST3
DST 4
DST5
04,01,02,05,06,11,17,26,37,40,57,46,58,66,70,71,72,75,84,86,89,94,95
18,12,31,03,20,21,22,35,38,19,52,53,59,62,81,55,65
36,27,28,07,23,30,14,29,39,41,43,44,60,61,63,68,69,76,77,67,79,80,85,87,88,90,96,97
54,51,42,09,25,45,32,48,13,45,49,50,56,64,78,73,74,83
93,92,91,10,08,24,33,34,16,47,54,98,99,100,82
137
them, channel capacity, congestion on a particular region, user approval, etc.,. In
principle, the message passes required for each node and for the overall system
can be defined as shown in the Equation 6.16 and Equation 6.17.
Definition 1: Let P(i) be a node. For P(i) to be part of a DST, the number of
message passes required can be defined as,
n(P(i)msg = - 6.16
Where,
n(P(i)msg is the number of message passes required by the node P(i) to become
the member of a DST, and i=1, 2, 3…..s. and „s‟ is the total number of nodes in
the system.
„r‟ is the number of nodes directly connected with P(i).
Definition 2: Let n(DSTmsg) be the total number of message passes required
by all the nodes in the system to form the DSTs which is given as,
- 6.17
Where, ‗s‘ is the total number of nodes in the system.
Equation 6.16 and Equation 6.17 help to estimate the number of message
passes required to convert the entire P2P DUDDI system into a number of logical
DST structured P2P DUDDI. From the simulation results, the value of n(DSTmsg)
is found to be 437 and the time taken to form the entire DST structured
P2P DUDDI is 6.39 seconds. It is also observed that around 124 Read operations
have been performed by 50 nodes in the first 100 seconds in the DST structured
P2P DUDDI, whereas it is only 72 Read operations been performed by 41 nodes
r, if P(i) = HN
r + 1, if P(i) ≠ HN
s
i
msgimsg PnDSTn0
)( )()(
138
for the same period in the simple P2P DUDDI. The values obtained through the
simulation are given in Table 6.2.
Table 6.2 Performance Comparison between P2P DUDDI System and
DST Structured P2P DUDDI System for Service Read and Write
Sl.
No. Performance Criteria
Simple P2P
DUDDI
DST
Structured
P2P DUDDI
1 No. of Messages to formulate the system NA 437
2 Time taken to formulate the system (in sec) NA 6.39
3 No. of read operations performed in first
100 seconds 72 124
4 No. of nodes involved in read operation in first
100 seconds 41 50
5 No. of write operations performed in first
100 seconds 28 51
6 No. of nodes involved in write operation in first
100 seconds 21 25
Thus, using DST as an interconnection structure, efficiency of the proposed
P2P DUDDI system can be improved upto 85% in the overall Read operations
by the way of reducing the number of required message passes. This is clearly
visible from the Figure 6.1. Similarly, it can also be observed that there are 51
Write operations performed by 25 nodes in the first 100 seconds in DST
structured P2P DUDDI, whereas there are only 28 Read operations performed by
21 nodes for the same period in the Simple P2PDUDDI. These values are
presented in Table 6.2. It can be clearly visible that the efficiency of the Write
operations on the P2P DUDDI system can be improved upto 80% by reducing
the number of message passes required for Write operations using DST Structure
in P2PDUDDI. This improvement is clearly visible from the Figure 6.2.
139
Figure 6.1 Comparison between the Simple P2P DUDDI and DST Structured P2P DUDDI in terms of Overall Read Operations
Figure 6.2 Comparison between the P2P DUDDI and DST Structured P2P DUDDI in terms of Overall Write Operations
com
p0
1
com
p0
2
com
p0
4
com
p1
1
com
p1
2
com
p1
6
com
p1
7
com
p1
8
com
p1
9
com
p2
2
com
p2
3
com
p2
4
com
p2
7
com
p2
8
com
p3
0
com
p3
2
com
p3
3
com
p3
4
com
p3
8
com
p4
0
com
p4
2
com
p4
7
com
p4
8
com
p4
9
com
p5
1
com
p5
4
com
p5
5
com
p5
6
com
p5
7
com
p5
8
com
p5
9
com
p6
1
com
p6
2
com
p6
3
com
p6
5
com
p6
6
com
p6
8
com
p6
9
com
p7
1
com
p7
3
com
p7
4
com
p8
1
com
p8
3
com
p8
8
com
p8
9
com
p9
1
com
p9
2
com
p9
3
com
p9
5
com
p9
8
0
2
4
6
8
10
Simple P2P DUDDI DST Structured P2P DUDDI
0
1
2
3
4
5
com
p0
2
com
p0
3
com
p0
4
com
p0
6
com
p0
8
com
p0
9
com
p1
1
com
p1
3
com
p1
7
com
p2
4
com
p2
7
com
p5
6
com
p5
9
com
p6
0
com
p6
1
com
p6
4
com
p6
6
com
p6
7
com
p7
0
com
p7
3
com
p7
4
com
p7
6
com
p7
8
com
p7
9
com
p8
2
Simple P2P DUDDI DST Structured P2P DUDDI
No. of
Rea
d O
per
atio
ns
Per
form
ed
No. of
Wri
te O
per
atio
ns
Per
form
ed
Leaf Nodes
Leaf Nodes
140
6.3.1.2 Assessment of Scalability
Method 2: In Method 2, experiments have been designed such that to
assess the scalability of the proposed environment, particularly from the Replica
Management perspective. Technically, P2P DUDDI is analyzed based on the
factor, the communication cost, which is the cost measure associated with the link
between any two nodes defined by its link‘s physical properties like distance,
capacity, etc. Here, if the communication cost is high then the nodes of the system
are considered to be spatially distributed sparse and the same is dense incase if the
communication cost is less.
A DUDDI system has been simulated with 103 nodes (10 times the size
considered for Method-1 experimental environment) for each type and the
analysis has been carried out in four different environments, which are
1) Sparse P2P DUDDI, 2) Sparse DST structured P2P DUDDI, 3) Dense
P2P DUDDI and 4) Dense DST structured P2P DUDDI
The system has been observed for the first 100 seconds and the results are
tabulated in Table 6.3. Here, the Success Ratio (SR) is defined as the ratio
between the number of Read/Write request made and the number of successful
Read/Write operations performed in a particular interval of time. The QoS values
derived from the set of values of the Table 6.3 are presented in Table 6.4 and the
same has been graphically represented as shown in Figure 6.3, Figure 6.4,
Figure 6.5 and Figure 6.6. The Figure 6.3 corresponds to the message density of
the system, which is defined as the total number of messages on the system, being
utilized for communication among the nodes at a particular time period.
Figure 6.4 corresponds to the number of message passes by unsuccessful
Read/Write operations at a particular time period. Figure 6.5 and Figure 6.6 show
the success ratio of Read and Write operations performed under different
scenarios respectively. Average is the average message density, average number
of message passes, average success ratio in Read/Write operations, as in the
Figure 6.3, Figure 6.4, Figure 6.5 and Figure 6.6 respectively.
141
Table 6.3 Performance Comparison between P2P DUDDI and DST Structured P2P DUDDI
Table 6.3.1: Read Operation
S. No
Simulation
Time Interval
(s)
READ OPERATION
SPDUDDI SDDUDDI DPDUDDI DDDUDDI
RR RS SR RR RS SR RR RS SR RR RS SR
1 0-10 21 16 76.2% 22 20 90.9% 19 16 84.2% 29 28 96.6%
2 10-20 17 13 76.5% 21 18 85.7% 17 15 88.2% 26 24 92.3%
3 20-30 17 12 70.6% 19 17 89.5% 19 16 84.2% 24 23 95.8%
4 30-40 18 15 83.3% 21 18 85.7% 19 17 89.5% 26 25 96.2%
5 40-50 18 13 72.2% 22 19 86.4% 18 15 83.3% 28 26 92.9%
6 50-60 21 15 71.4% 20 18 90.0% 21 16 76.2% 31 29 93.5%
7 60-70 18 13 72.2% 18 16 88.9% 19 13 68.4% 29 25 86.2%
8 70-80 18 11 61.1% 21 16 76.2% 18 12 66.7% 23 21 91.3%
9 80-90 15 10 66.7% 19 15 78.9% 18 13 72.2% 25 22 88.0%
10 90-100 14 9 64.3% 21 16 76.2% 19 12 63.2% 23 21 91.3%
SPDUDDI - Sparse P2PDUDDI RR - Read Request WR - Write Request
SDDUDDI - Sparse DST P2PDUDDI RS – Read Success WS – Write Success
DPDUDDI - Dense P2PDUDDI SR – Success Ratio
DDDUDDI - Dense DST P2PDUDDI
142
Table 6.3 Performance Comparison between P2P DUDDI and DST Structured P2P DUDDI
Table 6.3.2: Write Operation
SPDUDDI - Sparse P2PDUDDI RR - Read Request WR - Write Request
SDDUDDI - Sparse DST P2PDUDDI RS – Read Success WS – Write Success
DPDUDDI - Dense P2PDUDDI SR – Success Ratio
DDDUDDI - Dense DST P2PDUDDI
Sl. No
Simulation
Time Interval
(sec)
WRITE OPERATION
SPDUDDI SDDUDDI DPDUDDI DDDUDDI
WR WS SR WR WS SR WR WS SR WR WS SR
1 0-10 3 2 66.7% 4 3 75.0% 4 3 75.0% 6 6 100%
2 10-20 3 3 100% 5 4 80.0% 6 5 83.3% 6 4 66.7%
3 20-30 5 4 80.0% 5 5 100% 6 4 66.7% 7 7 100%
4 30-40 4 2 50.0% 6 5 83.3% 5 3 60.0% 6 6 100%
5 40-50 7 5 71.4% 7 6 85.7% 6 5 83.3% 4 4 100%
6 50-60 5 2 40.0% 6 5 83.3% 5 3 60.0% 9 8 88.9%
7 60-70 7 3 42.9% 4 3 75.0% 6 4 66.7% 11 8 72.7%
8 70-80 8 4 50.0% 6 5 83.3% 6 5 83.3% 7 7 100%
9 80-90 9 3 33.3% 7 5 71.4% 7 3 42.9% 7 6 85.7%
10 90-100 5 2 40.0% 3 2 66.7% 5 3 60.0% 5 4 80.0%
143
Table 6.4 Performance Comparison Between
Simple P2P DUDDI and DST P2P DUDDI Under Different Test Scenarios
S.No QoS Factor SPDUDDI SDDUDDI DPDUDDI DDDUDDI
1 Time taken to create the system
with technique (in sec) NA 29.32 NA 22.29
2 Time taken for 100 Read
operations (in sec) 78 56 69 41
3 Time taken for 100 Write
operations (in sec) 342 244 272 169
4 Average no. of message passes
required for a Read operation > 49 26 41 18
5 Average no. of message passes
required for a Write Operation 81 55 73 46
6 Message density in the system
after 100 seconds 10.23 x103 6.19 x103 9.2 x103 3.3 x103
7 Overall Success Ratio for Write
operation 53.6% 81.6% 67.9% 88.2%
8 Overall Success Ratio for Read
operation 74.5% 84.8% 80.6% 92.4%
SPDUDDI - Sparse P2PDUDDI
SDDUDDI - Sparse DST P2PDUDDI
DPDUDDI - Dense P2PDUDDI
DDDUDDI - Dense DST P2PDUDDI
144
Figure 6.3 Message Density with respect to Time in Different Conditions
Figure 6.4 Message Passes of Unsuccessful Read/Write Operations
0
2000
4000
6000
8000
10000
12000
Sparse P2P DUDDI Sparse DST Structured P2P DUDDI
Dense P2P DUDDI Dense DST Structured P2P DUDDI
0
100
200
300
400
500
600
700
800
10 20 30 40 50 60 70 80 90 100 Average
Sparse P2P DUDDI Sparse Structured DST P2P DUDDI
Dense P2P DUDDI Dense DST P2P DUDDI
Simulation Time (sec)
Mes
sage
Den
sity
Simulation Time (sec)
No. of
Mes
sage
Pas
ses
145
Figure 6.5 Success Ratio of Read Operation
Figure 6.6 Success Ratio of Write Operation
40%
60%
80%
100%
Sparse P2P DUDDI Sparse DST Structured P2P DUDDI
Dense P2P DUDDI Dense DST Structured P2P DUDDI
0%
20%
40%
60%
80%
100%
Sparse P2P DUDDI Sparse DST Structured P2P DUDDI
Dense P2P DUDDI Dense DST Structured P2P DUDDI
Succ
ess
Rat
io
Simulation Time (sec)
Succ
ess
Rat
io
Simulation Time (sec)
146
The overall success ratio of Write operation has increased from 53.6% to
81.6% from Sparse P2P DUDDI to Sparse DST P2P DUDDI and thereby the
advantage of the application of DST structures in P2P DUDDI is shown visibly.
Similarly, the overall success ratio of Read operation has also increased from
74.5% to 84.8% due to the application of the DST structures. Also, when the
Dense P2P DUDDI and Dense DST P2P DUDDI is compared, the overall success
ratio of the Write operation has increased from 67.9% to 88.2% and the same for
the Read operation has also increased from 80.6% to 92.4% which is again due to
the application of the DST structures. Hence it is proved that the application of
DST structures over the P2P DUDDI system contributes to the improvement of
the overall efficiency of the Replica Management in the proposed DUDDI system.
6.3.2 P2P DUDDI Vs DST P2P DUDDI Vs ACO Optimized DST P2P DUDDI
In this phase of analysis, the proposed system has been examined in three
different environments based on important issues in Service Replica Management
such as consistency, availability and the response time. For analysis,
experimentation setup established as said in Chapter 4 has been used with
different values for Service request generation with an additional change that the
ACO optimization is performed in the proposed DST structured P2P DUDDI
system. To route a replica request message from a requesting node to a SRL node,
where the requested replica is available, Ant Colony Optimized routing technique
has been tried, which is proved to be efficient in terms of the number of message
passes and response time, because of the dynamically identified optimal route
between every SRL node and the Service requesting nodes. Formulation of Ant
Colony Optimization of DST structured P2P DUDDI is the next step after the
implementation of DST structures in the P2P DUDDI, which is achieved by
sending Probe Request messages from Head Node to its Leaf Nodes and Head
Nodes to all other Head Nodes.
147
During the process of simulation, it has been observed that nearly 189 Read
operations have been performed by nearly about 59 nodes in 600 seconds (with a
delay of 100 ms). Thus the number of message passes for Read operation has been
proved reducing at a greater extent by using Ant Colony Optimization in the
DST structured P2P DUDDI and the Read operations are performed faster and
consistent as is been shown through the results.
As far as the Write operations are concerned, during the simulation, it is
found that about 23 Write operations have been performed by 16 nodes in 30
seconds. The outcome of the result analysis shows that the ACO optimized
DST structured P2P DUDDI can perform Read/Write operations at higher speed
and with consistency than it is without these techniques on them. Table 6.5 shows
a straight comparison of a DST structured P2P DUDDI with an ACO optimized
DST structured P2P DUDDI for various performance criteria measures identified
(Chapter 3). The comparison proves that for a propagation delay of 100 ms, the
number of Read/Write operations performed can be greatly improved by
optimizing the DST structured P2P DUDDI system with ACO.
Based on the results displayed in Table 6.5, it is clearly visible that the
ACO optimized DST strucutred P2P DUDDI system can perform the operations
nearly 50% faster than the simple DST structured P2P DUDDI system. The
simulation has been done for a channel of propagation delay set to 100ms. The
system‘s response could be further sped up by decreasing the propagation delay.
148
Table 6.5 Comparison Between
DST P2P DUDDI System and ACO Optimized DST P2P DUDDI System
S.No Measurement Criteria DST
P2PDUDDI
ACO
Optimized DST
P2PDUDDI
1 No. of Messages created to formulate the technique 437 220
2 Time taken to formulate the technique (in sec) 6.39 3.14
3 No. of Read operations performed in 600 sec 121 181
4 No. of Nodes involved in Read Operation in 600 sec 49 56
5 No. of Write operations performed in 30 sec 17 25
6 No. of Nodes involved in Write Operation in 30 sec 16 18
Table 6.6 Comparison of
P2P DUDDI Vs DST P2PDUDDI Vs ACO Optimized DST P2P DUDDI
With Respect to Various QoS Factors - Propagation Delay:10ms
S.
No QoS Factor P2PDUDDI
DST
P2PDUDDI
ACO
Optimized
DSTP2PDU
DDI
1 Time Taken to create network with
technique (in sec) NA 6.39 9.33
2 Time Taken for 100 Read Operations
(in sec) 69 45 36
3 Time Taken for 100 Write Operations
(in sec) 32 24 14
4 Average no. of Message Pass
required for a Read Operation 81 7 7
5 Average no. of Message Pass
required for a Write Operation 87 46 35
Based on the results of the simulation and the measured values of the
various QoS parameters, it is highly visible that the performance of a DST
structured P2P DUDDI is more when compared to that of the simple P2P DUDDI
and further the performance of ACO Optimized DST structured P2P DUDDI is
149
still more better when compared to the DST structured P2P DUDDI, which is
obvious when looking at the numeric figures at the Table 6.6.
6.3.2.1 Service Consistency Evaluation
Consistency Management of a Service item or its replica is a crucial issue
which directly influences the overall efficiency of the Replica Management
methodology. Web Service information or its replica updations are not so frequent
as the way the Distributed Database replicas are updated. Since the frequency of
updations of Web Services information is less, in the proposed DUDDI system, a
simple consistency model is just enough to keep the consistency and hence the
time based consistency model has been chosen, which is simple and effective for
Service / Replica consistency management applications.
Let Di be the Service/Replica item which is cached at time ‗Tc‟, then the
validity of the Service item is TRUE at time Tr, at which the Service request was
received, if it satisfies the condition, Tc + T < Tr . Here „Tc‟ is the time at
which Service item is cached in cache node, ‗Tr‘ is the time at which the Service
item is requested by a node and „T‟ is the validity period of the Service item
within the DUDDI system.
Every Head Node which stores the Service/Replica item also stores
metadata about the Service item Di which contains the time at which Di is being
cached. This information is used to check the validity of Service item. „T‟ is a
constant which varies based on the Service item being updated.
100× cached item serviceno.of Total
use before expired item serviceno.of Total-cached item serviceno.of Total
=usage item serviceconsistent of %
150
The measure used to evaluate the consistency can be defined as the ratio
between the number of Service item requests serviced to the sum of requests
served and the number of Service items expired before its usage. This can be
expressed as shown in Table 6.7, which shows the consistency statistics of the
sample Leaf Nodes in P2P DUDDI, DST structured P2P DUDDI and the ACO
optimized DST structured P2P DUDDI.
Also, Table 6.7 gives the experimental results for the number of Service
items expired before being used by any requesters, which shows that the services
replica is available in a Head Node where there are no users, i.e., the Service
requestors. A better Service replica utility can be seen from the figures of the
table, which proves that the Service replica utility is more in the
DST structured P2P DUDDI system when compared to the simple P2P DUDDI
system and the utility is further improved in ACO optimized DST structured P2P
DUDDI compared to the other two systems, which is shown in Figure 6.7. From
these statistics, it can be observed that the effective usage of cached Service items
are much improved in DUDDI with DST and ACO optimized DST schemes.
Compared to the traditional DUDDI approach, as per the illustration in the Figure
6.7 and Figure 6.8, the proposed techniques display improved performance.
151
Figure 6.7 Consistency in P2P DUDDI Vs DST P2P DUDDI Vs
ACO Optimized DST P2PDUDDI
Figure 6.8 Number of Service Items Expired Before Utilization in
P2P DUDDI Vs DST P2P DUDDI Vs ACO Optimized DST P2PDUDDI
0%
20%
40%
60%
80%
100%
P2P DUDDI DST Structured P2P DUDDI ACO Optimized DST P2P DUDDI
0
0.5
1
1.5
2
2.5
3
3.5
P2P DUDDI DST Structured P2P DUDDI ACO Optimized DST P2P DUDDI
Consi
sten
cy (
% )
Leaf Nodes
No. of
Ser
vic
e it
ems
expir
ed
Leaf Nodes
152
Table 6.7 Consistency in P2P DUDDI Vs DST Structured P2P DUDDI Vs ACO Optimized DST P2P DUDDI
S. No LN
P2PDUDDI DST Structured P2PDUDDI ACO Optimized DSTP2PDUDDI
No. of
data item
cached
No. of
data item
request
served
No. of
data
items
deleted
before
use
% of data
item used
before
consistenc
y expires
No. of
data
item
cached
No. of
data item
request
served
No. of
data
items
deleted
before
use
% of data
item used
before
consistenc
y expires
No. of
data
item
cached
No. of
data item
request
served
No. of
data
items
deleted
before
use
% of data
Item used
before
consistency
expires
1 comp02 2 9 1 50% 8 26 1 87.5% 9 23 2 77.7%
2 comp06 8 16 1 87.5% 5 12 2 60% 4 10 1 75.0%
3 comp09 5 11 2 60% 4 15 0 100% 5 15 0 100.0%
4 comp13 4 13 1 75% 3 9 1 66.6% 3 11 1 66.6%
5 comp17 3 6 1 66.6% 3 18 0 100% 4 16 0 100.0%
6 comp21 5 13 2 60% 5 23 2 60% 6 22 0 100.0%
7 comp24 4 12 2 50% 6 19 3 50% 7 26 2 71.4%
8 comp26 4 17 1 75% 5 14 1 80% 4 21 1 75.0%
9 comp29 5 21 3 40% 6 26 2 66.6% 8 23 2 75.0%
10 comp32 2 10 1 50% 3 21 0 100% 5 21 1 80.0%
11 comp37 1 0 1 0% 2 15 0 100% 4 19 0 100.0%
12 comp43 3 0 3 0% 5 9 2 60% 3 16 1 66.6%
13 comp46 2 5 1 50% 6 18 3 50% 6 21 2 66.6%
14 comp47 4 21 1 75% 3 12 1 66.6% 2 16 0 100.0%
15 comp49 3 8 2 33.3% 3 7 0 100% 5 14 1 80.0%
153
6.3.2.2 Assessment of Availability
Availability is defined as the ratio between the number of times a service
item is served to the total number of times it is requested or expected to be served.
This can be expressed as,
Since the operations in every DST are performed through Head Nodes, it
may easily become the traffic bottleneck and single point of failure of the DST.
Failure of the Head Node would contribute to a decrease in the availability of the
service item since the details about the Leaf Node which hold the cached service
cannot be accessed after the failure of the Head Node.
So, every Head Node operations are monitored and if any Head Node fails
and the failure period exceeds the set threshold time, then any Leaf Node adjacent
to that Head Node, which also satisfies the test conditions to become the Head
Node, will act as Head Node. This reduces the traffic in the existing Head Node.
Thus the dynamic selection of Head Node increases the availability of the cached
Service item.
The Service availability statistics of these approaches from the
experimental results have been tabulated in Table 6.8. Also, Table 6.8 tabulates
the experimental results for Service Ratio, which is a ratio between the total
number Services served and the total number of Services requested. The
performance of the DUDDI system after having DST structures and ACO
optimized has improved in terms of the Service Availability and the Service Ratio
which is illustrated in Figure 6.9 and in Figure 6.10. It proves the enhanced
performance of the proposed methodologies in comparison with the traditional
P2P DUDDI system.
100× failure LN cached to due dropped request no.of Total+ servedrequest item serviceno.of Total
servedrequest item serviceno.of Total
=tyavailabili item serviceof %
154
Table 6.8 Availability in P2P DUDDI Vs DST Structured P2P DUDDI Vs ACO Optimized DST P2P DUDDI
S.
No HN
P2PDUDDI DST Structured P2PDUDDI ACO Optimized DSTP2PDUDDI
No. of
requests
received
(A)
No. of
requests
served
(B)
Service
ratio
(A/B)
No. of
requests
dropped
due to
cached
LN
unavailab
ility
% of data
item
available
No. of
requests
received
(A)
No. of
requests
served
(B)
Service
ratio
(A/B)
No. of
request
dropped
due to
cached
LN
unavaila
bility
% of data
item
available
No. of
requests
received
(A)
No. of
requests
served
(B)
Service
ratio
(A/B)
No. of
request
dropped
due to
cached
LN
unavaila
bility
% of data
item
available
1 comp04 112 91 81.25% 21 81.2% 170 158 92.94% 12 92.9% 178 169 94.94% 9 94.9%
2 comp18 132 120 90.91% 12 90.9% 206 197 95.63% 9 95.6% 219 208 94.98% 11 94.9%
3 comp36 154 135 87.66% 19 87.6% 148 132 89.19% 16 89.2% 158 146 92.41% 12 92.4%
4 comp55 98 89 90.82% 9 90.8% 165 154 93.33% 11 93.3% 181 172 95.03% 9 95.0%
5 comp56 119 90 75.63% 29 75.6% 157 145 92.36% 12 92.4% 166 158 95.18% 8 95.1%
6 comp93 154 135 87.66% 19 87.6% 170 158 92.94% 12 92.9% 219 208 94.98% 11 94.9%
155
Figure 6.9 Availability with respect to Head Nodes of
P2P DUDDI Vs DST P2P DUDDI Vs ACO DST P2P DUDDI
Figure 6.10 Service Ratio with respect to Head Nodes of
P2P DUDDI Vs DST P2P DUDDI Vs ACO DST P2P DUDDI
50%
60%
70%
80%
90%
100%
comp04 comp18 comp36 comp55 comp56 comp93
P2P DUDDI DST Structured P2P DUDDI ACO Optimized DST P2P DUDDI
70%
80%
90%
100%
comp04 comp18 comp36 comp55 comp56 comp93
P2P DUDDI DST Structured P2P DUDDI ACO Optimized DST P2P DUDDI
Avai
labil
ity
( %
)
Head Nodes
Ser
vic
e R
atio
( %
)
Head Node
156
6.3.2.3 Assessment of Response Time
Response Time is a critical performance measure which refers to the process
of visiting each node in a DST structured P2P DUDDI exactly once, in a systematic
way at comparatively low number of hops, i.e, through a shortest path. To analyze
the performance of the proposed system in terms of the Response Time, the number
of hops need to be passed through, for every Service item request by a requester,
before reaching the nearest Head Node which carries the requested Service item or
its replica, is considered. The Response Time in terms of the number of hop count
for a Service item request in all the three environments under study has been
tabulated in Table 6.9. Also, the experimental results for a Leaf Node to reach its
Head Node and the number hops that it has to traverse to reach the Head Node are
tabulated in Table 6.9.
The tabulated data proves that the response time is better and the number of
hops to be traversed by a Leaf Node to reach its Head Node is minimized in the
ACO optimized DST structured DUDDI system, compared to the other two
systems. This system‘s efficiency in terms of response time and the number of hop
counts to reach the Head Node is shown in the Figure 6.11 and Figure 6.12
respectively. It is clear from the experimental results given in the Table 6.9 and
from the Figure 6.11 and Figure 6.12 that the approach of P2P DUDDI system with
the DST structured node distribution has better performance in terms of Response
Time and less number of hops to traverse to reach the Head Node. Also, the
Response Time is still better when the ACO optimized DST structured P2P UDDI
is compared with the other two systems. The difference of performance in these
systems in terms of the Response Time and the number of hop counts is clearly
illustrated in the graphs as shown in the Figure 6.11 and Figure 6.12 respectively.
157
Table 6.9 Response Time for Service Requests in
P2P DUDDI Vs DST P2P DUDDI Vs ACO Optimized DST P2P DUDDI
S.
No LN
P2PDUDDI DST P2PDUDDI ACO Optimized DSTP2PDUDDI
Number of hops required to
identify the nearest HN for
each data item request
Average
Hop
count
required
for first
HN
traversal
Average
Time
taken
for first
HN
traversal
(ms)
Number of hops required to
identify the nearest HN for
each data item request
Average
Hop
count
required
for first
HN
traversal
Average
Time
taken
for first
HN
traversal
(ms)
Number of hops required
to identify the nearest HN
for each data item request
Average
Hop
count
required
for first
HN
traversal
Average
Time
taken
for first
HN
traversal
(ms)
Rq 1 Rq 2 Rq 3 Rq 4 Rq 5 Rq 1 Rq 2 Rq 3 Rq 4 Rq 5 Rq 1 Rq 2 Rq 3 Rq 4 Rq
5
1 comp02 6 4 6 - - 3.3 39.6 3 2 2 - - 2.3 27.6 1 2 2 - - 1.6 27.6
2 comp06 5 8 3 - 3.3 39.6 2 3 1 1 - 2 24 1 3 1 1 - 1.5 18
3 comp09 2 5 8 3 12 6 72 2 3 1 4 2 2.4 28.8 3 2 3 2 1 2.2 28.8
4 comp13 5 6 - - - 5.5 66 5 2 - - - 3.5 42 3 1 - - - 2 24
5 comp17 - - - - - - - - - - - - - - - - - - - - -
6 comp21 7 8 - - - 7.5 90 3 2 - - - 2.5 30 2 3 - - - 2.5 30
7 comp24 7 8 2 - - 5.6 67.2 3 1 4 - - 2.6 31.2 2 1 3 - - 2 24
8 comp26 11 3 8 - - 7.3 87.6 4 3 1 - - 2.6 31.2 4 2 1 - - 2.3 27.6
9 comp29 3 6 2 - - 3.6 43.2 1 2 4 3 - 2.5 30 2 1 2 3 - 2 24
10 comp32 6 3 10 3 - 5.5 66 2 2 2 3 - 2.25 27 1 2 2 3 - 2 24
11 comp37 1 5 - - - 3 36 1 3 - - - 2 24 1 2 - - - 1.5 18
12 comp43 6 5 2 - - 4.3 51.6 6 2 1 - - 3 36 3 1 2 - - 3 36
13 comp46 - - - - - - - - - - - - - - - - - - - - -
14 comp47 6 13 1 - - 6.6 79.2 3 4 1 - - 2.6 31.2 3 3 1 - - 2.3 27.6
15 comp49 3 5 6 - - 4.6 55.2 1 2 1 - - 1.3 15.6 1 1 1 - - 1 12
158
Figure 6.11 Average Time Taken to Service the Requests by Leaf Nodes
Figure 6.12 Number of Hop Counts Required to Identify the
Nearest Head Node for Each Service Item Request
0102030405060708090
100
DST Structured P2P DUDDI P2P DUDDI ACO Optimized DST P2P DUDDI
0
1
2
3
4
5
6
7
8
P2P DUDDI DST Structured P2P DUDDI ACO Optimized DST P2P DUDDI
Tim
e ta
ken
(m
s)
Leaf Nodes
Hop C
ounts
Leaf Nodes
159
6.4 SUMMARY
The reason why the research topic has been chosen on Service Consistency
and related issues in a Distributed UDDI registry has been well established
through the discussions of the Chapter 1 and Chapter 2. Having identified the
research domain, the goals of the research work have been identified and
presented in the Chapter 3. Based on the set goals, necessary infrastructure
modeling has been done and explained through the Chapter 4. Experimentation
was conducted in the test bed, which was established through OMNET++, for
assessing the performance of the proposed DUDDI system. The experimental
results have been analyzed in this Chapter for assessing the performance of the
proposed DUDDI system in three variants viz., 1) A Traditional P2P based
DUDDI System, 2) A DST structured P2P based DUDDI system and 3) ACO
optimized DST structured P2P DUDDI system.
While evaluating the performance of the proposed DUDDI system, it is
identified that the application of DST structures on the proposed P2P DUDDI
system has contributed to the improvement in the total number of Read and Write
operations performed. Also, the Success Ratio for the Service Read request and
Write request is better in the DST structured P2P DUDDI system compared to the
traditional P2P DUDDI system, as shown in the Section 6.3.1. While the Section
6.3.1 proves the improvement in performance after the application of DST
structures in the traditional P2P DUDDI system, the Section 6.3.2 analyzes the
ACO optimized DST structured P2P DUDDI system with the simple DST
structured P2P DUDDI system. Results and its analysis from the set of tables and
graphs have shown appreciable performance improvements with respect the
Service Consistency, Service Availability and the Response Time for Service
Read and Write requests. Therefore, it is evident that the proposed DST structured
DUDDI system with ACO optimization can offer an effective and efficient
Replica Management system with good response time and least possible number
of message exchanges.