COSAR-CQN: Enabling Data Intensive...
Transcript of COSAR-CQN: Enabling Data Intensive...
COSAR-CQN: Enabling Data Intensive COSAR-CQN: Enabling Data Intensive
ApplicationsApplicationsJason Yap and Shahram Ghandeharizadeh
Dept. Of Computer Science, University Of Southern CaliforniaDept. Of Computer Science, University Of Southern California
Introduction MotivationIntroduction
“Classic” Web Application
Motivation
•Why?“Classic” Web Application
Architecture
Cache-Extended
Architecture
•Why?
Steady-state Throughput90000
….
Users
….
Users
50000
60000
70000
80000
Re
qu
est
s p
er
min
ute
….
HTTP
….
HTTP 20000
30000
40000
50000
Re
qu
est
s p
er
min
ute
Load Balancer
HTTP
Load Balancer
HTTP
0
10000
Re
qu
est
s p
er
min
ute
COSAR-CQN Classic
Web ServersSQL
Web ServersSQL
TCP/ UDP
• Challenge: Keep the cache consistent
Web Servers Web Servers
…
DBMS Server Cache ServersDBMS Server Memcached COSAR-CQN
ArchitectureCOSAR-CQN Architecture
Conceptual architecture (as viewed by an Application
COSAR-CQN
Advantages: Conceptual architecture (as viewed by an Application
Programmer) compared to the underlying Physical
architecture:
Advantages:
• Developer populates the cache without authoring
software for cache consistency. architecture:
Conceptual Physical
software for cache consistency.
• Reduced software development cycle: design,
development, testing, maintenance.development, testing, maintenance.
• Faster feature development at reduced costs.
• Comparable performance to developer provided • Comparable performance to developer provided
solutions
How?How?
• SQL
• Continuous Query Notification (CQN)• Continuous Query Notification (CQN)
Examples: Oracle 11g, Microsoft SQL Server 2005, 2008,
2008 R22008 R2
Future ResearchExperimental Results
• Predictive Framework: Registration of queries
carries its own overhead, so there are cases
Measured Request Rate
• COSAR-CQN outperforms Predictive Framework: Registration of queries
carries its own overhead, so there are cases
where selective registration and caching may
enhance overall performance.
• COSAR-CQN outperforms
Classic even when starting
with an empty cache, with enhance overall performance.
• Application of COSAR-CQN to RAYS.
• Public domain software release of COSAR-CQN.
with an empty cache, with
an execution time of
1.3 hours vs. 5.2 hours • Public domain software release of COSAR-CQN.
• Scalability with cache replication and
partitioning.
1.3 hours vs. 5.2 hours
for Classic.
partitioning.
•Monitoring Tools.• Comparison of COSAR with memcached:
2500000Cache Size Exponential Cost Model
• Cache-enabled Database Management
Systems.1000000
1500000
2000000
2500000
Incu
rre
d C
ost
Cache Size
(MB)
Exponential Cost Model
(Seconds)
COSAR memcached
32 1,796,640 (19.1%) 2,138,940
64 1,452,450 (33.7%) 1,941,570
0
500000
1000000
Incu
rre
d C
ost
64 1,452,450 (33.7%) 1,941,570
128 997,470 (67.9%) 1,674,680
256 582,540 (127.9%) 1,327,490
512 400,323 (111.7%) 847,601
DBMS today Cache-enabled DBMS
0
32 64 128 256 512 1024 1536
Memory Size (MB)
1024 85,110 (66.1%) 141,399
1536 29,268 (-0.1%) 29,244
Sponsored by