Incubation project social monitoring tool codename looking glass (Patrice Pelland)
-
Upload
ontico -
Category
Technology
-
view
233 -
download
0
Transcript of Incubation project social monitoring tool codename looking glass (Patrice Pelland)
![Page 1: Incubation project social monitoring tool codename looking glass (Patrice Pelland)](https://reader033.fdocuments.us/reader033/viewer/2022042701/559c1cd71a28ab0f158b46ad/html5/thumbnails/1.jpg)
Incubation: Looking glass -Progression to Windows Azure
Patrice PellandPrincipal Dev Manager, Microsoft Corp.
![Page 2: Incubation project social monitoring tool codename looking glass (Patrice Pelland)](https://reader033.fdocuments.us/reader033/viewer/2022042701/559c1cd71a28ab0f158b46ad/html5/thumbnails/2.jpg)
Social Monitoring – Incubation• Social Monitoring incubation project codename Looking Glass
• Silverlight 4 application, Windows Phone 7 application and iPhone/iPadapplication – Code Reuse.
• Progression of the back end from
• Windows Server 2008 R2 with WCF Services, SQL 2008 R2
• Windows Azure (Web Roles and Worker Roles), SQL Azure
• Windows Azure (Web Roles and Worker Roles), SQL Azure, Azure Storage (Table Store, Blob storage)
![Page 3: Incubation project social monitoring tool codename looking glass (Patrice Pelland)](https://reader033.fdocuments.us/reader033/viewer/2022042701/559c1cd71a28ab0f158b46ad/html5/thumbnails/3.jpg)
![Page 4: Incubation project social monitoring tool codename looking glass (Patrice Pelland)](https://reader033.fdocuments.us/reader033/viewer/2022042701/559c1cd71a28ab0f158b46ad/html5/thumbnails/4.jpg)
![Page 5: Incubation project social monitoring tool codename looking glass (Patrice Pelland)](https://reader033.fdocuments.us/reader033/viewer/2022042701/559c1cd71a28ab0f158b46ad/html5/thumbnails/5.jpg)
WP 7 Application
![Page 6: Incubation project social monitoring tool codename looking glass (Patrice Pelland)](https://reader033.fdocuments.us/reader033/viewer/2022042701/559c1cd71a28ab0f158b46ad/html5/thumbnails/6.jpg)
Code Re-Use Explorations• Since Silverlight is X-Platform and X-Browsers we
were able to have our project run (with the SL download) across browsers and cross OS.
• Worked on PCs, Mac OSx and Linux (via Moonlight)
• Worked on iPhone/iPad via Monotouch
• Kept 85% of the code to have the code run on
iPhone/iPad and Linux.
![Page 7: Incubation project social monitoring tool codename looking glass (Patrice Pelland)](https://reader033.fdocuments.us/reader033/viewer/2022042701/559c1cd71a28ab0f158b46ad/html5/thumbnails/7.jpg)
Back End Progression – Phase 1
![Page 8: Incubation project social monitoring tool codename looking glass (Patrice Pelland)](https://reader033.fdocuments.us/reader033/viewer/2022042701/559c1cd71a28ab0f158b46ad/html5/thumbnails/8.jpg)
Why it did not scale?• Regular Social APIs with limitations on # of
calls
• Generic Data Acquisition Service
• No partitioning
![Page 9: Incubation project social monitoring tool codename looking glass (Patrice Pelland)](https://reader033.fdocuments.us/reader033/viewer/2022042701/559c1cd71a28ab0f158b46ad/html5/thumbnails/9.jpg)
Back-End Progression – Phase 2
![Page 10: Incubation project social monitoring tool codename looking glass (Patrice Pelland)](https://reader033.fdocuments.us/reader033/viewer/2022042701/559c1cd71a28ab0f158b46ad/html5/thumbnails/10.jpg)
Scalability issues still there for the back end…
• Crawling became more scalable with worker queues
• Still not the complete data corpus and not fast enough to query – Full text index and tag indexes
![Page 11: Incubation project social monitoring tool codename looking glass (Patrice Pelland)](https://reader033.fdocuments.us/reader033/viewer/2022042701/559c1cd71a28ab0f158b46ad/html5/thumbnails/11.jpg)
Bing Data Agg.LGData Aggregators
LG SQL Azure
Bing IndexersLGIndexers Sentiment
Processing
CDN (xaps, jpg, png, css, …)Web Roles WCFWeb Roles
LG Worker Role Media Posting
Incubation v2.0 Phase 3
Visualization Services
LG – LMIData Agg.
Bing + LGData AggregatorsInternet
LG Azure
Bing Azure
Sentiment Processing
Azure Blob Storage –
Backup Index
![Page 12: Incubation project social monitoring tool codename looking glass (Patrice Pelland)](https://reader033.fdocuments.us/reader033/viewer/2022042701/559c1cd71a28ab0f158b46ad/html5/thumbnails/12.jpg)
Conclusion…
• Moving to Azure was cost effective
• Reliable, scalable and available
• Changing the approach to using indexers gave us a more interesting and complex query and filtering capability.