Solr Compute Cloud – An Elastic Solr Infrastructure: Presented by Nitin Sharma, BloomReach
Parse.ly: Inside a modern RIA built with Solr
25
1 Inside a modern RIA powered by Solr Andrew Montalenti Co-Founder & Technology Lead [email protected]
-
Upload
pixelmonkey -
Category
Technology
-
view
4 -
download
0
description
Transcript of Parse.ly: Inside a modern RIA built with Solr
22
Mainstream
30,000
3
Blogs
900,000
1From Technorati’s 2008 State of the Blogosphere
1
But,
4
What about your interests?4
your interests,
your web
55
your web
6
What is ?
• Your unique interests
• … create a filtered, prioritized, and personalized news feed
• … built just for you!
• 120K+ news and blog sources tracked
• The most personally relevant items at the top
• Bottom line:
You spend less time skimming headlines,
and more time reading relevant content.
7
Demo!
(if possible)
9
Let’s pop open the hood!
The RIA
ExtJS + jQuery
JS REST Binding
1010
REST API
django-piston
Solr Postgres
11
Batch size
Per-Doc Processing
12
IO-bound work
size
13
Solr in the Real World
• Storage of "canonical data“
• Relational vs. Search Index
• Complexity of custom relevancy scoring
• "Near-Real-Time" updates• "Near-Real-Time" updates
• Solr in a pipeline
• Pushing bits and marshalling cost
• Index size, corruption, and stability
• Administrability
14
Scaling Up Parse.ly
• Custom scoring
• Multicore
• Distributed search
• Celery / Disco
1616
•
• User-Article Binding Problem
17
Basic
solr.py
Almost There
collective.solr
Comprehensive
haystack
18
pysolr
solrpy
json/py output
solango python-solr
19
BatchingContext Lib
Caching
20
Comprehensive.
Pythonic.
Solr.
MulticoreProxies
Web Framework
Django
PaginationIterators
CachingMemoization
21
powered by
Andrew
DidierSachin
22
Quick Plug
Does your company or enterprise
need our services?
23
2424
Andrew Montalenti
25
@amontalenti
Product Twitter
@parse_ly
25
Website
http://parse.ly
Team Blog
http://blog.cogtree.com
Sign up now!
It’s Free!
Promo Code
SLIDES
