SFBay Area Solr Meetup - June 18th: Benchmarking Solr Performance
Enrico Berti "Harness the power of Solr and Spark with Hue"
-
Upload
dataconomy -
Category
Data & Analytics
-
view
901 -
download
1
Transcript of Enrico Berti "Harness the power of Solr and Spark with Hue"
![Page 1: Enrico Berti "Harness the power of Solr and Spark with Hue"](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3bd6bbb61eb53188b47a0/html5/thumbnails/1.jpg)
SPARK AND SOLR IN HUE
Enrico Berti
INDEX AND VISUALIZE DATA IN A FEW CLICKS!
![Page 2: Enrico Berti "Harness the power of Solr and Spark with Hue"](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3bd6bbb61eb53188b47a0/html5/thumbnails/2.jpg)
GOALOF HUE
WEB INTERFACE FOR ANALYZING DATA WITH APACHE HADOOP
SIMPLIFY AND INTEGRATEFREE AND OPEN SOURCE
—> OPEN UP BIG DATA
![Page 3: Enrico Berti "Harness the power of Solr and Spark with Hue"](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3bd6bbb61eb53188b47a0/html5/thumbnails/3.jpg)
VIEW FROM30K FEET
Hadoop Web Server You, your colleagues and even that friend that uses IE9 ;)
![Page 4: Enrico Berti "Harness the power of Solr and Spark with Hue"](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3bd6bbb61eb53188b47a0/html5/thumbnails/4.jpg)
OPEN SOURCE
~5200 COMMITS 65 CONTRIBUTORS1123 STARS440 FORKS
github.com/cloudera/hue
![Page 5: Enrico Berti "Harness the power of Solr and Spark with Hue"](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3bd6bbb61eb53188b47a0/html5/thumbnails/5.jpg)
TREND: GROWTH
gethue.com
![Page 6: Enrico Berti "Harness the power of Solr and Spark with Hue"](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3bd6bbb61eb53188b47a0/html5/thumbnails/6.jpg)
WHERE TO PUT HUE? IN ONE MACHINE
![Page 7: Enrico Berti "Harness the power of Solr and Spark with Hue"](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3bd6bbb61eb53188b47a0/html5/thumbnails/7.jpg)
WHERE TO PUT HUE? OUTSIDE THE CLUSTER
![Page 8: Enrico Berti "Harness the power of Solr and Spark with Hue"](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3bd6bbb61eb53188b47a0/html5/thumbnails/8.jpg)
WHERE TO PUT HUE? INSIDE THE CLUSTER
![Page 9: Enrico Berti "Harness the power of Solr and Spark with Hue"](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3bd6bbb61eb53188b47a0/html5/thumbnails/9.jpg)
FULL SUITE OF APPS
![Page 10: Enrico Berti "Harness the power of Solr and Spark with Hue"](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3bd6bbb61eb53188b47a0/html5/thumbnails/10.jpg)
LIST OF GROUPS AND PERMISSIONS
A permission can: - allow access to one app (e.g. Hive Editor) - modify data from the app (e.g drop Hive Tables or edit cells in HBase Browser)
CONFIGURE APPSAND PERMISSIONS
A list of permissions
![Page 11: Enrico Berti "Harness the power of Solr and Spark with Hue"](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3bd6bbb61eb53188b47a0/html5/thumbnails/11.jpg)
PERMISSIONS IN ACTION
User ‘test’ belonging to the group ‘hiveonly’ that has just the ‘hive’ permissions
CONFIGURE APPSAND PERMISSIONS
![Page 12: Enrico Berti "Harness the power of Solr and Spark with Hue"](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3bd6bbb61eb53188b47a0/html5/thumbnails/12.jpg)
• Impala, Hive integraGon
• InteracGve SQL editor
• IntegraGon with MapReduce, Metastore, HDFS
SQL
WHAT
![Page 13: Enrico Berti "Harness the power of Solr and Spark with Hue"](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3bd6bbb61eb53188b47a0/html5/thumbnails/13.jpg)
• AuthorizaGon for SQL, HDFS URI
•Who can see and do what on the database/tables
• Edit security role/privileges
• Next: Solr
SENTRY APP
WHAT
![Page 14: Enrico Berti "Harness the power of Solr and Spark with Hue"](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3bd6bbb61eb53188b47a0/html5/thumbnails/14.jpg)
• Solr & Cloud integraGon
• Custom interacGve dashboards
• Drag & drop widgets (charts, Gmeline…)
SEARCH
WHAT
![Page 15: Enrico Berti "Harness the power of Solr and Spark with Hue"](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3bd6bbb61eb53188b47a0/html5/thumbnails/15.jpg)
• Scala
• Python
• Java
• SQL
• YARN
SPARK NOTEBOOKS
WHAT
![Page 16: Enrico Berti "Harness the power of Solr and Spark with Hue"](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3bd6bbb61eb53188b47a0/html5/thumbnails/16.jpg)
DEMO TIME
![Page 17: Enrico Berti "Harness the power of Solr and Spark with Hue"](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3bd6bbb61eb53188b47a0/html5/thumbnails/17.jpg)
@gethue
USER GROUP
hue-‐user@
WEBSITE
h[p://gethue.com
LEARN
h[p://learn.gethue.com
THANKS!