Post on 07-Aug-2015
SPARK AND SOLR IN HUE
Enrico Berti
INDEX AND VISUALIZE DATA IN A FEW CLICKS!
GOALOF HUE
WEB INTERFACE FOR ANALYZING DATA WITH APACHE HADOOP
SIMPLIFY AND INTEGRATEFREE AND OPEN SOURCE
—> OPEN UP BIG DATA
VIEW FROM30K FEET
Hadoop Web Server You, your colleagues and even that friend that uses IE9 ;)
OPEN SOURCE
~5200 COMMITS 65 CONTRIBUTORS1123 STARS440 FORKS
github.com/cloudera/hue
TREND: GROWTH
gethue.com
WHERE TO PUT HUE? IN ONE MACHINE
WHERE TO PUT HUE? OUTSIDE THE CLUSTER
WHERE TO PUT HUE? INSIDE THE CLUSTER
FULL SUITE OF APPS
LIST OF GROUPS AND PERMISSIONS
A permission can: - allow access to one app (e.g. Hive Editor) - modify data from the app (e.g drop Hive Tables or edit cells in HBase Browser)
CONFIGURE APPSAND PERMISSIONS
A list of permissions
PERMISSIONS IN ACTION
User ‘test’ belonging to the group ‘hiveonly’ that has just the ‘hive’ permissions
CONFIGURE APPSAND PERMISSIONS
• Impala, Hive integraGon
• InteracGve SQL editor
• IntegraGon with MapReduce, Metastore, HDFS
SQL
WHAT
• AuthorizaGon for SQL, HDFS URI
•Who can see and do what on the database/tables
• Edit security role/privileges
• Next: Solr
SENTRY APP
WHAT
• Solr & Cloud integraGon
• Custom interacGve dashboards
• Drag & drop widgets (charts, Gmeline…)
SEARCH
WHAT
• Scala
• Python
• Java
• SQL
• YARN
SPARK NOTEBOOKS
WHAT
DEMO TIME
@gethue
USER GROUP
hue-‐user@
WEBSITE
h[p://gethue.com
LEARN
h[p://learn.gethue.com
THANKS!