Big Data Drupal
-
Upload
permaculture-cooperative -
Category
Documents
-
view
221 -
download
0
Transcript of Big Data Drupal
![Page 1: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/1.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 1/25
Big Data DrupalDEMOCRATIZING BIG DATA PROCESSES
![Page 2: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/2.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 2/25
Elements
Bonita
Cloudera
NutchSolr
Drupal
![Page 3: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/3.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 3/25
BonitaJAVA/ECLIPSE-BASED COMMERCIAL OPEN-SOURCE BUSINESPROCESS AUTOMATION & MODELLING
![Page 4: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/4.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 4/25
Bonita StudioDesign business process models
Human or Service Tasks
Human Tasks have Forms
Service Tasks have Connectors
![Page 5: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/5.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 5/25
BonitaExperienceWeb-based admin & workflow
![Page 6: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/6.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 6/25
Bonita Forms
![Page 7: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/7.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 7/25
Shell Script Task
sudo -u hdfs hadoop jar/opt/nutch/basil-apache-nutc1.6/build/apache-nutch-1.6.jo
org.apache.nutch.crawl.Crawl/user/nutch/demo-crawl/urls${dir} -depth ${depth} -topN 1threads 50
Runs Nutch job for Hadoop
![Page 8: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/8.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 8/25
ClouderaBIG DATA COMMERCIAL OPEN S OURCE
![Page 9: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/9.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 9/25
ClouderaCloudera Manager 4 (Free Edition)
Hbase
HDFS
Hive
Hue
Impala
Mapreduce
Oozie
Zookeeper
![Page 10: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/10.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 10/25
Nutch JobHadoop job started by Bonita Shellconnector
![Page 11: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/11.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 11/25
ApacheFoundation
Nutch
Solr
Hbase
HDFS
Hive
Impala
Mapreduce
Home to many of these projects
![Page 12: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/12.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 12/25
NutchIndustrial strength general purposeweb-crawler
http://blog.csdn.net/hadoopstudy/article/details/15
![Page 13: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/13.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 13/25
Nutch
http://blog.csdn.net/hadoopstudy/article/detai
![Page 14: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/14.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 14/25
SolrSearch & indexing
![Page 15: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/15.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 15/25
DrupalPHP WEB APPLICATION FRAMEWORK
![Page 16: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/16.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 16/25
Aegir BOA
![Page 17: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/17.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 17/25
DrupalNutch & Solr modules
Integrate with search & views
Created at IAS
Sponsored by Acquia
![Page 18: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/18.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 18/25
Apache SolrModule
![Page 19: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/19.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 19/25
Apache Solr
ExamplesModule
http://drupal.org/project/apachesolr_examples
![Page 20: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/20.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 20/25
Nutch Mulisite
![Page 21: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/21.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 21/25
Drupal SearchNutch crawl
Solr indexed
Drupal search & views
![Page 22: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/22.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 22/25
Nutch SolrSandbox
![Page 23: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/23.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 23/25
Big Data DrupalDEMOCRATIZING BIG DATA PROCESSES
![Page 24: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/24.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 24/25
Big Data DrupalAuthor
![Page 25: Big Data Drupal](https://reader034.fdocuments.us/reader034/viewer/2022051104/577cdce41a28ab9e78abac9a/html5/thumbnails/25.jpg)
7/30/2019 Big Data Drupal
http://slidepdf.com/reader/full/big-data-drupal 25/25
Big Data Drupal
Web www.BigDataDrupal.com
Email [email protected]
Contact Nicholas Roberts