Bigdata Machine Learning Platform
-
Upload
mk-kim -
Category
Data & Analytics
-
view
1.680 -
download
0
Transcript of Bigdata Machine Learning Platform
![Page 1: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/1.jpg)
2015.01
Bigdata Machine Learning Platform
BICubeTM
BICubeTM
http:www.bicube.co.kr
![Page 2: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/2.jpg)
2BICubeTM
Bigdata Machine Learning Platform
Sqoop Flume
HDFS (Hadoop Distributed File System)
Zookeeper
Yarn(2.0)
MapReduce
HivePig
Mahout
Mashup
RDB
Preprocess Classify Cluster Associate Visual
BICube
RDB Mashup SNS Crawler
Authent ication
CubeM
anager
Log Crawler
Machine Learning Engine
Spark
SparkSQL
SparkStream GraphXML
Storm Kafka Akka
BioinfoManipul
Mesos
BICubeTM Architecture
![Page 3: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/3.jpg)
3BICubeTM
Bigdata Machine Learning Platform
• MultiLinearRegression, KoreanMorpheme
• Logistic Regression, SVM, Adaboost, Neural Network
• RandomForest, NaiveBayssian, Timeseries Analysis
• Kmeans, LDA, HMM, PCA, SVD, CRF, TDA
• Covariance, Correlation, ROC, LSA, EigenFace Image
• CF Recommender, ConfusionMatrix, AUC
• Bagging, Wagging, ArcX4,LogitBoost,ModestAdaboost
• SAMME,BinaryClibration, IsonicCalibration...
• Discriminant Adaptive Nearist Neighbor
• Hierachical agglomerative clustering
• Kernel Recursive Least Square,Radial Base Network
• Local scaled density base clustering, EMGaussianMixture
• Sequential minimum optimization,Dual coordinate Descent
• T-Test, F-Test, G-Test, Chi-square-Test Anova etc….
BICubeTM Algorithms
![Page 4: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/4.jpg)
4BICubeTM
Bigdata Machine Learning Platform
Document-Topic Matirx ViewerDocument-Topic Matirx Viewer
Latent Dirichlet Allocation on Hadoop
![Page 5: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/5.jpg)
5BICubeTM
Bigdata Machine Learning Platform
Word-Topic Matirx ViewerWord-Topic Matirx Viewer
Latent Dirichlet Allocation on Hadoop
![Page 6: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/6.jpg)
6BICubeTM
Bigdata Machine Learning PlatformDocument Similarity Visualization
![Page 7: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/7.jpg)
7BICubeTM
Bigdata Machine Learning PlatformDocument Similarity Matrix
![Page 8: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/8.jpg)
8BICubeTM
Bigdata Machine Learning PlatformWord Cloud from SNS
![Page 9: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/9.jpg)
9BICubeTM
Bigdata Machine Learning PlatformOntology from Unstructured Document
![Page 10: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/10.jpg)
10BICubeTM
Bigdata Machine Learning PlatformConfusion Matrix for Accuracy Maesure
![Page 11: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/11.jpg)
11BICubeTM
Bigdata Machine Learning PlatformLatent Semantic Visualization
![Page 12: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/12.jpg)
12BICubeTM
Bigdata Machine Learning PlatformLatent Semantic Visualization
![Page 13: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/13.jpg)
13BICubeTM
Bigdata Machine Learning Platform
3D Visualization on GPU3D Visualization on GPU
Unstructured Document Clustering
![Page 14: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/14.jpg)
14BICubeTM
Bigdata Machine Learning PlatformAssociation Rule from MBA
![Page 15: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/15.jpg)
15BICubeTM
Bigdata Machine Learning Platform
Computer Vision on Hadoop
Image Analysis from Hadoop
![Page 16: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/16.jpg)
16BICubeTM
Bigdata Machine Learning PlatformFace Recognition from Hadoop
![Page 17: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/17.jpg)
17BICubeTM
Bigdata Machine Learning PlatformOLAP Analysis from Data Warehouse
![Page 18: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/18.jpg)
18BICubeTM
Bigdata Machine Learning PlatformGEO Analysis for location data
![Page 19: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/19.jpg)
19BICubeTM
Bigdata Machine Learning PlatformPDF Parser on Hadoop HDFS
![Page 20: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/20.jpg)
20BICubeTM
Bigdata Machine Learning Platform
Trade Market Prediction
Recurrent Neural Network Feedfoward Neural Network(Elman) Counterpropagation Neural Network
Hopfield Neural NetworkBoltzman Neural NetworkNeat Neural NetworkSom Neural NetworkArt 1 Neural NetworkBam Neural NetworkAdaline Neural Network
Stock Market Analysis using ANN
![Page 21: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/21.jpg)
21BICubeTM
Bigdata Machine Learning PlatformLog Analizer for machine data
![Page 22: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/22.jpg)
22BICubeTM
Bigdata Machine Learning PlatformMash-up data from multi-datasource
![Page 23: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/23.jpg)
23BICubeTM
Bigdata Machine Learning PlatformData Visualization
![Page 24: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/24.jpg)
24BICubeTM
Bigdata Machine Learning PlatformData Visualization
![Page 25: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/25.jpg)
25BICubeTM
Bigdata Machine Learning PlatformParallel cordinate & Facet Analysis
![Page 26: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/26.jpg)
26BICubeTM
Bigdata Machine Learning Platform
PointCloud on GPU for Topological Data AnalysisPointCloud on GPU for Topological Data Analysis
3D Point Cloud for TDA
![Page 27: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/27.jpg)
27BICubeTM
Bigdata Machine Learning Platform
Module Manager Add components by yourself–
Module Manager by DIY type
![Page 28: Bigdata Machine Learning Platform](https://reader031.fdocuments.us/reader031/viewer/2022030310/58f9a96f760da3da068b6e97/html5/thumbnails/28.jpg)
28BICubeTM
Bigdata Machine Learning Platform
Process Manager- Process UI Design Manager
UI Manager by DIY type