Intelligent Systems Lecture 23 Introduction to Intelligent Data Analysis (IDA). Example of system...
-
Upload
kory-harvey -
Category
Documents
-
view
218 -
download
0
Transcript of Intelligent Systems Lecture 23 Introduction to Intelligent Data Analysis (IDA). Example of system...
![Page 1: Intelligent Systems Lecture 23 Introduction to Intelligent Data Analysis (IDA). Example of system for Data Analyzing based on neural networks.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649e155503460f94afff63/html5/thumbnails/1.jpg)
Intelligent Systems
Lecture 23Introduction to Intelligent Data Analysis
(IDA). Example of system for Data Analyzing based on neural networks
![Page 2: Intelligent Systems Lecture 23 Introduction to Intelligent Data Analysis (IDA). Example of system for Data Analyzing based on neural networks.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649e155503460f94afff63/html5/thumbnails/2.jpg)
Synonyms of IDA
• Data mining
• Knowledge discovery, in particular, Knowledge Discovery in Databases (KDD)
• Knowledge acquisition
![Page 3: Intelligent Systems Lecture 23 Introduction to Intelligent Data Analysis (IDA). Example of system for Data Analyzing based on neural networks.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649e155503460f94afff63/html5/thumbnails/3.jpg)
Data Mining: Definition
• Data Mining is a collection of technologies which employ modern analysis techniques and computer power to find structure in data.
• Data Mining is composed of several branches, each of which attempts to solve a different problem.
![Page 4: Intelligent Systems Lecture 23 Introduction to Intelligent Data Analysis (IDA). Example of system for Data Analyzing based on neural networks.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649e155503460f94afff63/html5/thumbnails/4.jpg)
Place of KDD in Decision support system (in medicine)
![Page 5: Intelligent Systems Lecture 23 Introduction to Intelligent Data Analysis (IDA). Example of system for Data Analyzing based on neural networks.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649e155503460f94afff63/html5/thumbnails/5.jpg)
Place of Data Mining in Knowledge Discovery(Jiavei Han, Micheline Kamber “Data Mining.
Concepts and techniques”)
![Page 6: Intelligent Systems Lecture 23 Introduction to Intelligent Data Analysis (IDA). Example of system for Data Analyzing based on neural networks.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649e155503460f94afff63/html5/thumbnails/6.jpg)
Data Mining: Ontology
• Predictive Modeling
• Clustering
• Deviation Detection
• Text Mining
• Link Analysis
• Etc. ...
![Page 7: Intelligent Systems Lecture 23 Introduction to Intelligent Data Analysis (IDA). Example of system for Data Analyzing based on neural networks.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649e155503460f94afff63/html5/thumbnails/7.jpg)
Data Mining: Modeling
• Predictive Modeling attempts to predict values of future cases based on historical examples
• 90+% of all data mining is modeling
• Two major types:– estimation– classification
• Related to statistical regression
![Page 8: Intelligent Systems Lecture 23 Introduction to Intelligent Data Analysis (IDA). Example of system for Data Analyzing based on neural networks.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649e155503460f94afff63/html5/thumbnails/8.jpg)
Data Mining: Clustering
• Clustering attempts to separate cases into ‘natural’ groupings.
• Strictly, there are no ‘right answers’
• Tends to be compute intensive
• Very popular in marketing, as market segmentation
![Page 9: Intelligent Systems Lecture 23 Introduction to Intelligent Data Analysis (IDA). Example of system for Data Analyzing based on neural networks.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649e155503460f94afff63/html5/thumbnails/9.jpg)
Data Mining: Deviation Detection
• Deviation detection identifies cases which are ‘unexpected’
• All algorithms assume some model of ‘normality’- what is expected
• Related to outlier detection in conventional statistics
![Page 10: Intelligent Systems Lecture 23 Introduction to Intelligent Data Analysis (IDA). Example of system for Data Analyzing based on neural networks.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649e155503460f94afff63/html5/thumbnails/10.jpg)
Data Mining: Text Mining
• Text mining includes several, different methods for discovering structure in documents.
• The most common text mining applications are search and retrieval tools.
![Page 11: Intelligent Systems Lecture 23 Introduction to Intelligent Data Analysis (IDA). Example of system for Data Analyzing based on neural networks.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649e155503460f94afff63/html5/thumbnails/11.jpg)
Data Mining: Link Analysis
• Link analysis searches for indirect connections between items
• Primarily employed in fraud detection and law enforcement
• Link analysis tools typically include a data visualization component
![Page 12: Intelligent Systems Lecture 23 Introduction to Intelligent Data Analysis (IDA). Example of system for Data Analyzing based on neural networks.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649e155503460f94afff63/html5/thumbnails/12.jpg)
Structure of software AnalDB
Shell
DLL
DLL
…
Modules
with NNsDatabase
User
BDE
GUI, generation of reports
Control of NN
Reading from Database, Options,
Commands