Research Data Marts In Support Of Cancer Personalized Medicine
CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data...
-
Upload
eileen-oconnor -
Category
Documents
-
view
233 -
download
6
Transcript of CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data...
![Page 1: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/1.jpg)
1
CHAPTER 3Data and Knowledge Management
![Page 2: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/2.jpg)
2
1. Managing Data2. The Database Approach Big Data3. Data Warehouses and Data Marts4. Knowledge Management
![Page 3: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/3.jpg)
3
>>>1. Discuss ways that common challenges in
managing data can be addressed using data governance.
2. Discuss the advantages and disadvantages of relational databases.
3. Define Big Data, and discuss its basic characteristics.
![Page 4: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/4.jpg)
4
>>>4. Recognize the necessary environment to
successfully implement and maintain data warehouses.
5. Describe the benefits and challenges of implementing knowledge management systems in organizations.
![Page 5: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/5.jpg)
5
OPENING >• Flurry Gathers Data
from Smartphone Users
Do you feel that Flurry should be installed on your smartphone by various app makers without your consent? Why or why not? Support your answer.
What problems would Flurry encounter if someone other than the smartphone’s owner uses the device? (Hint: Note how Flurry gathers data.)
Can Flurry survive the privacy concerns that are being raised about its business model?
![Page 6: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/6.jpg)
6
Managing Data3.1
• Data Quality• Difficulties of Managing Data• Data Governance
![Page 7: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/7.jpg)
7
Data quality
•Accurate•Complete •Timely •Consistent•Accessible•Relevant•Concise
1. Relevant2. Complete
3. Accessible4. Timely
5. Accurate6. Consistent7. Concise
![Page 8: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/8.jpg)
8
The Difficulties of Managing Data
•The amount of data increases exponentially over time
•Data are scattered throughout organizations
•Data are generated from multiple sources (internal, personal, external)
•New sources of data
![Page 9: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/9.jpg)
9
The Difficulties of Managing Data (continued)
•Data Degradation•Data Rot•Data security, quality, and integrity are critical
•Legal requirements change frequently and differ among countries & industries
![Page 10: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/10.jpg)
10
’S ABOUT BUSINESS 3.1
• New York City Opens Its Data to All
What are some other creative applications addressing city problems that could be developed using NYC’s open data policy?
List some disadvantages of providing all city data in an open, accessible format.
![Page 11: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/11.jpg)
11
Data Governance
• Master Data Management• Master Data
![Page 12: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/12.jpg)
12
The Database Approach
3.2
• Data File• Database Systems Minimize &
Maximize Three Things• The Data Hierarchy• The Relational Database Model
![Page 13: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/13.jpg)
Figure 3.1: Database Management System
13
![Page 14: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/14.jpg)
14
Database Management Systems (DBMS) Minimize:
• Data Redundancy
• Data Isolation• Data Inconsistency
![Page 15: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/15.jpg)
15
Database Management Systems (DBMS) Maximize:
• Data Security• Data Integrity• Data Independence
In the old days, data files and programs …
![Page 16: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/16.jpg)
16
’S ABOUT BUSINESS 3.2
• Google’s Knowledge Graph Refer to the definition of a relational
database. In what way can the Knowledge Graph be considered a database? Provide specific examples to support your answer.
Refer to the definition of an expert system in Plug IT In 5. Could the Knowledge Graph be considered an expert system? If so, provide a specific example to support your answer.
What are the advantages of the Knowledge Graph over traditional Google searches?
![Page 17: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/17.jpg)
17
Data Hierarchy
• Bit• Byte
• Field• Record• Data File (Table)• Database
![Page 18: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/18.jpg)
Data Hierarchy (Figure from Laudon & Laudon)
Low
High
Bad exmpl - A principle of DB design: smlst elmt…
![Page 19: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/19.jpg)
19
Data hierarchy explained:
What they are Term in DB As component in DB
Smallest meaningful unit
Related fields
Same type of records
Related files
![Page 20: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/20.jpg)
Figure 3.2: Hierarchy of Data for a Computer-Based File
20
![Page 21: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/21.jpg)
21
The Relational Database Model
• Database Management System (DBMS)
• Relational Database Model• Data Model
EntityInstanceAttribute
![Page 22: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/22.jpg)
22
Relational Database Model Example
Entity Instance Attribute Attribute Value
![Page 23: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/23.jpg)
DISCUSSIONDatabase - maintains information about various types of
objects, places/organizations, people, and events
Entity
Attributes
object Ex: Bottled water
place Ex: State
place Ex: City
people Ex: Student
people Ex: Patient
event Ex: Stud-org-sponsored campus activities
Think: City names in State table? Similarly: UNIV,
COLLEGE, FACULTY, STUDENT
![Page 24: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/24.jpg)
24
The Relational Database Model (continued)
• Primary KeyUniquely:
• Secondary KeyHelp to identify but not uniquely:
• Foreign KeyThrough which relationship is
maintained and implemented
![Page 25: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/25.jpg)
Figure 3.3: Student Database Example
25Problem of this design?
![Page 26: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/26.jpg)
26
Big Data3.3
• Defining Big Data• Characteristics of Big Data• Issues with Big Data• Managing Big Data• Putting Big Data to Use
![Page 28: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/28.jpg)
28
Defining Big Data: Gartner
• Diverse, high volume, high-velocity information assets that require new forms of processing to enable enhanced decision making,
insight discovery, and process optimization.
![Page 29: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/29.jpg)
29
Defining Big Data: The Big Data Institute (TBDI)• Vast Datasets that:
Exhibit varietyInclude structured, unstructured, and semi-
structured dataGenerated at high velocity with an uncertain
patternDo not fit neatly into traditional, structured,
relational databasesCan be captured, processed, transformed,
and analyzed in a reasonable amount of time only by sophisticated information systems.
![Page 30: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/30.jpg)
30
Characteristics of Big Data
• Volume• Velocity• Variety
![Page 31: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/31.jpg)
31
Issues with Big Data
• Untrusted data sources• Big Data is dirty• Big Data changes, especially in data
streams
![Page 32: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/32.jpg)
32
Managing Big Data
• Big Data can reveal valuable patterns, trends, and information that were previously hidden:tracking the spread of diseasetracking crimedetecting fraud
![Page 33: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/33.jpg)
33
Managing Big Data (continued)
• First Step:Integrate information silos into a
database environment and develop data warehouses for decision making.
• Second Step:making sense of their proliferating data.
![Page 34: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/34.jpg)
34
Managing Big Data (continued)
• Many organizations are turning to NoSQL databases to process Big Data
![Page 35: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/35.jpg)
35
’S ABOUT BUSINESS 3.3
• The MetLife Wall Describe the problems that MetLife was
experiencing with customer data before it implemented the MetLife Wall.
Describe how these problems originated.
![Page 36: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/36.jpg)
36
Putting Big Data to Use
• Making Big Data Available• Enabling Organizations to Conduct
Experiments• Micro-Segmentation of Customers• Creating New Business Models• Organizations Can Analyze Far More
Data
![Page 37: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/37.jpg)
37
Data Warehouses and Data Marts
3.4
• Describing Data Warehouses and Data Marts
• A Generic Data Warehouse Environment
![Page 38: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/38.jpg)
Figure 3.4: Data Warehouse Framework
38
![Page 39: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/39.jpg)
39
Describing Data Warehouses and Data Marts
• Organized by business dimension or Use online analytical processing (OLAP)
• Integrated• Time variant• Nonvolatile • Multidimensional
Data warehouse supports data mining
![Page 40: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/40.jpg)
40
A Generic Data Warehouse Environment
• Source Systems• Data Integration• Storing the Data• Metadata
Data about data: type, structure, constraints, owner, source, revision, …
• Data Quality• Governance• Users
![Page 41: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/41.jpg)
Figure 3.5: Relational Databases
41
![Page 42: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/42.jpg)
Figure 3.6: Data Cube
42
![Page 43: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/43.jpg)
Figure 3.7: Equivalence Between Relational and Multidimensional Databases
43
![Page 44: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/44.jpg)
44
’S ABOUT BUSINESS 3.4
Data Warehouse GivesNordea Bank a Single Version of the Truth
What are other advantages (not mentioned in the case) that Nordea Bank might realize from its data warehouse?
What recommendations would you give to Nordea Bank about incorporating Big Data into their bank’s data management? Provide specific examples of what types of Big Data you think Nordea should consider.
![Page 45: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/45.jpg)
45
Knowledge Management
3.5
• Concepts and Definitions• Knowledge Management Systems• The KMS Cycle
![Page 46: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/46.jpg)
46
Concepts and Definitions
• Knowledge Management• Knowledge• Explicit and Tacit Knowledge• Knowledge Management Systems• The KMS Cycle
![Page 47: CHAPTER 3 Data and Knowledge Management 1. 1.Managing Data 2.The Database Approach Big Data 3.Data Warehouses and Data Marts 4.Knowledge Management 2.](https://reader036.fdocuments.us/reader036/viewer/2022062322/56649e905503460f94b94b11/html5/thumbnails/47.jpg)
Figure 3.8: The Knowledge Management System Cycle
47