Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

20
Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt

Transcript of Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

Page 1: Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

Linking Social, Open, and Enterprise Data

Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt

Page 2: Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

Contents• Trends• Information Silos• Questions That Motivated Us• System Design and Architecture• Data Modeling and Models• Example Queries• Future Work• Questions

Page 3: Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

Trend 1 – Big Data

Page 4: Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

Trend 2 - LoD

Page 5: Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

Trend 3 – App Economy

Page 6: Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

Trend 4 – Social Media

Page 7: Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

Typical Corporation Information Silos

Page 8: Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

Questions We Asked• How to manage and extract value from these

disparate, isolated data, and• How to take advantage of information from

external, non-enterprise, and social media to provide new, exciting, and useful services that create value for BT customers

Page 9: Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

Linking Social, Open, and Enterprise Data

• Social Data: LinkedIn• Open Data: OpenCorporates• Enterprise Data: BT’s internal SalesForce data

and HR data

Page 10: Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

System Architecture

Page 11: Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

Unified Ontology

Page 12: Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

LDAP data schema

Page 13: Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

Modeling LDAP

Page 14: Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

Modeling SalesForce Data

Page 15: Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

Modeling LinkedIn data

Page 16: Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

Example Query

Page 17: Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

Challenges Encountered (1/2)• Establishing the Business Case: Set out goals and establish

what data needs to be linked

• Data Discovery and Provenance: Appropriate internal and external data need to be searched for and discovered (Quality problems, etc)

• Information Extraction and Data Harvesting: Not all the data will be useful. Relevant data items need to be extracted

Page 18: Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

Challenges Encountered (2/2)

• Data Cleaning: Most of these datasets, internal and external, will not be in the format that can be made use of. Need to be cleaned

• Data Interlinking: The Choice of Join Points. What do you use to do the inter-linking?

• Data Modeling

• Data Management: Some data need to be brought in at run-time, or cached and made available when needed. Therefore, policies to manage the live and cached data sets need to be devised

Page 19: Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

Future Work• Future Work includes • System Trials• Adding more internal BT data• Ingesting more external data

Page 20: Linking Social, Open, and Enterprise Data Tope Omitola, J. Davies, A. Duke, H. Glaser, N. Shadbolt.

Questions ?• Tope Omitola, [email protected]