ALIGNED: Bringing Software and DataEngineering together

Rob Brennan

International Workshop on Big Data Standards, Dublin, 7 March 2016

3/11/20162

This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 644055.

This communication reflects only the author’s view and the Commission is not responsible for any use that may be made of the information it contains.

Genesis of ALIGNED

• (Web) Data is hot!– First class citizen

– Quality still problematic

– Rich data models support both quality and model-driven engineering

– Linked Data entering the enterprise

• Data and Software have:– Distinct and independent lifecycles

– Different tools

– Different teams!

ApplicationUsers

Data Harvesters

DatasetDomain Experts

Software Developers

SystemAdmins

Data Architects

Dev.Managers

Software Testers Data

Consumers

SoftwareAnalysts

Implementation

Analysis

Planning

Maintenance

SoftwareEngineering

Lifecycle

Design

Manual Revision/ Author

Inter-linking/Fusing

Classify/Enrich

Quality Analysis

Evolve /RepairSearch/

Browse/Explore

Extract

Store/Query

DataEngineering

Lifecycle

SystemAnalysts

How can we get these guys to talk?To improve: Productivity, Agility, Quality?

1. Identify Common Engineering Artefacts

SoftwareEngineering

Lifecycle

DataEngineering

Lifecycle

DefectReports

TestCases

Schema Definitions

Requirements

SystemRoles

EngineeringRoles

DesignIntents

EngineeringTools

LifecycleStages

2. Develop Key Tools for Productivity, Agility, Quality- That exchange the common engineering artefacts

SoftwareEngineering

Lifecycle

DataEngineering

Lifecycle

InterlinkedSoftware and Data Testing

Data Quality Validation

Model Catalogues

Semantics-aware Model-DrivenApplications

UnifiedProcess

Governance

Data Integrity Assurance

Data IntegrationAssurance

Semi-Supervised

Data Curation

Model-Driven Data

Transformations

Evolvable Data-IntensiveApplications

Model-Driven Linked Data

Consumption

Unified Requirements

Analysis

CollaborationTools

3. Validate in Real-World, Data Intensive Systems

Global History Databank

Legal InformationSystem

Nucleus for the Web of Data

SemanticMiddleware

ALIGNED Tools

SoftwareEngineering

DataEngineering

InterlinkedSoftware and Data Testing

Data Quality ValidationModel

Catalogues

Semantics-aware Model-DrivenApplications

UnifiedProcess

Governance

Data Integrity Assurance

Data IntegrationAssurance

Semi-Supervised

Data Curation

Model-Driven Data

Transformations

Evolvable Data-IntensiveApplications

Unified Requirements

AnalysisModel-Driven Linked Data

Consumption

See: http://aligned-project.eu/open-source-tools/https://www.poolparty.biz/

Model Catalogue

ALIGNED Works with Standards

• W3C Data Activity– PROV-O– Data Shapes WG– Data on the Web Best Practices WG– Semantic Web IG

• ISO – ISO11179 , Information Technology -- Metadata registries (MDR)– ISO19763, Information Technology – Metamodel Framework for

Interoperability (MFI)

• DG Connect Unit E2: Software and Services, Cloud Computing– Member of Software Engineering for Services and Applications Cluster

• Common standards activity

https://eucloudclusters.wordpress.com/software-engineering-for-services-and-applications/

• Knowledge and Data Engineering Group/ADAPT Centre, Trinity College Dublin

• Software Engineering Group, University of Oxford

• Institute of Cognitive and Evolutionary Anthropology,University of Oxford

• Agile Knowledge Engineering and Semantic Web GroupUniversität Leipzig

• Semantic Web Company GmbH• Content Strategy and Architecture Department,

Wolters Kluwer Germany,Wolters Kluwer Poland

• Institute of PrehistoryAdam Mickiewicz University at Poznan

Partners

We want to help you!The ALIGNED Consultancy Program

• Are you a business?

• Do any of these apply:– Are you building data-intensive applications?

– Do you want to curate high quality data?

– Need help integrating Linked Data + apps?

– Want to integrate your software and data engineering teams?

Call on the ALIGNED consultancy program!

http://aligned-project.eu/aligned-consultancy-program-opportunities/

Contact: rob.brennan@cs.tcd.ie

Web: http://www.aligned-project.eu

Twitter: @AlignedProject