iWay Software: Information Management and roadmap€¦ · iWay Service Manager 8.x Current Projects...
Transcript of iWay Software: Information Management and roadmap€¦ · iWay Service Manager 8.x Current Projects...
Fateh NAILI
iWay Software: Information Management and roadmapTransforming data into business value
Enterprise Solutions Manager
August, 23rd 2018
Agenda
Introduction and Context
Information Builders Solutions
Data Integration
Data Quality
Master Data Management
Roadmap
Wrap-up
Introduction and Context
3
4
Information BuildersFocused on Modern Challenges and Opportunities
A complete data & analytics software platform
Data Quality
Data Governance
Master DataManagement
Batch ETL Real-Time ESB
ApplicationsLegacy Systems Relational/Cubes Big Data Columnar/In Memory Unstructured Social Media Web Services Trading PartnersIoT
Hadoop-Based
Data Discovery Reporting Dashboards Location Analytics
Schedulingand Alerts
In-DocumentAnalytics
Natural Language/Narrative BI
High-PerformanceData Store
SearchPredictive Analytics
Infographics Performance Management
Write-Back
BI Portal Embedded InfoApps™ Mobile
Integrity
Integration
Intelligence
6
Omni Data HubModern Data Management platform to generate trusted data
Data Accessibility
Data Quality Problems
Data Inconsistency
Multi-sourced Data
Structured & Unstructured
Big Data
IoT/Machine Generated
Accessible
Integrated
Real-time
Accurate
Consistent
Governed
Compliant
Trusted
A well defined implementation approach
7
Data
Governance
Share
CommunicateAnalyse
PropagateData Distribution
BuildMatch
MergeData Mastering
ImproveStandardise
EnrichData Quality
GetConnect
OrchestrateData Integration
KnowExplore
ProfileData Analysis
Manage
Control
Data Integration
8
9
Introduction to iWay Service Manager
Unique and powerful Integration Platform
Real time and Batch Processing
Compose, Orchestrate and Automatecomplex integration processes
Drag and drop interface for pre-builtcomponents
Expose processes as reusableServices (Web Service, REST, API Management …)
300+ Pre-Built Adapters Bi-directional Data, Application, Industry, etc
Use any messaging infrastructure
9
iWay Service Manager
10
Key features
Open standard-based solution
Backbone for all data processingData Quality, Master Data Management, Data Governance, WebFOCUS can all be stacked on top of the engine for complete data access.
Native XML and JSON processing Automatically transform A2A and B2B messages (IoT)
Complete end-to-end security authentication, authorization, encryption
Full API supportGenerate and consume API/REST
Cloud and on-premise deployment
10
iWay Service Manager
11
Tools and components
11
iWay Service Manager
iWay Service Manager
iWayRepositories
iWay Web Console
IWay BAM
IWay Sentinel
iWay Designer
iWay Transformer
iWay Application
Explorer
ApplicationServer
BPMApplication
BI Application
Web ServiceApplication
SWIFT Adapter
MySAPAdapter
OracleAdapter
….
iWay Process Flows
Event DrivenReal Time Processing
REST, API Mgt, Web Service
iWay Adapter Framework
CICSAdapter
Mainframe Data, Applications and
Transactions
Applications,ERP, CRM, …
Files, Excel CSV, XML
SWIFT, HIPAA, EDI Formats
Databases, Data Warehouse,
Design TimeOperational Time Run Time
iWay Integration ToolsiWay Operational Tools
Routing Transform Security XA
Data Quality
12
13DQ Rules DQ MonitoringDQ Profiling
Introduction to Omni-Gen DQ Edition
Business based solution designed to optimize the integrity of informationthroughout the enterprise
Packaged with comprehensive,fully customizable business rulesand a portfolio of libraries
Collaboration
Well defined approach
Omni-Gen DQ Edition
Remediation
14
ComponentsOmni-Gen DQ Edition
Data QualityWorkbench
Data QualityRemediation
Data QualityMonitor
Administration
Omni-Gen Governance Console
Omni-Gen DQ Server
CleanseService
MatchService
MergeService
RemediationService
ManualOverrideService
Internal Merge
Omni-Gen DQRepository
Source Systems
Mainframe
Applications,ERP, CRM, …
Files, Excel CSV, XML
SWIFT, HIPAA, EDI Formats
Databases, EDW …
DownstreamSystems
AuditingMonitoringGovernance…
15
Data Quality Workbench
Data profiling shows the presence oferrors with Metrics Information
Profiling Features include Patterns/Masking Custom Business Rules Extremes Quantities Frequency Analysis Foreign Key Analysis Localization Charting Grouping/Aggregate Drilldown/Interactive Displays
Profile the quality of the data
Most organizations say data quality issues are detected when reported by employees, customers or prospects. Fewer than 50% of companies conduct proactive data audits to discover data quality issues.
16
Data Quality Rules
Data Cleansing and Standardization
Data Enrichment
Data Scoring
Internal/external reference data
Matching / Merging Probabilistic and Deterministic Levenshtein distance Golden record
Implement Data Quality rules
Id column for NamesAlter Format
Remove titlesStrip Titles
Parse NamesGuess Name Surname
Prepare out valuesColumn Assigner
Remove columnsAlter Format
𝒚=𝒇 𝒙
“John”“Smith”
17
Data Quality Monitoring
Web-based Business tool
Allow organizations to monitor and track their data overtime and map them to the business objectives and risks
Defined by user and relevant to data context
DQ Key Performance Indicators
Complex computation Dimensions and Measures
17
Analyze data overtime
18
Data Quality Remediation
Operational Dashboard for Data Stewards and Data Supervisors
Provide an ability to correct data
Cleansing, Matching, Merging, Unlinking…
Improved reporting, filtering and searches
Track data quality issues in real time
End-to-end audit trail of all datachanges
Workflow interface18
Manual correction
19
Data Quality Firewall
Avoid dissemination at root (Upstream vs Downstream correction)
Extend the reach of your Data Quality Initiative
Create a firewall protecting your systems from bad data
Extending Data Quality
Master Data Management
20
21
Introduction
Top-down approach centered on business problemsCollaboration between the business and IT
Simplifies data integration and mapping of source systemsPre-packaged mapping documents
Automates key steps in the Data Hub processingdata integration, Data Quality and data mastering
Facilitates the implementation of data warehousing and data mastering
Advanced business user interfacesMaster view, source and instance records for full resolution and 360 ° view
Omni-Gen MDM Edition
22
Key Benefits
Cost/Rapid time to value – couple of weeks VS couple of monthsShorter development = smaller development costs
Simplify – Data Warehousing, Master Data or Data Quality in a boxData Integration, Data Quality, Data Governance, Mastering
Automation - Model Driven Development Top down development vs. bottom up
Flexible DeploymentCloud, departmental and enterprise deployments
Data Ownership Provide the LOB tools to own the data
22
Omni-Gen MDM Edition
23
Omni Designer
Model driven and multi-domain development framework
Generate the various components part of your MDM hub
Data Model configuration Data Quality setting Reference Data setting Workflow customization editor
Omni-Gen MDM Edition
24
360 Viewer
360⁰ view of Data Subjects.
Centralised view of all attributes belonging to a mastered record.
View all instance informationand full history.
Omni-Gen MDM Edition
25
Life cycle
25
Omni-Gen MDM Edition
Cloud-based systems
Legacy assets
ERP applications
Business partners
Cloud-based systems
Downstream applications
Data warehouses
Business partners
Roadmap – Data Integration
26
27
Product Management direction
Simplicity, Usability & Accessibility at all levels
Optimized the automated deployment and maintenance
All-in-one Application Projects supporting Team Work
Micro-services and API Management platform
Blockchain support
27
iWay 8
28
Simple and Streamlined Design Time
28
iWay 8
Modern Look & Feel Development environment
Rich Object Pallet enables quick access to components
Intuitive action based approach “Just tell us what you want to do”
Remote component access
Shared Configurations
Searchable variables
Native JSON support
29
API Management and Micro services
29
iWay 8
* 2018 Q3
Construct APIs based on RAML or by user interaction
Supported security model includes Oauth, IP lists, and others…
API Management with defined SLAs and versions*
API Analyzes based on usage, application, and other measures*
Enables Micro services architecture
30
Application Project
30
iWay 8
Application Project provides all-in-one packaged approach for developing, deploying and running your application
All components within project are included in final application
Apply different configurations to the project
Expedites deployment process
31
Current Projects
31
iWay 8
Swagger support for API Design
API Management and Monitoring Versioning Service Level Agreements End-point performance and execution monitoring Library view of available services in the environment
Ongoing addition of new components (eg: Twitter, Splunk, …)
Amazon Connectors (S3, Dynamo DB, Redshift)
IoT update includes MQTT, zeroMQ, CoAP (Constrained Application Protocol) …
Big Data connectors (Kafka, HDFS, Avro)
iIT Process Flow debugger (based on the current line debugger)
And much more …
32
iWay Service Manager 8.x
32
Current Projects
iWay Applications running on Raspberry Pi3 providing great portability
Logs written to USB storage upon connection for easy application debugging
Easy to manage black box implementation
Clustering few together enables parallelism
Complements IoT enabling projects
33
iWay Service Manager 8.x
33
Roadmap
Release 8.0 – Dec, 2017
•New L&F Intuitive Design Environment
•Local and Remote Component Library
•New process flow palette & new objects
•Action/Verb approach for process configuration
•API Design via RAML
•Native JSON support and new services
•Blockchain (Fabric)
•Python/JS support as part of process flow
Release 8.0 SP1 – Spring 2018
• MQTT and Queues update
• JPATH Builder
• Blockchain (Ethereum )
• Twitter, DynamoDB
• AD/LDAP Authentication Updates
• SWIFT/HIPAA updates
Release 8.0 SP2 - Fall 2018
• Swagger Support
• API Management and SLAs
• Docker support
• Amazon connectors
• Big Data connectors
• Updated iSM Console
• Management/Monitoring via Explorer
Roadmap – Data Integrity
34
35
Omni-Gen Initiatives
Workbench Additions Remediation rule builder and case management – Q4 2018 Matching/Merging Rules – Q3 2018 Rule Intelligence - Q4 2018
Hierarchies/Groups
Consumption View Builder – Q4 2018
Omni Edition Additions Omni Personal Edition – Q3 2018 Omni-Customer Edition – Q2 2018 Omni-Supplier Edition – Q2 2018 Omni-Item Edition – Q4 2018
WebFOCUS reports for Omni-Gen Customer and Supplier – Q3 2018
35
2018 Roadmap
36
Omni Verticals
Omni-Customer, Omni-Supplier, Omni-Item
Data Models (Customer, Supplier, Item) Built in reference data (code sets) Integrated master and transactional data
Sample table data, load plans & groups
Data Quality plans and mastering rules
Competitive Distinction Persisting and linking important transactions Consumption – WebFOCUS Artifacts Out-of-the-box mastering and remediation
Jumpstart Out of the Box
37
Omni Verticals
Sales ImprovementCompare total sales dollars and product units year over year
Order AccuracySummarize all sales orders with returns greater than 5 product units, or perfect percentages less than 80%, or on time delivery less than 70* by year, or fill rates less than 95% by week
Product QualitySummarize all sales order with returns by total number of returns by product group by week
37
Built-in Consumption
38
Omni-Gen
38
Consumption View Builder