IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial...
Transcript of IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial...
![Page 1: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/1.jpg)
IT ALL COMES BACK TO FAST AND
SUSTAINABLE SYNCHRONIZATION
SMALLWORLD ENTERPRISE GATEWAY 2018 EMEA User Conference, Wembley, UK
![Page 2: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/2.jpg)
INTRODUCTION
1993Graduated Technical University of Twente
1994 at RealworldSystems
Lead two
large projects
Gert Wijsman
RealworldSoftware Products
BV
Company originated in
The Netherlands
Divisions all over the worldUK, AUS, ROM,
GER, IND, SA
SWEG is maintained in the Products
division
Product Manager for:
- Diagnostics
- Enterprise Gateway
![Page 3: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/3.jpg)
WHAT IS SWEG
WHAT IS SWEG FOR
WHY SWEG
InSync to SWEG
CONTENT
› Introduction
› Open Smallworld data to other means than Smallworld (next to data warehouse)
› High performance;
› Improved speed for full sync;
› Configuration instead of customization;
› Low total cost of ownership
![Page 4: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/4.jpg)
“The noblest pleasure is the joy of understanding”
Leonardo da Vinci (1454 – 1519)
![Page 5: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/5.jpg)
What is SWEG
• SWEG is an on-demand synchronization enginethat hooks into the two databases:
✓ ORACLE
✓ Smallworld Database
![Page 6: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/6.jpg)
History
Performance
1990s 2018
InSync
2006 : Realworld started
synchronisation product
2010 : Release 2
2012 : SWEG 4.3
2018 : SWEG 5.1.7
2016 : SWEG 5
![Page 7: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/7.jpg)
01
02
03
04
ORACLE
INTEGRATION
HIGH AVAILABILITY
ACCESSIBILTY
PURPOSE
![Page 8: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/8.jpg)
Design objectives
1. Performance
2. Reliable
3. Only configuration (no customisation)
![Page 9: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/9.jpg)
High speed
Imports Oracle data
changes into Smallworld
Deep Smallworld
support
Fully integrated User Interface
WHY SWEG
![Page 10: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/10.jpg)
SWEG FEATURES
PERFORMANCE
METADATA
DATAMODEL•Changes
•Joins
•Geometry Mapping
OTHER. Two way
synchronisation
Parallel synchronisation
•Heterogeneous Joins
• Internal Worlds
•Enumerators
•Topology export
![Page 11: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/11.jpg)
Fix for common tolerance issues in geometries 5
Full reports of sync runs by email6
Configuration backup7
Automated script running (SQL and magik)8
Advanced Mapping 1
XML export of configurations 2
Coordinate system transformations 3
Multiple Smallworld sources into a single Oracle target 4
Other features
![Page 12: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/12.jpg)
OPTIMAL LEVERAGE OF ORACLE AND SMALLWORLD TECHNOLOGY
PARALLEL PROCESSING
DATASET MULTIPLEXING03
02
01
HIGH PERFORMANCE
![Page 13: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/13.jpg)
User Interface
• Administration Settings
• Collection Mappings
• Datamodel
• Manage Oracle spatial
• Manage enumerators
• Manage Network connectivity (called manifolds in Smallworld)
• Process monitoring
• Logging
![Page 14: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/14.jpg)
Unified log in Oracle Start directly from the GUI Multiple GUI instances
Monitor all running SWEG processes
LOGGING CONTROL FEEDBACK
Delete and import configurations
Clean up the target Oracle schema
Upgrade the Oracle schema
Individual SW session logs in files
![Page 15: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/15.jpg)
“Simplicity is the ultimate sophistication”
Leonardo da Vinci (1454 – 1519)
![Page 16: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/16.jpg)
BENEFITSConfiguration SWEG and upgrade do not interfereUpgrade to CST 5 will be simplified
SWEG 5 is compatible with CST 4.3 Make new configuration.
Advised migration path:First step: Upgrade InSync to SWEG 5 Second step: Upgrade to CST 5
Migration path InSync to CST 5
![Page 17: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/17.jpg)
![Page 18: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/18.jpg)
InSync
SETUP AND MAINTENANCE
Requires the creation and maintenance ofinitial mappings as well as the Oracle Spatial
metadata to match the configured Oracledatabases
Automatically creates mappings andmaintains the connection to Oracle usingconfigurations and Oracle data dictionary
Information. It has centralized log, full access to configuration metadata in Oracle and integrated
Smallworld session management.
SWEG
![Page 19: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/19.jpg)
PERFORMANCE
InSync SWEG
Very slow if Smallworld data update volume is
high
High speed ACPT interface to Oracle provides
10x or better performancegains over the native Smallworld interface.
It is scalable using multiple processes on multiple
machines for even more throughput.
![Page 20: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/20.jpg)
SWEGGeneral Capabilities InSync
Intuitive user interface with good functions to automatically setup and
map a database✓
Intuitive user interface with good functions to automatically setup and
map a database✓~~User Interface
Several panels with multiple windows and steps to complete basic mapping
and replication
Error handling Errors produce tracebacks, handled at the sync run levels
Tracks error for individual records while completing the rest of the
synchronization run✓
Tracks error for individual records while completing the rest of the
synchronization run✓
Joins included
.
1:n support via manual foreign key creation
Full support for heterogeneous joins (with specific metadata)
Includes Network connectivity YES
Includes Internal Worlds
Enumerator values included
Support for datamodel evolution
Post-Sync reporting and email
Spatial metadata management
Geometry correction
![Page 21: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/21.jpg)
vs
vs
vs
vs
vs
vs
runwithin minutes
Derived fields aresupported
complete replication of data within a single day
selected collections orfields can be re-replicated
single configuration for bothreplication andsynchronization
“One Click” migration ofconfiguration to other
environments
can sometimes take more than a day
derived fields are not supported
complete replication of data took almost 5 days
not able to re-replicate selected fields
separate configurationsneeded for replication and
synchronization
migration of configurationto other environments
is difficult
SWEG InSyncDaily
synchronization
Limitations
Replication
Configuration
Customer experience example
![Page 22: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/22.jpg)
References
![Page 23: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/23.jpg)
CONCLUSION
It all comes back to Fast and Sustainable Synchronization!
CONFIGURATIONSaves you on maintenance!
HIGH PERFORMANCENo more issues with small maintenance windows!
Be CST 5 ready by replacing InSynctoday with SWEG!.
1
3
2
4
![Page 24: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and](https://reader034.fdocuments.us/reader034/viewer/2022051912/6003667ea70a2338e61c312e/html5/thumbnails/24.jpg)
“It's easier to resist at the beginning than at the end”
Leonardo da Vinci (1454 – 1519)