Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS)...
Transcript of Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS)...
![Page 1: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/1.jpg)
FME in Action
Ken Bragg European Services Manager
#fmewt
![Page 2: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/2.jpg)
5 Topics
1. An Update on Databases
2. Working with Raster & Point Clouds
3. FME and Data Validation
4. Real Time Data
5. Performance
![Page 3: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/3.jpg)
1. An Update on Databases
![Page 4: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/4.jpg)
Named Connections
Tools > FME Options > Database Connections
![Page 5: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/5.jpg)
Named Connections
Define when adding reader or writer
…or Tools – FME Options
![Page 6: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/6.jpg)
Named Connections
Available for all database formats except Geodatabase and SDE
Available in related transformers
Shareable
Publishable
![Page 7: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/7.jpg)
Named Connections
Geodatabase SDE & ArcSDE use .sde connection files
Define in ArcCatalog/ArcMap first
![Page 8: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/8.jpg)
Writer Harmonization
Project to improve and simplify the setting up of database updates to make inserts, updates, deletes easier
Done for SQL Server family of formats
Done for FileGDB writer
Done for JDBC writer
![Page 9: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/9.jpg)
Writer Harmonization
DEMO
![Page 10: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/10.jpg)
JDBC
New format – Java based database connection
Many providers for many formats
Read – FME Professional Edition
Write – FME Database Edition
![Page 11: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/11.jpg)
JDBC
Accessed as jdbc:<subprotocol>:
Uses named connection technology
Writer has new harmonized layout
Allows access to cloud databases
More details on FMEPedia
![Page 12: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/12.jpg)
Exploring Raster & Lidar Data with FME
![Page 13: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/13.jpg)
Raster Terminology
Band
Palette
Origins and extents
Data type
![Page 14: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/14.jpg)
Working with Bands Band Management
Combining and Separating Bands
Selecting Bands
![Page 15: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/15.jpg)
Key to Format Conversion: Interpretation
Data Type
Bit Depth
Data Interpretation
Palettes vs Bands
RasterInterpretationCoercer
INT32 GRAY8 JPEG
![Page 16: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/16.jpg)
Raster and Vector Interaction
Working with vector
and raster data
simultaneously
![Page 17: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/17.jpg)
Raster Cell Manipulation & Algebra
Raster Cell Calculations:
RasterCellValueReplacer
RasterCellValueCalculator
RasterExpressionEvaluator
![Page 18: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/18.jpg)
Reports with Pictures!
“…a big part of GIS work is making a PDF site location map that’s going to go into a forgotten report…”
Marc Pfister from Geohipster
![Page 19: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/19.jpg)
FME and Point clouds
![Page 20: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/20.jpg)
Translate Point Cloud
LAS Reader/Writer
LAZ Reader and Writer - Using LAStools Open Source LASZip technology (http://laszip.org)
RIEGL Laser Scan Database
Oracle Spatial Point
Terrasolid TerraScan
XYZ
Z+F LaserControl ZFS Reader
ESRI Read and Write LASD meta data
![Page 21: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/21.jpg)
Formats
NEW Formats:
CARIS Spatial Archive (CSAR) Point Cloud
Mojang Minecraft (covered in 3D presentation)
Updated Format:
LAS 1.3 and 1.4 support
Esri zLAS (FME 2015.1)
![Page 22: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/22.jpg)
Transformers
PointCouldComponent…
PointCloudCoercer
PointCloudCombiner
PointCloudCreator
PointCloudExpressionEvaluator
PointCloudThinner
PointCloudFilter
PointCloudOnRasterComponentSetter
PointCloudPropertyExtractor
PointCloudSplitter
![Page 23: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/23.jpg)
New Transformers
PointCloudSorter
PointCloudMerger
PointCloudStatisticsCalculator
![Page 24: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/24.jpg)
Usage example
Several scenarios in a single workspace:
Classification
Biomass calculation
Feature Extraction
![Page 25: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/25.jpg)
Usage example
Classification
![Page 26: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/26.jpg)
Meet the SharedItem Family
4 new transformers to manipulate:
Appearances
Textures
Rasters in textures
Geometry Definitions (Instances)
![Page 27: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/27.jpg)
New transformers in action
Replacing Instances
DEMO
Replace these…
..with this…
…and get this
![Page 28: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/28.jpg)
FME and Data Validation
![Page 29: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/29.jpg)
Why are we talking about this?
Bad data costs time, money and even lives.
![Page 30: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/30.jpg)
Why are we talking about Validation and Quality Control?
FME and FME Server are powerful tools for checking data and providing feedback
Many partners, integrators and users use FME today for Validation and Quality Control
![Page 31: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/31.jpg)
What can we check?
Schema
Feature Type Name
Attribute Present
Attribute Names
Attribute Data Types
Coordinate System
![Page 32: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/32.jpg)
How can we check schema?
Key Tools
Schema (Any Format) Reader
FeatureTypeFilter
StatisticsCalculator
AttributeClassifier transformer
XMLValidator Transformer
JSONValidator Transformer
![Page 33: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/33.jpg)
What can we check?
Attribute Values
Values exist
Data Type (numeric, alpha etc)
Value within in range
No duplicates
![Page 34: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/34.jpg)
How Can we Check Attribute Values?
Key Tools
Tester and TestFilter
AttributeClassifier
AttributeRangeFilter & AttributeFilter
NullAttributeMapper
Matcher
DuplicateRemover
StringSearcher
StatisticsCalculator
![Page 35: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/35.jpg)
What can we check?
Geometry 2D and 3D
Intersections
Orientation
Duplicate Vertices
Missing Surface Normals
Invalid Solid Voids
etc
![Page 36: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/36.jpg)
How can we check geometry?
Key Tools
GeometryValidator (12 tests and counting)
Detection and repair
old transformers bundles in eg Self-Intersector
GeometryFilter
Matcher
SpatialFilter (Sweco example)
SliverRemover & SpikeRemover
AreaCalculator & LengthCalculator
OrientationExtractor
![Page 37: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/37.jpg)
Workspace Example
![Page 38: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/38.jpg)
Validation Workflows on FME Server
Submit data via email, upload, directory watcher, scheduled task
Provide report or results via email, form, data download, PDF
![Page 39: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/39.jpg)
Validation Workflows on FME Server
![Page 40: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/40.jpg)
Partner Validation Examples #1 Axmann CheckGeo
1. Users upload data
2. Workspaces Check Schema, Geometry, Attributes
3. Email sent with PDF Report and Bad Data in AutoCAD
![Page 41: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/41.jpg)
Partner Validation Examples #1 Axmann GeoChecker
Detailed Reports & AutoCAD File of Errors
![Page 42: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/42.jpg)
Partner Validation Examples #2 Veremes - Qualigéo
Generic Approach to avoid “Chamber of Horrors”
![Page 43: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/43.jpg)
Partner Example #4
1Spatial - UKPostcodeValidator
![Page 44: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/44.jpg)
FME and Real Time Data
![Page 45: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/45.jpg)
Two Types of Real-Time Data
1. Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message / second Continuous Data Stream High Velocity Data Stream of > 1 message / second.
![Page 46: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/46.jpg)
Real-Time #1:
Notifications
![Page 47: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/47.jpg)
Real-Time #1 - Notifications Notifications all follow the same pattern:
Something happens
FME Workspace is run
Output is delivered
![Page 48: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/48.jpg)
Notification Service – Sample Workflow
FTP - Report - Email
Publisher (FTP)
FTP
Workspace
Create a
Report
Subscriber
(Email delivery)
DEMO
![Page 49: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/49.jpg)
Real-Time #2 Data Streams
![Page 50: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/50.jpg)
FME Engine(s)
directly
connected to
data stream.
![Page 51: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/51.jpg)
Data Streams Example Workflow
Device
TCP/IP
Workspace ALWAYS RUNNING
Web App
DEMO
WebSockets
![Page 52: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/52.jpg)
Supported Direct Connections
HTML5 WebSockets
Java Message Service (JMS)
Amazon Simple Queue Service (SQS)
TCP/IP
![Page 53: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/53.jpg)
JMS / WebSockets Demo
![Page 54: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/54.jpg)
Performance & Profiling
It is all about Time!
![Page 55: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/55.jpg)
What is taking so long?
![Page 56: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/56.jpg)
Improving Performance
Use the Database
Blocking Transformers
Live Feature Counts
Log File Options
![Page 57: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/57.jpg)
Profiling
Shows how much time in each “Factory”
To turn it on:
Select “Tools | Edit Header”
Add line at the top:
FME_PROFILE_RESULT_CSV <file path>
Get a file like slide “FME Profile Result”.
DEM
O
![Page 58: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/58.jpg)
http://fmepedia.safe.com/articles/How_To/Performance-Tuning-FME
![Page 59: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/59.jpg)
Thank You!
Questions?
![Page 60: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/60.jpg)
Summary of What’s Great in FME Desktop
![Page 61: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/61.jpg)
Workbench - Dynamic!
Dynamic Feature Counting
Run with Full Inspection
Automatic Attribute Schema
Object resizing
Undo history tree
Syntax highlighting for scripting
Snap to grids and guides
Attribute merging
Order writers by workspace position
![Page 62: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/62.jpg)
Formats - 3D & BIM
● IFC (writing)
● CARIS CSAR Point Cloud
● Minecraft (read and write)
● OpenSceneGraph
● TetGen
DEMO
![Page 63: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/63.jpg)
Formats - Business Intelligence
● Sharepoint Lists
● Socrata REST
● JDBC Read/Write (non-spatial formats with JDBC driver;
rssbus.com, Faircom, EXtremeDB, SAP HANA etc.)
● Word (FMEPedia)
● OData Reader 2.0
● Oracle Database Cloud
![Page 64: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/64.jpg)
Formats - Spatial
● GME Raster Reader (Reader/Writer since 2014)
● ArcGIS Feature Service reader/writer
● Oracle Database Cloud
● CartoDB
● MBTiles
● WMTS
● SXF Panorama exchange (Russia)
● Land Victoria Incremental Update Format (Australia)
● OGC GeoPackage
● Three.js (JSON Templater)
![Page 65: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/65.jpg)
Transformers
PDFPageFormatter
TableAdder (FME Store)
ChartGenerator
HttpCaller
FTPCaller
TweetStreamer
GoogleMapsEngineStyle
S3…
XMLAppender
GMLFeatureComposer GeoRSSFeature..
SharedItem…
TraitMerger
PointCloudMerger
PointCloudStatistics..
![Page 66: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/66.jpg)
Thank You!
Questions?
For more information:
@kenatsafe #FMEWT
![Page 67: Ken Bragg European Services Manager · 2019-10-10 · HTML5 WebSockets Java Message Service (JMS) Amazon Simple Queue Service (SQS) TCP/IP . JMS / WebSockets Demo . Performance &](https://reader033.fdocuments.us/reader033/viewer/2022053021/5f8a8de93826760bc83dcb7b/html5/thumbnails/67.jpg)
Thank You!
Questions?
For more information:
@kenatsafe