FME World Tour 2015 Belfast - Introduction to FME - Ciaran Kirk
FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with...
Transcript of FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with...
![Page 1: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/1.jpg)
FME and FMEServer in SDFEbest practice
FME and FMEServer in SDFEbest practice
Peter LaulundPeter Laulund
![Page 2: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/2.jpg)
About me
● Working with FME since 1997● Working with FMEServer since 2001● Certifiede professionel 2007● Works at SDFE (KMS, GST)● SQLExecuter and TCLCaller
![Page 3: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/3.jpg)
About SDFE and FME
● FME and FMEServer● Kortforsyningen.download● Transportbåndet● Datamodtagelsen
![Page 4: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/4.jpg)
Databank
Services
Validering
Styrelsen for Dataforsyning og Effektivisering
klienterGIS
klienter AppsGIS
AppsAtomFeed Download
Switchboard
WMS WFSFTP HTTP
Rest
AppsWebApps
Data on demand
FMEServer
Filer
Data Relationelle Raster CSV Proprietærer formater
DownloadWeb services
…..
…..
Databank - Oracle
![Page 5: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/5.jpg)
WorkflowWorkflowToday FME is more than a translator as it has a big number of toolshandling the workflow, like zipping and unzipping, copying files,moving to ftp, running workspaces, etc.
Today FME is more than a translator as it has a big number of toolshandling the workflow, like zipping and unzipping, copying files,moving to ftp, running workspaces, etc.
![Page 6: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/6.jpg)
FME and Workflow
Reading and writing zip files
File Copy writer – including zipping
Directory and File Pathnames Reader
HttpCaller, FtpCaller
AttributeFileReader/Writer
SystemCaller
………
SQLCreator, SQLExecutere
XMLAppender
FeatureReader
FeatureWriter
WorkspaceRunner
FMEServer…
Tools Structural
![Page 7: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/7.jpg)
SDFE INSPIRE project
![Page 8: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/8.jpg)
INSPIRE.fmw
![Page 9: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/9.jpg)
INSPIRE.fmw - Gml_Writer
![Page 10: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/10.jpg)
INSPIRE.fmw - Move2server
![Page 11: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/11.jpg)
Atom feed
![Page 12: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/12.jpg)
Atom feed
● An Atom feed is a xml file with ‘news’● In this context it is an index to data files● The contend is metadata about the dataset - Time, area, name, bounding
box, link to data● We can view it in a browser● We can use it in a machine to machine scenario● FME reads and write the feed as well as the data● Feeds are mandatory in relation to INSPIRE
![Page 13: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/13.jpg)
View in a browser
![Page 14: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/14.jpg)
AtomFeed.fmw
![Page 15: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/15.jpg)
SQLExecutor
● Run any sql – Select, Insert, Delete● Returns the result of the command● Run pl/sql code● Run more than one command
![Page 16: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/16.jpg)
AtomFeed – SQLExecuter sql
FME_SQL_DELIMITER ;
UPDATE LOG_ATOMFEED SET STATUS = 1, SKREVET = @Count(feature_count),TID = ( @Timestamp(^s) - $(t0) +1 ) where JOBID = @Value(jobId);
COMMIT ;
SELECT JOBID, FME_JOB_ID, MASKINE, FILNAVN AS "filecopy_source_dataset", DESTPATH AS "dest_dir"
FROM LOG_ATOMFEEDJOIN ( SELECT UNIQUE DATASET, DESTPATH FROM LDS_OPSLAG.LDS_ATOM_INIT ) ONDATASET = TEMAWHERE JOBID = @ Value(jobId)
![Page 17: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/17.jpg)
AutoAjour
![Page 18: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/18.jpg)
AutoAjour.fmw
![Page 19: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/19.jpg)
Part of INSPIRE job view
![Page 20: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/20.jpg)
AutoAjour jobs this month
![Page 21: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/21.jpg)
Database and system design
FMEServer
AutoAjour.fmw
Oracle views
INS_<FeatureType><user attributes>sdfe_feature_type
sdfe_sortsdfe_sort_key
JOB_INSPIRE
INS_ATOMFEED
LOG_JOB_INSPIRE
INSPIRE.fmw
AtomFeed.fmw
Log2html.fmw
Oracle tables
LOG_INSPIRE
METADATA
GeoDatabank<FeatureType>
LOG_AUTOAJOUR
SEQUENCE.BatchIdSEQUENCE.JobId
![Page 22: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/22.jpg)
Summary
![Page 23: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/23.jpg)
Best practice summary
- Let the database do the job- Use the database for configuration- Log all jobs to the database- Use FME for the workflow- Generic and dynamic workspace- One way trough the workspace- Split job on more than one workspace
![Page 24: FME and FMEServer in SDFE best practice...About me Working with FME since 1997 Working with FMEServer since 2001 Certifiede professionel 2007 Works at SDFE (KMS, GST) SQLExecuter and](https://reader033.fdocuments.us/reader033/viewer/2022050400/5f7e40feca0f68334c47dd69/html5/thumbnails/24.jpg)
RESOURCESYou can finde the INSPIRE data and Atom feed here
● https://download.kortforsyningen.dk/● https://download.kortforsyningen.dk/feeds/