Automating ArcSDE Geodatabase Maintenance
-
Upload
sade-jordan -
Category
Documents
-
view
36 -
download
0
description
Transcript of Automating ArcSDE Geodatabase Maintenance
![Page 1: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/1.jpg)
AUTOMATING ARCSDE GEODATABASE MAINTENANCE2011 IGIC Conference
Muncie, Indiana
Presenter: Trent Pell, GISP
![Page 2: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/2.jpg)
HISTORY
MCCOG is a Metropolitan Planning Organization(MPO)
MCCOG provides GIS and Planning support to Madison County
Approximately 130,000 in population Approximately 86,000 land parcels Approximately 450 sqaure miles County/Community in transition Largest City: Anderson
![Page 3: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/3.jpg)
GIS OVERVIEW
Automation on a single SDE Geodatabase Versioned w/global ID’s Multiple Editors RDMS is SQL Server 2008 R2 (processor
license) Windows 7 & Server 2008 R2 – 64 bit ArcGIS Server 10sp1 Standard Enterprise
Edition
![Page 4: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/4.jpg)
WHY AUTOMATE?
Performance Streamlines process After hours Why not!
![Page 5: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/5.jpg)
WHAT SHOULD BE AUTOMATED?
Rebuild Database Statistics Compress Database Reconcile & Post database versions Delete & Re-create Versions Sync Database changes to Web Geodatabase
![Page 6: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/6.jpg)
PROCESS
Rebuild Statistics Compress Database Reconcile & Post versions to Default Kill all connections to Database Stop Web Services Delete all versions Compress Database Rebuild Statistics Re-create Versions
![Page 7: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/7.jpg)
REBUILD STATISTICS
Analyze Tool Updates database statistics of business tables,
feature tables, and delta(adds & deletes) tables Create model & export as python script Run on client machine
![Page 8: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/8.jpg)
STATISTICS
![Page 9: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/9.jpg)
COMPRESS DATABASE
SDE command line Sdeversion –o compress –u sde –p password –i
ServiceName -N Batch file on server
![Page 10: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/10.jpg)
COMPRESS DATABASEUncompressed State Tree Compressed State Tree
![Page 11: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/11.jpg)
RECONCILE & POST VERSIONS TO DEFAULT
Reconcile Tool Create model & export as python script Run on client machine
![Page 12: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/12.jpg)
RECONCILE & POST VERSION TO DEFAULT
![Page 13: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/13.jpg)
KILL CONNECTIONS TO DATABASE
SDE command line sdemon -o kill -t all -p password -N -i
Madison_Managed Batch file on server
Stop WebServices accessing database AGSSOM arcscript command Batch file on server cd C:\Users\tpell\Desktop\AGSSOMv10.0 AGSSOM.exe -x WebServiceName
![Page 14: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/14.jpg)
DELETE VERSIONS
SDE command line Sdeversion –o delete –V VersionName –N –u
VersionOwnerName –p VersionOwnerPassword –i ServiceName
Batch file on server Delete your QA version LAST!
![Page 15: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/15.jpg)
DELETE VERSIONS
![Page 16: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/16.jpg)
CLEANUP!
Compress database again Re-run Analyze/Re-build Statistics Re-Create Versions
SDE command line Batch file on server
![Page 17: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/17.jpg)
FINAL COMPRESS
![Page 18: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/18.jpg)
RE-CREATE VERSIONS
![Page 19: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/19.jpg)
AUTOMATION
Utilize Windows Task Scheduler on both client and server
Allow ample time for each task to complete
![Page 20: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/20.jpg)
AUTOMATION TIME-LINE
1am - Rebuild Statistics 1:30am - Compress Database 1:45am - Reconcile & Post versions to Default 2am - Kill all connections to Database 2:15am - Stop Webservices 2:30am - Delete all versions 2:45am - Compress Database 3am - Rebuild Statistics 3:30am - Re-create Versions
![Page 21: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/21.jpg)
AUTOMATION – WINDOWS TASK SCHEDULE
![Page 22: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/22.jpg)
AUTOMATION – TRIGGERS
![Page 23: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/23.jpg)
AUTOMATION – ACTIONS
Browse to necessary program or file For python scripts browse to the python.exe Python scripts require arguments Argument is just the
python file For batch files just browse to the .bat file
![Page 24: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/24.jpg)
ONE STEP FURTHER
Automate changes to Web based applications
![Page 25: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/25.jpg)
GETTING CHANGES TO THE WEB
Each dataset needs to be versioned with Global IDs
One way synchronization between internal Geodatabase and ‘Web’ Geodatabase
![Page 26: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/26.jpg)
TO THE WEB!
Stop all web services – AGSSOM batch file on server
Export, Compare & Import Schema Changes between Managed & Web Geodatabase – python script
Sync changes between Geodatabases – python script
Start Webservices – AGSSOM batch file on server
![Page 27: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/27.jpg)
SCHEMA CHANGES & REPLICATION
![Page 28: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/28.jpg)
AUTOMATION TIME-LINE 1am - Rebuild Statistics 1:30am - Compress Database 1:45am - Reconcile & Post versions to Default 2am - Kill all connections to Database 2:15am - Stop Webservices 2:30am - Delete all versions 2:45am - Compress Database 3am - Rebuild Statistics 3:30am - Re-create Versions 3:45am - Export Replica Schema 4:15am - Compare & Import Replica Schema 4:45am - Sync Managed & Web Geodatabases 5:15am – Start Webservices
![Page 29: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/29.jpg)
USEFUL TOOLS
PythonWin ArcScript AGSSOM tool Geodatabase Toolset or GDBT SDE command line is your friend
![Page 30: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/30.jpg)
LESSONS LEARNED
Communicate TEST! Make Backups Local security settings
Ensure user on server has Log as a Batch Job privleges under Local Security Policy>User Rights Assignment
Be flexible with your time-line and implementation
![Page 31: Automating ArcSDE Geodatabase Maintenance](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812db1550346895d92db02/html5/thumbnails/31.jpg)
THANK YOU!Trent Pell, GISPGIS CoordinatorMadison County Council of [email protected]