StonebranchArchitecture: Agent and Integration Technologies · PDF...

©Stonebranch2017.Allrightsreserved.

Stonebranch Architecture:AgentandIntegrationTechnologiesOverview,StatusandOutlook

Gregor Heinrich,5October2017

Objectives

§ GiveanoverviewofhowtheUniversalAgentfitsintoStonebranch’s integrationarchitecture.

§ ShowhowStonebranch enhancementsdidandwillimprovetheagentasmainapplicationexecutionandmonitoringcomponent.

§ ShowhowcustomersareandwillbeabletoenhanceAgentfunctionalityusingStonebranch’s architecture.

6.October2017 |©Stonebranch2017.Allrightsreserved. Seite2

Agenda

010203

UniversalAgent:StatusandOutlook

UniversalIntegrationPlatform:StatusandOutlook

04 Conclusion

Stonebranch Architecture:Motivationandoverview


UniversalAgentUniversalAgent

UniversalAgent

Stonebranch Architecture:ProvidingControlandVisibility

§ “Agent-only”Installations§ Centralmonitoringandcontrolusingthird-partyschedulers§ MaintenanceusingUECandAgentUtilities

Scheduler-AgnosticAgent

©Stonebranch 2017.Allrightsreserved. Seite 4

UniversalAgents

TWS Control-M UC4 AnyScheduler…

CLI SOA MFTSAP AnyAPI…

Control

Visibility

Distributed

Third-partyscheduling

Agent-basedautomation

6.October2017 |

UEC UniversalUtilities


UniversalAgent

Stonebranch Architecture:ProvidingControlandVisibility

FromClient-AgnosticAgenttoAPI-Agnostic“EnterpriseAutomationBroker”

©Stonebranch 2017.Allrightsreserved. Seite 5

UniversalAgents

UniversalController

OMSTWS Control-M UC4 AnyScheduler

N

…

REST+CLI WebUI Self-ServicePython AnyClient

CLI SOA MFTSAP AnyAPI…

Control

VisibilityREST+SOAP JDBC SSH AnyAPI

1(+HA)

…

Central

Distributed

UniqueFlexibility:AnyAPI.AnyApplication.AnyScheduler.AnyServiceModel.

Clientintegration

Agentlessautomation

Third-partyscheduling

Agent-basedautomation

6.October2017 |

UEC UniversalUtilities

DesignGoals

§ Reliability§ Security§ Compliance§ Scalability§ Interoperability§ Openness§ EaseofUse

§ EasytoOperate§ CLI,UIs§ TroubleshootingWorkload

§ EasytoMaintain§ Install§ Upgrade

§ EasytoIntegrate§ AnyScheduler§ AnyApplication

§ EasytoTransition§ AnySchedulertoUniversalController§ Migrationtoolsupport

UniversalAgentandUniversalAutomationCenter

©Stonebranch 2017.Allrightsreserved. 6.October2017 | Seite6

InteroperabilityandOpennessarekeysuccesscriteria.

Agenda

010203



04 Conclusion



UniversalAgent

UniversalAgent:Components

UCMD UDM USAP USOA UEM UFTP …UPPS

UniversalAutomationCenter(UAC)

UniversalBroker


AnyScheduler

AnyApplication

UniversalAgent

UniversalAgent:SelectedUpdates

Done andplanned

UCMD UDM USAP USOA UEM UFTP …UPPS


UniversalBroker


AnyScheduler

SignificantinvestmentinUAgent,whichwillremainthecoreexecutionmodule.

SOAConnector:Refreshed

UBroker:Newkeystore

FTPClient:NewFTP(S)Module

Peoplesoft Connector:NewUAgent Module

UAgent:Debian packagingUEncrypt update

UCMD+UDM:Newciphers,e.g.,AES256-GCM-SHA384

UAgent platformsupport:

NewPowerLinux LEandBEportsUpdatesforAIX,IBMiDockerimage

UCMD+UDM:JES-lessschedulingWorkloadbalancing

CustomAgent:Easilyextendagentfunctionality

AnyApplication

UniversalAgent

UniversalAgent+Controllerintegration:Components

IntegrationwithUniversalController

UCMD UDM USAP USOA UEM UFTP UAG OMSUPPS …

UniversalBroker


OMS

UniversalController

L/UnixTask

WinTask

z/OSTask

PPSTask

SAPTask

UDMTask

TaskMon

EmailMon

FileMon

…

Task,MonitorandTriggerTypes

AnyApplication

UniversalAgent

UniversalAgent+Controllerintegration:SelectedUpdates

Done andplanned

UniversalController

UCMD UDM USAP USOA UEM UFTP UAG OMSUPPS …

UniversalBroker


L/U/WTasks

z/OSTask

WebSvcTask

PPSTask

SAPTask

UDMTask

TaskMon

EmailMon

FileMon

…


OMS

UAgent benefitsfromintegrationwithUController.

UAGAgent:Sysplex supportwithfulltracking

CustomAgent:Easilyextendagentfunctionality

SAPConnector:Calendarimport

EmailMonitor:Newemailobserver

UniversalTask:CustomcodeonCLIorREST;Implementationsforvariousapplications+SSH/agentless

WebServicesTask:NewRESTandSOAPconnector(agentless)

Peoplesoft Task:IntegratewithUPPS

ControllerExtensions:Custom Controllerfunctionality

Agentauto-update:Centrallymanageversionsandconfigs;keystore,credentials

“AgentManager”:Controllercentrallymanagesdefinitionsandtracksinstances

UAgent connectivity:MultipleagentsonWindows;MultipleOMSperagent

“UEC++”

Status10/2017andOutlook

Updates2017:§ SOAConnectorRefresh§ Security:

§ Certificates/BrokerKeyStore§ UEncrypt§ Newciphersuites

§ DEBPackages§ UPPS:Peoplesoft Connector§ UFTP:FTPClient

Outlook:§ Platformsupport:PowerLinux,IBMi;Docker§ Multi-BrokerDeployment§ Workloadbalancing§ z/OSspecific:

§ JES-lessschedulinginUCMD§ ParallelSysplex (fulltracking)forUAG

§ UController as“AgentManager”§ UEC§ WorkloadBalancing§ Keystore§ Auto-updateandconfig§ Definejobs(taskdefinitions)§ Trackjobexecution(taskinstances)

§ CustomAgents

UniversalAgentkeyenhancements

©Stonebranch 2017.Allrightsreserved. Seite126.October2017 |

UniversalAgent

Peoplesoft ConnectorArchitecture

Multi-architectureintegration:UCMDvs.OMSControl

UniversalController

UCMD UDM USAP USOA UEM UFTP UAG OMSUPPS

UniversalBroker


L/UnixTask

WinTask

z/OSTask

PPSTask

SAPTask

UDMTask

EmailMon

TaskMon

FileMon


OMS

UAgent

UBroker

UCMDMgr

PeopleSoft

Third-PartyScheduler

…

…

UA

UC

Agenda

010203



04 Conclusion



UniversalAutomationCenter

Scopeofintegrations


1(+HA)

N


OMS

UniversalAgents

UniversalController

OMS

UniversalAutomationCenter:Control/VisibilityCycle

Scopeofintegrations


1(+HA)

N

Data

Control


OMS

UniversalAgents

UniversalController

Down-streamSystems

OMS

Applications+ServicesContainersCloudInfrastructureAutomation

(anyAPI/CLI)

SystemstateLoggingdataEvents

UniversalAutomationCenter:Control/VisibilityCycle

Scopeofintegrations


1(+HA)

N

DataData

Control Control


OMS

UniversalAgents

UniversalController

Up-streamSystems

Down-streamSystems

OMS

Self-serviceSchedulersAutomation


(anyAPI/CLI)

SystemstateLoggingdataEvents

SystemstateLoggingdata

Events

UAgent andUController partofcontrol/dataloop:“EnterpriseAutomationBroker”.

DataData

Control Control

Up-streamSystems

Down-streamSystems

UniversalIntegrationPlatform:EnablingExtensibilityandInteroperability

Do-it-yourselfextensibilityandinteroperabilityforfutureautomationneeds

Self-serviceSchedulersAutomation


(anyAPI/CLI)

…


LanguageBindings 1(+HA)

N SystemstateLoggingdataEvents

SystemstateLoggingdata

Events

ConversionToolkit

Data


AutomationasCode

DataData

ExternalVersionControl

OMS

UniversalController

RESTAPI/CLI

UCMD UDM SAP UAGCustomAgents

ControllerExtensions

UniversalTasks

UniversalAgents

Status10/2017andOutlook

Status2017:§ SOAConnectorRefresh§ WebServiceTask(UController)§ RESTfulAPI(UController)§ UniversalTask(UController)

Outlook:§ Customagent§ Controllerextensions§ RESTAPIsrevised:JSON§ AutomationasCode§ Git integration

§ Marketplace

UniversalAgent


UA

UC

UniversalAgent

CustomAgents:LiberatingDistributedControlandVisibility

Multi-architectureintegration:UCMDvs.OMSControl

UniversalController

UCMD UDM USAP USOA UEM UFTP UAG OMSUPPSCustomAgents

ControllerExtensions

UniversalTasks

UniversalBroker


L/UnixTask

WinTask

z/OSTask

PPSTask

SAPTask

UDMTask

EmailMon

TaskMon

FileMon


OMS

UAgent

UBroker

UCMDMgr

AnyExternalAPI

AutomationClient

UniversalTasks:Form-basedautomationagainstanyCLIorWebService

UsecustomvariablesandfunctionstointeractwithCustomAgentfunctionality

CustomAgents:Implementcustomfunctionalityagainstexternalprotocolsandinterfaces

ControllerExtensions:ImplementnewfunctionalityinUniversalController

CustomUCMDScriptExtensions

Availabletoday

UBroker:ManageslifecycleofdifferentUAgent modules

Custompy scriptUCMD

Universal

Broker CLI

IPC/socket

(short-runningcommands)

UCMDMgr. AnyAPI

AnyScheduler

Customscript(Pythonorother):Executescustomlogic,usingwidearrayofavailablePythonmodules

Port7887/tcp

Control

Custom

©Stonebranch 2017.Allrightsreserved. 6.October2017 | Seite 21

PythonRuntime

ScriptExtensionstoaccesssychronous APIs.

CustomUCMDExtensionAgent

FullUBroker support;EmbeddedPythonRuntime;SimilartoSAP,FTPandPeoplesoft Connectors

UBroker:ManageslifecycleofdifferentUAgent modules,incl.CustomAgentModule

CustomAgentInterface

CustomAgent(py script)

Python/CRuntime+CLILibrary

UCMDUniversal

Broker

CLI

IPC/sockets

(short-runningcommands)

UCMDMgr. AnyAPI

AnyScheduler

CustomAgentImplementation:Executescustomfunctionality,usingwidearrayofavailablePythonmodules

Port7887/tcp

Control

Custom


CustomAgentInterface:TranslatesbetweenCustomAgentandCLI,includesPythonruntime;configuredviaUBroker

trivialmessageexchange

CustomAgentsaddUBroker configuration,preservestate,loadmodules,customauthentication,etc.

CustomOMSExtensionAgent

FullUBroker support;EmbeddedPythonRuntime;SimilartonewPeoplesoft MessagingConnector

UBroker:ManageslifecycleofdifferentUAgentmodules,incl.OMS

OMS

IPC/sockets

UniversalController

UCExtensions UniversalTasksJavaUController Extensions:ImplementlogictotranslateOMSmessagesintovariablesandfunctionsusedinUniversalTask

UniversalTasksv2:UsecustomvariablesandfunctionstointeractwithCustomAgentfunctionality

AnyAPI

Control

Port7878/tcp

Port7878/tcp

Custom



Python/CRuntime+Libraries

CustomAgentImplementation:Executescustomfunctionalityagainstexternalprotocolsandinterfaces,usingwidearrayofavailablePythonmodules,exchangingmessagesonOMS

Universal

Broker


CustomAgentInterface:TranslatesbetweenCustomAgentandCLI+OMS,includesPythonruntime,configuredviaUBroker

CustomOMSAgentsaddmessagingtoUController (monitoringetc.),allowcomplexAPIinteraction.

Credentials,keys,settingscanbeconfiguredfromUController.

CustomHybridExtensionAgent

UAGandOMSintegration;MaximumFlexibility


UAG

Universal

Broker

CustomAgentInterface:TranslatesbetweenCustomAgentandCLI+OMS

CLI

IPC/sockets

UniversalController

OMS



AnyAPI

Control

Port7878/tcp

Port7878/tcp

Custom




CustomAgentImplementation:Executescustomfunctionality,usingwidearrayofavailablePythonmodules,abletohandletheCLIandtoexchangemessagesonOMS


CustomHybridAgentsaddallowaccessfromUAGandOMS,allowcomplexAPIinteraction.

Credentials,keys,settingscanbeconfiguredfromUController.

CustomHybridExtensionAgent

CLIcanbereusedforUCMD


UAGUniversal

Broker

CLI

IPC/sockets

UniversalController

OMS



AnyAPI

Control

Port7878/tcp

Port7878/tcp

Custom




CustomAgentImplementation:Executescustomfunctionality,usingwidearrayofavailablePythonmodules,abletohandletheCLIandtoexchangemessagesonOMS

UCMD

UCMDMgr.Port7887/tcp


CustomAgentInterface:TranslatesbetweenCustomAgentandCLI+OMS

AnyScheduler

CLI

CustomUCMDandUAGExt.Agentsshareoneimplementation.

CustomAgentSummary:EmpoweringYouthecustomers

CLI

UniversalController

UCExtensions UniversalTasks

AnyAPI

Control

OMS

OMS

Custom



Python/CRuntime+LibrariesUCMDMgr.UCMD/UDM


AnyScheduler

OneCustomAgentforallarchitectures.

UniversalAgentUBr

Benefits:• Forcustomers:FromquickadaptationstoOne-offcomplexintegrations(beyondscripting)

• ForStonebranch:Fastertimetomarketforstandardapplicationintegration

• SBDevTeamcanfocusonwhereitprovidesuniquevalue:ImprovingtheCore

Conclusion

§ UniversalAgentiskeytosupportStonebranch’sintegrationarchitecture:Anyclient,anyscheduler,anyAPI.

§ InteroperabilityandOpennessgoals:AnyonecanextendAgentfunctionality,andthiswillbebecomesimplerandmorepowerful.

§ UniversalControllerwillimprovecentralmanagementofUniversalAgentsanddefinecustomintegrations.



UniversalAgentUniversalAgents

UniversalController

AnyScheduler

AnyClient

AnyAPI

AnyAPI

Thankyou!ContactInformation

Dr.GregorHeinrichChiefProduct Architect

StonebranchGmbH∣ Siemensstr.1461352BadHomburgv.d.Höhe

T:+49617285538-70M:[email protected]

StonebranchArchitecture: Agent and Integration Technologies · PDF...

Documents

Transcript of StonebranchArchitecture: Agent and Integration Technologies · PDF...