IBM MQ v8 enhancements
-
Upload
chris-sparshott -
Category
Technology
-
view
478 -
download
0
Transcript of IBM MQ v8 enhancements
© 2014 IBM Corporation
Messaging across IT: IBM MQ V8 enhancements
Leif Davidsen – Senior Product Manager, IBM MessagingIBM Hursley [email protected]
© 2014 IBM Corporation
The need for connectivity is growing
• Connectivity in business infrastructure is increasing – More information, more systems, more
services, deployed anywhere
• New sources of data are changing the world– However data without connectivity
becomes a burden not an asset
• Connect systems together– Deliver timely updates of targeted data– Gain business insight
– Applications and data change from growing costs to valuable assets
2
© 2014 IBM Corporation
The challenge of using data to grow value
• Multiple data sources write massive amounts of information into storage– Challenge of useful off-line analysis grows
by the second once the data is committed to disk
• Extracting value from customer or transaction data is greatest as it is created– Realize the greatest value by moving the
data to where it can be consumed
– Movement must be rapid, reliable and secure to protect the integrity and security of the data
– Every second more data is being created – it becomes even more urgent to move it to where it can provide value
3
© 2014 IBM Corporation
Moving data – where does it need to go?
• Systems are dynamic – new applications, new sources of data, new consumers of data– The challenge of delivering data to meet changing demands
needs a flexible infrastructure
• Roll-your own code in the applications
– Increases cost, time and complexity, but can deliver the code where you need it
• Storing the data in a database or file
– Creates a permanent record, but does nothing to provide timely analysis
• A messaging infrastructure can meet both needs– Keeps the application simple and able to adapt to change
– Can deliver filtered information to consuming applications, and also deliver to a permanent information store
4
© 2014 IBM Corporation
Why Messaging is still important…do these sound familiar?
•Failures still happen - application and network – cloud and mobile especially
•Don’t try to handle these failures in your business application logic –
•Moves any type of data and any type of system, device or environment, with a common shared API
•Configurable: Persistence, Performance, Management, Security, etc.
“business transactions must happen only once”
“adding new services or applications is unpredictable”
“change is relentless”
“need to adopt new industry standards”
“must become more agile”
“losing data costs time money and reputation”
“business insight is key in today’s market”
“consumer interaction is forcing us to respond faster”
“we need to become more event driven”
Here is why messaging is important…
“our applications are getting too complex”“we need to recover from IT
failures better”
5
© 2014 IBM Corporation
IBM Messaging – Market segments
Deliver Messaging Backbone for EnterpriseFocus on traditional MQ values, rock-solid enterprise-class service, ease-of-operation, breadth of platform coverage, availability, z/OS exploitation
Capture Big Data from Mobile and Internet of ThingsFocus on Internet-scale events, m2m device enablement, zero-admin, security and privacy, feed into real-time analytics, location-based notifications
Enable Developers to build more scalable, responsive applicationsFocus on new app dev use cases, breadth of languages, ease-of-deployment, lightweight services, integration with developer frameworks
6
© 2014 IBM Corporation
So what is IBM MQ?
• Messaging you need– Simplifies applications, no need for complex connectivity logic or error
handling
– Scales from single application deployments to billions of messages per day
– Connects from the mainframe to the mobile and the Internet of Things, moving data from applications, files and services
– Most widely deployed enterprise messaging solution with the largest ecosystem and set of skilled practitioners
• Messaging as you need it– A secure messaging environment, with your customer and business data
encrypted end to end
– Built-in High Availability with automated failover
– A single point of visibility and control for the data flowing through your business
– Reliable, robust movement of data with transactional integrity
7
© 2014 IBM Corporation
What does IBM MQ do?Provides messaging services to applications and Web services that need to exchange data and events with:
Universally supported by multiple platforms20 years leading in transactional message delivery
Financial Services & Banking
Government
Manufacturing
Retail
Q Manager Q Manager
Message
Queue
Application ZApplication A
Channels
Inherent reliable delivery and transaction control
Native, high-speed handling of any type of message or file
Native lightweight capabilities for supporting remote devices & sensors
End-to-end advanced security
Single point of control, visibility, and management for all data movement
Applications become more flexible and datamovement becomes more reliable
Capabilities like the Coupling Facility in System z provide unique strengths
Extensive support through years of development, skills and partner ecosystem extensions
Comprehensive single solution reduces complexity of deployment and operation
8
© 2014 IBM Corporation
IBM MQ V8.0 and IBM MQ V8.0 for z/OS
Simplify your applications, increased resilience for your business
Rapid, reliable, simple, secure exchange of data across applications, systems and
services
Connect your applications, share information held in files, streamline your processes
Scale to meet peaks in transaction workloads and provide the QoS your business
demands
What’s new in IBM MQ V8.0
Grow your deployment faster, with larger
workloads, easier administration
Enhanced security with simpler, more
powerful operational support
New capabilities, additional platform
coverage, support for new standards
IBM MQ AMS available on IBM i for the first
time
What’s new in IBM MQ for z/OS v8.0
Exploit System z capabilities to improve
manageability &performance
Improved throughput, scalability and
operational tasks
Enhanced security and connectivity, with
support for new standards
No Charge for connecting MQ clients from
other platforms to MQ for z/OS
Scalable, secure, comprehensive connectivity using reliable messaging everywhere you need it
9
© 2014 IBM Corporation
Key MQ enhanced capabilities• Key themes for this release
– Ease of use
• Get started faster
• Lowers the skills and cost for larger production operation/admin
– Scalability
• More messages through any machine
• More efficient clusters for increased throughput in larger multi-queue manager environments, especially for publish-subscribe
– Security
• Strong security on all platforms with SHA-2 and AMS everywhere
• More flexibility in security configuration and improved ease of use
– Exploitation of platform and standards currency
• Leverage the latest hardware for z/OS
• Consistent capabilities across platforms, support for JMS 2.0
10
© 2014 IBM Corporation
Why should you care?
• Ease of use improvements?– Operational cost and complexity is a big concern
– Improvements here lower cost and dependency on highly skilled staff
• Security improvements– Security is growing in exec awareness everyday– No good having a system that can be secure if it is too complex to secure
• Scalability– Better exploitation of each machine, and use in clustering helps all
production use, from small to large– Many admin and operation tasks associated with scaling have simplified
too
• Exploitation of Hardware and standards– Can’t afford to build different solutions for different environments
11
© 2014 IBM Corporation
IBM MQ V8 delivering best in class enterprise messaging
Platforms & Standards
Security Scalability System z exploitation
64-bit for all platformsUserid authentication via OS & LDAP
Multiplexed client performance
64-bit buffer pools in MQ for z/OS means less paging, more performance
Multiple Cluster Transmit Queue on all platforms
User-based authorisation for Unix
Queue manager vertical scaling
Performance and capacity
Support for JMS 2.0 AMS for IBM i & z/OSPublish/Subscribe improvements
Performance enhancements for IBM Information Replicator (QRep)
Improved support for .Net and WCF
DNS Hostnames in CHLAUTH records
Routed publish/subscribe
Exploit zEDC compression accelerator
SHA-2 for z, i & NSSMultiple certificates per queue manager
SMF and shared queue enhancements
12
© 2014 IBM Corporation
MQ V8 – details of key features across platforms
• Security– Verify userid and password against operating system, including PassPhrase for z/OS and
LDAP for non-z/OS systems
• Reduces admin tasks , and increases security outcomes
– Use DNS hostnames for CHLAUTH
• Simplifies admin tasks when maintaining network
• IP address still preferred option
– Multiple certificate authorities per Queue Manager
• Easier to configure and deploy MQ to connect to internal and external endpoints
• Lowers operational costs, saves time, reduces errors
– AMS code integrated into core MQ code
• No install required, faster to start, faster operations
• Scalability – multiple updates including:– Routed Publish Subscribe in Clusters
• Better performance for publications and subscription notifications in clusters
• Standards and consistency– Support for JMS 2.0
• Enables application development complying to latest JMS spec
– Multiple Cluster Transmit Queue everywhere
• Allows multiple applications running at different speeds in a single cluster13
© 2014 IBM Corporation
MQ V8 – details of key new z/OS-focused specific enhancements
• 64 bit buffer pools– Exploit large amounts of storage in today’s z hardware
– Increases performance and throughput
– Reduces admin overhead
• Log RBA constraint relief– Widens RBA field to hugely extend time taken to fill log
– Removes the need to restart Queue Manager due to full log, reduces risk of loss of persistent messages
• Making use of zEDC compression accelerator – SSL encryption increases security for message exchange
– Compression of message delivers higher throughput
– Transaction cost for message movement can be lower depending on the message
• Support for zEC12 and zBC12 Flash Express– Improving resiliency by leveraging increased memory in Coupling Facility
– Provides real benefits to users of MQ Shared Queues – further extending the unique capabilities provided by the Coupling Facility
• Performance improvements for IBM Information Replicator – Reduced CPU usage, and increased throughput14
© 2014 IBM Corporation
MQ Client Attachment Feature
• MQ CAF is an additional charge applied to customer systems which connect MQ Clients on non z/OS platforms to MQ for z/OS– MLC charge, based on a percentage cost of their MQ MLC cost.
• Chargeable features like MQ CAF distort MQ architecture and use-cases– Drove customers to connect via intermediary Queue Managers, thus putting in layers
between the MQ for z system and the application user
– Deploying new applications on z/OS that benefitted from Client Connectivity needed additional justification
MQ Clientconnectivity
MQ Clientconnectivity
MQ Clientconnectivity
MQ Clientconnectivity
MQ Serverconnectivity MQ for z/OS
No CAF charged
MQ for z/OSCAF needed
• No CAF in WMQ for z/OS V7.1 VUE– Encouraged new workloads
• New in V8, and for V7 of MQ for z/OS– No CAF in V8 – not needed for client
connectivity to encourage new workloads on z/OS
– CAF can be removed from V7 deployments by applying a PTF
– Price of CAF for V7 set to $0 on 1st June 2014, to remove the need to apply PTFs15
© 2014 IBM Corporation
What makes IBM MQ Advanced different?
• IBM MQ Advanced is a part that provides entitlement to IBM MQ Server, Managed File Transfer service, Advanced Message Security, and Telemetry:
– Buy a single part at a single price (per PVU) for all the distributed server capabilities.
– Buying 1000PVUs of IBM MQ Advanced, gets entitlement to 1000 PVUs of each of the 3 capabilities: base server, MFT service, and AMS, plus the option to connect unlimited Telemetry clients to the IBM MQ Servers.
• IBM MQ Advanced makes it easier for clients to buy and deploy all the IBM MQ distributed server capabilities they need within a single purchase.
– IBM MQ Advanced for Developers is also available specifically for development use only
Important points to note:
– Customers can also extend their network by purchasing Managed File Transfer agents to deploy on non-server entitled machines.
– To access the full capabilities of IBM MQ Advanced, deployment must use v7.5 or above.
– It is still possible to purchase individual MQ capabilities where a customer needs to be more specific about their system requirements.
– System availability can be improved with additional Idle-Standby parts.
IBM MQ Advanced
MQ AMS TelemetryMFT Service
16
© 2014 IBM Corporation
IBM MQ
system
Channels
Application B
Where does Advanced Message Security fit in?
Application A
IBM MQ has many built in security features including:
– Control over administration commands (e.g. strmqm for starting a queue manager).
– Fine grained control over access to resources (e.g. queues).
– Secure communications (e.g. SSL and access controls).
– Extensible architecture which can be customised to meet the demands of an individual
business.
When the privacy of sensitive data must be guaranteed, businesses use IBM MQ
Advanced Message Security (AMS), a chargeable component for IBM MQ, or
included in MQ Advanced.
The data is encrypted from the point it leaves the sending application to the point it
enters the receiving application.
The encryption is controlled by policies on the queue manager so no changes are
required to existing applications.17
© 2014 IBM Corporation
Where does Telemetry fit in?
• When a business needs real-time access for enterprise applications to connect to a range of mobile devices, remote sensors, actuators and other telemetry devices, they use Telemetry, a chargeable component of IBM MQ.
• IBM MQ Telemetry includes the following key components:– The Telemetry service that runs on the IBM
MQ server
– MQ Telemetry clients that are distributed to remote devices and applications
• Telemetry uses the MQTT protocol to send and receive messages between devices or applications and the MQ queue manager.
• From the MQ queue manager, the messages can be exchanged with other messaging applications.
Application BApplication A
Enterprise
Medical
DeviceVehicle
Oil Rig
Smart
Phone
Sensor
(e.g. RFID)
Telemetry client
Telemetry service
18
© 2014 IBM Corporation
Where does Managed File Transfer fit in?
When businesses need to configure, track, and audit file transfer activity in a
consistent way, they use Managed File Transfer (MFT), available as two separate
chargeable components of IBM MQ (MFT Service and MFT Agent) as the
WebSphere MFT offering. MFT Service entitlement is included in MQ Advanced.
An MFT Agent performs the fundamental file transfer function
of sending and receiving files from the local system.
– When requested to send a file, an agent reads the file’s contents
and sends it to the destination agent over IBM MQ channels in the
form of one or more MQ messages.
– An optional logging component stores the contents of file
transfer log messages.
MFT Service installs a file transfer agent on a MQ server with
additional capabilities:
– Protocol bridge agents which are used to send and receive files
with legacy FTP, FTPS, or SFTP servers.
– MQ MFT supports file-to-file movement, but also file-to-message, and
message-to-file
– These offer unique ways to exploit the valuable data held in files
An MQ Explorer integrated GUI or command-line is used to configure and administer MFT.
IBM Sterling Control Center is included to provide additional monitoring of file transfers
MFT Agent MFT Agent
Application BApplication A
Logging
component
Channels
MQ network
19
© 2014 IBM Corporation
Enhanced Managed File Transfer capabilities with IBM MQ
Enterprise Messaging with
publish/subscribe and queuing for any
application, on any OS, using any language
Connects applications reliably and securely
to send data anywhere to any solution
Extends application messaging to Mobile,
Internet of Things and Managed File
Transfer
Single, simplified licensing to provide all
the capabilities to connect the business,
and maximize data value
Do more with your MQ investment, lowering
operational overheads, and raising
efficiencies
Ensures all possible functions and
capabilities are available instantly to allow
the business to respond faster to changing
needs
Moves data from anywhere to anywhere
with included end to end monitoring and
management
MQ Advanced
MQ Advanced
All functions available and separately chargeable
All functions available for one single price
Sterling C:D
Sterling C:C
MQ
MQ Telemetry
MQ AMS
MQ MFT
MQ (D05V1LLB)
MQ Telemetry(D0PJTLL)
MQ AMS(D0PLFLL)
WMQ MFT(D0PJZLL)
These MFT functions also
available as a separate
bundle called WebSphere
Managed File TransferNOTE: WebSphere Managed File Transfer is exactly the
same as Sterling Connect:Direct Advanced
WebSphere MFT
(D14CXLL)
20
© 2014 IBM Corporation
Key dates you need to know
• MQ V7.0.0 and V7.0.1 for multiplatforms – EOM, EOS effective September 2015– V7.0 will have had more than 7 years of support
• MQ V7.0.1 for z/OS – EOM, EOS effective September 2015– V7.0 .0 already out of service
• MQ V8 Announce: 22 April 2014
• MQ V8 Availability:
– 23 May 2014 (eGA Distributed)
• MQ Advanced for Developers now available to download at no cost, as well as per user with IBM support
– 13 June 2014 (z/OS and pGA Distributed)
21
© 2014 IBM Corporation
Summary
• The need for messaging continues and grows in today’s infrastructure with the move to cloud, big data, mobile and the Internet of things
• MQ has been evolving rapidly with simpler packaging, more advanced features and easier access for development
• MQ V8 continues this progress with improved scalability, ease of use, security, support for standards and exploitation of h/w
• New workloads on z/OS can be supported with MQ for z/OS VUE
• Growing recognition of need for end to end encryption of messaging data provided by MQ AMS
• New opportunities for a simple story around Managed File Transfer with new package on distributed platforms including Sterling Connect:Direct and Sterling Control Center
22
© 2014 IBM Corporation
1990s 2000s 2010s
JMS
MQIAssured delivery
IBM
MQSeries
Multi-platform
Mobile
.NET
Common criteriaEclipse
JMS 1.1RCMS
IBM MQ
Low
Latency
V1.1V2
V5V5.1
V5.3
V2.1
V5.2
V6
V7V7.0.1
SSLSOAP
XML
IBM MQ
Managed File
TransferIBM
MQTT
HTTPAJAXREST
Web 2.0Managed
File Transfer
Pub/sub
IBM MQ
Everyplace
IBM MQ
Advanced
Message
Security
V7.1V7.5
Integrated Messaging
Hypervisors
IBM MQ
Advanced
System PatternApplication Pattern
IBM MQ
Advanced for
Developers
IBM
MessageSight
Multiple clusterXMIT queue
Multi-instanceQMGR
IBM MQ
Low
Latency
20th Anniversary of MQ at IMPACT
V8
Timeline
23
© 2014 IBM Corporation
Call to action for IBM MQ V8
• Find out more about how WebSphere MQ can meet your needs– Read the latest paper on why to upgrade to MQ V8 : Download it
here: https://ibm.biz/BdR5NA
• Talk to other developers, share your ideas, listen to issues, learn more from bite size blogs– The IBM Messaging community is already waiting for you– join the discussion here:
https://www.ibm.com/developerworks/community/blogs/messaging/
– Visit the download site and download IBM MQ Advanced for Developers V8 today: https://ibm.biz/BdR5Nk
24