WebSphere MQ Low Latency Messaging V2.1. High Throughput and Low Latency to Maximize Business Responsiveness IBM Corporation

Transcription

1 WebSphere MQ Low Latency Messaging V2.1 High Throughput and Low Latency to Maximize Business Responsiveness 2008 IBM Corporation

2 WebSphere MQ Low Latency Messaging Extends the WebSphere MQ messaging family New product that provides a messaging transport optimized for low latency, high-throughput delivery Provides low-latency, high-throughput messaging Capable of over 8 million messages per second Can achieve less than 30µs latency Traffic control with static & dynamic rate control Delivers semi-reliable delivery Choice of Multicast and Unicast transport with range of topology, speed and reliability characteristics Ordered (FIFO) delivery Stream failover for high availability Filters messages flexibly Coarse-grained, topic-based and fine-grained filtering Included in WebSphere Front Office for Financial Markets High-Speed Low-Latency WebSphere MQ Low Latency Messaging

3 Product History WebSphere MQ Low Latency Messaging Ultra low-latency & high-throughput market and trade data messaging transport for front-, middle-, and back-office First separate release (V2.0) in November, Announce and General Availability V2.1 August 26, 2008 Positioned as part of MQ family of transports Based on patented technology from IBM Haifa Research Lab Java implementation used in WebSphere Event & Message Broker (MQ Multicast and MQ Real-Time Transports) Integrated in IBM WebSphere Front Office for Financial Markets (WFO) 3

4 Low Latency Messaging Customer Applications High volume, reliable messaging for Financial Market Applications Front Office to Back Market Data Trade Data Reference Data Event Data (update notifications, alerts ) Partners such as Data Vendors/ISVs (e.g. Reuters) Included with WebSphere Front Office for Financial Markets (WFO) Other Industries with similar quality of service requirements 4

5 Low Latency Messaging and MQ in the Trade Process Data Aggregators / Exchanges Execution Venues Compliance Reporting Counterparty Confirmations Custodial Settlement Instructions External Payments Analysis, Pricing, Trade, and Order Management Pre- / Post-Trade Compliance WebSphere MQ Low Latency Messaging WebSphere MQ Internal / Reference Data Positions / Portfolios Market & Credit Risk Analytics Security Master Accounting and General Ledger Front Office Middle Office Back Office Internal 5

6 Positioning of IBM Messaging Transports Speed Quality of Service Reliability Quality of Service WebSphere MQ Time Independent As-Soon-As-Possible Ultra-Reliable Bet-The-Business WebSphere MQ Low Latency Messaging Ultra-Fast Microseconds Semi-Reliable Know-when-you-lose data Target Market Enterprise Messaging Low Latency Messaging Target Industries Topology All Via QM Financial Markets Others with similar QoS needs Direct sender(s) to receiver(s) Queuing Yes No Send-Receive Connect APIs Platform coverage Interoperates with Asynchronous JMS, XMS and MQI from C, Java,.NET, COBOL, PL/I, BAL, RPG, etc. 80 platforms WAS, WMB, WESB, DataPower XI50, DB2, CICS, IMS, etc, etc Synchronous LLM API from C, Java,.NET Linux and Windows on x86, and Solaris on x86 and SPARC Included in WebSphere Front Office 6

7 Major features of WebSphere MQ LLM V2.1 Multicast and Unicast Reliable UDP Multicast (RMM) Reliable UDP Unicast (Point to point RMM) Reliable TCP Unicast (RUM) Low Latency and High Throughput Publishes 20million, 12-byte messages per second Below 100µs latency at typical market data rates for 1G ethernet Single digit µs latency using native InfiniBand Reliable Reliable and Consistent Message Streaming (RCMS) Maintains buffers for retransmission Reconnects as necessary Zero or minimal messages lost due to transient network or application failure Fine-grained message filtering Allows for millions of logical message flows Filtering on message properties APIs to monitor statistics and performance Provides visibility into the status of the network, senders and receivers Congestion and Traffic rate control Automatically detects and handles slow consumers Informs application of slow consumers and allows actions Highly configurable Adaptable for varying application messaging and threading requirements Runs on a large number of platforms Windows (32, 64), Linux (32, 64), Solaris (Sparc, x86, 32, 64) API support for C, Java, and.net 7

8 Reliable Multicast Messaging (RMM) API Reliable Multicast using UDP Highly scalable, topic-oriented communication. Support pub-sub messaging paradigm Supports PGM specification NAK reliability- feedback only if a packet is lost (request for retransmission) Duplicate NAK suppression Sliding history window Slow receiver expulsion - Maintains high transmission rate, expels slow receivers Reliable Unicast using UDP Efficient point to point, topic-oriented communication multicast group address or IP address LAN1 stream of UDP packets Standard multicast routing or PGM support ACK reliability (all packets acknowledged) Periodic feedback (heartbeat) from clients Higher reliability (similar to that of TCP) Controlled ACK parameters LAN2 8

9 Reliable Unicast Messaging (RUM) API High throughput using TCP Basic messaging technology above TCP primitives Channel (queue) definition (no need to handle sockets) IP address stream of TCP packets Multiple streams on a single connection Message send/receive API (no need to handle TCP streaming) LAN1 Wide Area Network Firewalls Proxies Connection liveness, heartbeating Breaks a few dozen K write/sec TCP limit Can be used in WAN or through firewall LAN2 9

10 Reliability Reliable Multicast using UDP NAK reliability feedback only if a packet is lost (request for retransmission) NAK Sliding history window most recent messages buffered for retransmission Manages congestion Adaptive packet rate Duplicate NAK suppression Slow receiver suspension or expulsion Reliable Unicast using UDP Higher reliability similar to that of TCP ACK reliability periodic feedback for each packet (all packets acknowledged) Periodic heartbeat ensures liveness Reliable Unicast using TCP Reliability handled by TCP ACK multicast group address LAN1 NAK or IP address ACK stream of UDP packets NAK NAK Standard multicast routing or PGM support ACK ACK LAN2 10

11 Performance features of WebSphere MQ LLM V2.1 Several factors contribute to LLM s high performance Batching Grouping individual messages into packets for transmission Proprietary algorithms dynamically optimize packet size based on Throughput Message size Operating system and receiver feedback Results in efficient transmission of all message sizes Compact packet headers Leaves more network bandwidth for application data Efficient handling of packet loss Reduces the chances of network congestion Congestion management features limit repair traffic Native support for InfiniBand 11

12 Monitoring features of WebSphere MQ LLM V2.1 LLM provides a robust monitoring API that provides access to Instance statistics Overall message rates, bytes sent, memory utilization, etc. Topic statistics Packets and messages received, filtered, or lost, etc. statistics List of current receivers buffer utilization, NAK generation and congestion management policies. Latency statistics Transmitter and receiver topic latency information. The level of detail for these statistics is configurable and ranges from basic buffer utilization info to detailed histograms of internal and external latency timings. LLM provides a facility to load an independent external monitoring tool. Shared object loaded by advanced configuration into application process space Receives callbacks for instance and topic creation and destruction, event notification and log event notification. Provides access to the APIs that are available to the application. 12

13 Differentiating Features of WebSphere MQ LLM V2.1 Performance Highest published message throughput Lowest published message latency Native InfiniBand High Availability Reliable and Consistent Message Streaming (RCMS) Transparent stream failover Zero message lost due to application failure Monitoring Comprehensive application performance statistics API for both application and external monitoring Congestion Management Transmission rate and queue depth limits with event notification Automatic detection and suspension of individual slow consumers Message Filtering Support for millions of logical message flows Property based filtering (SQL92-based) 13

14 Basic RMM Application Transmitter 1.Create RMM transmitter instance 2.Create topic transmitter(s) 3.Send messages 4.Close topic transmitter(s) 5.Stop transmitter instance 1.Create RMM receiver instance 2.Create topic receiver(s) 3.Join to multicast group(s) 4.Receive messages 5.Leave multicast group(s) 6.Close topic receiver(s) 7.Stop receiver instance RmmTxConfig config = new RmmTxConfig(); transmitter = rmmfactory.initrmmtransmitter(config); RmmTxTopicParameters params = new RmmTxTopicParameters(); params.destaddress = ; params.transport = new RmmTransportType(RmmTransportType.RMM_TRANSPORT_MULTICAST); params.topicname = allaboutibm ; topic = transmitter.createtopic(params); msg = new RmmTxMessage(); msg.msgbuf = new byte[sz]; msg.msglen = sz; topic.submitmessage(msg); RmmRxConfig config = new RmmRxConfig(); receiver = rmmfactory.initrmm(config); RmmRxTopicParameters params = new RmmRxTopicParameters(); receiver.joinmulticastgroup(dst); params.topicname = allaboutibm ; params.onevent = new RMMEvent("Topic"); topic = receiver.createtopic(params); class RMMMessage implements RmmMessageListener { public void onmessage(rmmrxmessage msg) { thread.processmessage(msg) 14

15 WMQ LLM 2.1 Performance with InfiniBand and Cisco DAL Message size (bytes) Maximum Throughput (4 stream) Network IP over InfiniBand DAL over InfiniBand Ethernet (1 Gbit/sec) msgs/sec Mbit/sec msgs/sec Mbit/sec msgs/sec Mbit/sec 12 21,061,412 2,021 13,340,552 1,281 8,276, ,752,110 2,430 3,713,911 1,337 2,495, ,364,942 2,270 1,980,897 1, , , ,754 2, ,283 1,586 98, IPoIB stands for IP over Infiniband. This protocol does interrupt the CPU for packet transmission, unlike RDMA based network stacks like DALoIB DALoIB stands for Datagram Acceleration Layer of Infiniband. This is Cisco s socket implementation over Infiniband that allows traditional sockets based applications to leverage the RDMA capabilities of the Infiniband Host Channel Adapters (HCA) cards. The reported throughput (in the Mbit/sec column) is that of the application; the throughput going out to the network is actually higher due to headers which are appended to each packet 12,000 22,391 2,149 16,119 1,547 9, ,000 2,639 2,533 1,800 1, Network 1 Gbit/sec Ethernet (1GbE) IP over InfiniBand (IPoIB) DAL over InfiniBand (DALoIB) Single hop latency (microseconds) Message size [bytes] Transmission rate (msgs/sec) 10K 100K 250K 500K 1M Latency in M icroseconds , , , ,000 1,000,000 Transmission Rate in messages/sec 1GbE 45 byte IPoIB 45 byte DALoIB 45 byte 1GbE 120 byte IPoIB 120 byte DALoIB 120 byte 1GbE 1000 byte IPoIB 1000 byte DALoIB 1000 byte 15

16 WebSphere MQ Low Latency Messaging Roadmap WMQ Low Latency Messaging v2.0.0 RMM Transport RUM Transport Simple Stream Failover C Bindings Monitoring API Congestion Management Slow Consumer API Linux Support Windows Support Solaris Support InfiniBand (IPoIB) WMQ Low Latency Messaging V2.1.0 High Availability with heartbeating (RCMS) Native InfiniBand Property-based message filtering Java bindings.net bindings Multiple NICs on multiple networks Total order sequencing Sun JVM support Non-guaranteed late joiner support Potential Future Content DataPower appliance (2008) Additional platforms MQ convergence Enhancements to RCMS Persistence High priority OEM / customer requirements * 2007 Nov 2008 Aug 2009 All statements regarding IBM's future direction or intent are subject to change or withdrawal without notice, and represent goals and objectives only. This information is for planning purposes only. The information herein is subject to change before the products described become available. 17

17 WebSphere MQ Low Latency Messaging evaluation The performance and interoperability of WebSphere MQ Low Latency Messaging will give our clients even more open access to Reuters systems at greater speed than ever. For the first time, developers will be able to build new applications using IBM messaging software to access content from [Reuters Market Data System] RMDS and to distribute it into other parts of their organizations. This is another example of our key aim to put customers first, and we look forward to working more closely with IBM as it introduces further enhancements to the suite of IBM WebSphere Software products. Peter Moss, Global Head of Enterprise Solutions, Reuters

18 Additional Information Financial Markets Analytics is the IBM portfolio of offerings that address high velocity trading and analytics in the front office. Faster Data ibm.com/financialmarkets/fasterdata Financial Market Analytics ibm.com/financialmarkets/analytics WebSphere MQ Low Latency Messaging ibm.com/software/integration/wmq/llm/ * Links clickable only in screen show mode 19