Showing posts with label Transaction Monitoring. Show all posts
Showing posts with label Transaction Monitoring. Show all posts

Tuesday, February 10, 2009

Do not Confuse BTM with Traditional Tools!

Even experienced IT professionals can confuse traditional monitoring tools and the newer generation of transaction monitoring tools. In today's market, all of the marketing messages are the same so it is very hard to differentiate between the old and the new. The following provides insight into the difference which needs to be understood before considering the purchase of any monitoring tool.

Disclaimer: There is nothing wrong with traditional tools, they do their job well and all of the vendors that have been listed are good competent vendors. As with any technology, newer generations tend to improve on the old ones. Additionally, BTM has yet to fully mature and vendors of traditional tools are bound to jump to the newer generation at some point.

Traditional Monitoring:

Traditional Tools monitor the performance of each component individually and display all of these metrics on a "single pane of glass".

"End to end" performance monitoring means that you can see the performance of every component in a single centralized console. So for example you see the resource consumption of your servers, the threads that your application is running, the throughput of your network components and the calls to your database all displayed in their own section.

When traditional tools monitor transactions what they do is pick up various segments of transactions throughout the data center without stitching them together into one full transaction flow.

For example: The database monitor picks up all of the SQL statements that it sees and displays them on the central dashboard along with their response times, while the real user monitor picks up all of the requests that are sent out to the datacenter and displays them on the same dashboard along with their response times. Now say that an application slow down occurs and both monitors (including the application server monitor which was not mentioned) are showing erratic response times for various "transactions" – the real user measurements only show that the user is experiencing a problem but cannot show where the problem is within the datacenter – and the silo specific tools do not have the context of the CICS program names, SQL statements, web service calls which are showing erratic performance. The IT professional is stuck with a glut of confusing information on the dashboard that is not connected.

How to identify traditional monitoring tools: Vendors
that provide these tools typically sell them as suites. What they will do is develop or acquire separate server monitoring tools, network monitoring tools, application performance management tools and real user measurement tools - and then offer them bundled as an end to end package. These tools tend to be pricey and hard to implement not to mention their limited visibility due to the lack of correlation between tiers. On the up side they can provide more thorough metrics within the tier – that is why the new generation seeks to complement the traditional tools as opposed to replacing them.

Some examples of vendors: Opnet, Compuware, Quest, NetScout, CA, IBM

The New Generation of Monitoring Tools:

The new tools connect every single process within the datacenter to a click of a user within the application that initiated all of the activity within the datacenter.

"End to End" means that the user request and the related activity within the proxy, web server, app server, database server, MQ and mainframe are all connected as a single transaction instance.

The resource consumption at each component can still be seen – but at the granularity of a single transaction segment.

For Example: If service levels are starting to degrade, this new generation of tools not only pick up the performance degradation that the user is experiencing but they also immediately know what is causing the specific degradation down the line.

Some examples of vendors: Optier, Correlsense, HP Transaction Vision, SeaNet

Saturday, November 1, 2008

Transaction Management and “Deep Dive” Java/.NET Profilers

When an Enterprise finally gets the wakeup call when their applications are performing under par they start looking into Transaction Monitoring (or Transaction Tracking/Tracing) solutions. One type of solution is the "Deep Dive" Java/.NET solution which is defined as those solutions that use Bytecode Instrumentations (or Java/.NET Hooks) in order to collect thorough code level
metrics for J2EE/.NET experts. These Application Performance Management solutions are used throughout the entire lifecycle of the product; they are a strong tool for the developer, but a very weak tool for the production environment since they are unable to monitor all of the transactions on all tiers all the time due to very high overhead.

Who Offers These Solutions?

These solutions tend to be offered by the larger corporations:

  • CA Wily – Introscope
  • HP – TransactionVision
  • BMC – Application Problem Resolution (Identify)
  • Dynatrace – PurePath
  • Precise – APM

Overview

These tools provide deep diagnostics into Java/.NET applications – to the code level. They are used by J2EE/.NET experts in order to locate problems before deployment. These solutions are too low level for use by most operations teams and system administrators as they extract a glut of data and do not enable a high level view of the system, on the other hand, application teams rely on them for development, and they can be use in production to a certain extent in order to monitor synthetic transactions or a small percentage of the real transactions that are flowing through the system.

How they Work

Bytecode Instrumentations (or Java hooks) retrieve data from the nodes that are running J2EE/.NET applications. This is done by utilizing the class loading mechanism of the interpreter (JVM for J2EE or CLR for .NET) that in order to intercept specific classes or method calls within the application.

Applications

  • Gives J2EE/.NET experts insight into where the problems are
  • Used mainly in the development phase and pre-deployment
  • Can be used in production for a few percent of the transactions

Advantages

  • Gives developers deep insight into problems at the source code transaction data level
  • With the help of synthetic transactions, deep diagnostics can be performed during production
  • You can get a full method call, similar to a debugger

Drawbacks

  • Lengthy Implementation
  • Only works with certain environments
  • Cannot trace all transactions in real time
  • Not recommended for the production environment
  • Difficult for IT support staff to use
  • It only helps with Java or .NET
  • The solutions are not designed for a high level production view, they do not provide an extensive topology of the system
  • Lots of detailed data is collected. application owners and system administrators do not always know what to do with all of the information

Business Transaction Management

Although the list of drawbacks is long, the objective of this article is not to bash on this kind of solution (really, they will do wonders for your application development team), it is simply to help you understand that if you are looking for a solution that will cover all of your bases during production; these kinds of solutions won't cut it (they provide up to 10% sampling for limited periods of time). These solutions cannot monitor the entire topology of each transaction even though they claim to be end to end, these traits are by design, and no amount of marketing hype will enable these products to solve all of your problems as they claim to do.

Tuesday, October 14, 2008

Transaction Monitoring Application Performance Management Solutions

Why has no one posted a comprehensive index of these products?
Well, let us be the first (please let us know if we have left anyone out):

Correlsense

Sharepath

http://www.correlsense.com

Optier

Corefirst

http://www.optier.com/product_overview.aspx

HP

TrancactionVision

https://h10078.www1.hp.com/cda/hpms/display/main/hpms_content.jsp?zn=bto&cp=1-11-15-25^2872_4000_100__

CA Wily

Introscope

http://www.wilytech.com/solutions/products/Introscope.html

Dynatrace

PurePath

http://www.dynatrace.com/en/purepath_technology.aspx

B-Hive

Conductor

http://www.bhive.net/products/conductor.html

Correlix

Latency Intelligence

http://www.correlix.com/products.html

Compuware

Vantage

http://www.compuware.com/products/vantage/464_ENG_HTML.htm

Precise

Precise

http://www.precise.com/solutions/products.asp

IBM Tivoli

Transaction Performance

http://www-01.ibm.com/software/tivoli/products/monitor-transaction/

BMC

Transaction Management

http://www.bmc.com/products/products_services_detail/0,,0_0_50721704,00.html

Amberpoint

Transaction Tracking

http://www.amberpoint.com/products/transaction_tracking.shtml

Radware

Inflight

http://www.radware.com/Products/RealtimeIntelligence/Inflight.aspx

Quest

Foglight

http://www.quest.com/foglight-transaction-recorder/

Oracle

Quickvision

http://www.clearapp.com/products/index.php?quickvision

Monday, October 13, 2008

Looking into Investing in a Business Transaction Management Solution?

If so, the following is a short list of qualifiying questions you should be asking yourself:
  • Is there a need to monitor and manage every business transaction?  You can’t know in advance which transaction will fail or which transaction will be important.
  • Do you experience ‘war-room’ like committees to solve ‘needle in the hay stack’ problems?  Do you need to improve your current Mean Time To Repair (MTTR)? 
  • Are you able to accurately address (business) transaction level SLAs?
  • Are you able to accurately charge-back based on IT infrastructure (i.e., machine and device) usage for each transaction at each junction?
  • Are you able to perform pre-deployment testing, comparing transaction models before and after changes, perform business transaction impact analysis of changes in IT topologies and resources?

Sunday, October 12, 2008

The BTM Competitive Landscape

 High Level Overview

The competitive landscape can be divided into three categories: 

  1. Large established companies (IBM, CA, Microsoft), 
  2. Independent performance management focused companies
  3. Startups (most of which are past their first round of funding) 

Many of the existing tools started their way several years ago. Over the years, the complexity of the applications increased and the large vendors have a hard time coping with the rapid change in application architectures.

The Challenge

Efficient management of today’s multi-tier applications requires a new approach – moving from managing servers and operating systems to managing applications and transactions. A new space named “transaction management” was formed. There is currently no market leader in this space and there are several startups that are tackling the challenge from different angles.

A Look at What the Startups are Offering

Optier - CoreFirst

  • Automatically discover the topology of every transaction
  • Track and Monitor transactions across tiers automatically and continuously
  • Show transactions at their instance level along with their individual work units
  • Provide analytics and historical reports
  • Attain low overheads
Correlix - Latency Intelligence
  • Monitor real‐time latency in complex trade execution flows and market data latency across  distribution infrastructure
  • Break down latency into the individual components and parties pinpointing bottlenecks
  • Track trends through historical analysis to optimize latency in trade execution flows

B-Hive - Conductor

  • Dynamic self-mapping of virtual and physical infrastructure to applications and underlying end-to-end transactions
  • Real-time monitoring of all infrastructure for usage and performance of the application and end user actions
  • Latency break-down for all infrastructure tiers within a single transaction context
Correlsense - Sharepath
  • Environment Independent – Sharepath analyzes network traffic and is therefore generic. 
  • Extremely low overhead - by design.
  • Accurate tracking of every transaction, traces a transaction through all tiers collecting real metrics, with no guess work.
  • Resource consumption profiling and modeling on all of the tiers
  • Advanced proactive management 

SLA Management Visualization

The following video takes a look at how SLA Management can be done with a single bubble chart: