For the following examples, the list of events that are used in the scorecard definition is as follows.
The following events are based on Tealeaf request variables:
HTTP Status Code
HTTP 400 - Bad RequestHTTP 401 - UnauthorizedHTTP 402 - Payment RequiredHTTP 403 - ForbiddenHTTP 404 - Not FoundHTTP 405 - Method Not AllowedHTTP 500 - Internal Server Error
HTTP USER AGENT
Googlebot VisitMSNbot Visit
Hit property exceeds threshold value
Large Page SizeLong Page Generation TimePage Generation > 5s- Create this Boolean event to evaluate the output of thePage Generation Timeevent.Page Generation Time > 10s- Create this Boolean event to evaluate the output of thePage Generation Timeevent.Page Generation Time > 15s- Create this Boolean event to evaluate the output of thePage Generation Timeevent.Page Generation Time > 20s- Create this Boolean event to evaluate the output of thePage Generation Timeevent.
0-sized response
- Create Boolean event to detect value of the
Session Response MBevent is equal to0.
URL
Note: These events must be created for your specific web application to detect the URLs of the pages where these business functions are performed.
Checkout: Sign-inCheckout: Billing and ShippingCheckout: PaymentCheckout: SummaryCheckout: ConfirmationWeb Application 1Web Application
HTTP REFERER
Came from Login Page- Create this event to detect the value of theREFERRERitem in the request that is indicating the login page of your web application.Came from shopping cart- Create this event to detect the value of theREFERRERitem in the request that is indicating the shopping cart page of your web application.
Login field in [urlfield] section of Tealeaf request
- Non-blank login field
- Login field not present
Useful events based on response text
- Error uncompressing page
- Global Error Page
- Credit Card Declined
- Credit Card Number Invalid
- Credit Card Zip Code Mismatch
Compound Events
- Came to Billing page from shopping cart: Events 1(e)ii
AND1(f)ii - Came to Billing page sign-in through login: Events 1(e)ii
AND1(g)i - Came to Billing page through anonymous sign-in: Events 1(e)ii
AND1(f)iAND1(g)ii - Checkout count:
ORof all Events in 1e - Page Generation Time > 5s in Checkout: Events 1(c)iiA
AND3d - Page Generation Time > 10s in Checkout: Events 1(c)iiB
AND3d - Page Generation Time > 15s in Checkout: Events 1(c)iiC
AND3d - Page Generation Time > 20s in Checkout: Events 1(c)iiD
AND3d - 0-sized response in Checkout: Events 1d
AND3d - Global Error Page in Checkout: Events 2b
AND3d - HTTP 40x - 403
OR404 Errors: Events 1(a)ivOR1(a)v - Web Application 1 - 40x Errors: Events 1(e)vi
AND3k - Web Application 1 - 500 Errors: Events 1(e)vi
AND1(a)vii - Web Application 1 - Long Page Time: Events 1(e)vi
AND1(c)iiE - Web Application 1 - Large Page Size: Events 1(e)vi
AND1(c)i - Web Application 2 - 40x Errors: Events 1(e)vii
AND3k - Web Application 2 - 500 Errors: Events 1(e)vii
AND1(a)vii - Web Application 2 - Long Page Time: Events 1(e)vii
AND1(c)iiE - Web Application 2 - Large Page Size: Events 1(e)vii
AND1(c)i
Example: Checkout
In this example, the KPI scorecard measures the performance of key pages in the following checkout process.
- Create scorecard: Define per-hit events to detect the following conditions:
- Create a simple per-hit event that detects all HTTP client error (4xx) status codes by looking for the following string in the request:
\nStatusCode=4 - Create a simple per-hit event that detects all HTTP server error (5xx) status codes by looking for the following string in the request:
\nStatusCode=5 - Create an
After Every Hitevent that uses the above two events as conditions to detect all HTTP error status codes. - Create five
After Every Hitevents that detect the preceding error-detecting event when it occurs on each of the five pages that are listed as Process Steps. - Create an
After Every Hitevent of all the page-specific events that are defined in the previous step to detect the error-detecting event when it occurs on any of the Process Step pages.
- Create a simple per-hit event that detects all HTTP client error (4xx) status codes by looking for the following string in the request:
- Create scorecard: Create a KPI scorecard that uses Negative Comparison.
- Use the event that is detecting the process's first page (which can be either
/addtobasket.jspor/getsavedbasket.jsp). Configure the count of this event to be the scorecard's activity indicator. - In the scorecard, create a single availability group by using the five page-specific "all errors" events and weight them by the importance of each page. These weights can be used to define the availability letter grade.
For example, the grading weights can be:
- HTTP error code on
/addtobasket.jsp OR /getsavedbasket.jsp: 5% - HTTP error code on
/checkout.jsp: 20%. - HTTP error code on
/shipping.jsp: 10%. - HTTP error code on
/confirm.jsp: 15%. - HTTP error code on
/ordercompleted.jsp: 50%.
- HTTP error code on
Example: Checkout errors
Define the following KPI groups for checkout errors.
Global Error Page in Checkout0-sized response in CheckoutPage Generation Time > 5s in CheckoutPage Generation Time > 10s in CheckoutPage Generation Time > 15s in CheckoutPage Generation Time > 20s in CheckoutCheckout PathsCame to Billing page from shopping cartCame to Billing page sign in through login
Example: Spiders
Define the following KPI groups for spider visits.
Googlebot VisitMSNbot Visit
Example: Transaction failures
Define the following KPI groups for credit card failures.
Credit Card DeclinedCredit Card Number InvalidCredit Card Zip Code Mismatch
Example: Unacceptable response time
Define the following KPI groups for response time errors.
Page Generation Time > 5sPage Generation Time > 10sPage Generation Time > 15sPage Generation Time > 20s
Example: Multiple applications
Define the following KPI groups for two web applications.
Web Application 1 - 40x ErrorsWeb Application 1 - 500 ErrorsWeb Application 1 - Long Page TimeWeb Application 1 - Large Page SizeWeb Application 2 - Large Page Size