Analytics Expert

A few lucky SiteCatalyst users got a sneak preview showing of our Summit session, and the nearly unanimous reaction was that one of our three advanced tactics really stood out as the most exciting: the getPercentPageViewed plug-in, which (as the name suggests) allows SiteCatalyst to capture the percentage of a page (vertically) that the user has viewed. Best of all, the plug-in is completely free and available to all Omniture users. You can download it, along with basic documentation and installation instructions, from within SiteCatalyst by going to Help > Home, and then choosing Supporting Docs > Implementation > Plug-ins from the left navigation menu.

getPercentPageViewed—an overview

Omniture already offers a number of tools to help you understand what users are doing on your site. As far as page design and layout analysis are concerned, you’re probably familiar with ClickMap, which applies a graphical overlay to links and buttons to show you which page elements your visitors are clicking (and how often they’re clicking them). But this is just one gauge of page consumption. There are plenty of scenarios where it would be great to know not just what the user clicked, but also what the user saw. How much real estate do you really have at your disposal? Are users finding the page elements that you want them to find? This is exactly what the getPercentPageViewed plug-in does. It calculates the length of the page (even adjusting if users resize their browser) and then determines how far down visitors go before clicking away. This value updates as the user scrolls, and will always retain the maximum percentage viewed—even if the user later scrolls back up to the top.

To implement the plug-in, you will need the following:

1. Two Custom Traffic (s.prop) variables.
2. A correlation between the two variables.

That’s it. You can do more with additional s.prop variables and correlations, but we’ll start out with just these two items.

NOTE: The plug-in can (obviously) only determine how much of the page the user has viewed after the page has loaded, and only as the user scrolls. This means that the only reliable way to capture this data for a given page is on the next page view. Thus, we’re really capturing “percentage of previous page viewed,” but we can still marry this to the correct page name for analysis. I’ll explain how to do it below.

First Custom Traffic variable: Percentage of Page Viewed

To the developer’s enormous credit, the plug-in is extremely easy to implement. Instructions are available in the Knowledge Base, but essentially you drop the bulk of the code into your plug-ins section where you probably already have other code snippets such as getQueryParam and getValOnce. Then, within the s_doPlugins() function, you make a call to the plug-in as shown below (using s.prop1 as our Custom Traffic variable):

// capture the percentage of previous page viewed
s.prop1=s.getPercentPageViewed();

Simple. However, this doesn’t really give us anything actionable on its own. Just a bunch of numbers representing the raw percentages viewed for all pages on your site:

The really useful data comes when we also capture the previous page name (or previous site section, previous search term, etc.) into a separate Custom Traffic variable and enable a correlation between these two variables.

Second Custom Traffic variable: Previous Page Name

As described above, the second Custom Traffic variable captures the previous page name so that we can break down page name by percentage of page viewed, since that is where the magic happens. Fortunately, there is another plug-in (available in the same location as getPercentPageViewed) called getPreviousValue which makes capturing the previous page name easy. Installation of getPreviousValue is very similar to installation of getPercentPageViewed, and you would call the plug-in as shown here (using s.prop2 to capture the previous page name):

// pass the previous page name into prop2
s.prop2=s.getPreviousValue(s.pageName,'gpv_pn')

That’s it. So, finally, combining the two into a conditional, here’s how we recommend implementing these two plug-ins:

// capture previous page name; if it exists, capture percent of page viewed
s.prop2=s.getPreviousValue(s.pageName,'gpv_pn');
if (s.prop2){
s.prop1=s.getPercentPageViewed();
}

At this point, you’ll have a Custom Traffic report in SiteCatalyst with a bunch of raw percentages, and another Custom Traffic report that looks very similar to your Pages report, except that it shows the previous page name for each page view.

Correlation

Adam Greco wrote about data correlations in a previous blog post, and I highly recommend reading his advice if you’re unclear on how correlations work or on how to set them up. In this case, you will want to enable a correlation between the two Custom Traffic reports that correspond to the variables that you’re using to grab the percentage of page viewed and the previous page name. Once the correlation has been set up, you can go to the Previous Page Name report and click the green correlation icon to break down any page name by the Percentage of Page Viewed report, giving you something like this if you chose to break down the “Home” page name:

This is starting to become useful. We can see that our home page typically gets users to view around 50% of the page. If we have important links, ads, videos, etc., we probably should put them in the top half of the page. Or maybe the page is altogether too long and could be shortened.

Another useful way to look at this data involves grouping the various percentages in the report using SAINT. Looking at the raw percentages (0-100) is a good start, but bucketing can help bring to the forefront trends that may be harder to see by viewing the percentages as-is. And because you can add multiple classifications to any report, you can actually slice and dice your percentages in a variety of ways: quartiles, quintiles, deciles, etc. This gives you easily digestible reports, such as this one:

Where this gets even cooler is in the context of A/B testing. You can send various page layout names into a Custom Traffic report (using getPreviousValue, of course) and correlate with percentage of page viewed to see how the different options engage users differently. You’ll already know what they clicked, thanks to ClickMap or other reports, but the getPercentPageViewed plug-in can help you see how different variants affect page consumption.

You can do some great things with these reports.

• On the surface of it, you can let your team know exactly how much “real estate” they realistically have to work with on key pages.
• Key features that you want to highlight can be moved into the appropriate locations where you know most users will see them.
• Where appropriate, pages can be shortened to lengths more suitable to actual user behavior.
• Calendar events can help show how site/page changes affected consumption.
• Comparing to ClickMap or custom link data, you can understand the relationships between viewing a certain portion of the page and clicking on links within that portion of the page.

A few final questions (and answers)

Q: Should I use a Custom Conversion (eVar) variable as well (or instead)?

A: My feeling is generally that a Custom Traffic approach is best. Because the percentage of page viewed is going to be captured on every page, there isn’t much value to the persistence offered by eVars. The only use case that I can imagine for eVars in this scenario is the ability to understand how page consumption on the entry page affects conversion (which could be accomplished by using the plug-in to populate an eVar set to “Original Value” so that the entry page receives credit for the conversion). For the majority of users, the real value here is simply in understanding how page layouts and lengths are working, which can be accomplished using a Custom Traffic variable.

Q: What happens if users abandon my site? Do we still get to see how much of the page they viewed?

A: Because the plug-in captures the percentage of the previous page that the user viewed, if users close their web browsers, click a browser bookmark, or enter a different URL in their address bar, SiteCatalyst will not receive the percentage for that final page (as there is no “next page” on which to capture the data). However, if the user clicks an exit link, the percentage of the page that the user viewed will be captured prior to the user leaving your site.

Q: What if users resize their browser horizontally?

A: It will have no effect on the plug-in’s ability to capture the percentage vertically. If resizing the browser changes the maximum length of the page, the plug-in will adjust to it.

We have already seen SiteCatalyst users do some great analysis and optimization based on this functionality, so hopefully you’re as excited about this new plug-in as I am. Next time, we’ll cover the final topic from my Summit session: participation. (Adam already described this feature, but we have a few things to add.) Of course, if you have any questions about getPercentPageViewed, either based on this blog post or on the content we shared at Omniture Summit (or if you asked a question at Summit and we didn’t get a chance to answer it!), please let me know by leaving a comment here. You can also contact me via Twitter (@OmnitureCare).

Whew! Omniture Summit 2010 has come and gone, but hopefully you’re still deriving real value from some of the thoughts, tactics, and strategies that were discussed, both formally and informally, at the conference. As promised, I will be blogging about each of the three advanced SiteCatalyst solutions that my team and I covered in our breakout session. (It’s also worth noting that, while we discussed SiteCatalyst specifically in my session, these ideas become even more powerful when coupled with an advanced segmentation tool, such as Discover or ASI, or when used in the context of Test & Target.) Let’s get started with the first topic from our session.

Visitor Scoring—an overview

You probably have a number key activities on your site that constitute a highly engaged visitor. These are things that you want users to do, because they either constitute direct success (i.e., conversion), indicate the building of loyalty (e.g., social elements such as “Write a Review”), or suggest that the user is truly interacting with your site (e.g., internal searches, viewing photos, etc.). Visitor scoring in SiteCatalyst allows you to assign numerical “scores” to each of these key activities, and then aggregate these scores as visitors move through these different site elements.

The idea is that you can begin to see how varying visitor (and visit) scores affect conversion and customer loyalty. For example, you may notice that users with a score of 30 or higher spend twice as much money on each order when compared to users with score less than 30. You can also drill down to see which site elements are preferred by highly engaged visitors so that you can focus your efforts on those areas. Additionally, the solution allows you to see which visitor acquisition channels generate the highest levels of interaction with key site elements, and which campaigns are the stickiest in terms of leading users to these aspects of your site.

To do this, you will need three things:

1. A scoring system that assigns values to each of your top 5-10 key engagement points.
2. One “counter eVar,” which will be explained below.
3. One custom event, set to “numeric” as its type.

The Scoring System

This is the most complex aspect of the Visitor Scoring solution because you will need to lay out a relative points system for the 5-10 top site elements that you want users to engage. Some users may have access to advanced systems for scientifically assigning relative value to different site activities, but in the absence of such a system here is how we recommend doing this:

1. Identify the top several key “things” that you want users to do on your site (including, but not necessarily limited to, conversion). As described above, these should be activities that show engagement; the idea is to gauge how active a visitor’s experience is.
2. Isolate either the activity that you consider most valuable or the activity that you consider least valuable on your list.
3. Assign that value an arbitrary score, such as “5.” (This can be anything, and can be adjusted later.)
4. Assign other scores relative to that first score. For example, if we believe that “internal search” is our important, but is our least “valuable” activity of those on our list, we might give it a value of 4. Let’s say that subscribing to a newsletter is significantly more valuable; we might give it a value of 8. Reading a review may be even less valuable in our minds than performing a search; we’ll give it a value of 3.

This chart shows an example of how this system might be laid out:

This will be entirely unique to your business and, at the beginning, may involve a bit of educated estimation. Fortunately, as you work more closely with these reports, you’ll be able to see where scores are being inflated (or deflated) by user activities that have been overvalued or undervalued, and you can adjust your scoring appropriately.

The Counter eVar

A staple of almost any SiteCatalyst implementation is the “eVar” variable, which allows you to set a value (e.g., an internal search keyword) and persist it for a customizable period of time so that you can tie subsequent success metrics back to the values. (In the convenient “internal search keyword” example, an eVar allows you to view the amount of revenue, number of leads, etc. that occurred after the given keyword was searched.) These eVar variables accept text strings by default, but also have a nifty option for accepting numbers. Adam Greco defined counter eVars in outstanding detail in a previous blog post, which contains information on enabling counter eVars as well as a number of use cases.

In the case of Visitor Scoring, we’re going to take advantage of eVars’ persistence by setting the number of points for the key activities that were defined in the previous step into the eVar each time the activity occurs. For example, based on the chart above, we would set a value of “+3″ into the counter eVar immediately after the user rates a product, “+5″ every time the user e-mails an item to a friend, and so forth. Implementation-wise, using eVar1 as an example, it looks like this:

// after an internal search
s.eVar1="+4"

// after writing a review
s.eVar1="+5"

(Not that this has anything to do with Visitor Scoring, but it’s worth mentioning here—because we forgot to do it in one of our two chances to present this topic—that you CAN pass negative numbers into counter eVars to subtract from the overall visitor value.)

As the user moves through an experience on your site, interacting with the various key elements that you have defined, he/she will accrue points. If the user converts, you’ll be able to see their “score” at the time of conversion. If they don’t convert, you’ll be able to see that, too.

Pretty confusing, right? We can see that scores of 16-17 appears to be the “sweet spot,” but it’s hard to really understand what we’re looking at here. Fortunately, you can use SAINT to “group” visitor scores, and note that SAINT is flexible and allows you to rearrange/reallocate scores into different buckets depending on your changing needs and observations. After doing this, the report is much more digestible and actionable:

Now we’ve got something we can use. This makes it much easier to see how different engagement levels affect conversion. Again, how you divide up the different scores into groups is completely up to you, and you’ll probably want to adjust it as you dig into these reports. Also, note that you can do some really powerful things here with segmentation; using Discover, ASI, or Data Warehouse, you can focus in on the user experience both for users in the “Very High” group and in the “Low” group to see what they’re doing, and optimize your site around those findings.

The Numeric Event

The final piece of our Visitor Scoring system involves a numeric (a.k.a. “incrementor”) event, which you can enable using the Admin Console. (Mr. Greco documented numeric events as well in a previous post.) This might be my favorite part of the solution.

In addition to setting a counter eVar whenever a user does something that we’re scoring, this method also sets the value in an event so that you can view the score as a metric in various reports. This does involve using the s.products string, but don’t worry; we’re not going to mess with any actual product data. The implementation would look something like this (expanding on the examples given above and using event2 as our numeric event):

// after an internal search
s.eVar1="+4"
s.events="event2"
s.products=";;;;event2=4"

// after writing a review
s.eVar1="+5"
s.events="event2"
s.products=";;;;event2=5"

(Make sure to note that “event2″ exists both in s.events and in s.products in this case, and that there are exactly four semi-colons in s.products before event2 gets set.)

The great thing about this is that it allows you to see how various data dimensions affect engagement with key site elements. You’ll probably want to set up a calculated metric to divide this “score” metric by visits, because the raw score may be higher for different data dimensions simply due to varying levels of traffic; for example, when viewing this metric in the Campaigns report, a campaign that has 10,000 click-throughs will likely have a higher visitor score than a campaign that has 10 click-throughs simply because the overall traffic level is higher. When we view various marketing channels through the lens of this calculated metric, we immediately get a great report:

Social media sites, natural search, and partners are the clear winners in terms of bringing interested, engaged visitors to our site. Looks like we know where to focus our efforts—especially if we already know (from our experience with our counter eVar) how much more conversion a high-score visitor is likely to generate on our site. This gets even better when we focus on individual items within our top channels, breaking down this report by referring domain:

Not only do we know that social media brings eager visitors to our site, but we even know exactly which social media efforts/campaigns were most powerful (in this case, Fark.com, Delicious, LinkedIn, and Facebook).

Conclusion—and two bonus tips!

We didn’t mention this during the Advanced SiteCatalyst session at Summit, so be glad you read down this far. A really useful twist on this solution if you have two available eVars for use with visitor scoring is to configure one of them to expire at the end of the visit and another to a much longer expiration (such as “never”). The first eVar then gives a uniform view of individual visits, and how varying levels of interaction with key site elements affects conversion within the individual visit only. The second eVar would provide a view of “lifetime engagement” across multiple visits since the user last cleared his/her cookies. You can slice and dice both data sets to get some powerful views into how user behaviors may change over time.

Along these same lines, it’s possible that different teams or individuals may want to assign different scores to certain site activities. Don’t fight about it! Don’t let this scoring system destroy the harmony in your marketing department. Instead, similar to the tip just mentioned, if you’ve got an extra eVar, you can actually assign different scores to the same key site activities. Here’s a quick example using s.eVar1 and s.eVar2:

// this one is for the first team
s.eVar1="+5"
// this one is for the second team
s.eVar2="+30"

So there you have it. One tactic down, two to go. Next time, we’ll cover perhaps the most popular of the topics that we covered—the brand-new getPercentPageViewed plug-in. If you have any questions about Visitor Scoring, either based on this blog post or on the content we shared at Omniture Summit, please let me know by leaving a comment here. You can also contact me via Twitter (@OmnitureCare).

We love ideas. Always have. I spend most of my waking hours talking to Omniture users on Twitter, the Yahoo! Forum, blogs, etc., and many of these conversations center on ideas—how best to use our products, how to solve perplexing problems, and how to improve the Omniture Suite.

Because we love ideas—and because we especially love to use ideas—we recently launched the Idea Exchange, where any Omniture Suite user can log in and tell us exactly what ideas they have for any of our products. Then other users can “promote” the ideas that they feel would help them do their jobs most effectively, giving us a great sense of which features are most critical for our users.

(Speaking of critical ideas, enjoy this clip and just know that our building will not be demolished as we’re reviewing the ideas that you send us.)

In all seriousness, it’s a mutually beneficial situation. You have a quick and effective way of letting us know how we can improve your online business optimization efforts, and we have plenty of ideas and feedback that we can implement to make that happen. Our job then becomes to monitor your ideas, interact with you to understand the underlying business questions and your suggestions, and figure out how to get them to you. Various members of our organization spend a lot of time out there; one of the neatest things about last week’s Omniture Summit was hearing Brett Error (Vice President and General Manager, Products and Technology) speak with intimate knowledge about many of the ideas that have been submitted already. So, yeah. We’re listening intently.

You want more eVars? Submit an idea and watch others promote it. (Actually, that one has already been submitted, so you’d be best served by promoting the existing entry.)

Need rule-based SAINT classifications? Describe how you want it to work and follow the implementation process.

Want an entirely new product that does something cool? Yep, you guessed it; Idea Exchange FTW.

You can also use the Idea Exchange to get to know other users in the Omniture community. Everyone has a profile and can add information about himself or herself, upload an avatar, post contact info on several major instant messenger platforms, and more. It’s a great place to get to know how others are using Omniture tools, and it’s also a great place just to get to know others. You can even interface directly with various Omniture folks including developers, Product Managers, and more. You’ll definitely see me around. I’m one of the folks who makes sure things are running smoothly out there.

To begin using the Idea Exchange, just log in to the Omniture Suite as you normally would. Then go to Help > Idea Exchange. You will be prompted to choose a username. Once you have chosen a username, it will be paired up with your SiteCatalyst login info, and you can access the Idea Exchange thereafter either via the Help menu, or directly by logging in to ideas.omniture.com.

So have at it! We need your best ideas, and we need them now. And if you have any questions, please let me know. You can follow me on Twitter at @OmnitureCare, or just send me a message on the Idea Exchange. See you there!

This morning, Omniture announced new solutions in Display Advertising to help advertisers increase their return on ad spend. The press release may be found here: Omniture Announces Display Advertising Solutions for Increased Return on Ad Spend

Today, I’d like to add color to a particularly exciting part of the release titled “Dynamic Ad Targeting & Optimization Using Omniture Test&Target“. This capability marks significant progress towards our ability to increase ad relevancy by providing a capability that matches a visitor that belongs to an advertiser segment (identified using Site Catalyst, Discover or Test&Target) with a dynamic ad (via Test&Target). The ad is dynamically assembled and may contain messaging relevant to the segment.

During the limited release phase for the solution, we have seen a significant increase in ad click through rates (CTR). Given that ad impressions may only be shown to visitors that fall in segments that have proven ROI for return conversions, advertisers reduce impression waste and increase conversion rates, increasing their return on ad spend. This is extremely exciting.

As the Product Manager for the solution, I wanted to outline two major capabilities as we push to bring this solution into the hands of some of the largest advertisers in the world.

Display Testing for Acqusition Campaigns: For Advertisers that are interested in optimizing their acquisition campaigns, Test&Target provides AB and Multivariate testing for elements within the ad. Agencies can purchase media through their current processes. Ad creative would be produced using a Test&Target ad template and would be trafficked across the media plan. Typically, the ad would be served by the agency ad server.

Display Targeting for Remarketing Campaigns: For Advertisers that are interested in optimizing their remarketing campaigns, Test&Target provides the capability to target visitor segments to ads. The creative may be generated dynamically for the relevant segment. For example if you had a visitor segment that was in market for travel between any origin and destination city, they could be shown a dynamic ad containing the origin and destination city. As prior, the ad creative would be produced using a Test&Target ad template and would be trafficked across the media plan and the ad would be served by the agency ad server.

Last but certainly not least, the vision is not limited to increasing the CTR on the ad. The solution includes connecting the messaging in the ad to the messaging on the landing page (via a unified Test&Target Experience) and through the funnel, i.e. the “long ad” to enable our advertisers to increase their conversion rates through reinforced messaging. Advertisers can view reports from “click to close” that allows advertisers to evaluate their ad spend against the metric they really care about, i.e. against conversions or revenue.

For those attending Omniture Summit 2010 , you can learn more at the keynote this morning. I would also suggest you attend a couple of breakout sessions. The first is Optimizing Display Advertising Campaigns The second session is How Data and Analytics Are Shifting the Display Advertising Landscape. Hope to see you there!

I’ll be using this blog to keep you posted on our developments in this space. I’d also love to hear about your thoughts so feel free to comment here or email me directly at schaudha at adobe.com.