Introduction To Multivariate Testing

In split testing, we test one element of your sales page or website. For example, we can test headline A vs headline B (or vs C, D and so on), and we see which is the winner.

Split testing is pretty easy and straightforward to set up and implement.

But there are several drawbacks.

It’s very time consuming and costly. That’s because you can only test 1 element at a time.

Say we want to also test different images, location of image, sub headlines and so on…we can only do so one element at a time – one after another.

Because of this, by the time you are finished with all the elements, it could be weeks or months later!

You waste more time. And money as well as you incur more cost when the duration of the test drags.

There is another important point to consider. With split testing, it doesn’t tell us how each elements affect one another.

You might independently test the headline, and find one that performs really badly – so you don’t use it. Then you test your image, and find one that does really bad – so again, you don’t use it.

But what if the combination of the seemingly bad headline and image can send conversion through the roof? Well…you won’t know! Because you have already rejected the bad headline!

The Solution – Multivariate Testing

As the name suggest, multivariate testing allows you to test multiple elements (e.g. headline, image, offer, guarantee etc) – simultaneously – all in 1 go.

So say you have the following elements to test:

3 versions of headlines

2 versions of images

2 versions of offer

You will have a total of 12 (3 x 2 x 2) combinations of these elements.

When you carry out a multivariate test, traffic will then be split equally to each of these combination.

Sounds like a lot of work? Not to worry.

You can automate the whole process by using Google’s free Google Website Optimizer.

Benefits:

• Increased conversion
• More leads/sales
• Reduced cost per lead/acquisition
• Greater customer interaction on your site
• No more guesswork/dispute over which elements perform best

Powerful isn’t it? Let me know your comments.

To your success,

Jag Foo

P.S  If you want a greater in-depth information how testing and tracking can positively affect your ROI, then click here:

=> http://emoneymarketing.com/SmallChangesBigProfits

Great way of comparing elements. Even though it has several drawbacks yet it really works wonders while comparing several elements.
Pay off Credit Debt´s last blog ..Paying Off Credit Card Debts With Loans

I have never thought about this Multivariate Testing and SEO for my landing pages… Now I should start doing it. Good article.

Matvey

Client´s last blog ..Fractals of Massey Energy Co (MEE)

Thanks you very much for informing aopbut the disadvantages of this kind of testing – everything is not so simple. But now it is accessible to me to control the risks.

hey guys,

thanks for your input. Multivariate testing (MVT)is an extremely powerful tool for optimization and improvement.

Just to let you all know – MVT can be applied to almost all areas of business and operational processes.

Trumps Six Sigma anytime.

Thank god for statisticians!

Jag

Thanks you very much for informing

It is very interesting to read about Multivariate testing.I have found good features and benefits of multivariate testing.Yes it is powerful tool for optimization as you have said.I like that you have provided such valuable information to us.

The increased coversion and improvement is sales is certainly an advantage of this Multivariate Testing.

The best benefit is the headline. To have variation of keywords and conversions is a large resource. You have approx 7 seconds to capture attention. This really can help

Looks Great

Powerful method indeed – and what’s more important, numbers are easy to analyze. You can run a bunch of multivariate tests in a few weeks (without putting your website offline!) and analyse from real visitors, real persons, what worked and did not. Extremely useful – but make sure you test on a regular basis!

i carry out a multivariate test, traffic will then be split equally to each of these combination.
compare pillar drills´s last undefined ..Response cached until Tue 4 @ 4:55 GMT (Refreshes in 23.90 Hours)

Multivariate Testing is first time listening till today i used traditional approaches for testing.

i just see this article and due to curiosity read it, and obtained it is really helpful.

thanks for this awareness.

This is the most interesting book that I read about multiple tests of the characteristics and advantages of good multiple tests this is powerful tool for optimizing as you say. I like is you have provided this valuable information.

Great way of analyzing the elements. Great post indeed!
ipad skins´s last blog ..Apple ipad Skins

In split testing, we test one element of your sales page or website. For example, we can test headline.Powerful method indeed – and what’s more important, numbers are easy to analyze. You can run a bunch of multivariate tests in a few weeks and analyse from real visitors, real persons

Peter Dunk

long island wedding photographer ´s last blog ..LIPA In Port Jefferson Blows Valve

Split testing is pretty old method and it did not give you the exact results what we want as compared to Multivariate testing.

I am conducting a study by telephone about grocery stores, and would like to know how could I improve my introduction to get more people on the phone and therefore more complete surveys.
Excel Tips´s last blog ..VBA CheckBox Problems

Good analysis : ) Took abit of time for me to get a clear picture though. You guys should do rocket science

This field is rather complicated but I’ve understood that statistical analyzes in interesting for me due to your article! Thanks – now it’ll be one more area for me to study.

Thanks you very much for informing
M.Akif´s last blog ..Teröre lanet !

Nice Post! I am looking for Wholesale kitchen gadgets can you please provide some relevant info regarding it.

I always use traditional methods for testing.They are time consuming.If multivariate testing allows you to test multiple elements,then it is great thing to save the time and money.

This sphere is so new for me! But after studying your article I felt interest to multivariate testing! I would like to study this further!

his is the most interesting book that I read about multiple tests of the characteristics and advantages of good multiple tests this is powerful tool for optimizing as you say. I like is you have provided this valuable information.

There are so many variables you can’t say how it will all play out. Think of a team that has an injured player. Sometimes the injury helps the team come together and win when it shouldn’t've been possible. There’s an X factor in anything that keeps us from knowing the exact result with any definition. We can theorize all we want, but there will never be a way to predict with 100% accuracy any outcome.

Thanks for explaining this to me!
Peter Dunin´s last blog ..Featured Post Of the Week

Thanks Jag, I did not even know about Google’s Website Optimizer. That is a must for my business.

Yes it is powerful tool for optimization as you have said.I like that you have provided such valuable information to us.

I constantly use conventional strategies for screening.They are time consuming.If multivariate testing means that you can check many factors,then it is good matter to conserve the time and funds.

Really i agree with you.Acxording to me If you are a businessman and you want lower your marketing cost and thus wants to acquire this basic aspect of a bright buyer.

Yes it is powerful tool for optimization as you have said.I like that you have provided such valuable information to us.

They are time consuming.If multivariate testing allows you to test multiple elements,then it is great thing to save the time and money.

They are time consuming.If multivariate testing means that you can check many factors,then it is good matter to conserve the time and funds.

Thanks for the option of multivariate testing. It will be helpful to a lot of people.

I didn’t new anything about multivarite testing, but it shows from your article that it is useful; so thanks for sharing !

Thanks for your input. Multivariate testing (MVT)is an extremely powerful tool for optimization and improvement.

Just to let you all know – MVT can be applied to almost all areas of business and operational processes.

hanks for the option of multivariate testing. It will be helpful to a lot of people.
Borsa´s last blog ..Dolar’dan Tarihi Rekor

his brings us to next important point: why not make the word “free” clickable? I am sure if I had analyzed the location of clicks on the page, I would have found a lot of visitors clicking on the “Download for Free” headline, only to realize it is not a link. I should have definitely tested a version with a clickable headline.

I have first time read such productive information about multivariate test.