FundRaising Success

You will be automatically redirected to fundraisingsuccessmag in 20 seconds.
Skip this advertisement.

Advertisement
Advertisement
 
 

What Should You Test?

November 2007 By Stephen Hitchcock
1
The question we as fundraising consultants are asked most often also is the question we keep asking ourselves: What elements of a direct-mail package are most important to test?

The question is important. What makes direct mail so successful as a fundraising medium is that we can track results and learn from them.

Everyone involved in direct mail makes decisions based on anecdotal information and on personal preferences. We also depend on experience: We compare one year’s results to another year’s results, or we line up returns from one package mailed in June against returns from another package mailed in September.

But those judgment calls are at best a calculated risk. At worst, delusions.

Testing is a must

To make consistent improvement in your fundraising program, you must test. That means mailing random samples (with test and control panels of names from your own donor list or from prospect lists) at exactly the same time and then subjecting those results to the rules of statistical validity.

But the catch is that even if you’re committed to testing, you must mail a large enough quantity to achieve statistical validity: To conduct reliable tests — with some important exceptions — your house list should be 10,000 names or larger, and an acquisition effort (prospect mailing) should include at least 50,000 pieces.

Tests to try

If that’s the case, then here are three of my favorite elements to test:

1. In fundraising mail, the test that usually makes the greatest difference involves the amount you request. That’s particularly the case in acquisition mailings: Will you persuade more individuals to become members or donors by asking for an initial gift of $15, $20, $25 or $35? For some organizations, asking for a lower initial gift results in a higher response rate without a decline in the average gift.

Our firm also has tested gift levels in special appeals and renewals. Since the purpose of these mailings is to generate net income, increasing response rate can make a big difference in income.

The great advantage here — besides an increased number of new members or higher net income — is that testing gift amounts is one of the least expensive tests you can perform. It doesn’t involve expensive variations in copy or package design.

2. Postage is an other crucial element to test. In acquisition efforts, we test to learn whether we get more members by using BREs or, instead, reply envelopes where the new member places a stamp on the envelope. BRE postage is expensive and, in some cases, we’ve found through testing that results actually are higher when BRE envelopes aren’t used.

For special appeals and renewal mailings sent to those who already are donors, we like to find out for which groups or segments of donors a “live stamp” reply envelope makes a difference. Adding a postage stamp to each return envelope does dramatically increase costs, but in many cases it can double the response rate.

For some acquisition programs, it also might be worth testing whether sending your mail via First Class rather than bulk (the new “standard mail”) can significantly boost returns. If you struggle to acquire new members, investing in First Class postage just might be worth it.

3. Involvement techniques — surveys, petitions, post cards to elected officials, etc. — often can boost response rates. You also might try a test that involves asking prospective or current members to sign a “Statement of Principle” or a “commitment to act.”

When you test these involvement devices in acquisition, be prepared to receive more responses without any contribution enclosed — or with low-dollar contributions. You could end up acquiring no more renewable members (typically, those whose initial gift is at least $15 or $20), but you’ll have some additional income to offset the investment cost of your acquisition mailings.

There are some tests that I give lower priority — except for all but the largest organizations that regularly mail in quantities of 250,000 plus. The most notable example is testing the size of envelopes. Using bigger or odd-size envelopes hasn’t had much of an impact for our clients. In smaller quantities, those special envelopes haven’t increased the response enough to justify their increased cost.

Stephen Hitchcock is vice president of client services at Mal Warwick Associates. www.malwarwick.com
 

Companies Mentioned:

1

SPONSORED CONTENT

MORE ON DIRECT MAIL >>

FROM THE BOOKSTORE

<P><SPAN style="FONT-SIZE: 10pt">“Hey, stuff happens”—the cliché is a cliché for a reason: because it’s true. It always has been and always will be, and that is why insurance, and subsequently, insurance marketing, will never find itself out of a job. And, believe it or not, the oft-neglected direct mail channel has proven itself to be the most successful in lead generation when it comes to insurance marketing. </SPAN></P>
<P><SPAN style="FONT-SIZE: 10pt">Everything you need to take advantage of this growing market is right here in Insurance Marketing: The Competitive Intelligence Report. It’s full of direct mail trends, best practices and analysis, including formats, copy and design, premium usage, seasonality trends, branding and integrative marketing.<B><BR> <BR></B>You’ll get dozens of insurance direct mail trends based on research from DMIQ’s Who’s Mailing What archive, plus in-depth analysis of grand controls and campaigns from some of the biggest insurance giants in the business, complete with: </SPAN></P>
<UL>
<LI><SPAN style="FONT-SIZE: 10pt">Volume comparisons</SPAN> 
<LI><SPAN style="FONT-SIZE: 10pt">Seasonality trends</SPAN> 
<LI><SPAN style="FONT-SIZE: 10pt">Trends in package format, 4-color printing, personalization and variable data</SPAN> 
<LI><SPAN style="FONT-SIZE: 10pt">Trends in offers and premiums</SPAN> 
<LI><SPAN style="FONT-SIZE: 10pt">Review of the mail that uses copy drivers</SPAN> 
<LI><SPAN style="FONT-SIZE: 10pt">Analysis on the integrative future of insurance mail</SPAN> 
<LI><SPAN style="FONT-SIZE: 10pt">And more!</SPAN></LI></UL>
<P><SPAN style="FONT-SIZE: 10pt">Plus, this book contains full company profiles and statistics of the top 20 insurance companies in the industry, including GEICO, AAA, State Farm, New York Life, Allstate, and many more. </SPAN></P> Insurance Marketing: The Competitive Intelligence Report

“Hey, stuff happens”—the cliché is a cliché for a reason: because it’s true. It always has been and always will be, and that is why insurance, and subsequently, insurance marketing, will never find itself out of a job. And, believe it or not, the oft-neglected direct mail channel

...

ORDER NOW

Available as a PDF<BR><BR>A guide to the science of direct response testing today, including best practices, power tests, small vs. large test, analyzing results, testing mistakes, new tricks and more.<BR> <BR>Direct marketing — regardless of the channel — is that unique combination of art and science. Direct marketing strategists are constantly striving for better response rates, open rates, conversions, cost-per-order, and life-time value. <BR><BR>And what is the tool that these strategists turn to again and again? That’s right! It’s testing. <BR><BR>In direct marketing, there are plenty of elements to test — from subject lines, premiums, envelope sizes, list selects, pricing, the placement of the shopping cart on the web page ... the choices seem endless. <BR><I><BR>Secrets of Direct Marketing Testing </I>is your personal BRAIN TRUST of testing strategies that you can start to put to use today. <BR><BR>In this guide, you’ll find everything you need to learn — the why, what, when and how-to of testing. From testing structure to basic principles, and from test ideas to mistakes to avoid, you’ll get a crash course in coding, tracking, reading and applying test results. <BR><BR>You’ll learn about: <BR>• Simple copy tests that drive response <BR>• Fine-tuning your offer <BR>• Web and Email testing <BR>• Offer tests <BR>• How to make sure you’re getting reliable results <BR>• Retesting and rolling out your findings <BR>• Plus the Rules that you should test now — or ignore at your own peril! <BR><BR>Are you are searching for ways to raise response, save on your promotion costs, drive down your cost-per-order and extend the lifetime value of your customers? The DirectMarketingIQ and Target Marketing editorial teams have been researching, writing and collecting expert advice from industry leaders about the how-tos of testing for years. <BR><BR>We’ve compiled this information and made it easy for you to find all in one place with our easy-to-read report – <EM>Secrets of Direct Marketing Testing</EM>. Secrets of Direct Marketing Testing

Available as a PDF

A guide to the science of direct response testing today, including best practices, power tests, small vs. large test, analyzing results, testing mistakes, new tricks and more.

Direct marketing — regardless of the channel — is that unique combination of art and science. Direct marketing strategists are constantly striving



...

ORDER NOW

 

COMMENTS

Click here to leave a comment...
Comment *
Most Recent Comments:
mary davidson - Posted on November 13, 2007
You missed a couple of points: importance of testing against a control panel of comparable composition to be able to effectively evaluate results; testing levels of personalization in various components vs generic; testing premium vs. no premium offer and testing various types of premiums offered (house and prospect mailings).

On test sizes: acquisition: key factor is (1) not solely the size of the mailing in aggregate as much as the quantities of the lists comprising the test- they must be significant enough in size to be statistically significant response.
Click here to view archived comments...
Archived Comments:
mary davidson - Posted on November 13, 2007
You missed a couple of points: importance of testing against a control panel of comparable composition to be able to effectively evaluate results; testing levels of personalization in various components vs generic; testing premium vs. no premium offer and testing various types of premiums offered (house and prospect mailings).

On test sizes: acquisition: key factor is (1) not solely the size of the mailing in aggregate as much as the quantities of the lists comprising the test- they must be significant enough in size to be statistically significant response.