Designing web-surveys

As more people have access to the Internet, it is becoming easier to use the Internet to conduct market research via web based surveys.

The basics are similar to most market research surveys. Decide who you want to talk to. Find out how to get hold of them online and then design mechanisms to find the information you want. The major difference with web- surveys is that you are able to design much more sophisticated surveys than could be carried out either on paper or via the telephone. In addition, you need to have surveys that are designed to look good and engage the respondent.

SurveyGarden is our dedicated on-line research facility for hosting our own and third party questionnaires.

On-line surveys are the main means of collecting quantitative data on the Internet. The main forms of Internet research comes from surveys placed on a web site (hosted surveys) either for access via an email address or via a pop-up survey on the site itself.

Of the two, pop-up surveys are very good for direct research about the web site being visited as people are recruited on the spot, but pop-up blockers that come with many browsers mean that many potential respondents will not see the invitation. Increasingly Javascript is being used to overlay the survey on top of the page to get round these pop-up blockers. These normally redirect people to a conventional web-survey

Becuase of the problems of controlling the sample, the main method of Internet research is therefore to send emails direct to individuals with links to the on-line surveys URL. Depending on the survey itself this may include aspects such as unique IDs or password access to prevent public access to the survey and ensure only valid respondents take part. In other situations an open survey method might be used to allow for techniques such as a 'snowball' sample where friends are encouraged to ask other friends to join in, particularly for special interest groups like sports associations.

One of the major strengths of using the Internet for collecting information means that you can control the content more tightly. For instance ensuring that routing is correct, validating answers or using previous answers to generate new questions for tasks such as pricing research. In addition Internet research opens up new possibilities for research methods because of the availability of a computer to drive the questionnaire. We have designed numerous 'internet-only' research techniques such as anchored scale or repertoire-based conjoint analysis for collecting information about how people make decisions. In addition, with larger sample sizes available at lower cost, you can radically transform the way you think of a questionnaire. Our non-linear research technique exploits the fact that research questions are rarely asked in the order that is of most interest to respondents.

If you just want regular market research, there are plenty of off-the-shelf packages which are readily available for producing web-surveys and there are sites such as Zoomerang which allow you to field simple questionnaires quickly and cheaply.

However, for us it is the fact that web-surveys open up a range of different questioning and investigation techniques that makes Internet research such a rich area. For instance rather than using scales or measures of likelihood of use where answers are notoriously difficult to interpret into the real world, it is much more realistic to ask questions involving real choices. We produce our surveys in-house allowing us to build in elements such as trade-off exercises, BPTO or even to use uniquely internet techniques such as non-linear questionnaires.

For questionnaires that are longer than a 10 minutes, it is advisable to use incentives and reminders to encourage people to take part. The overall design of the questionnaire is also important as on-line surveys do suffer drop-out rates. This is not just about the design of the questions, but also making sure that the look of the survey is also properly designed and will work on the wide range of browsers that are in-use.

Once data are collected, producing analysis and reports are carried out in a similar fashion to other market research. However, the use of computers means that results are typically available faster than in non-Internet research. With many of the new techniques we are developing, there is increasingly the possibility of creating dynamic market models which help marketers look at the value of trade-offs in the markets they serve

On the qualitative side of internet research, there are a number of research possibilities. Email or forum-based groups are lead by a moderator who introduces everyone and starts with some simple open-ended questions. In the subsequent discussions via email respondents here from each other and from the moderator who probes and tests the needs and wants of those in the group. Emails can be passed to the group directly, or after checking via the moderator (for instance to avoid flaming or bad language), or in summary form from the moderator (to reduce the volume of email that has to be read).

Such discussions have a formal discussion guide so the moderator can ensure all topics are investigated and typically last one to two weeks.

A common alternative is chat groups. These require several people to simultaneously log in to a chat area where a discussion is held (everyone typing frantically). These are most analogous to traditional qualitative groups, but responses tend to be shorter and more abrupt because of the typing involved.

Naturally, as there is no visual or face-to-face element to the qualitative research, it can be difficult for the interviewer and other respondents to understand things like tone or body language.

More advanced qualitative techniques include things like delphi research where experts are invited first to complete a survey and then after everyone has completed the survey, they are shown the results and invited to change their response or justify why their answers might be different from the consensus.

In the future we expect more research to take place via things like Skype-based interviewing and so have the option both of conference telephone calls, but also enable the interviewer to share chat messages and files and pictures with respondents. Currently many large corporates restrict access to Skype, but as it becomes more common, it may become the dominant form of business-to-business executive depth interviews.

Many companies offer blog and news analysis research. This is actually not a new technique and has been around since the mid-1990s. Whilst it can be interesting, we have found there is a danger that the loudest or most eloquent opinions are heard often drowning out the views of genuine customers and so potentially steering the business in the wrong direction. Note that this type of research should also be very cheap, since in reality any one can do it

For help and advice on carrying out on-line research projects contact info@dobney.com or take a look at SurveyGarden.