Global Reach/Iraq Survey 2 Documentation

Overview

This toolkit is a supplement to our New Readers Iraq Phone Survey 2 results. It provides an overview of the context and methodologies through which the phone survey data were gathered and organized. To enable those interested in further investigation, we also provide a list of recommendations on how to utilize the raw data to optimize meaningful analysis and exploration.

2nd Iraq phone survey

There are a total of 16 questions in the survey, addressing the following categories:

• Internet use
• Mobile phone use (smartphones & basic voice/SMS phones)
• Awareness and use of Wikipedia
• Awareness and use of Wikipedia (Wikipedia Zero campaign-related)
• General demographics

Phone surveys were conducted between June and August of 2017 by Votomobile prior to the Wikipedia Zero Launch. This is the 2nd of 2 surveys in Iraq as it acts as a follow-up for Wikipedia awareness campaign impact evaluation (1st survey found here). The survey collected 2500 total responses, representing populations in 5 geographical regions served by 3 mobile Iraqi operators. 3 language choices (Arabic, English, Kurdish) were provided.

Here are the main questions this survey was designed to answer. However, analyzing the full data set allows you to conduct more in-depth data explorations and gain meaningful insights beyond the points presented here. Since we are primarily interested in how the Wikipedia Zero awareness campaign has influenced targeted Asiacell users, we chose “internet users, Asiacell subscribers” as the basis of our results.

• What is the actual number of people who use the internet?

(Real-world behavior makes this difficult to measure from industry reports, since people might have access to the internet through school, friends, internet cafés, public Wifi, etc.)

• How many people have heard of Wikipedia? What do they use it for? How often?
• Has the awareness campaign impacted the Wikipedia awareness among Asiacell and Non-asiacell users in any significant ways? How does awareness level differs between Asiacell an non-Asiacell users group?
• What are the channels through which people are exposed to Wikipedia? Any relationship with the awareness campaign?
• How many people use smartphones?
• How many people have heard of Wikipedia? What do they use it for? How often?

Survey Distribution Among Mobile Carriers

• Our 2017 Iraq survey is a composite of individual surveys based on the market share distribution statistics of 3 mobile carriers provided by World Cellular Information Services.
• The breakdown of the first 1500 responses: Zain (41%), Asiacell (39%), Korek (20%)
• 1000 additional responses were all from Asiacell users. 1000 additional responses were all from Asiacell users. Since we have launched our Wikipedia Zero program and awareness campaigns through Asiacell, we wanted to gather more details about Asiacell users for impact evaluations and analysis.

Where to get the data

• This page shows graphs of the responses received for each question in the survey.

Flow diagram of survey questions

• The full data set can be found at: Dan Foy (2017). Iraq phone survey 2017. figshare doi:10.6084/m9.figshare.5435110. This is the canonical version which contains a CSV including every answer from each of the 2502 responses.
• The full text of the questions can be found here.

Using the data effectively for analysis

Looking at carrier-proportional results

For an overview of Iraq, you should turn on “Country subset” filter to obtain a subset of 1500 responses, with each carrier survey size contribution determined by its market share.

Looking at Asiacell specific results

Focusing solely on Asiacell survey results might provide additional insight as we conduct impact evaluation on the awareness campaign. To select Asiacell-only results, create an “Asiacell” filter under “Carrier” and obtain 1555 results.

Non-linear progression & Margin of Error

It is important to note that this survey is non-linear. Depending on how a question is answered, the flow of the rest of the survey may change. For example, if a respondent says that he or she does not have a smartphone, we skip the smartphone-related questions. You can review the flow diagram to see how the survey progresses. For proper statistical validity, our survey size of is large enough where the questions asked of all respondents have a 95% degree of certainty of being accurate within a 2% margin of error.

Methodologies

Addressing Biases

One issue with phone surveys is the tendency for some respondents to favor the first response to a question. To address this problem, most of the survey questions presented the responses in a random order for each call. This distributes any bias evenly among the responses instead of accumulating it all on one response. Note that questions that have a 'none of these' or 'other' response always kept this option as the last one presented. A couple of survey questions, however, have a strong order dependency of their responses and are confusing if they are presented in a completely random order. For instance, when we ask how often they use Wikipedia, asking in a non-sequential order would not make sense (e.g. an order of “once a week”, “once a month”, “once a day”). For these questions, we would randomly present the question in one of two orders: either from lowest to highest, or highest to lowest.