User:Stu/comScore data on Wikimedia

From Meta, a Wikimedia project coordination wiki

One of the major online audience measurement companies, comScore, Inc., has generously donated access to its Media Metrix and World Metrix data sets to the Foundation. comScore has an opt-in panel of two million internet users around the globe and uses a range of statistical techniques to create an internally consistent portrait of the global internet audience. As an example, below is a chart summarizing comScore's estimated audience over the past few years for wikipedia.org, both in the U.S. and worldwide.


January 2010 data[edit]

comScore estimates that, during the month of January 2010, 365 million unique visitors (UVs) viewed our projects from a personal computer, which it estimates was a "reach" of 29.5% of the 1.24 billion worldwide PC-based web browser audience:

Worldwide unique visitors
Google Sites (includes YouTube) 920 million
Microsoft Sites 734 million
Yahoo! Sites 599 million
FACEBOOK.COM 471 million
Wikimedia Foundation Sites 365 million
AOL LLC 267 million
eBay 260 million
Amazon Sites 245 million
Ask Network 228 million
CBS Interactive (includes CNET) 212 million

Geographic breakdown[edit]

comScore estimates our audience in different regions, and also estimates what percentages of the audience within each region visited one of our sites:

Unique visitors Reach in region
Worldwide 364.7 million 29.5%
Europe 136.9 million 40.3%
Asia Pacific 89.9 million 17.4%
--India 10.2 million 27.4%
--China 3.4 million 1.4%
North America 82.5 million 41.1%
Latin America 32.8 million 33.5%
Middle East - Africa 23.4 million 27.2%

Language breakdown[edit]

comScore estimates visitors to the different language versions of Wikipedia and estimates the unique visitors worldwide:

Worldwide unique visitors
English Wikipedia 189.9 million
Japanese Wikipedia 35.1 million
Spanish Wikipedia 32.0 million
French Wikipedia 26.4 million
German Wikipedia 25.1 million
Russian Wikipedia 13.9 million
Portuguese Wikipedia 11.1 million
Italian Wikipedia 10.5 million
Arabic Wikipedia 8.6 million
Chinese language wikipedias 6.3 million
Vietnamese Wikipedia 4.7 million
Korean Wikipedia 2.5 million
Indian language wikipedias .6 million
Javanese Wikipedia .02 million

Demographic breakdown[edit]

comScore's panelists report age and sex so it can generate detailed demographic estimates, including raw data and also an index which measures the extent to which a set of visitors to our sites is over or under-represented compared to visitors to all sites on the internet. For January, comScore estimates our 365 million audience is made up of 199 million men (29.7% of men online) and 166 million women (29.2% of women online). We index slightly higher with men (101) than with women (99). Here's a breakdown of different age groups:

Worldwide unique visitors Reach in
age group
Index
Ages 15-24 98.6 million 29.2% 99
Ages 25-34 85.3 million 26.4% 89
Ages 35-44 76.5 million 28.7% 97
Ages 45-54 58.4 million 33.4% 113
Ages 55+ 46.0 million 34.0% 115

We index highest for older users (ages 45-54 and 55+) and lowest for those 25-34 years old. I dug into this issue, at first thinking it was driven by twenty-something preference for YouTube and Facebook. As far as I can tell, though, our comparatively weak performance in the 25-34 year old demographic is the result of our weakness in China where comScore believes there is a huge audience in that age range. For example, the large China-based sites like Tencent, Baidu, SINA and Alibaba all index globally around 120 for this demographic group.

Project breakdown[edit]

comScore estimates our audience by project:

Worldwide unique visitors
Wikipedia 362.2 million
Wiktionary 10.5 million
Wikimedia Commons 4.5 million
Wikibooks 4.1 million
Wikiquote 3.2 million
Wikisource 2.5 million
Wikinews .6 million
Wikiversity .5 million
Wikispecies .1 million

China, India trends[edit]

comScore estimates the unique visitors to our sites from home and office users in China (excluding Taiwan and Hong Kong). In July of 2008, comScore estimated 232,000 UVs to our sites in China. In August, the month of the 2008 Beijing Olympics, comScore estimates we had 1.3 million visitors. By March of 2009, the audience estimate was 2.75 million. In January, comScore estimates 3.4 million visitors, comprised of 2.5 million UVs to one of the Chinese language wikipedias and 1.0 million to the English Wikipedia. By contrast, comScore estimates the Baidu Encyclopedia had 47 million visitors from within China. Given that comScore does not track internet usage from public locations (e.g. internet cafes), these estimates certainly undercount overall activity from China.

In India, comScore estimates 10.1 million unique visitors came to our sites, or 27% of internet users in India. Of these, 9.9 million visited the English Wikipedia while 320,000 visited one of the different Indian language wikipedias.

Source of traffic[edit]

comScore also provides analysis of the site a user surfs just prior to visiting us. The percentage of these "entries" from Google and other search engines is often used as an indicator of reliance on the search engines for traffic. Other major sites like YouTube, eBay or Facebook typically see entries from Google at 10% to 15% of their traffic while we are typically over 50%. Here's a breakdown for us for December (this data is published later than other information so is a month behind):

Entries % of total entries
Google Sites (includes YouTube) 1,686 million 60.1%
Yahoo! Sites 159 million 5.7%
Microsoft Sites 105 million 3.7%
FACEBOOK.COM 44 million 1.6%
Logon 35 million 1.3%

Trend data[edit]

I put together a summary of comScore’s unique visitor estimates by project for the past few years (PDF on meta or Excel format on my blog).

Participation rates[edit]

comScore gives data on unique visitors, and Erik Zachte calculates the number of logged-in users who have made more than five edits in a month which provides a reasonably good metric for active participation. With data coming from two different data sources it's a bit apples-and-oranges, but is still useful.

The table below shows the calculations for the biggest few Wikipedias for December, the latest month with available editor counts. On the English Wikipedia only about .02% of the unique visitors actively edit. Put another way, that's one-fifth of one-tenth of one percent. If you include all logged-in users who made at least one edit, it's about fifteen times higher at one-third of one percent. Including anonymous editors would result in even higher participation rates but to date Erik has not been able to analyze anonymous editing.

Dec '09 UVs from comScore Dec '09 editors with >5 edits % of UVs
with >5 edits
All Wikipedias 344,536,990 85,125 0.025%
English Wikipedia 179,585,865 38,458 0.021%
Japanese Wikipedia 32,687,972 4,119 0.013%
Spanish Wikipedia 29,704,232 4,122 0.014%
French Wikipedia 25,279,011 4,949 0.020%
German Wikipedia 23,655,350 6,882 0.029%
Russian Wikipedia 13,803,828 4,130 0.030%
Source: Unique Visitor estimates from comScore, editor stats from http://stats.wikimedia.org/EN/TablesWikipediaZZ.htm

Analysis from earlier months[edit]

Discussion of comScore & Wikimedia[edit]

Jay Walsh on the Foundation's staff is managing the comScore relationship overall, Erik Zachte is helping drive the statistical analysis, and a volunteer named Josh Holman has a lot of experience with comScore data. Feel free to reach out to me or any of them with questions. If there's interest, we'll try to update this page every month or two as new data comes out.

comScore is just one of the different internet measurement options (others include Alexa, Compete, Google Insights for Search, Google Trends, Hitwise, Nielsen, Quantcast, server log analysis).

Finally a quick thank you to comScore. The data they donated typically sells for thousands and thousands of dollars, so we're lucky to be able to review. Speaking on behalf of all of us in the community, I want to thank them for their support.

Benefits[edit]

  • comScore has a large and professional team dedicated to audience measurement. We are able to benefit from their insights with no coding, no servers, no hard drives stuffed full of log data, and almost no effort.
  • comScore reports "unique visitors", which estimates the actual people using the internet. This puts things into more human terms than page views or an ambiguous "traffic rank" metric. Also, comScore works hard to exclude bots, crawlers, mirrors, click farms, etc.
  • comScore works to combine different domains and subdomains. This is particularly useful for international properties. For example, we are able to generate a single audience number for all five or so Chinese language Wikipedias and compare that, both worldwide and within China, to the audience using the English Wikipedia.
  • Because comScore does its analysis consistently for all websites, with the same statistical techniques and methodology, we can compare among our projects and to others.
  • With a panel of two million users globally, comScore has strong international coverage.
  • comScore panelists provide demographic data so we can see estimates of factors like age and sex.

Limitations[edit]

  • Coverage of educational users -- comScore focuses on users 15 years old and older using the internet at home or work. Globally, it does not have coverage in schools (though it does have coverage in universities in a few countries). Given our strengths in education this will inevitably lead to significant underreporting of school use and thus our overall audience.
  • Coverage of worldwide usage -- comScore recruits a panel of users across the world, but their coverage can't be perfect. Given our strong international presence, this will likely also lead to some misreporting of our audience. Also, the dynamics of their panel make analysis less and less valuable the deeper you drill down. Statistics for a specific smaller countries (e.g. Egypt) are typically not available or if they are might be less useful depending on the size and make-up of comScore's panel there.
  • Coverage outside home/work -- comScore does not measure people who go online from an internet café or other public/shared computers. This means their audience estimates in certain parts of the world will be significantly underreported. This will have a major impact of underreporting total audience in countries with strong public/shared internet usage. Whether this has a big impact in percentage reach numbers depends on differences in home/work usage and public/shared usage (which might be meaningful in some countries where governments are believed to trace people's internet usage).
  • Coverage of the mobile audience -- This data set of comScore's is of the PC-based internet audience, so excludes access through mobile phones. A July 2008 Nielsen research report estimated there were about 40 million mobile web users in the U.S. alone, and most industry observers expect this number to grow rapidly. This is likely another source of underreporting of the total audience we reach.

What's included?[edit]

comScore offers a sophisticated ability to combine domains and subdomains to better understand the audience for and performance of our projects. We've worked extensively with them clean up their definition. We want to be inclusive and careful in defining the different Media titles ([M]), Channels ([C]), and Subchannels ([S]) so we can see what's happening with the different projects. Also, we don't need to be exhaustive and capture every single domain name. A domain which automatically redirects to one of our other sites would end up being counted after the redirect. If you see other changes we should request, start a thread on the Talk page.

Below is comScore's definition as of January 2010, which includes some still experimental efforts to identify edit pages:

[P] Wikimedia Foundation Sites

[M]:     WIKIBOOKS.ORG (p)

        *.WIKIBOOKS.COM*
        *.WIKIBOOKS.ORG*

[C]:         Wikibooks Edit Pages

            *.WIKIBOOKS.ORG*&ACTION=EDIT*

[M]:     Wikimedia Commons

        *.COMMONS.WIKIMEDIA.ORG*
        COMMONS.WIKIMEDIA.ORG*

[C]:         Wikimedia Commons Edit Pages

            *.COMMONS.WIKIMEDIA.ORG*&ACTION=EDIT*
            COMMONS.WIKIMEDIA.ORG*&ACTION=EDIT*

[M]:     Wikimedia Community Sites

[C]:         MEDIAWIKI.ORG

            *.MEDIAWIKI.ORG*

[C]:         WIKIMEDIA.AT

            *.WIKIMEDIA.AT*

[C]:         WIKIMEDIA.CH

            *.WIKIMEDIA.CH*

[C]:         WIKIMEDIA.DE

            *.WIKIMEDIA.DE*

[C]:         WIKIMEDIA.FR

            *.WIKIMEDIA.FR*

[C]:         WIKIMEDIA.IN

            *.WIKIMEDIA.IN*

[C]:         WIKIMEDIA.IT

            *.WIKIMEDIA.IT*

[C]:         WIKIMEDIA.NO

            *.WIKIMEDIA.NO*

[C]:         WIKIMEDIA.ORG* (p)

            *.WIKIMEDIA.COM*
            *.WIKIMEDIA.ORG*

[S]:             Wikimedia Meta-Wiki Edit Pages

                *.META.WIKIMEDIA.ORG*&ACTION=EDIT*
                META.WIKIMEDIA.ORG*&ACTION=EDIT*

[C]:         WIKIMEDIA.ORG.AR

            *.WIKIMEDIA.ORG.AR*

[C]:         WIKIMEDIA.ORG.AU

            *.WIKIMEDIA.ORG.AU*

[C]:         WIKIMEDIA.ORG.CO

            *.WIKIMEDIA.ORG.CO*

[C]:         WIKIMEDIA.ORG.IN

            *.WIKIMEDIA.ORG.IN*

[C]:         WIKIMEDIA.ORG.UK

            *.WIKIMEDIA.ORG.UK*

[C]:         WIKIMEDIA.ORG.VE

            *.WIKIMEDIA.ORG.VE*

[C]:         WIKIMEDIA.RO

            *.WIKIMEDIA.RO*

[C]:         WIKIMEDIA.TW

            *.WIKIMEDIA.TW*

[C]:         WIKIMEDIA.WEB.ID

            *.WIKIMEDIA.WEB.ID*

[C]:         WIKIMEDIAFOUNDATION.ORG (p)

            *.WIKIMEDIAFOUNDATION.COM*
            *.WIKIMEDIAFOUNDATION.ORG*

[C]:         WIKIMEDIAHK.ORG

            *.WIKIMEDIAHK.ORG*

[C]:         WMNL.NL

            *.WMNL.NL*

[M]:     WIKINEWS.ORG

        *.WIKINEWS.ORG*

[C]:         Wikinews Edit Pages

            *.WIKINEWS.ORG*&ACTION=EDIT*

[M]:     Wikipedia International Portals

[C]:         WIKIPEDIA.AT

            *.WIKIPEDIA.AT*

[C]:         WIKIPEDIA.BE

            *.WIKIPEDIA.BE*

[C]:         WIKIPEDIA.CH

            *.WIKIPEDIA.CH*

[C]:         WIKIPEDIA.DE

            *.WIKIPEDIA.DE*

[C]:         WIKIPEDIA.DK

            *.WIKIPEDIA.DK*

[C]:         WIKIPEDIA.FR

            *.WIKIPEDIA.FR*

[C]:         WIKIPEDIA.IT

            *.WIKIPEDIA.IT*

[M]:     WIKIPEDIA.ORG (p)

        *.WIKIPEDIA.COM*
        *.WIKIPEDIA.CZ*
        *.WIKIPEDIA.HU*
        *.WIKIPEDIA.NL*
        *.WIKIPEDIA.NO*
        *.WIKIPEDIA.ORG*
        *.WIKIPEDIA.PL*
        *.WIKIPEDIA.SE*

[C]:         Arabic Wikipedia

            AR.WIKIPEDIA.ORG*

[C]:         Chinese Wikipedias

            *.WIKIPEDIA.TW*
            *.WUU.WIKIPEDIA.ORG*
            *.ZH-CLASSICAL.WIKIPEDIA.ORG*
            *.ZH-MIN-NAN.WIKIPEDIA.ORG*
            *.ZH-YUE.WIKIPEDIA.ORG*
            WUU.WIKIPEDIA.ORG*
            ZH-CLASSICAL.WIKIPEDIA.ORG*
            ZH-MIN-NAN.WIKIPEDIA.ORG*
            ZH-YUE.WIKIPEDIA.ORG*
            ZH.WIKIPEDIA.ORG*

[C]:         English Wikipedia

            EN.WIKIPEDIA.ORG*

[C]:         French Wikipedia

            FR.WIKIPEDIA.ORG*

[C]:         German Wikipedia

            DE.WIKIPEDIA.ORG*

[C]:         Indian Wikipedias

            *.AS.WIKIPEDIA.ORG*
            *.BH.WIKIPEDIA.ORG*
            *.BN.WIKIPEDIA.ORG*
            *.BPY.WIKIPEDIA.ORG*
            *.GU.WIKIPEDIA.ORG*
            *.HI.WIKIPEDIA.ORG*
            *.KN.WIKIPEDIA.ORG*
            *.KS.WIKIPEDIA.ORG*
            *.ML.WIKIPEDIA.ORG*
            *.MR.WIKIPEDIA.ORG*
            *.NE.WIKIPEDIA.ORG*
            *.NEW.WIKIPEDIA.ORG*
            *.OR.WIKIPEDIA.ORG*
            *.PJ.WIKIPEDIA.ORG*
            *.SA.WIKIPEDIA.ORG*
            *.SD.WIKIPEDIA.ORG*
            *.TA.WIKIPEDIA.ORG*
            *.TE.WIKIPEDIA.ORG*
            *.UR.WIKIPEDIA.ORG*
            AS.WIKIPEDIA.ORG*
            BH.WIKIPEDIA.ORG*
            BN.WIKIPEDIA.ORG*
            BPY.WIKIPEDIA.ORG*
            GU.WIKIPEDIA.ORG*
            HI.WIKIPEDIA.ORG*
            KN.WIKIPEDIA.ORG*
            KS.WIKIPEDIA.ORG*
            ML.WIKIPEDIA.ORG*
            MR.WIKIPEDIA.ORG*
            NE.WIKIPEDIA.ORG*
            NEW.WIKIPEDIA.ORG*
            OR.WIKIPEDIA.ORG*
            PJ.WIKIPEDIA.ORG*
            SA.WIKIPEDIA.ORG*
            SD.WIKIPEDIA.ORG*
            TA.WIKIPEDIA.ORG*
            TE.WIKIPEDIA.ORG*
            UR.WIKIPEDIA.ORG*

[C]:         Italian Wikipedia

            *.IT.WIKIPEDIA.ORG*
            IT.WIKIPEDIA.ORG*

[C]:         Japanese Wikipedia

            *.JA.WIKIPEDIA.ORG*
            *.WIKIPEDIA.JP*
            JA.WIKIPEDIA.ORG*

[C]:         Javanese Wikipedia

            *.JV.WIKIPEDIA.ORG*
            JV.WIKIPEDIA.ORG*

[C]:         Korean Wikipedia

            *.KO.WIKIPEDIA.ORG*
            KO.WIKIPEDIA.ORG*

[C]:         Portugese Wikipedia

            *.PT.WIKIPEDIA.ORG*
            *.WIKIPEDIA.ORG.BR*
            PT.WIKIPEDIA.ORG*

[C]:         Russian Wikipedia

            *.WIKIPEDIA.SU*
            RU.WIKIPEDIA.ORG*

[C]:         Spanish Wikipedia

            ES.WIKIPEDIA.ORG*

[C]:         Vietnamese Wikipedia

            *.VI.WIKIPEDIA.ORG*
            VI.WIKIPEDIA.ORG*

[C]:         Wikipedia Edit Pages

            *.WIKIPEDIA.ORG*&ACTION=EDIT*

[S]:             English Wikipedia Edit Pages

                EN.WIKIPEDIA.ORG*&ACTION=EDIT*

[C]:         Wikipedia.org Homepage

            WWW.WIKIPEDIA.ORG/
            WWW.WIKIPEDIA.ORG/?SVR*

[M]:     WIKIQUOTE.ORG (p)

        *.WIKIQUOTE.COM*
        *.WIKIQUOTE.ORG*

[C]:         Wikiquote Edit Pages

            *.WIKIQUOTE.ORG*&ACTION=EDIT*

[M]:     WIKISOURCE.ORG (p)

        *.WIKISOURCE.COM*
        *.WIKISOURCE.ORG*

[C]:         Wikisource Edit Pages

            *.WIKISOURCE.ORG*&ACTION=EDIT*

[M]:     Wikispecies

        *.SPECIES.WIKIMEDIA.ORG*
        SPECIES.WIKIMEDIA.ORG*

[C]:         Wikispecies Edit Pages

            SPECIES.WIKIMEDIA.ORG*&ACTION=EDIT*

[M]:     WIKIVERSITY.ORG (p)

        *.WIKIVERSITY.COM*
        *.WIKIVERSITY.ORG*

[C]:         Wikiversity Edit Pages

            *.WIKIVERSITY.ORG*&ACTION=EDIT*

[M]:     WIKTIONARY.ORG (p)

        *.WIKTIONARY.COM*
        *.WIKTIONARY.ORG*

[C]:         Wiktionary Edit Pages

            *.WIKTIONARY.ORG*&ACTION=EDIT*