Doing a number on Web site traffic

In 2004, new kid on the block MySpace was watching its user traffic rise fast. But executives were having a tough time luring new advertisers to the social network because it didn't show up in the lists of top Web sites compiled by Internet audience trackers ComScore and Nielsen Online.

"We had a hard case telling people how big we were and how many unique visitors we had. They didn't believe us. We didn't show up on people's radars," said Jason Feffer, former vice president of operations at MySpace who is now president and chief executive at opinion-forums site SodaHead.com. "It was frustrating that advertisers wanting to advertise to that demographic would go to Friendster when we were 10 times bigger than them."

That changed fairly quickly for MySpace. But the problem persists for many other Web sites competing for advertising dollars in an environment where the difference between being ranked fourth or fifth in a category can directly impact the bottom line. Being undercounted by the audience measurement firms costs publishers advertising deals and threatens their ad-based businesses.

For instance, MLB.com, the site for Major League Baseball, has repeatedly complained that audience figures reported for the site by Nielsen Online are much lower than those shown by MLB.com's internal data. League subsidiary MLB Advanced Media has asked Nielsen Online to stop reporting on its traffic because of the discrepancy.

How big of a difference is there? Nielsen Online reported MLB.com with about 6.2 million unique visitors in December while MLB.com recorded 19.4 million unique visitors during that month. For 2007, Nielsen Online's figures were one quarter those recorded by MLB.com, according to MLB.com.

"That's like a pilot of a plane landing in the wrong continent," says Bob Bowman, chief executive of MLB Advanced Media. "There are probably some advertisers or agencies that actually believe the numbers and are steering their ad buys elsewhere."

Nielsen Online is responding to MLB.com's concerns, said Mainak Mazumdar, vice president of measurement science and research service MegaPanel at Nielsen Online. "The best way to address this is to understand what the methodology is and the audit will show that."

An old but tenacious conflict
This isn't a new problem, but, it is hoped, it is one that will be addressed this year. The Interactive Advertising Bureau, which represents more than 300 Web publishers, including CNET Networks, asked ComScore and Nielsen Online to submit to audits by the Media Rating Council, a nonprofit group that approves audience ratings systems. In a letter sent last April to the heads of the two companies, IAB Chief Executive Randall Rothenberg complained that they were "still relying on panels, a media-measurement technique invented for the radio industry exactly seven decades ago, to quantify the Internet."

"To persist in using panels that undercount or ignore the diverse populations that are the future of consumer marketing is to deny marketers the insights they need to build their businesses," Rothenberg wrote. "And it certainly appears to us as if they are being undercounted or disregarded, for our members' server logs continue to diverge starkly from your companies' sample-based assessments, by 2x to 3x magnitudes, in some cases far beyond any legitimate margin of sampling error."

Nielsen Online and ComScore say the audits are on schedule to be completed by the end of the year, said David Doty, a marketing and public relations senior vice president at IAB. Meanwhile, the IAB is also working on guidelines for publishers for measuring their own traffic. Those guidelines should come out in the second quarter, Doty said.

The IAB has become a "referee to an increasingly ugly street brawl," said Tim Hanlon, executive vice president at Denuo, the media futures arm of ad firm Publicis Group.

Third-party audience measurement provides a measurement independent of Web publishers who have financial incentive to inflate their numbers to ad buyers.

The numbers will never be exactly the same because the methods of measurement are different and they measure different things. ComScore and Nielsen Online use data gleaned from samples of Internet users who have monitoring software installed on their computers, while publishers are looking at their actual server log data. Panels give a glimpse into who is visiting a site; server data shows exact visits to the site.

To some, the debate comes down to which is more accurate--a sample panel whose stats are projected out to represent a wider population, as with television and radio panels, or server data that shows the number of visits to a site, the number of page views, and the time spent?

More from News.com on this story's topics

Marketing

Create an email alert | RSS feed

Advertising

Create an email alert | RSS feed

Publishing

RSS feed

See more CNET content tagged:
ComScore, advertiser, audit, MySpace, visitor