Home On TV & Video How The YouTube Scandal Exposes A Double Measurement Failure

How The YouTube Scandal Exposes A Double Measurement Failure

SHARE:
Nico Neumann, assistant professor and fellow, Centre for Business Analytics at Melbourne Business School

By now, most people working in advertising have heard about the recent YouTube scandal

A comprehensive report from measurement company Adalytics provides a long list of cases where TrueView ads didn’t seem to adhere to Google’s quality standards. Ads were served on third-party sites and apps via the YouTube partner network, known as GVP. 

Many advertisers were unaware their TrueView ads were actually running on GVP sites. Of particular concern is that numerous ads placed on GVP were found to be muted and/or auto-playing, sometimes without any accompanying video content.

Google and other traffic verification companies have released several press statements pertaining to the scandal. But discrepancies across the various attempts to quantify the issue and address everyone’s concerns have just raised more questions.

The statistics war

While everyone largely agrees that problematic or inferior GVP ads are not what media buyers expect when paying premium dollars for TrueView placements, opinions diverge on the scale of the uncovered problem. How many campaigns actually include GVP inventory? And how many GVP TrueView placements may end up being outstream, muted, auto-played or hidden?

The Adalytics report found between 50%-90% of the TrueView billable cost of audited campaigns ended up on GVP. But “Pixability found that across all their video campaigns only 11% of their ads ended up on GVP, whereas IAS found that GVP accounted for 21% of campaigns with both YouTube and GVP inventory,” according to Google’s official statement.

This range of numbers has made people wonder who to believe. However, such a debate completely misses the point. 

The various reported percentages represent samples from diverse campaigns and varying time periods. They appear to focus on different units of measure (billable views vs. impressions). And this matters a lot for a product like TrueView, where only a fraction of impressions results in a completed, billable view.

Therefore, it’s impossible to draw any absolutes from these summary statistics. It’s like measuring the temperature in Celsius and Fahrenheit at different months of the year in different countries at different times of the day – and then asking which value best describes what the weather’s like on Earth. 

Interestingly, Google – the only company that should know the exact numbers – just mentioned in their press release that “the overwhelming majority of video ad campaigns serve on YouTube, not GVP.”

Subscribe

AdExchanger Daily

Get our editors’ roundup delivered to your inbox every weekday.

Exposing a double measurement failure

The most important lesson we can draw is that, too often, there is a double measurement failure.

The first failure relates to the walled garden mentality. Currently, no verification vendor is allowed to measure campaigns on YouTube. Instead, advertisers must rely on the information that Google provides through Ads Data Hub for their assessment of campaign quality. This basically means it’s impossible to determine how many GVP campaigns suffer from the reported problems.

Let’s be clear about this concern. Imagine you are a food safety and health inspector, but are never allowed to enter the kitchen of an establishment you are supposed to examine. Instead, the restaurant only sends you some sample photos. How many restaurants would send a picture showing a dirty kitchen or health code violation?

Yet, any ad-placement-level analysis only represents the first measurement layer in the media procurement chain. And this step will always depend on the goodwill of the publisher or platform to allow any external JavaScript tags or tracking pixels. Even in a world with privacy regulations increasing, there must be a way to allow external parties to properly run audits while protecting sensitive information.

A second layer of measurement

Even without access to ad placement data, there should always be a second layer of measurement. A working ad effectiveness method should be in place to help identify any campaign inefficiency, be that viewability, fake traffic, or poor ad placements. This should serve as a safety net in case the first layer fails.

Let’s not forget – unseen ads should not have an impact on any meaningful marketing outcome, be it brand awareness or sales.

So the question is: How many marketers have a method in place that would flag the performance of a problematic GVP campaign? Too often, marketers still prefer volume-related vanity metrics or benchmark-inflating attribution models that don’t reveal campaigns without incremental advertising effects.

What actions can marketers take today?

There are four questions that any brand should ask their agency or media buyer now:

  1. How much are our campaigns affected? Conduct an independent review of your video placements using log-level data and digital forensics. Don’t rely on summary reports.
  2. How much of YouTube’s inventory is on GVP? How much is outstream versus instream? There should be no excuse to hide such basic measurable information.
  3. How can we minimize exposure to the problematic GVP inventory? Untick the box when running campaigns and avoid performance choices that do not allow removing GVP inventory if you want your money to be spent on actual YouTube ads.
  4. Would your measurement methods pick up any problematic GVP or other video campaigns? It’s never too late to review your media analysis choices and opt for more robust scientific methods, such as ongoing experimentation.

Let’s not waste time arguing about industry statistics. They are all averages. What matters is how your brand is affected.

On TV & Video” is a column exploring opportunities and challenges in advanced TV and video. 

Follow Nico Neumann and AdExchanger on LinkedIn.

For more articles featuring Nico Neumann, click here.

Must Read

Why Vodafone Is Giving Out Grades For Its Creative

One way to get a handle on your brand creative is to, well, grade your homework, according to Anne Stilling, Vodafone’s global director of brands and media.

Inside The Fall Of Oracle’s Advertising Business

By now, the industry is well aware that Oracle, once the most prominent advertising data seller in market, will shut down its advertising division. What’s behind the ignominious end of Oracle Advertising?

Forget about asking for permission to collect cookies. Google will have to ask for permission to not collect them.

Criteo: The Privacy Sandbox Is NOT Ready Yet, But Could Be If Google Makes Certain Changes Soon

If Google were to shut off third-party cookies today and implement the current version of the Privacy Sandbox, publishers would see their ad revenue on Chrome tank by around 60% on average.

Privacy! Commerce! Connected TV! Read all about it. Subscribe to AdExchanger Newsletters

Platforms Are Autogenerating Creative – And It’s Going To Be Terrible

This week, we’re diving into the most important thing in advertising – the actual creative – and how major ad platforms are well on their way to an era of creative innovation. Actually, strike that. I meant creative desolation.

Comic: TFW Disney+ Goes AVOD

Disney Expands Its Audience Graph And Clean Room Tech Beyond The US

Disney expands its audience graph and clean room tech to Latin America, marking the first time it will be available outside the US. The announcement precedes this week’s launch of Disney+ with ads in Latin America.

Advertible Makes Its Case To SSPs For Running Native Channel Extensions

Companies like TripleLift that created the programmatic native category are now in their awkward tween years. Cue Advertible, a “native-as-a-service” programmatic vendor, as put by co-founder and CEO Tom Anderson.