Ready to start hiring?
Dealing with hard-to-fill positions? Let us help.

Post Job

Statistics and damn lies: Online job ads

By Michael Overell - Feb. 9, 2012
jobs
Post A Job For Free, Promote It For A Fee

Job ads in Australia increased 6.4% from December to January, according to recent data. This was the biggest monthly increase since 2010. Commentators wet themselves in delight: ‘Job ads hit 2 year high’. Politicians even got in on the game, with the federal Treasurer claiming this as a reminder that our economic fundamentals are strong.

Surely this is great news?

Well no, not necessarily. There are 2 problems with this good news story: trend data, and data integrity.

Don’t yawn, this is a simple case of reading the fine print. We’ll keep it light, and also call out some funky practices that could make these employment ‘statistics’ look more like ‘damn lies’.

1. Trend data

Job ads might have increased 6.4% since December. But from a year earlier, the rise was only 1.4%. Less impressive? You bet. A more relevant comparison? Unfortunately, yep. But a 1% annual increase doesn’t help any headline get more clicks. Much easier to burier that stat deep in the article. Or better yet, just leave it out!

An obvious issue in any Dec-Jan comparison is the holiday season. ANZ acknowledges this issue in their commentary of the data:

Even after seasonal adjustments, there was considerable volatility in the job ad data in December and January, as often happens this time of year due to the large swings in advertising over the holiday period. This means emerging trends are more tentative than usual.

For those who want to use these headline statistics to push their own agenda, the relevant measure would be trend data. That is, average changes in the data over a fixed period. Unfortunately the news on this front isn’t good. ANZ reports:

In trend terms, total job ads rose by 0.5% in January to be 2.6% lower than a year earlier.

So, while the headline statistics might seem like great news, the real data tells another story.

 

2. Data integrity

This one’s a little more fun, and points to potentially bigger issues than a few commentators neglecting the fine print: Does a measure of job ads actually tell us anything?

ANZ would like us to think so. They proudly reference a 2003 report from the Australian Bureau of Statistics, which analyses the leading indicators of employment growth over the period 1984 – 2002.

The ABS analysis finds that the ANZ job advertisement series has a correlation coefficient of 0.75 with employment growth at a lead period of three quarters.

But again, reading the fine print:  This correlation applies only to ANZ newspaper jobs series. Not online job ads. In 2002, Seek.com.au (Australia’s #1 job site with 70% market share) was only 5 years old, and still a private company. Online jobs were less than 15% of the total jobs market.

Today, 83% of all job ads are online. Newspaper job ads are dying a slow death. So, if we’re going to use measures of ‘job ads’ for any purpose, we need to ask whether online job numbers bear any relationship to actual employment growth. So far the answer is ‘we don’t know’.

I’m not going to run a correlation analysis, but we can take a quick look at the integrity of online jobs data. That’s more fun anyway, and confirms some funky practices that could impact the ability of online job numbers to tell us anything about real employment.

What’s wrong with the job ads?

We’ve all heard stories of recruiters and companies playing funny buggers with online job ads. Multiple postings and dummy job ads are the most common complaint. Candidates are the big loser in this game. Unless, of course, this behaviour starts to obscure any genuine trends, and real decisions are then based on this data.

A quick search on Seek (8 Feb 2012) does indeed confirm some funny business:

1. The same job ad posted twice in the same day

The same job ad on the same day

Crowding out the competition

 

2. The same job ad posted multiple times on different dates

The same ad on different dates

Staying at the top of search results

 

3. The Jackpot: The same job ad, on multiple dates, categories and different agencies

The Jackpot: Different dates, categories and agencies

A tough role to fill

 

Clearly, the job data ain’t right. 

Were these practices common in the old ‘newspaper’ days? Almost certainly not to the same extent. A newspaper ad would cost an employer/agency thousands of dollars, whereas a high-volume advertiser on Seek can post ads for less than $50.

What do these practices mean for our measures of employment trends? The fact is we don’t know. In their last published report (2005 – that’s 7 years ago!), ANZ actually stated:

So far, no statistically robust relationship exists between total (newspaper plus internet) job ads and employment growth.

But they still report the data, and commentators happily quote as if it means anything for real employment trends.

Until we can be confident of any relationship between online job ad data and real employment growth, we should beware any measure of job ads. We can only hope our policy makers do the same…

Next up on the topic of damn lies in employment:  The unemployment rate.

 

Michael Overell is a seasoned entrepreneur and business leader with a proven track record in building companies, products, and teams in both startup and hyper-growth environments. Currently, he serves as a key executive at ClassDojo, where he is responsible for driving revenue growth and helping children around the world access quality education. Michael is also actively involved in investing and providing support to promising foreign founders looking to break into the US market through his work with Antipodes. Prior to his work at ClassDojo, Michael played a pivotal role in scaling Lyft's product organization as the company experienced rapid growth, expanding from 3,000 to 6,000 employees and successfully going public. His expertise in hiring and recruiting was further honed during his time as the co-founder and CEO of RecruitLoop, a company he launched in Sydney before relocating to San Francisco. Under his leadership, RecruitLoop raised funding, developed a globally distributed team, and achieved profitability. The company had a modest exit in 2019 and ultimately closed its operating business. Michael began his career at McKinsey, where he focused on strategy in the tech and telecommunications sectors, with a particular emphasis on next-generation fiber broadband networks. His insights and thought leadership have been featured in prominent publications such as TechCrunch.

Author

Michael Overell

Michael Overell is a seasoned entrepreneur and business leader with a proven track record in building companies, products, and teams in both startup and hyper-growth environments. Currently, he serves as a key executive at ClassDojo, where he is responsible for driving revenue growth and helping children around the world access quality education. Michael is also actively involved in investing and providing support to promising foreign founders looking to break into the US market through his work with Antipodes. Prior to his work at ClassDojo, Michael played a pivotal role in scaling Lyft's product organization as the company experienced rapid growth, expanding from 3,000 to 6,000 employees and successfully going public. His expertise in hiring and recruiting was further honed during his time as the co-founder and CEO of RecruitLoop, a company he launched in Sydney before relocating to San Francisco. Under his leadership, RecruitLoop raised funding, developed a globally distributed team, and achieved profitability. The company had a modest exit in 2019 and ultimately closed its operating business. Michael began his career at McKinsey, where he focused on strategy in the tech and telecommunications sectors, with a particular emphasis on next-generation fiber broadband networks. His insights and thought leadership have been featured in prominent publications such as TechCrunch.

Find Your Next Hire Out Of Over 5 Million Candidates

Get connected with quality candidates whose resumes on Zippia best fit your job description.

Ready To Start Hiring?

Related posts

Find Your Next Hire Out Of Over 5 Million Candidates

Get connected with quality candidates whose resumes on Zippia best fit your job description.

Topics: Talent Professionals