Blog

Belling the cat: The rise of independent fact-checking at scale » Nieman Journalism Lab

Over the past few years, much has been said and written about the post-truth nature of our world. We’ve dissected and analyzed the problem from various vantage points. After much handwringing, finger-pointing, and bemoaning of the end of democracy, fact-checking was anointed the primary antidote. We patted ourselves on our backs for solving a hard problem.

But not much has changed with the post-truthiness of the world. We are, it appears, at an impasse, because who will bell the cat? Who will take on the responsibility of fact-checking? But more importantly, who do we trust to do the job? Car Hood Liner Material

In 2023, we will see a new set of challengers attempting to bell the cat. We’ll witness the rise of independent, technology-driven fact-checking at scale. (Fingers crossed.)

These new efforts will build on the foundation laid down by the numerous fact-checking outfits already doing commendable and laudable work. They’ll continue to rely on and take inspiration from the mainstays — the consortiums of fact-checkers, ethical codes governing the practice, and the generally accepted taxonomy for facts.

This new breed of fact-checkers will set themselves apart by excelling where the old ones faltered, in achieving the trifecta of trustworthiness, scale, and sustainable financing.

Most fact-checking operations are part of or have close ties to larger media ventures. Therein lies the problem of trust: When trust in media is at historical lows, how can you build trust in facts as determined by the same media brands?

In a world where the lines between objective facts and subjective opinions are blurry, it’s increasingly difficult to prove non-partisanship. Facts are by nature tribal. A sense of shared reality is the glue that holds together social groups; one’s beliefs, masquerading as facts, become part of one’s social identity. Anything that threatens that identity is deemed an outsider — a partisan hack job that should not be trusted.

For a fact-checking effort to gain trust, the arbiters of truth cannot also be its distributors. Journalism will have to rely on third-party fact-checkers.

Fact-checking as it’s done today relies heavily on the expertise of trained professionals. It’s a time-consuming manual process.

Facts are, among other things, temporal and geographical. The veracity of the statement “It’s raining” depends on when and where it’s said. These are only some of the many challenges that make fact-checking extremely complex to automate.

To keep up with the rate of generation and circulation of mis/dis/mal-information, it’s imperative to be able to scale up fact-checking. And that means more automation, more machine-aided human-in-the-loop decision-making. It also means more well-designed, well-sourced, and frequently updated knowledge graphs.

The financial incentives for separating the signals from the noise are misaligned. Some skepticism would not be misplaced when expecting a social media site that profits (at least in the short term) from the virality of a fake account to police the account effectively.

Today, fact-checking, when not part of a media organization, usually takes the form of nonprofits relying on grants or exists as a line item in the CSR efforts of large corporations.

As we’ve learned painfully time and again in journalism, any effort that cannot sustain itself financially will be left by the wayside at the first sign of economic trouble. It’s therefore important for fact-checking to be a revenue center and not just a cost or a write-off.

Information disorder is an intractably large problem for any one institution to solve or address by itself. It will take many attempts, missteps, and capital disasters before we arrive at a working solution.

And when we do, the new crop of fact-checkers will most likely be venture-funded independent entities where the primary product or service offering is fact-checking powered by technology. These will be systems that can peek into the walled gardens of social media to identify harmful narratives. (While we’re at it, I hope 2023 will also be the year the walls come down and walled gardens of social media become more open.) They will not be monopolies but a group of agencies working in tandem, not unlike how credit scores work today. They will work closely with journalism and other civic institutions. They will operate behind the scenes away from the spotlight. And once again, our shared sense of reality will become less fragmented.

It will also throw up a new set of challenges around the regulation of these agencies, the structuring of capital to maintain church-and-state separation between funders and facts, and more. But that’s for another day and another year.

Kavya Sukumar is a developer-journalist who leads technology and media investment at Lightrock India.

Kavya Sukumar is a developer-journalist who leads technology and media investment at Lightrock India.

Over the past few years, much has been said and written about the post-truth nature of our world. We’ve dissected and analyzed the problem from various vantage points. After much handwringing, finger-pointing, and bemoaning of the end of democracy, fact-checking was anointed the primary antidote. We patted ourselves on our backs for solving a hard problem.

But not much has changed with the post-truthiness of the world. We are, it appears, at an impasse, because who will bell the cat? Who will take on the responsibility of fact-checking? But more importantly, who do we trust to do the job?

In 2023, we will see a new set of challengers attempting to bell the cat. We’ll witness the rise of independent, technology-driven fact-checking at scale. (Fingers crossed.)

These new efforts will build on the foundation laid down by the numerous fact-checking outfits already doing commendable and laudable work. They’ll continue to rely on and take inspiration from the mainstays — the consortiums of fact-checkers, ethical codes governing the practice, and the generally accepted taxonomy for facts.

This new breed of fact-checkers will set themselves apart by excelling where the old ones faltered, in achieving the trifecta of trustworthiness, scale, and sustainable financing.

Most fact-checking operations are part of or have close ties to larger media ventures. Therein lies the problem of trust: When trust in media is at historical lows, how can you build trust in facts as determined by the same media brands?

In a world where the lines between objective facts and subjective opinions are blurry, it’s increasingly difficult to prove non-partisanship. Facts are by nature tribal. A sense of shared reality is the glue that holds together social groups; one’s beliefs, masquerading as facts, become part of one’s social identity. Anything that threatens that identity is deemed an outsider — a partisan hack job that should not be trusted.

For a fact-checking effort to gain trust, the arbiters of truth cannot also be its distributors. Journalism will have to rely on third-party fact-checkers.

Fact-checking as it’s done today relies heavily on the expertise of trained professionals. It’s a time-consuming manual process.

Facts are, among other things, temporal and geographical. The veracity of the statement “It’s raining” depends on when and where it’s said. These are only some of the many challenges that make fact-checking extremely complex to automate.

To keep up with the rate of generation and circulation of mis/dis/mal-information, it’s imperative to be able to scale up fact-checking. And that means more automation, more machine-aided human-in-the-loop decision-making. It also means more well-designed, well-sourced, and frequently updated knowledge graphs.

The financial incentives for separating the signals from the noise are misaligned. Some skepticism would not be misplaced when expecting a social media site that profits (at least in the short term) from the virality of a fake account to police the account effectively.

Today, fact-checking, when not part of a media organization, usually takes the form of nonprofits relying on grants or exists as a line item in the CSR efforts of large corporations.

As we’ve learned painfully time and again in journalism, any effort that cannot sustain itself financially will be left by the wayside at the first sign of economic trouble. It’s therefore important for fact-checking to be a revenue center and not just a cost or a write-off.

Information disorder is an intractably large problem for any one institution to solve or address by itself. It will take many attempts, missteps, and capital disasters before we arrive at a working solution.

And when we do, the new crop of fact-checkers will most likely be venture-funded independent entities where the primary product or service offering is fact-checking powered by technology. These will be systems that can peek into the walled gardens of social media to identify harmful narratives. (While we’re at it, I hope 2023 will also be the year the walls come down and walled gardens of social media become more open.) They will not be monopolies but a group of agencies working in tandem, not unlike how credit scores work today. They will work closely with journalism and other civic institutions. They will operate behind the scenes away from the spotlight. And once again, our shared sense of reality will become less fragmented.

It will also throw up a new set of challenges around the regulation of these agencies, the structuring of capital to maintain church-and-state separation between funders and facts, and more. But that’s for another day and another year.

Kavya Sukumar is a developer-journalist who leads technology and media investment at Lightrock India.

Kavya Sukumar is a developer-journalist who leads technology and media investment at Lightrock India.

Bill Grueskin     Local news will come to rely on AI

J. Siguru Wahutu     American journalism reckons with its colonialist tendencies

Eric Ulken     Generative AI brings wrongness at scale

Jody Brannon     We’ll embrace policy remedies

Sue Schardt     Toward a new poetics of journalism

Jaden Amos     TikTok personality journalists continue to rise

Janet Haven     ChatGPT and the future of trust 

Mario García     More newsrooms go mobile-first

Sam Gregory     Synthetic media forces us to understand how media gets made

Paul Cheung     More news organizations will realize they are in the business of impact, not eyeballs

Matt Rasnic     More newsroom workers turn to organized labor

Kaitlin C. Miller     Harassment in journalism won’t get better, but we’ll talk about it more openly

Tre'vell Anderson     Continued culpability in anti-trans campaigns

Kirstin McCudden     We’ll codify protection of journalism and newsgathering

Nicholas Jackson     There will be launches — and we’ll keep doing the work

Peter Sterne     AI enters the newsroom

Andrew Donohue     We’ll find out whether journalism can, indeed, save democracy

A.J. Bauer     Covering the right wrong

Valérie Bélair-Gagnon     Well-being will become a core tenet of journalism

Eric Holthaus     As social media fragments, marginalized voices gain more power

Ariel Zirulnick     Journalism doubles down on user needs

Mael Vallejo     More threats to press freedom across the Americas

Jacob L. Nelson     Despite it all, people will still want to be journalists

Al Lucca     Digital news design gets interesting again

Alexandra Borchardt     The year of the climate journalism strategy

David Cohn     AI made this prediction

Julia Angwin     Democracies will get serious about saving journalism

Anika Anand     Independent news businesses lead the way on healthy work cultures

Danielle K. Brown and Kathleen Searles     DEI efforts must consider mental health and online abuse

Brian Stelter     Finding new ways to reach news avoiders

Bill Adair     The year of the fact-check (no, really!)

Dana Lacey     Tech will screw publishers over

Janelle Salanga     Journalists work from a place of harm reduction

Larry Ryckman     We’ll work together with our competitors

Cory Bergman     The AI content flood

Mar Cabra     The inevitable mental health revolution

Peter Bale     Rising costs force more digital innovation

Eric Thurm     Journalists think of themselves as workers

Sue Cross     Thinking and acting collectively to save the news

Josh Schwartz     The AI spammers are coming

Jenna Weiss-Berman     The economic downturn benefits the podcasting industry. (No, really!)

Priyanjana Bengani     Partisan local news networks will collaborate

Sarah Alvarez     Dream bigger or lose out

Joanne McNeil     Facebook and the media kiss and make up

Mauricio Cabrera     It’s no longer about audiences, it’s about communities

Stefanie Murray     The year U.S. media stops screwing around and becomes pro-democracy

Joni Deutsch     Podcast collaboration — not competition — breeds excellence

Errin Haines     Journalists on the campaign trail mend trust with the public

Karina Montoya     More reporters on the antitrust beat

Jennifer Choi and Jonathan Jackson     Funders finally bet on next-generation news entrepreneurs

Anita Varma     Journalism prioritizes the basic need for survival

Lisa Heyamoto     The independent news industry gets a roadmap to sustainability

Hillary Frey     Death to the labor-intensive memo for prospective hires

Tamar Charney     Flux is the new stability

Cassandra Etienne     Local news fellowships will help fight newsroom inequities

Richard Tofel     The press might get better at vetting presidential candidates

Ryan Gantz     “I’m sorry, but I’m a large language model”

Elite Truong     In platform collapse, an opportunity for community

Ayala Panievsky     It’s time for PR for journalism

Burt Herman     The year AI truly arrives — and with it the reckoning

Dannagal G. Young     Stop rewarding elite performances of identity threat

Emily Nonko     Incarcerated reporters get more bylines

Doris Truong     Workers demand to be paid what the job is worth

Susan Chira     Equipping local journalism

Alan Henry     A reckoning with why trust in news is so low

Rodney Gibbs     Recalibrating how we work apart

Esther Kezia Thorpe     Subscription pressures force product innovation

Jesse Holcomb     Buffeted, whipped, bullied, pulled

David Skok     Renewed interest in human-powered reporting

Victor Pickard     The year journalism and capitalism finally divorce

Snigdha Sur     Newsrooms get nimble in a recession

Sumi Aggarwal     Smart newsrooms will prioritize board development

Christina Shih     Shared values move from nice-to-haves to essentials

Molly de Aguiar and Mandy Van Deven     Narrative change trend brings new money to journalism

Wilson Liévano     Diaspora journalism takes the next step

Upasna Gautam     Technology that performs at the speed of news

Kavya Sukumar     Belling the cat: The rise of independent fact-checking at scale

Taylor Lorenz     The “creator economy” will be astroturfed

Jakob Moll     Journalism startups will think beyond English

Jessica Maddox     Journalists keep getting manipulated by internet culture

Kathy Lu     We need emotionally agile newsroom leaders

John Davidow     A year of intergenerational learning

Andrew Losowsky     Journalism realizes the replacement for Twitter is not a new Twitter

Amethyst J. Davis     The slight of the great contraction

Ryan Kellett     Airline-like loyalty programs try to tie down news readers

Khushbu Shah     Global reporting will suffer

Simon Galperin     Philanthropy stops investing in corporate media

Surya Mattu     Data journalists learn from photojournalists

Dominic-Madori Davis     Everyone finally realizes the need for diverse voices in tech reporting

Michael W. Wagner     The backlash against pro-democracy reporting is coming

Michael Schudson     Journalism gets more and more difficult

Sarah Marshall     A web channel strategy won’t be enough

Cindy Royal     Yes, journalists should learn to code, but…

Eric Nuzum     A focus on people instead of power

Pia Frey     Publishers start polling their users at scale

Mariana Moura Santos     A woman who speaks is a woman who changes the world

Masuma Ahuja     Journalism starts working for and with its communities

Julia Beizer     News fatigue shows us a clear path forward

Gordon Crovitz     The year advertisers stop funding misinformation

Amy Schmitz Weiss     Journalism education faces a crossroads

Shanté Cosme     The answer to “quiet quitting” is radical empathy

Gina Chua     The traditional story structure gets deconstructed

Alex Sujong Laughlin     Credit where it’s due

Anna Nirmala     News organizations get new structures

Jennifer Brandel     AI couldn’t care less. Journalists will care more. 

Don Day     The news about the news is bad. I’m optimistic.

S. Mitra Kalita     “Everything sucks. Good luck to you.”

Martina Efeyini     Talk to Gen Z. They’re the experts of Gen Z.

Laxmi Parthasarathy     Unlocking the silent demand for international journalism

Zizi Papacharissi     Platforms are over

Rachel Glickhouse     Humanizing newsrooms will be a badge of honor

Jarrad Henderson     Video editing will help people understand the media they consume

Kaitlyn Wells     We’ll prioritize media literacy for children

Delano Massey     The industry shakes its imposter syndrome

Barbara Raab     More journalism funders will take more risks

Basile Simon     Towards supporting criminal accountability

Nicholas Diakopoulos     Journalists productively harness generative AI tools

Sam Guzik     AI will start fact-checking. We may not like the results.

Nikki Usher     This is the year of the RSS reader. (Really!)

Brian Moritz     Rebuilding the news bundle

AX Mina     Journalism in a time of permacrisis

Johannes Klingebiel     The innovation team, R.I.P.

Juleyka Lantigua     Newsrooms recognize women of color as the canaries in the coal mine

Cari Nazeer and Emily Goligoski     News organizations step up their support for caregivers

Mary Walter-Brown and Tristan Loper     Mission-driven metrics become our North Star

Megan Lucero and Shirish Kulkarni     The future of journalism is not you

Tim Carmody     Newsletter writers need a new ethics

Daniel Trielli     Trust in news will continue to fall. Just look at Brazil.

Kerri Hoffman     Podcasting goes local

Joe Amditis     AI throws a lifeline to local publishers

Parker Molloy     We’ll reach new heights of moral panic

Laura E. Davis     The year we embrace the robots — and ourselves

Emma Carew Grovum     The year to resist forgetting about diversity

Alex Perry     New paths to transparency without Twitter

Jim Friedlich     Local journalism steps up to the challenge of civic coverage

Jonas Kaiser     Rejecting the “free speech” frame

Felicitas Carrique and Becca Aaronson     News product goes from trend to standard

Alexandra Svokos     Working harder to reach audiences where they are

Elizabeth Bramson-Boudreau     More of the same

Nicholas Thompson     The year AI actually changes the media business

Moreno Cruz Osório     Brazilian journalism turns wounds into action

Leezel Tanglao     Community partnerships drive better reporting

Francesco Zaffarano     There is no end of “social media”

Sarah Stonbely     Growth in public funding for news and information at the state and local levels

Walter Frick     Journalists wake up to the power of prediction markets

Ryan Nave     Citizen journalism, but make it equitable

Jim VandeHei     There is no “peak newsletter”

Sarabeth Berman     Nonprofit local news shows that it can scale

Anthony Nadler     Confronting media gerrymandering

Jessica Clark     Open discourse retrenches

Christoph Mergerson     The rot at the core of the news business

Joshua P. Darr     Local to live, wire to wither

Ståle Grut     Your newsroom experiences a Midjourney-gate, too

Raney Aronson-Rath     Journalists will band together to fight intimidation

Gabe Schneider     Well-funded journalism leaders stop making disparate pay

Ben Werdmuller     The internet is up for grabs again

Sue Robinson     Engagement journalism will have to confront a tougher reality

To promote and elevate the standards of journalism

Covering thought leadership in journalism

Pushing to the future of journalism

Exploring the art and craft of story

The Nieman Journalism Lab is a collaborative attempt to figure out how quality journalism can survive and thrive in the Internet age.

composites It’s a project of the Nieman Foundation for Journalism at Harvard University.