← All publications

COLM 2025

Multi-Agent Retrieval-Augmented Framework for Evidence-Based Counterspeech Against Health Misinformation

Anirban Saha Anik, Xiaoying Song, Elliott Wang, Bryan Wang, Bengisu Yarimbas, and Lingzi Hong

A coordinated system of specialized agents that retrieves, synthesizes, generates, and refines evidence-based counterspeech.

The problem

Why this work matters

Conventional RAG systems often depend on a narrow evidence source and provide limited control over response quality. For health misinformation, a useful correction must be current, factual, relevant, and respectful at the same time.

Methodology

How the approach works

Multi-agent retrieval-augmented counterspeech framework with static and dynamic evidence paths
Multi-Agent RAG for Health Misinformation methodology overview.

Contributions

What this work contributes

  1. 01

    A modular multi-agent architecture for evidence retrieval, summarization, response generation, and refinement.

  2. 02

    Joint use of curated medical guidance and real-time web evidence for both authority and timeliness.

  3. 03

    A public Reddit health-misinformation dataset covering COVID-19, influenza, and HIV claims.

  4. 04

    Ablation and human-preference studies that isolate the value of each agent and evidence path.

Evaluation

Key results

0.88

Politeness

Respectful corrections across evaluated claims.

0.86

Factual accuracy

Improved evidence grounding over RAG baselines.

0.78

Informativeness

More useful detail from complementary sources.

0.70

Relevance

Responses remain focused on the original claim.