← All publications

Findings of EMNLP 2025

Speaking at the Right Level: Literacy-Controlled Counterspeech Generation with RAG-RL

Xiaoying Song, Anirban Saha Anik, Dibakar Barua, Pengcheng Luo, Junhua Ding, and Lingzi Hong

A RAG and reinforcement-learning framework that adapts health-misinformation corrections to a reader's health-literacy level.

The problem

Why this work matters

A single explanation cannot serve every reader equally well. Existing counterspeech systems often ignore health literacy, producing responses that may be accurate but too technical, too simple, or poorly aligned with the intended audience.

Methodology

How the approach works

Controlled-Literacy pipeline combining readability-aware retrieval, generation, rewards, and reinforcement learning
Literacy-Controlled Counterspeech methodology overview.

Contributions

What this work contributes

  1. 01

    Controlled-Literacy, a framework that combines level-aware retrieval with reinforcement learning.

  2. 02

    A hybrid reward balancing readability alignment and simulated reader preference.

  3. 03

    MisinfoLiteracy, a dataset of 440 health-misinformation posts paired with literacy-controlled counterspeech.

  4. 04

    Cross-level evaluation showing that readers prefer responses matched to their intended literacy level.

Evaluation

Key results

0.91

Factual accuracy

Compared with 0.87 for prompt-only generation.

0.84

Politeness

Compared with 0.41 for the prompt-only baseline.

0.90

Target distance ↓

Closer readability alignment than the 2.74 baseline.

0.74

User preference

Highest when the response matches the reader's level.