M^3Check: A Demonstration System for Multilingual Multi-clue Multi-Hop Fact-Checking

Wed, 01 Jan 2025 00:00:00 +0000

Imagine that, while we cannot simply Google a complex claim, we can still find some relevant clues to help us. The question is, how can we use these clues to verify the input claim? M^3Check is a RAG model that follows three major steps: 1) break down the claim into clues, 2) verify each clue based on articles, and 3) conclude, check, and reason the claim based on a structured, supervised, and verified chain of clues. This project leverages findings from multiple projects, offering a good example of how research outcomes can be applied to address a real-world problem.

TART – An Open-Source Tool-Augmented Framework for Explainable Table-Based Reasoning

Wed, 01 Jan 2025 00:00:00 +0000

TART is designed to overcome the limitations of LLMs in table reasoning by combining structured table processing, precise tool execution, and explainability. The key components of TART are:

Table Formatter: Prepares tables by formatting, aligning, and cleaning the data for structured input.
Tool Maker: Dynamically generates tools (Python functions) tailored for complex table operations.
Explanation Generator: Integrates structured reasoning steps and tool outputs into human-readable explanations.

TART is evaluated on nine table-based reasoning benchmarks, including SCITAB, TabFact, FinQA, and HybridQA. The framework consistently outperforms Chain-of-Thought (CoT) prompting by integrating structured tool-assisted reasoning.

TART has received the Best Paper Runner-Up Award at the 3rd Table Representation Learning Workshop at NeurIPS 2024 and has been accepted at NAACL 2025. Its code and dataset are publicly available for further research. Researchers working on LLM explainability, table reasoning, and AI-assisted fact-checking are encouraged to contribute.

Fact-Checking | Web IR NLP Group @ NUS

M^3Check: A Demonstration System for Multilingual Multi-clue Multi-Hop Fact-Checking

TART – An Open-Source Tool-Augmented Framework for Explainable Table-Based Reasoning