Anh Tuan Luu | Web IR NLP Group @ NUS

Beyond In-Context Learning: Aligning Long-form Generation of Large Language Models via Task-Inherent Attribute Guidelines

Fri, 01 Aug 2025 00:00:00 +0000

A Comparative Analysis of Representation Flow in State-Space and Transformer Architectures

Wed, 01 Jan 2025 00:00:00 +0000

State-space models (SSMs) have emerged as promising alternatives to Transformers, particularly for long-context tasks, due to their efficiency in modeling long-range dependencies through structured state transitions. While prior work has focused on interpreting final-layer outputs, this study investigates the feature flow across layers in SSMs. By comparing this behavior to Transformers, we show fundamental differences in how contextual information is encoded and propagated. Our analysis reveals trade-offs in efficiency and expressivity, offering a deeper understanding of learning dynamics in both architectures. This work not only advances our understanding of SSMs but also lays the foundation for designing hybrid models that combine the strengths of both paradigms.

Multi-expert Prompting Improves Reliability, Safety and Usefulness of Large Language Models

Thu, 12 Dec 2024 00:00:00 +0000

SSNLP '24

Wed, 06 Nov 2024 00:00:00 +0000

ToXCL: A Unified Framework for Toxic Speech Detection and Explanation

Tue, 26 Mar 2024 00:00:00 +0000

ChatGPT as a Math Questioner? Evaluating ChatGPT on Generating Pre-university Math Question

Wed, 28 Feb 2024 00:00:00 +0000

Fact-Checking Complex Claims with Program-Guided Reasoning

Sat, 01 Jul 2023 00:00:00 +0000