跳到正文
原文
HuggingFace Daily Papers(社区热门论文)·· 27 天前AI 评分37

MaP-SQL:用可复用记忆替代微调的 Text-to-SQL listwise 选择方法

Replacing Training with Memory: Listwise Selection for Text-to-SQL

AI 导读

论文提出 MaP-SQL,一种免微调的 Text-to-SQL listwise 选择器,用从训练数据蒸馏出的结构化记忆作为评估候选 SQL 的显式标准,并通过聚合多输入排列的排序来缓解位置偏差。

正文

Modern Text-to-SQL systems often follow generate-execute-select pipelines, generating multiple candidate queries then selecting the best one. Listwise selection, by jointly comparing multiple candidates, has been widely adopted, but fine-tuning listwise selectors is costly. We thus propose a fine-tuning-free listwise selector. We replace two major fine-tuning objectives with inference-time strategies: (1) learning selection criteria as ordering and (2) mitigating positional bias. First, we build reusable structured memories instead of learning selection behavior as model parameters. Given a question, MaP-SQL retrieves memories distilled from training data that encode how natural language maps to schema elements, SQL operations, and expected outputs. These memories serve as explicit decision criteria for evaluating candidates in a listwise manner. Second, to mitigate ordering bias of listwise selectors, we aggregate rankings across multiple input permutations, with inference cost optimized by execution results and pointwise scoring. Our approach improves selection accuracy while maintaining efficiency and compatibility with existing large language models. Across Text-to-SQL benchmarks, it produces more stable selection without fine-tuning and fewer unnecessary comparisons than existing methods. On BIRD-dev, it outperforms the previous state-of-the-art selector-based method R^3-SQL by 2.02 execution accuracy points on average using the same candidate sets, with 2.92x fewer tokens.

来源:HuggingFace Daily Papers(社区热门论文) · arxiv.org