蚂蚁 inclusionAI 发布 MiniMax-M2.7-singprobe:基于 MiniMax-M2.7 的流式安全探针

蚂蚁 inclusionAI:HuggingFace 新模型·2026-09-14 11:15·18小时前
AI 导读

蚂蚁 inclusionAI 发布 MiniMax-M2.7-singprobe,这是一个构建在 MiniMax-M2.7 上的内置流式护栏,复用基座模型隐藏状态,在生成每个 token 时对查询意图、回复不安全和幻觉风险打分,解码开销低于 0.5%。

蚂蚁 inclusionAI:HuggingFace 新模型
46AI 编辑部评分,满分 100

蚂蚁 inclusionAI 发布 MiniMax-M2.7-singprobe:基于 MiniMax-M2.7 的流式安全探针

2026-09-14 11:15· 18小时前
AI 导读

蚂蚁 inclusionAI 发布 MiniMax-M2.7-singprobe,这是一个构建在 MiniMax-M2.7 上的内置流式护栏,复用基座模型隐藏状态,在生成每个 token 时对查询意图、回复不安全和幻觉风险打分,解码开销低于 0.5%。

Model Description

SingProbe is an intrinsic streaming guardrail built on MiniMaxAI/MiniMax-M2.7. Rather than running a separate safety model, this lightweight probe reuses the base model's hidden states during generation to score, at every token, query intent, response unsafety, and hallucination risk. It adds less than 0.5% decode-time overhead.

Base model Probe parameters Tapped layers Outputs
inclusionAI/MiniMax-M2.7-singprobe 6.17M [19, 39, 60] 8 intents + unsafe + hallucination

See the technical report for methodology and complete results. Training codes are available at inclusionAI/SingProbe.

Evaluation

Higher is better for every metric. Results are averages over the benchmark suites specified below.

Task Metric MiniMax-M2.7-singprobe Reference baseline
Query intent classification (6 benchmarks) F1 0.8731 YuFeng-XGuard-Reason-8B: 0.8714
Response safety classification (8 benchmarks) F1 0.8698 Qwen3Guard-Gen-8B-strict: 0.8604
Streaming safety (3 benchmarks) R-AUC / T-AUC 0.9902 / 0.9483 Qwen3Guard-Stream-8B-strict: 0.9640 / 0.8893
Hallucination detection (6 benchmarks) AUC 0.7777 DRIFT: 0.8000
Deployment characteristic Result
Benign-response false-positive rate 0.03% average across 5 datasets
Decode overhead < 0.5%

Quick Start

SingProbe is supported through the SGLang integration branch or vLLM integration branch. Load the probe by its Hugging Face ID at server launch:

python -m sglang.launch_server \
  --model-path MiniMaxAI/MiniMax-M2.7 \
  --probe-ckpt inclusionAI/MiniMax-M2.7-singprobe \
  --port 30000

The integrations return one score dictionary per generated token (label_0label_9). Use the exact base-model/probe pair: MiniMaxAI/MiniMax-M2.7 with this checkpoint.

Citation

@article{singteam2026singprobe,
  title = {SingProbe Technical Report},
  author = {Sing Team},
  journal = {arXiv preprint arXiv:2608.30703},
  year = {2026},
}

来源:蚂蚁 inclusionAI:HuggingFace 新模型· huggingface.co