datasette-llm 0.1a11 发布:支持 OpenAI 兼容端点
datasette-llm 0.1a11
Datasette 的中间插件 datasette-llm 发布 0.1a11,新增对 OpenAI 兼容端点的支持,可将 Datasette 配置为使用任何遵循该协议的 LLM 服务。这意味着用 LM Studio、Ollama 或刚发布 v1.0.0 的 llama.cpp 跑本地模型的用户,可通过 uvx 启动由本地模型驱动的 Datasette Agent 实例。
Release: datasette-llm 0.1a11
datasette-llm is the intermediate plugin for Datasette that supports configuring LLMs for use with other Datasette plugins.
This release adds support for OpenAI-compatible endpoints, so you can configure Datasette to use an LLM hosted anywhere that talks the OpenAI pseudo-standard web protocol.
This means that if you're running local models with LM Studio or Ollama or llama.cpp (which just hit v1.0.0) you can run Datasette via uvx like this:
wget https://datasette.io/content.db uvx --with datasette-agent datasette \ --root --secret 1 \ -s plugins.datasette-llm.default_model '{ "model": "lmstudio-qwen", "model_name": "qwen/qwen3.8-27b", "api_base": "http://localhost:1234/v1" }' content.db
And you'll get a local server running a Datasette Agent instance powered by your local model!

Tags: uv, datasette-agent, llm, datasette, llms, ai, generative-ai
来源:Simon Willison 博客 · simonwillison.net