Data and Orchestration Weekly
Short snippets on the substrate underneath AI systems — data infrastructure, retrieval and memory, agent frameworks, and the protocols that wire models to tools and to each other. Collected weekly.
Latest digest
Data and Orchestration Weekly — 15 November 2026
MCP maintainers draft an extension for moving files without routing them through the model
Model Context Protocol blog · 10 Nov 2026 · Protocols
The File Uploads Working Group has published an experimental draft that lets a client send files to, or fetch them from, a server without the bytes passing through the model. A server marks a tool argument as a file, the client first sends only metadata so the server can check permissions and quota, and the server then returns an upload target plus a tamper-protected state token; the client uploads straight to storage and retries the call. Downloads come back as target details in result metadata, and every target states whether the client’s MCP credentials may be attached. The extension is optional and has no reference implementation, leaves open where download details belong and whether an origin allowlist should be mandatory, and is aimed at stability before the end of the year.
FastMCP 4.2 serves a team’s agent skills from its MCP server
Prefect · 13 Nov 2026 · Agent tooling
Following FastMCP 4’s move to general availability, version 4.2 lets one server publish skill folders alongside its tools, so a fix to a skill reaches every agent on its next read instead of waiting for each installed copy to be refreshed. It validates each skill against the Agent Skills spec at startup, applies existing auth rules to what each caller can discover, and offers two routes for clients that cannot yet read skills over MCP: exposing them through resource-reading tools, or copying them into a local skills folder after checking sizes and hashes. Support for the underlying Skills extension is labelled experimental, VS Code reads skills over MCP only in preview behind a setting, and 4.2 drops Python 3.10.
Neo4j open-sources Relate, an embedded graph database for agents
Neo4j · 11 Nov 2026 · Graph stores
Relate is a new Rust implementation that runs inside the host process, with libraries for Python, JavaScript, Rust, Java, Go and Swift, as a command-line tool, or as a WebAssembly build, so there is no server to deploy. It speaks Cypher and GQL, and a single query can combine graph traversal with vector and full-text search; data can stay in memory, live in one file, or be backed by Parquet, JSON or Markdown. An MCP endpoint, an installable agent skill and an agent mode that returns compact output with capped rows ship with it. The startup and query-latency figures are Neo4j’s own, no independent benchmark is cited, and the post does not name a licence.
LlamaIndex releases ParseBench-2, a document-parsing benchmark that scores errors by severity
LlamaIndex · 12 Nov 2026 · Evaluation
The open benchmark grows from 2.1k to 4.3k cases and adds forms as a sixth dimension, and its metrics are calibrated against more than 330 error types labelled critical, major, minor or harmless, so a swapped digit now costs far more than returning a table as Markdown instead of HTML. In the authors’ own example a wrong number drops from a 0.13-point penalty to 10, and users can set their own severity policy. Of 41 ranked configurations, LlamaIndex’s LlamaParse Agentic Plus leads at 89.8 against 83.9 for the best rival parser, but the post quotes different scores for the same modes elsewhere and the authors sell the product being ranked. It matters as a yardstick for parsing pipelines rather than for models, with the dataset, code and paper all public.
vLLM extends encoder disaggregation for multimodal serving
vLLM blog · 11 Nov 2026 · Serving
Multimodal requests can now run media encoding on separate instances from prefill and decode, with handoffs that pass layout metadata instead of raw media and move embeddings over NIXL or Mooncake. Routing support has landed in vLLM Router, SMG and llm-d, and a shared Mooncake Store lets encoders reuse one another’s outputs. In a DeepSeek V4.1 Flash document-QA test on GB200, adding four encoder GPUs gave 6.6 to 9.5 percent more throughput per GPU at concurrency 64 to 128, counting all twelve GPUs, and cut P90 time to first token by 44 to 47 percent; at concurrency 16 it fell behind. DeepSeek support is on the main branch only, the cache-reuse result is a single best-case run, and a small accuracy dip in an audio test is left unexplained.
MCP moves its specification to two fixed releases a year
Model Context Protocol blog · 11 Nov 2026 · Protocols
Specification releases will land on the last Tuesday of March and September, with the next, version 2027-03-30, targeted for 30 March 2027. Planning starts eight months ahead, a soft freeze falls about two and a half months before release, Tier 1 SDK betas follow, and a hard freeze in the final month admits only critical fixes; a proposal that misses a freeze slips to the next release rather than delaying it. A release manager role is formalised, with Luca Chang joining the two lead maintainers. Nothing changes for existing clients or servers, so the practical effect is a predictable window for SDK work.
Earlier digests
Data and Orchestration Weekly — 8 November 2026
Apache Airflow 3.4 adds task loops, non-Python Dags and generally available LLM and agent tasks; LangChain ships async subagents.
Data and Orchestration Weekly — 1 November 2026
Temporal takes its integrations for seven agent frameworks to general availability, and Pinecone open-sources a Postgres vector-search extension.
Data and Orchestration Weekly — 25 October 2026
DuckDB 2.0 LTS ships with a client-server protocol, async object-storage reads and an agent-aware CLI, while Qdrant adds native BM25 full-text ranking.
Data and Orchestration Weekly — 18 October 2026
LangSmith adds natural-language search over agent traces, and Qdrant shows page-image embeddings compressed 21x while keeping 96.5 percent of retrieval quality.
Data and Orchestration Weekly — 11 October 2026
Temporal makes a coding agent survive worker crashes, Qdrant shrinks embedding RAM up to 77x, and DuckDB's shell adapts its output for AI agents.
Data and Orchestration Weekly — 4 October 2026
A thin week: LangChain's Open SWE model router cut median thread cost 64 percent without a measurable quality drop, alongside Qdrant, Temporal and Weaviate updates.
Data and Orchestration Weekly — 27 September 2026
LangChain's Managed Deep Agents v0.8 adds per-user memory and credentials, headlining a week of framework, evaluation, and orchestration updates.
Data and Orchestration Weekly — 20 September 2026
A non-LLM 'System One' model outperforms frontier LLMs as an agent judge, while Weaviate, Pinecone and Qdrant push retrieval efficiency forward.
Data and Orchestration Weekly — 14 September 2026
AWS adds direct long-term memory ingestion for Bedrock agents, headlining a week of vector-store, MCP, and multi-agent context updates.