{"id":29296,"date":"2026-09-16T21:07:39","date_gmt":"2026-09-16T19:07:39","guid":{"rendered":"https:\/\/whiteduck.de\/token-control-5-1-responses-api-tool-governance-and-more-models\/"},"modified":"2026-09-29T14:40:19","modified_gmt":"2026-09-29T12:40:19","slug":"token-control-5-1-responses-api-tool-governance-and-more-models","status":"publish","type":"post","link":"https:\/\/whiteduck.de\/en\/token-control-5-1-responses-api-tool-governance-and-more-models\/","title":{"rendered":"Token Control 5.1: Responses API, tool governance, and more models"},"content":{"rendered":"<p>With Token Control 5.1, we are expanding governance for the <a href=\"https:\/\/learn.microsoft.com\/azure\/ai-foundry\/openai\/how-to\/responses\" target=\"_blank\" rel=\"noreferrer noopener\">Responses API<\/a>. The focus is on a changing way of using AI: instead of single responses, multi-step tasks emerge in which models research, use tools, and develop results over longer periods. This is complemented by centralized approvals for these models\u2019 tools, additional models from Azure AI Foundry, and an API key that serves multiple approved deployments.  <\/p>\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><a href=\"https:\/\/tokencontrol.ai\/\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" class=\"wp-image-25817\" style=\"aspect-ratio: 1.7777988769226596; width: 794px; height: auto;\" src=\"https:\/\/whiteduck.de\/wp-content\/uploads\/2026\/09\/token-control-slide-1024x576-1.png\" alt=\"\" title=\"\"><\/a><\/figure>\n<h2 id=\"VondereinzelnenAntwortzurmehrstufigenAufgabe\">From a single response to a multi-step task<\/h2>\n<p>Research starts with a question. However, before producing an answer, the model may search multiple times, evaluate documents, and incorporate additional information. The Responses API supports such workflows, among other things, through Web Search, File Search, and specialized deep-research models. A single request can therefore trigger numerous processing steps.   <\/p>\n<p>Longer-running tasks can also be executed in the background, independent of an application remaining open. The task continues to run, and the application retrieves the result later. Closing the interface does not stop it.  <\/p>\n<p>For operations, this means: it is not only the final answer that matters. The ongoing task also needs a clear assignment, traceable access rights, and a governed way of handling status and cancellation. With <a href=\"https:\/\/whiteduck.de\/token-control-5-0-mehr-flexibilitaet-mehr-kontrolle-mehr-klarheit\/\" target=\"_blank\" rel=\"noreferrer noopener\">Token Control 5.0<\/a>, we made visible in March what AI costs in the enterprise. Token Control 5.1 answers the question that has been added since then: what the models do on the way to the answer.   <\/p>\n<figure class=\"wp-block-image aligncenter size-large\"><a href=\"https:\/\/whiteduck.de\/wp-content\/uploads\/2026\/09\/token-control-traces-scaled-1.png\"><img decoding=\"async\" class=\"wp-image-25832\" src=\"https:\/\/whiteduck.de\/wp-content\/uploads\/2026\/09\/token-control-traces-1024x469-1.png\" alt=\"\" title=\"\"><\/a><figcaption class=\"wp-element-caption\">Every tool call visible in the trace<\/figcaption><\/figure>\n<h2 id=\"ResponsesAPIf\u00fcrmoderneKIAnwendungenundAgenten\">Responses API for modern AI applications and agents<\/h2>\n<p>Token Control now supports the Responses API for OpenAI and Azure-based deployments, including streaming and\u2014depending on provider and approval\u2014background processing. Your existing cost and access rules therefore also apply to these calls. <\/p>\n<p>Tasks can be started, retrieved, cancelled, and deleted. Token Control records the assignment of each task. Even a response that is retrieved or cancelled hours later remains assigned to the same API key, the same cost center, and the same access rights as at the start. A task does not lose its context just because no one is watching anymore.   <\/p>\n<p>Token Control serves the endpoints that current SDKs and agent clients expect. If you work with the Microsoft Agent Framework, the .NET SDK, or a Copilot-like client, you do not need to change anything in your configuration.<\/p>\n<p>All approvals in this release are based on the same structure. A deployment is your configured model instance with a provider. You set approvals at the deployment level and, where more granular control is required, for individual models within it. In addition to Azure OpenAI and Azure AI Foundry, Token Control now also supports OpenAI and Anthropic directly as providers.   <\/p>\n<h2 id=\"ZentraleFreigabenf\u00fcrWebSearch,FileSearchundMCP\">Central approvals for Web Search, File Search, and MCP<\/h2>\n<p>You can now explicitly approve or block not only models, but also their tools. The rules are inherited along your organizational hierarchy; subordinate units cannot broaden them. You restrict external MCP servers via a URL allowlist.  <\/p>\n<p>Why this matters to us is illustrated by an example we consider underestimated. Web Search in the Azure OpenAI Responses API uses Grounding with Bing Search. Microsoft states in its documentation that the <a href=\"https:\/\/learn.microsoft.com\/azure\/foundry\/openai\/how-to\/web-search\" target=\"_blank\" rel=\"noreferrer noopener\">Data Protection Addendum does not apply to data sent to Grounding with Bing Search, and that your data leaves your compliance and geo boundary<\/a>. If you have committed to the EU Data Boundary, you should not have this function enabled without noticing.   <\/p>\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><a href=\"https:\/\/whiteduck.de\/wp-content\/uploads\/2026\/09\/token-control-responses.png\"><img decoding=\"async\" class=\"wp-image-25830\" style=\"aspect-ratio: 0.7959105821316853; width: 585px; height: auto;\" src=\"https:\/\/whiteduck.de\/wp-content\/uploads\/2026\/09\/token-control-responses-815x1024.png\" alt=\"\" title=\"\"><\/a><figcaption class=\"wp-element-caption\">Approve or block tools individually<\/figcaption><\/figure>\n<p>Specifically, in Token Control 5.1:<\/p>\n<ul class=\"wp-block-list\">\n<li><strong>Web Search and File Search<\/strong> are disabled by default for Azure OpenAI and Azure AI Foundry and are explicitly approved per deployment or per individual model. We reject requests that are not approved before they reach the provider. With OpenAI as a direct provider, both tools remain available unchanged, including cost tracking per tool call.  <\/li>\n<li><strong>MCP and Function Tools<\/strong> remain usable. MCP is governed via the URL allowlist; Function Tools remain available as usual so that developer tooling does not fail due to tool names. <\/li>\n<\/ul>\n<p>In the portal, you will find these approvals directly on the deployment, together with the models allowed there.<\/p>\n<h2 id=\"EigeneDokumente\u00fcberAzureFileSearcheinbinden\">Integrate your own documents via Azure File Search<\/h2>\n<p>You upload files, manage vector stores, and search your documents via the Responses API\u2014through the same Token Control endpoint that your OpenAI SDK clients address anyway. This noticeably simplifies the integration of document-based assistants. <\/p>\n<p>Agent clients submit their tools with every request. As long as File Search was blocked across the board, this made the entire endpoint unusable. Now you can approve File Search selectively; it remains disabled by default, and we pass your existing configuration through to Azure unchanged.  <\/p>\n<p>The costs for search, indexing, vector stores, and storage remain with Azure and are not included in your budgets. Token Control bills the model tokens and additionally records how often File Search was called. <\/p>\n<h2>Expanded Foundry model support<\/h2>\n<p>Chat models from <a href=\"https:\/\/learn.microsoft.com\/azure\/foundry\/foundry-models\/concepts\/models-sold-directly-by-azure\" target=\"_blank\" rel=\"noreferrer noopener\">Azure AI Foundry<\/a> now run through the same budgeting, pricing, and billing logic as Azure OpenAI. Specifically, these are DeepSeek V4 Pro, GLM 5.5, and MiniMax M3. In addition, the GPT-5.6 family is included.  <\/p>\n<p>Azure OpenAI and Azure AI Foundry remain two separate, independently configurable paths. We do not enforce a migration path. <\/p>\n<p>Two details are particularly valuable for billing. Input, Cached Input, and Output are resolved separately, budgeted, and billed exactly once. And configured models are resolved precisely: an unknown model is never silently billed as a known one, but is rejected in a controlled manner. We prefer a rejected request to a misassigned line item.   <\/p>\n<p>In the existing cost dashboard, you will find these models with the same breakdown by model, cost center, and user as your Azure OpenAI deployments.<\/p>\n<h2 id=\"EinAPI-Keyf\u00fcrmehrerefreigegebeneDeployments\">One API key for multiple approved deployments<\/h2>\n<p>An application can use the same API key for chat and OCR, for example. Based on the requested model, Token Control selects the appropriate assigned deployment. If multiple suitable targets are available, you set a default on the API key and override it per request as needed.  <\/p>\n<p>The result is less administrative effort while access remains clearly constrained. In the portal, you assign the approved deployments via multi-select and see, per API key, which deployments it is allowed to reach. <\/p>\n<h2 id=\"UnsereRoadmap\">Our roadmap<\/h2>\n<p>Governance and compliance will remain our focus for the upcoming releases. In addition, we are documenting our APIs: we want to make both connecting your own applications and managing Token Control via the API significantly easier. In parallel, we will keep model support up to date and add the next GPT generation\u2014announced as GPT-6 Astra\u2014at short notice.  <\/p>\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/whiteduck.de\/wp-content\/uploads\/2026\/09\/token-control-compliance.png\"><img decoding=\"async\" class=\"wp-image-25834\" src=\"https:\/\/whiteduck.de\/wp-content\/uploads\/2026\/09\/token-control-compliance-1024x576.png\" alt=\"\" title=\"\"><\/a><figcaption class=\"wp-element-caption\">Distributed tracing \u2013 Traceable down to the individual request<\/figcaption><\/figure>\n<h2 id=\"DieModelledirektvonunsbeziehen\">Source the models directly from us<\/h2>\n<p>You can also source the models you use via Token Control directly from us. We are a CSP partner for Microsoft Azure and provide Azure OpenAI and Azure AI Foundry on your own subscription. This means procurement, operations, and governance of the AI platform come from a single source: one point of contact for Azure services, for support, and for the control plane on top of it.  <\/p>\n","protected":false},"excerpt":{"rendered":"<p>With Token Control 5.1, we are expanding governance for the  [&#8230;]<\/p>\n","protected":false},"author":30,"featured_media":29297,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[598],"tags":[586,853,678,720],"class_list":["post-29296","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-2","tag-ai-2","tag-azure-ai-foundry-2","tag-governance-2","tag-token-control-2"],"acf":[],"_links":{"self":[{"href":"https:\/\/whiteduck.de\/en\/wp-json\/wp\/v2\/posts\/29296","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/whiteduck.de\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/whiteduck.de\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/whiteduck.de\/en\/wp-json\/wp\/v2\/users\/30"}],"replies":[{"embeddable":true,"href":"https:\/\/whiteduck.de\/en\/wp-json\/wp\/v2\/comments?post=29296"}],"version-history":[{"count":0,"href":"https:\/\/whiteduck.de\/en\/wp-json\/wp\/v2\/posts\/29296\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/whiteduck.de\/en\/wp-json\/wp\/v2\/media\/29297"}],"wp:attachment":[{"href":"https:\/\/whiteduck.de\/en\/wp-json\/wp\/v2\/media?parent=29296"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/whiteduck.de\/en\/wp-json\/wp\/v2\/categories?post=29296"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/whiteduck.de\/en\/wp-json\/wp\/v2\/tags?post=29296"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}