{"id":4912,"date":"2026-01-26T01:51:00","date_gmt":"2026-01-26T06:51:00","guid":{"rendered":"https:\/\/chubes.net\/?documentation=data-machine-documentation"},"modified":"2026-04-29T00:09:34","modified_gmt":"2026-04-29T04:09:34","slug":"data-machine-documentation","status":"publish","type":"documentation","link":"https:\/\/chubes.net\/docs\/data-machine\/data-machine-documentation\/","title":{"rendered":"Data Machine Documentation"},"content":{"rendered":"<p>Complete user documentation for Data Machine, the AI-first WordPress plugin that combines a visual pipeline builder, conversational chat agent, REST API, and handler\/tool extensibility under a single workflow engine.<\/p><h2 class=\"wp-block-heading\">Quick Navigation<\/h2><h3 class=\"wp-block-heading\">Core Concepts<\/h3><ul class=\"wp-block-list\"><li><strong>Engine Execution<\/strong>: Breakdown of four-action execution cycle, Single Item Execution Model, and job status logic.<\/li><li><strong>Troubleshooting Problem Flows<\/strong>: Automated monitoring of consecutive failures\/no-items and how to resolve them.<\/li><li><strong>Architecture<\/strong>: End-to-end breakdown of execution engine, services layer, and handler infrastructure.<\/li><li><strong>Abilities API<\/strong>: WordPress 6.9 capability discovery and execution for Data Machine operations.<\/li><li><strong>Database Schema<\/strong>: Tables that persist pipelines, flows, jobs, and processed items.<\/li><li><strong>Changelog<\/strong>: Historical summary of notable releases and architectural changes.<\/li><\/ul><h3 class=\"wp-block-heading\">Architecture Deep Dives<\/h3><ul class=\"wp-block-list\"><li><strong>Agent Memory Backends<\/strong>: Store selection model for disk-backed memory, optional guideline-backed stores, and the DMC file-projection boundary (<a href=\"https:\/\/chubes.net\/docs\/data-machine\/architecture-data-machine\/agent-memory-backends\/\">architecture\/agent-memory-backends.md<\/a>).<\/li><li><strong>Pipeline Execution Axes<\/strong>: Queue, fan-out, and per-step iteration semantics (<a href=\"https:\/\/chubes.net\/docs\/data-machine\/architecture-data-machine\/pipeline-execution-axes\/\">architecture\/pipeline-execution-axes.md<\/a>).<\/li><li><strong>Policy Resolvers<\/strong>: Why <code>ToolPolicyResolver<\/code>, <code>MemoryPolicyResolver<\/code>, <code>ActionPolicyResolver<\/code>, and <code>PipelineTranscriptPolicy<\/code> stay as four single-purpose classes (<a href=\"https:\/\/chubes.net\/docs\/data-machine\/architecture-data-machine\/policy-resolvers\/\">architecture\/policy-resolvers.md<\/a>).<\/li><li><strong>Iteration Budget<\/strong>: Shared bounded-iteration primitive backing <code>conversation_turns<\/code> and <code>chain_depth<\/code> budgets (<a href=\"https:\/\/chubes.net\/docs\/data-machine\/architecture-data-machine\/iteration-budget\/\">architecture\/iteration-budget.md<\/a>).<\/li><\/ul><h3 class=\"wp-block-heading\">Engine &amp; Services<\/h3><ul class=\"wp-block-list\"><li><strong>Universal Engine<\/strong>: Shared AI infrastructure for pipeline and chat agents.<\/li><li><strong>AI Conversation Loop<\/strong>: Turn-based conversation execution with directive orchestration.<\/li><li><strong>AI Directives System<\/strong>: Hierarchical directive injection for contextual AI behavior.<\/li><li><strong>Tool Execution<\/strong>: Centralized discovery, validation, and execution of AI tools.<\/li><li><strong>Tool Manager<\/strong>: Runtime tool enablement, provider checks, and contextual metadata.<\/li><li><strong>Request Builder<\/strong>: Directive-aware construction of provider requests.<\/li><li><strong>Conversation Manager<\/strong>: Message normalization, logging, and tool call tracking.<\/li><li><strong>Prompt Builder<\/strong>: Priority-based directive registration via filters.<\/li><li><strong>Parameter Systems<\/strong>: Unified parameter handling across tools and handlers.<\/li><li><strong>Tool Result Finder<\/strong>: Utility for interpreting tool responses inside data packets.<\/li><li><strong>OAuth Handlers<\/strong>: Base classes for OAuth1\/OAuth2 providers and app-password flows.<\/li><li><strong>Handler Registration Trait<\/strong>: Centralized registration pattern for fetch, publish, and upsert handlers.<\/li><li><strong>HTTP Client<\/strong>: Standardized outbound request flow for handlers with structured logging and browser-mode header support.<\/li><li><strong>Import\/Export System<\/strong>: Pipeline configuration backup, migration, and sharing functionality.<\/li><\/ul><h3 class=\"wp-block-heading\">Handler Documentation<\/h3><ul class=\"wp-block-list\"><li><strong>Fetch Handlers<\/strong>: Source-specific data retrieval with deduplication, filtering, and engine data storage.<\/li><li><strong>Publish Handlers<\/strong>: Modular destination integrations with consistent response formatting and logging.<\/li><li><strong>Upsert Handlers<\/strong>: Identity-aware create-or-update operations \u2014 find existing content by identity strategy, update if changed, create if new.<\/li><\/ul><h3 class=\"wp-block-heading\">AI Tools<\/h3><ul class=\"wp-block-list\"><li><strong>Tools Overview<\/strong>: Global and context-aware tools available to AI agents.<\/li><li><strong>Execute Workflow<\/strong>: Modular execution of multi-step workflows from the chat toolset.<\/li><li><strong>Global Tools<\/strong>: Google Search, Local Search, Web Fetch, WordPress Post Reader, and others used across agents.<\/li><li><strong>Chat Tools<\/strong>: AddPipelineStep, ApiQuery, ConfigureFlowSteps, ConfigurePipelineStep, CreateFlow, CreatePipeline, RunFlow, UpdateFlow, and other workflow management tools.<\/li><\/ul><h3 class=\"wp-block-heading\">API Reference<\/h3><ul class=\"wp-block-list\"><li><strong>API Overview<\/strong>: Catalog of REST endpoints for API consumers.<\/li><li><strong>Endpoints<\/strong>: Auth, Execute, Files, Flows, Jobs, Logs, and other REST resources.<\/li><\/ul><h3 class=\"wp-block-heading\">Development<\/h3><ul class=\"wp-block-list\"><li><strong>Hooks<\/strong>: Core actions, filters, and engine hooks for extension development.<\/li><li><strong>REST Integration<\/strong>: Patterns for extending the REST API and custom endpoints.<\/li><\/ul><h3 class=\"wp-block-heading\">Admin Interface<\/h3><ul class=\"wp-block-list\"><li><strong>Pipeline Builder<\/strong>: React-based page for creating pipelines, configuring steps, and enabling tools.<\/li><li><strong>Settings Configuration<\/strong>: Provider credentials, tool defaults, and global behavior settings.<\/li><li><strong>Jobs Management<\/strong>: React-based job history and admin cleanup actions.<\/li><\/ul><h2 class=\"wp-block-heading\">Documentation Structure<\/h2><div class=\"code-block-wrapper\"><div class=\"code-block-header\"><span class=\"code-block-language\"><\/span><button class=\"code-copy-btn\" aria-label=\"Copy code\"><svg><use href=\"https:\/\/chubes.net\/wp-content\/themes\/chubes\/assets\/icons\/chubes.svg#icon-copy\"><\/use><\/svg><\/button><\/div><pre data-chubes-enhanced class=\"wp-block-code\"><code>docs\/\n\u251c\u2500\u2500 overview.md                        # System overview, data flow, and key concepts\n\u251c\u2500\u2500 architecture.md                    # Execution engine, architecture principles, and shared components\n\u251c\u2500\u2500 architecture\/                      # Architecture deep dives (axes, policies, primitives)\n\u251c\u2500\u2500 CHANGELOG.md                       # Semantic changelog for releases\n\u251c\u2500\u2500 core-system\/                       # Engine, services, and core infrastructure pieces\n\u2502   \u251c\u2500\u2500 abilities-api.md               # WordPress 6.9 Abilities API for flow queries, logging, and post filtering\n\u2502   \u251c\u2500\u2500 ai-directives.md               # AI directive system and priority hierarchy\n\u2502   \u251c\u2500\u2500 engine-execution.md            # Execution cycle and Single Item Execution Model\n\u2502   \u251c\u2500\u2500 troubleshooting-problem-flows.md # Monitoring consecutive failures and no-items\n\u2502   \u251c\u2500\u2500 http-client.md                 # Centralized HTTP client architecture\n\u2502   \u251c\u2500\u2500 import-export.md               # Pipeline import\/export functionality\n\u2502   \u2514\u2500\u2500 [other core system docs...]\n\u251c\u2500\u2500 handlers\/                          # Fetch, publish, and update handler specifics\n\u251c\u2500\u2500 ai-tools\/                          # AI agent tools, workflows, and tool usage\n\u251c\u2500\u2500 admin-interface\/                   # User guidance for admin pages\n\u251c\u2500\u2500 api\/                               # REST API for consumers\n\u2502   \u251c\u2500\u2500 index.md                       # Complete API overview and common patterns\n\u2502   \u2514\u2500\u2500 endpoints\/                     # Individual REST endpoint documentation\n\u2502       \u2514\u2500\u2500 errors.md                  # Error handling reference\n\u251c\u2500\u2500 development\/                       # Developer-focused documentation\n\u2502   \u251c\u2500\u2500 hooks\/                         # Core actions, filters, and engine hooks\n\u2502   \u2514\u2500\u2500 rest-integration.md            # REST API extension patterns\n\u2514\u2500\u2500 README.md                          # This navigation and orientation page<\/code><\/pre><\/div><h2 class=\"wp-block-heading\">Component Coverage<\/h2><p>Refer to the individual files listed above for implementation details, operational guidance, and API references.<\/p>","protected":false},"excerpt":{"rendered":"<p>Complete user documentation for Data Machine, the AI-first WordPress plugin that combines a visual pipeline builder, conversational chat agent, REST API, and handler\/tool extensibility under a single workflow engine. Quick&#8230;<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"footnotes":""},"tags":[],"project":[487],"project_type":[484],"class_list":["post-4912","documentation","type-documentation","status-publish","hentry","project-data-machine","project_type-wordpress-plugins"],"project_info":{"id":487,"name":"Data Machine","slug":"data-machine"},"project_type_info":{"id":484,"name":"WordPress Plugins","slug":"wordpress-plugins"},"_links":{"self":[{"href":"https:\/\/chubes.net\/wp-json\/wp\/v2\/documentation\/4912","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/chubes.net\/wp-json\/wp\/v2\/documentation"}],"about":[{"href":"https:\/\/chubes.net\/wp-json\/wp\/v2\/types\/documentation"}],"version-history":[{"count":6,"href":"https:\/\/chubes.net\/wp-json\/wp\/v2\/documentation\/4912\/revisions"}],"predecessor-version":[{"id":11492,"href":"https:\/\/chubes.net\/wp-json\/wp\/v2\/documentation\/4912\/revisions\/11492"}],"wp:attachment":[{"href":"https:\/\/chubes.net\/wp-json\/wp\/v2\/media?parent=4912"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/chubes.net\/wp-json\/wp\/v2\/tags?post=4912"},{"taxonomy":"project","embeddable":true,"href":"https:\/\/chubes.net\/wp-json\/wp\/v2\/project?post=4912"},{"taxonomy":"project_type","embeddable":true,"href":"https:\/\/chubes.net\/wp-json\/wp\/v2\/project_type?post=4912"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}