Try any driver free for 30 days

Docs · Driver manuals

AI Concierge

Claude AI assistant inside a Control4 system: talk to the house, control it, and get help troubleshooting

AI Concierge is powered by Claude, Anthropic's AI assistant. It is made of three Control4 drivers: Claude Agent (one per project, under Agents), Claude (the room driver, one per room) and Claude Chat (an optional chat button). Store slug: ai-concierge. Current versions: Claude room driver 20261108i, Claude Agent 20261108f, Claude Chat 20261108 (versions are date stamps).

Overview

Customers type or dictate plain requests on a touchscreen or in the Control4 app, for example "dim the kitchen to 30%", "put Netflix on in the family room", "movie mode in the theater" or "why won't the TV turn on?". Claude carries them out with Control4's own commands and answers in plain language.

What it can do:

  • Find things: rooms, devices, device details and state, connections, programming.
  • Lights and comfort: light levels, thermostats, blinds, door locks.
  • Watch and listen: list and pick room sources (powers the TV and receiver, routes the source, opens mini apps on Apple TV by Papaya and Samsung TV by Papaya App Switchers, starts music services such as Pandora, Spotify, Apple Music, SiriusXM, TuneIn and My Music through the room's speakers), volume, mute, transport, room off.
  • Any other command a Control4 driver supports.
  • Home management: rename devices, create, list and delete schedules, remember preferences.
  • Troubleshooting: for "won't turn on" problems it checks the device state, follows the programming to the real hardware, and traces the control path back to the IR, serial or Global Cache gateway before suggesting a fix.
  • Dealer contact: when it cannot fix something, it asks the customer "Want me to send a report to your dealer?" and sends a service ticket only after a yes.

It remembers the conversation, so follow-ups like "turn it off" work. After every action it reads the device back and only says "done" when the device actually changed.

The Claude Agent also watches the project for devices going offline, runs diagnostics, and emails the dealer a service ticket.

Requirements

  • Control4 OS 4.x (the room driver lists OS 3.0.0 as its minimum and the Agent OS 3.1.3; development and testing were on OS 4.x).
  • An Anthropic API key from the Anthropic Console (console.anthropic.com). Usage is billed by Anthropic to whoever owns the key. A claude.ai login or subscription cannot be used.
  • Controller internet access to Anthropic's API.
  • For dealer email and remote chat: the relay settings (Relay URL, Relay System ID, Relay Token) supplied with your AI Concierge setup.
  • Streaming app launching by voice needs the app's mini app bound to an Apple TV by Papaya or Samsung TV by Papaya App Switcher in that room.

Installing and first setup

  1. Under Agents, add Claude Agent. Set API Key, Dealer Email, Site Name and Daily Spend Cap USD. Optionally set Customer Email, Model and System Prompt (house rules, names).
  2. Add the Claude room driver to each room that should have it. Within a few seconds it finds the Agent and inherits the key, model and instructions. Agent Status shows Connected and Status shows Ready.
  3. On a Claude room driver, fill in Relay URL, Relay System ID and Relay Token to turn on dealer email and remote chat.
  4. Make the button visible. Control4 adds every experience button as Hidden. In Agents > Navigator (or the room's Menu Settings), pick a room, select Comfort, click Modify, set Claude to Visible, then Apply To all rooms. Refresh Navigators. This is a one-time project step.
  5. Run Test Connection on the Agent and on a room driver. Last Response shows OK.
  6. Optional: add Claude Chat to a room, set its Claude Engine property to that room's Claude driver, and make it visible the same way.

Update the Agent and room drivers in either order. If they restart together, the room driver keeps asking the Agent for its settings for a few minutes and holds any request instead of failing it.

Properties

Claude Agent properties

  • API Key: the Anthropic API key, shared with room drivers. Never shown in logs. API Key Length (read only) confirms one is set.
  • Model: Claude model for every room. Default is the Sonnet model; Opus and Haiku models are also listed.
  • Max Tokens: 256 to 16384, default 8192. Longest answer allowed.
  • System Prompt: dealer instructions added to every room's Claude.
  • Dealer Email: where diagnostics and reports go.
  • Customer Email: homeowner's address, included in reports.
  • Site Name: the home's name, used in prompts and email subjects.
  • Daily Spend Cap USD: 0 to 1000, default 5. Estimated daily API spend limit.
  • Auto Diagnostics: On (default). When a device goes offline after being online, run a sweep and email the dealer.
  • Auto Sync Settings to Drivers: On (default). Room drivers inherit key, model and prompt.
  • Debug Mode: Off, Print (default), Log, Print and Log. Keys are always masked.
  • Read only: Driver Version, Last Updated, Status, Device ID, Last Settings Request, Last Response, Last Error, Diagnostics Status, Email Send Attempts, Last Email Debug.

Claude room driver properties

  • Read only: Driver Version, Last Updated, Status (Ready, Requesting, Error, Not Configured), API Key Status, Inherited Model, Last Response, Last Error, Agent Device ID, Agent Status, Last Push Tag.
  • Debug Mode: Off, Print (default), Log, Print and Log. Set to Off for normal use.
  • Relay URL / Relay System ID / Relay Token: dealer email and remote chat settings. Leave blank to turn both off.

Claude Chat properties

  • Claude Engine: pick the room's Claude driver.
  • Target Device ID: read only. The chosen Claude driver.
  • Debug Mode: Off or Print.

Actions

Claude Agent:

  • Test Connection: asks Claude to reply "OK".
  • Process Request (Prompt, Room): sends a project-wide prompt.
  • Run Diagnostics: runs a sweep now and always emails the dealer.
  • Send Dealer Email (Subject, Body).
  • Clear Last Response.

Claude room driver:

  • Test Connection.
  • Process Request (Prompt): sends a prompt, for example from a button.
  • Clear Last Response.
  • Find Agent / Resync from Agent: re-reads the Agent's settings now (use after changing the API key).
  • Halo Button Pressed (Prompt) / Voice Scene Triggered (Prompt): hand-offs from Halo remote and voice programming.

Programming

Claude room driver:

  • Commands: Test Connection, Process Request, Clear Last Response, Find Agent, Resync from Agent, Halo Button Pressed, Voice Scene Triggered.
  • Events: Response Received, Error, Request Started, Button Pressed, Halo Pressed, Voice Triggered, Agent Connected, Agent Reply Received.
  • Conditional: HasResponse (has a response ready).
  • Variables: LAST_RESPONSE and LAST_ERROR (updated with the events), LAST_AGENT_REPLY.

Claude Agent:

  • Commands: Test Connection, Process Request, Run Diagnostics, Send Dealer Email, Clear Last Response.
  • Events: Response Received, Error, Request Started, Diagnostics Started, Diagnostics Complete, Issue Detected, Dealer Notified.
  • Conditional: HasResponse.

Example: a keypad button runs Process Request with "Movie mode in the theater". On Response Received, the answer is in Last Response.

Connections and bindings

None. The room driver and Claude Chat are experience buttons; the Agent lives under Agents. Claude Chat points at a room driver with its Claude Engine property.

Best practices

  • Use a dedicated Anthropic API key per project, and set Daily Spend Cap USD.
  • Put house names and rules in the Agent's System Prompt (for example what "movie mode" means in this home).
  • Set Debug Mode to Off on room drivers and the Agent once the system is working.
  • Bind mini apps to the Apple TV or Samsung TV App Switchers so Claude can open streaming apps.
  • Fill in Dealer Email and the relay settings so customers can send reports.
  • Tell the customer Claude asks before emailing the dealer and only sends after a yes.

Troubleshooting

  • Status: Not Configured on a room driver: check the Agent is installed with an API key and Auto Sync is On. Run Resync from Agent.
  • Claude is not on the touchscreen: set it Visible in Comfort with Modify and Apply To, then Refresh Navigators.
  • Last Error: API 401: the API key on the Agent is wrong or revoked.
  • Last Error: API 429 or 529: Anthropic is rate limiting or busy. Try again shortly.
  • Answers say "not confirmed": the command reached Control4 but the device did not change. Check the device (power, IR emitter, serial or network). Ask Claude to troubleshoot it.
  • A streaming app cannot be found: bind that app's mini app to the Apple TV or Samsung TV App Switcher in the room.
  • Dealer email not received: check Dealer Email on the Agent, the relay fields on a room driver, and Last Email Debug. "failed: 400" means no dealer email on the relay; "failed: 502" means the relay's mail server failed.
  • Room drivers stuck Not Configured after updating everything at once: wait a few minutes or run Resync from Agent.
  • Need details: Debug Mode = Print, reproduce, read the Lua tab.

Limitations

  • Cannot reboot the controller, change programming or refresh Navigators. Claude says so and offers to email the dealer.
  • Devices that report no state are described as "sent", not confirmed.
  • Needs internet and a working Anthropic API key. API usage costs are billed by Anthropic.
  • Music: starts services; picking a station or playlist is not supported.
  • Diagnostics cover network devices and devices that report an online state. Devices that are turned off, and idle drivers that still answer, are not reported as faults.

Version history highlights

  • Room 20261108i / Agent 20261108f: diagnostics device table on dealer tickets; devices with several network ports count as online if any port is connected.
  • Room 20261108h: music services through the room's speakers.
  • Room 20261108g: offers a dealer report and sends only after a yes; reports name the room.
  • Room 20261108e: keeps asking the Agent for settings after a restart.
  • Agent 20261108c to e: diagnostics read every device, email only on new problems.
  • Room 20261108a to d: every action read back and confirmed; Samsung TV mini apps; dealer email through the relay; encrypted code.
  • 20261106 to 20261107: tool set, room sources, schedules, memory, diagnostics, relay chat.

Still stuck? Ask Fixxy (bottom right) or open a ticket.