---
title: "Desktop Agent — AVCodex Docs"
description: "Desktop Agent — AVCodex documentation for AV integrators, programmers, and ops teams."
lang: en
json-ld:
---

[](/)

Solutions

[Pricing](/pricing)[The Signal](/blog)[Resources](/resources)

Learn

[Free AI Assessment](/scorecard)[Get Started →](/pricing)

[Documentation Home](/docs)

Guides 

Getting Started

-   [The Alchemist Copilot](/docs/guides/the-alchemist-copilot)
-   [Choosing a Model](/docs/guides/choosing-a-model)
-   [Skills & Templates](/docs/guides/skills-and-templates)
-   [Pricing & Usage](/docs/guides/pricing-and-usage)
-   [Understanding Tokens](/docs/guides/understanding-tokens)
-   [Maximize AVCodex Capabilities](/docs/guides/maximize-avcodex-capabilities)

Knowledge & Memory

-   [How Knowledge Sources Work](/docs/guides/how-knowledge-sources-work)
-   [Knowledge Retrieval Settings](/docs/guides/knowledge-retrieval-settings)
-   [User Memory](/docs/guides/user-memory)
-   [Consumer Brain](/docs/guides/consumer-brain)

Agent Capabilities

-   [Image Recognition](/docs/guides/image-recognition)
-   [Image Generation](/docs/guides/image-generation)
-   [Video Generation](/docs/guides/video-generation)
-   [Deep Research and Deep Thinking](/docs/guides/deep-research-and-deep-thinking)
-   [Heartbeat (Proactive AI Outreach)](/docs/guides/heartbeat-proactive-ai-outreach)
-   [Database Connections](/docs/guides/database-connections)
-   [Agent-to-Agent Links](/docs/guides/agent-to-agent-links)
-   [Message Tagging](/docs/guides/message-tagging)
-   [Lead Generation Forms](/docs/guides/lead-generation-forms)
-   [Multilingual Apps](/docs/guides/multilingual-apps)
-   [Understanding Evaluations](/docs/guides/understanding-evaluations)

Design & Experience

-   [Style Studio](/docs/guides/style-studio)
-   [Component Studio](/docs/guides/component-studio)
-   [HQ Profile](/docs/guides/hq-profile)
-   [Multiplayer Chat](/docs/guides/multiplayer-chat)
-   [Circles](/docs/guides/circles)
-   [Desktop Agent](/docs/guides/desktop-agent)

Voice & Phone

-   [Phone Numbers](/docs/guides/phone-numbers)
-   [Outbound Calling](/docs/guides/outbound-calling)
-   [Voice Cloning](/docs/guides/voice-cloning)

Publish & Share

-   [Embed Chat Widget](/docs/guides/embed-chat-widget)
-   [Custom Domains](/docs/guides/custom-domains)
-   [PWA Installation](/docs/guides/pwa-installation)
-   [AVCodex Sites](/docs/guides/avcodex-sites)
-   [Embed on Kajabi](/docs/guides/embed-on-kajabi)
-   [How to Use AVCodex with Claude Code](/docs/guides/how-to-use-avcodex-with-claude-code)

Monetization & Access

-   [Selling Access](/docs/guides/selling-access)
-   [Consumer Monetization](/docs/guides/consumer-monetization)
-   [Access Control](/docs/guides/access-control)
-   [Bring Your Own Auth](/docs/guides/bring-your-own-auth)
-   [Clever SSO for Schools](/docs/guides/clever-sso-for-schools)

Analytics & Operations

-   [Analytics & Chat History](/docs/guides/analytics-and-chat-history)
-   [Performance Dashboard](/docs/guides/performance-dashboard)
-   [Programmatic Usage Stats](/docs/guides/programmatic-usage-stats)
-   [Session Lifecycle Webhooks](/docs/guides/session-lifecycle-webhooks)
-   [Audit Logs](/docs/guides/audit-logs)

Teams & White-Label

-   [Team Management](/docs/guides/team-management)
-   [Enterprise Whitelabel](/docs/guides/enterprise-whitelabel)

Alchemist Platform

-   [Alchemist Tickets](/docs/guides/alchemist-tickets)
-   [Alchemist Getting Started](/docs/guides/alchemist-getting-started)
-   [Alchemist Working with Tickets](/docs/guides/alchemist-working-with-tickets)
-   [Alchemist Local Development](/docs/guides/alchemist-local-development)

Alchemist Operations

-   [Alchemist Environment Variables](/docs/guides/alchemist-environment-variables)
-   [Alchemist Deploys and Domains](/docs/guides/alchemist-deploys-and-domains)
-   [Alchemist Self-Healing](/docs/guides/alchemist-self-healing)

Alchemist API & Automation

-   [Alchemist API Keys](/docs/guides/alchemist-api-keys)
-   [Alchemist MCP Server](/docs/guides/alchemist-mcp-server)
-   [Alchemist Pipeline Configuration](/docs/guides/alchemist-pipeline-configuration)
-   [Alchemist Pipeline Permutations](/docs/guides/alchemist-pipeline-permutations)

Developer Platform

-   [Building Custom MCP Servers](/docs/guides/building-custom-mcp-servers)
-   [Consumer OAuth for Custom MCP Servers](/docs/guides/consumer-oauth-for-custom-mcp-servers)

AVCodex MCP Server

-   [Overview](/docs/guides/overview)
-   [MCP Reference](/docs/guides/mcp-reference)
-   [Setup & Installation](/docs/guides/setup-and-installation)
-   [Authentication](/docs/guides/authentication)
-   [Tools Reference](/docs/guides/tools-reference)
-   [Common Workflows](/docs/guides/common-workflows)
-   [Rate Limits](/docs/guides/rate-limits)

Custom Actions 

Pro Actions 

API 

Builder API 

Agentic Commerce (ACP) 

Integrations 

[Docs](/docs)/ Guides / Design & Experience 

# Desktop Agent

Last updated · MAR 2026 · [Read as Markdown](/docs/guides/desktop-agent.md)

The AVCodex Desktop Agent is a native macOS menu bar app. Hold a hotkey, speak, release. The agent sees your active app, the window title, the focused element, and selected text. It can type, paste, fire keyboard shortcuts, open URLs and apps, and take a screenshot when context isn't enough.

It's the fastest way to use AVCodex while you're elbows-deep in Crestron Home, SIMPL Windows, Q-SYS Designer, AMX RPM, or D-Tools without leaving your workflow.

> **Warning:** Desktop Agent is an Enterprise-only feature. Contact sales for access.

## [What it can do# ](#what-it-can-do)

Capability

Description

**Hold-to-talk voice**

Hold Fn (or a custom hotkey) to speak, release to send.

**Screen context**

The agent reads the active app, window title, focused element, and selected text.

**Type text**

Smart dictation into any app with agent intelligence.

**Press keys**

Execute keyboard shortcuts (Cmd+Enter, Tab, etc.).

**Paste text**

Insert larger blocks while preserving formatting.

**Open apps and URLs**

Launch applications or navigate to websites.

**Take screenshots**

Capture visual context when the accessibility tree isn't enough.

**Multi-agent switching**

Switch between agents from the menu bar.

## [System requirements# ](#system-requirements)

-   **macOS 14.0 (Sonoma)** or later.
-   Intel or Apple Silicon (native support).
-   Permissions: Accessibility, Microphone, Input Monitoring.

## [Getting started# ](#getting-started)

**1\. Install the app**

Download the Desktop Agent from your AVCodex dashboard. Drag it into your Applications folder.

**2\. Sign in**

Launch the app and sign in with your AVCodex builder account. Your session is stored securely in the macOS Keychain.

**3\. Grant permissions**

The app guides you through three macOS permissions:

-   **Accessibility.** Lets the agent read UI elements and simulate keystrokes in other apps.
-   **Microphone.** For voice input while holding the hotkey.
-   **Input Monitoring.** For global hotkey capture outside the app.

Each permission opens System Settings to the right location.

**4\. Configure your hotkey**

Default: **Fn** (hold to start, release to stop). Configurable to any key combination in the menu bar dropdown.

## [Use cases# ](#use-cases)

### [Smart dictation in any AV tool# ](#smart-dictation-in-any-av-tool)

Hold Fn and speak. In SIMPL Windows comments, it writes module headers. In a Crestron `.usp` file, it dictates a function comment. In Q-SYS Designer block comments, it explains a Lua control script. In Outlook, it drafts an RFP response.

### [Filling out commissioning paperwork# ](#filling-out-commissioning-paperwork)

A field tech opens the commissioning checklist PDF, holds Fn, and dictates room status, mounting verification, and signal flow notes. The agent fills the form fields directly.

### [Code refactoring in programming environments# ](#code-refactoring-in-programming-environments)

In VS Code working on a SIMPL# Pro project, select a method and say "refactor this to use async/await for the Cresnet poll." The agent sees the selection, rewrites it, and replaces the selection.

### [Cross-app workflows for service ops# ](#cross-app-workflows-for-service-ops)

"Take what's in this Excel device list and draft a service email to the client." The agent captures visible rack data, drafts the email, opens Mail, and pastes it.

### [Quick recall from your knowledge base# ](#quick-recall-from-your-knowledge-base)

"What was the IP scheme we standardized for Biamp Tesira on the Houston campus?" The agent speaks the answer aloud from memory. No app switch required.

## [The command bar# ](#the-command-bar)

Press **Cmd+K** to open a Spotlight-style floating overlay where you can:

-   Type commands to the active agent.
-   View recent actions and history.
-   Switch agents without opening the menu bar.

## [Screen context details# ](#screen-context-details)

When you hold the hotkey, the agent can see:

Context

What it reads

**Active app**

Which application is focused (SIMPL Windows, Q-SYS Designer, VS Code, Outlook, etc.).

**Window title**

The current window name (for example, "Boardroom4.smw - SIMPL Windows").

**Focused element**

Text fields, buttons, and UI elements via Accessibility APIs.

**Selected text**

Highlighted content in the active app.

**Screenshots**

Full window or screen region on request.

Context is captured on-demand only when the hotkey is held. There is no background recording.

## [Troubleshooting# ](#troubleshooting)

**Hotkey not working?**

-   Check Input Monitoring permission in System Settings, Privacy, Input Monitoring.
-   If you're using a custom hotkey, verify it doesn't collide with a system or app shortcut.

**Agent can't see the screen?**

-   Verify Accessibility permission is granted.
-   Some Electron apps (Slack, VS Code) expose limited accessibility data. The agent may request a screenshot instead.

**Text not typing into apps?**

-   The app uses multiple methods (character-by-character, clipboard paste, accessibility APIs) with automatic fallback.
-   If direct typing fails in a specific app, the agent falls back to clipboard paste.

> **Note:** Desktop Agent includes all voice capabilities. For voice configuration details, see the Voice Agents guide.

\*AVCodex · Your AV expertise. Amplified by AI.\*

Was this helpful? 

[Edit this page →](#)

[

Previous

Circles

](/docs/guides/circles)[

Next

Phone Numbers

](/docs/guides/phone-numbers)

On this page

-   [What it can do](#what-it-can-do)
-   [System requirements](#system-requirements)
-   [Getting started](#getting-started)
-   [Use cases](#use-cases)
-   [Smart dictation in any AV tool](#smart-dictation-in-any-av-tool)
-   [Filling out commissioning paperwork](#filling-out-commissioning-paperwork)
-   [Code refactoring in programming environments](#code-refactoring-in-programming-environments)
-   [Cross-app workflows for service ops](#cross-app-workflows-for-service-ops)
-   [Quick recall from your knowledge base](#quick-recall-from-your-knowledge-base)
-   [The command bar](#the-command-bar)
-   [Screen context details](#screen-context-details)
-   [Troubleshooting](#troubleshooting)

[](/)

The AI platform built exclusively for professional AV. Build, deploy, and sell AI tools that understand your industry.

### Platform

-   What You Can Build
-   Templates
-   [Pricing](/pricing)

### Services

-   [Done-For-You](/pricing)
-   [Academy](/academy)
-   [Contact](/contact)

### Company

-   About
-   [The Signal](/blog)
-   [Docs](/docs)
-   [LinkedIn](#)

© 2026 AVCodex. A Future Ready Holdings Inc. product. SOC 2 Type II Certified · HIPAA Compliant