Running agents locally
This guide walks through running agents with fullsend on your machine. It sets the base to help you run any agent, default or custom. Both macOS and Linux are supported with Podman as the container runtime.
For building fullsend from source, see the "Building from source" section in CONTRIBUTING.md.
Prerequisites
| Requirement | macOS | Linux |
|---|---|---|
| Container runtime | Podman Desktop with a running machine | Podman |
| OpenShell | Pinned per release | Same |
| GCP project | Agent Platform API enabled with Claude models enabled | Same |
| GCP credentials | Service account key (see section below) | Same |
| GitHub PAT | Classic PAT with repo scope (see section below) | Same |
Download the fullsend CLI
Download the latest release from GitHub Releases. Pick the archive matching your platform:
| Platform | Archive |
|---|---|
| macOS (Apple Silicon) | fullsend_{version}_darwin_arm64.tar.gz |
| macOS (Intel) | fullsend_{version}_darwin_amd64.tar.gz |
| Linux (x86_64) | fullsend_{version}_linux_amd64.tar.gz |
| Linux (arm64) | fullsend_{version}_linux_arm64.tar.gz |
Extract and move to a directory in your PATH:
tar xzf fullsend_{version}_darwin_arm64.tar.gz
mv fullsend_{version}_darwin_arm64/fullsend $HOME/.local/bin/Verify the installation:
Note: the fullsend binary is not signed, on macOS you need to run xattr -d com.apple.quarantine fullsend
fullsend --versionInstall OpenShell
OpenShell provides the sandbox runtime. There are multiple ways to install it, here we use one similar to how we download it on Fullsend. Use the version fullsend is pinned to — the source of truth is .github/scripts/openshell-version.sh in the fullsend repo at your release tag (also printed on Fullsend workflow runs).
export OPENSHELL_VERSION=0.0.116 # check the pin file for the current version
curl -LsSf https://raw.githubusercontent.com/NVIDIA/OpenShell/v${OPENSHELL_VERSION}/install.sh | OPENSHELL_VERSION=v${OPENSHELL_VERSION} sh
openshell --versionGet Google Cloud Platform credentials
Fullsend uses GCP's VertexAI to run inference, so you need a GCP project. After authenticating on gcloud run:
gcloud iam service-accounts create fullsend-local \
--display-name="Fullsend local agent runner" \
--project={project-id}
gcloud projects add-iam-policy-binding {project-id} \
--member="serviceAccount:fullsend-local@{project-id}.iam.gserviceaccount.com" \
--role="roles/aiplatform.user"
gcloud iam service-accounts keys create fullsend-local-credentials.json \
--project={project-id} \
--iam-account=fullsend-local@{project-id}.iam.gserviceaccount.com
chmod 600 fullsend-local-credentials.jsonThis creates a service account and a local file to authenticate with that account. If you lack permissions give yourself or ask your GCP administrator for permissions or a key for local development.
Create an environment file somewhere secure, current directory or $HOME may be a good option. In our example it is ./fullsend-gcp.env:
# fullsend-gcp.env
ANTHROPIC_VERTEX_PROJECT_ID={project-id}
GOOGLE_CLOUD_PROJECT={project-id}
CLOUD_ML_REGION=global
GOOGLE_APPLICATION_CREDENTIALS=fullsend-local-credentials.jsonTip: if you plan to run the CLI from the container image instead of the native binary, keep the key file and env file in your working directory — the container mounts it as /work and resolves GOOGLE_APPLICATION_CREDENTIALS relative to it.
Get an OpenAI key (GPT on pi or codex)
GPT models run on the pi and codex runtimes, with the credential kept out of the sandbox by an OpenShell provider. In CI the runner obtains it from OpenAI with the job's GitHub identity (OpenAI Workload Identity); on your machine there is no such identity, so use an API key from the same OpenAI project. Put it in an environment file, like the GCP settings above — never in the harness YAML and never under env.sandbox (the runner refuses to export it into the sandbox):
# fullsend-openai.env
OPENAI_API_KEY=sk-...Then pick a GPT model when you run:
fullsend run triage --runtime pi --model openai/gpt-5.6-luna \
--env-file fullsend-openai.env --env-file fullsend-triage.env ...Codex takes the same key and the same harness requirements — swap --runtime pi for --runtime codex.
A committed inference.openai block in the repository's config.yaml is ignored here while OPENAI_API_KEY is set (there is no GitHub OIDC endpoint to exchange with), so the same checkout works in CI and on your machine.
The agent's harness must declare the provider (providers: [openai]; both the definition and the fullsend-openai profile are built into fullsend, nothing needs to be on disk) and a sandbox policy (policy: policies/base.yaml — the fleet's agents already have it; a custom harness needs it because the sandbox image's default policy leaves an uninspected route to api.openai.com, which the gateway refuses to carry the credential over). The sandbox only ever sees a placeholder; the provider holding your key belongs to this run, expires an hour after the run at the latest and is deleted when the run ends.
Get a GitHub token
Create a fine grained token at GitHub. The permissions depend on the agent to execute, but generally with Write access to Issues, Contents and Pull Requests you cover most of them. If this is not enough, explore the codebase or ask in our community channels.
Clone repositories
First clone your target repository locally:
git clone git@github:{org}/{target_repository} /tmp/target-repoNext clone the repository where the agent definitions live. The canonical source is fullsend-ai/agents. To learn more about custom agents visit Configuring Agents.
git clone --depth 1 https://github.com/fullsend-ai/agents.git /tmp/fullsend-agents/Run default agents
Depending on the agent you want to run you need a different set of environment variables. Check the variables they need in their environment files, referenced in their harness files.
Tip: use --no-post-script in the fullsend run calls to avoid side-effects. You can also use --keep-sandbox to debug failures (but remember to remove them).
Tip: fullsend run uses multiple tools on your system. Instead of installing them all, you can use a container image fullsend publishes — see Run from a container below.
Note: to run custom agents set --fullsend-dir to the directory where your custom agent definitions exist.
Triage agent
Add to an env file:
# fullsend-triage.env
GH_TOKEN={github-pat}
GITHUB_ISSUE_URL=https://github.com/{org}/{repo}/issues/{issue_num}fullsend run triage \
--fullsend-dir /tmp/fullsend-agents/ \
--target-repo /tmp/target-repo/ \
--env-file fullsend-gcp.env \
--env-file fullsend-triage.envReview agent
Add to an env file:
# fullsend-review.env
# In CI, REVIEW_TOKEN is auto-minted by the binary when --mint-url is provided.
# For local runs, supply a GitHub PAT manually:
REVIEW_TOKEN={github-pat}
GITHUB_PR_URL="https://github.com/{org}/{repo}/pull/{pr_number}"
PR_NUMBER="{pr_number}"
REPO_FULL_NAME="{org}/{repo}"fullsend run review \
--fullsend-dir /tmp/fullsend-agents/ \
--target-repo /tmp/target-repo/ \
--env-file fullsend-gcp.env \
--env-file fullsend-review.envCode agent
Add to an env file:
# fullsend-code.env
# In CI, GH_TOKEN and PUSH_TOKEN are auto-minted by the binary when --mint-url is provided.
# For local runs, supply GitHub PATs manually:
GH_TOKEN={github-pat}
PUSH_TOKEN={github-pat}
PUSH_TOKEN_SOURCE=pat
GITHUB_ISSUE_URL=https://github.com/{org}/{repo}/issues/{issue_num}
REPO_FULL_NAME={org}/{repo}
ISSUE_NUMBER={issue_num}
CODE_ALLOWED_TARGET_BRANCHES=main
REPO_DIR=/tmp/repo-dir
GITHUB_WORKSPACE=/tmp/fullsend run code \
--fullsend-dir /tmp/fullsend-agents/ \
--target-repo /tmp/target-repo/ \
--env-file fullsend-gcp.env \
--env-file fullsend-code.envChoosing the runtime
Every example above runs on Claude Code, the default runtime. Fullsend also has two opt-in runtimes — pi and codex — and any example on this page runs on either by adding one flag to the same command:
fullsend run triage \
--fullsend-dir /tmp/fullsend-agents/ \
--target-repo /tmp/target-repo/ \
--env-file fullsend-gcp.env \
--env-file fullsend-triage.env \
--runtime piCodex is selected the same way (--runtime codex); it runs OpenAI models only, so pair it with --model openai/gpt-5.6-luna and the OpenAI key above.
Everything else about runtimes lives in one place: Agent runtimes for selecting and overriding the runtime, model and effort — per run, or per agent in config.yaml — and Pi › Running it locally or Codex › Running it locally for what a local run on either needs, its models and its troubleshooting.
Remote resource flags
When your harness references URL-based skills with transitive dependencies, you can tune resolution limits:
| Flag | Default | Description |
|---|---|---|
--forge | (auto-detect) | Forge platform to use (github, gitlab). Auto-detected from CI env vars (GITHUB_ACTIONS, GITLAB_CI) when omitted |
--max-depth | 10 | Maximum dependency depth for transitive resolution (0 disables) |
--max-resources | 50 | Maximum total remote resources fetched per harness |
--offline | false | Reject network fetches; only use cached remote resources |
Lock files
If a lock.yaml file exists in the fullsend directory, fullsend run uses it to skip re-resolution when the harness has not changed since the lock was generated. Generate or update a lock file with:
fullsend lock code --fullsend-dir /path/to/.fullsendTo lock all harnesses in the directory at once:
fullsend lock --all --fullsend-dir /path/to/.fullsendWhen --forge is specified, only that platform variant is locked. When omitted, all forge variants defined in the harness are resolved and the union of their dependencies is locked.
When the lock entry is current (harness SHA256 matches), dependencies are resolved from the local cache without network access. If the harness has changed or a cached artifact is missing, fullsend run falls back to normal network resolution and prints a warning suggesting you re-run fullsend lock.
Use --update to force re-resolution even if the lock entry appears current.
Status notification flags
When running agents locally you can optionally enable status comments on the target issue/PR. These flags mirror what the CI workflows pass automatically:
| Flag | Description |
|---|---|
--run-url | URL of the CI/CD run shown in the status comment |
--status-repo | Repository (owner/repo) to post status comments on |
--status-number | Issue or PR number for status comments |
--mint-url | Mint service URL for on-demand status comment tokens (default: $FULLSEND_MINT_URL) |
--forge | Forge platform (github or gitlab); auto-detected from CI env vars when omitted |
Example:
fullsend run triage \
--fullsend-dir /tmp/fullsend-agents/ \
--target-repo /tmp/target-repo/ \
--env-file fullsend-gcp.env \
--env-file fullsend-triage.env \
--status-repo myorg/myrepo \
--status-number 42 \
--run-url "https://github.com/myorg/myrepo/actions/runs/12345"For GitLab repositories, use --forge gitlab instead of --mint-url. The agent reads GITLAB_TOKEN from the environment and does not require the mint service. See the operations guide for required environment variables.
Status comment behavior is configured via status_notifications in config.yaml. See Status Notifications.
Run from a container
Instead of downloading the fullsend binary and installing its host-side dependencies, you can run the CLI from the released runner image:
podman pull ghcr.io/fullsend-ai/fullsend-runner:latestYou still need on the host: Podman, OpenShell (the gateway and sandboxes stay on the host; only the CLI moves into the container), GCP credentials, and a GitHub token.
Mount your OpenShell client config and the same paths you would pass to a native fullsend run. --network=host lets the containerized CLI reach the gateway:
podman run --rm -it --network=host \
-v "$HOME/.config/openshell:/root/.config/openshell" \
-v /tmp/fullsend:/tmp/fullsend \
-v /tmp/fullsend-agents:/tmp/fullsend-agents \
-v /tmp/target-repo:/tmp/target-repo \
-v "$PWD:/work" \
ghcr.io/fullsend-ai/fullsend-runner:latest \
run triage \
--fullsend-dir /tmp/fullsend-agents/ \
--target-repo /tmp/target-repo/ \
--env-file fullsend-gcp.env \
--env-file fullsend-triage.envThe image's working directory is /work, so relative paths in --env-file resolve against the mounted current directory. Run artifacts are written to /tmp/fullsend/ — mount it (or pass --output-dir pointing at a mounted path) to keep them on the host.
macOS: use /private/tmp/... for the /tmp mounts above (and $(pwd -P) instead of $PWD) — see "Container image mounts" in the macOS platform notes. No other change is needed: fullsend detects when it's running inside a container whose loopback doesn't reach the gateway — the case on a macOS Podman machine, where --network=host shares the VM's network namespace, not the Mac's — and transparently points the OpenShell client at host.containers.internal instead. See "Container image" in the macOS platform notes if you need a manual override.
When using --keep-sandbox the CLI within the container is not able to gather podman logs, because the podman binary is not installed within. Run podman logs <sandbox-container> manually on your machine.
On SELinux-enforcing hosts (Fedora/RHEL), bind mounts may need the :z suffix. Prefer adding :z only to the /tmp and $PWD mounts — relabeling ~/.config/openshell touches files the host gateway also reads.
Simulating Fullsend's real customization layers
Fullsend automatically aggregates different layers of information before running fullsend run. In case you want to test how customizations impact default agents, or you custom agents, follow the next steps.
If your organization uses config-driven agents registered in config.yaml, pass your .fullsend config repo as --fullsend-dir:
git clone --depth 1 https://github.com/{org}/.fullsend.git /tmp/org-fullsend/When you execute fullsend run, pass --fullsend-dir as /tmp/org-fullsend/. See Bring Your Own Agent for the config-driven approach.
Platform notes
macOS
- Podman machine: ensure the Podman machine is running (
podman machine start) before invoking fullsend. The CLI does not start it automatically. - Podman host-gateway: if sandbox creation fails with
unable to replace "host-gateway", sethost_containers_internal_ip = "192.168.127.254"under[containers]in~/.config/containers/containers.confand restart the Podman machine. - Architecture mismatch: if your sandbox image uses a different CPU architecture than the host (e.g. amd64 image on an arm64 Mac via QEMU emulation), set
FULLSEND_SANDBOX_ARCH=amd64so the CLI downloads the correct binary. This is not needed in the typical setup where the Podman VM matches the host arch. - Container image:
--network=hostshares the Podman VM's network namespace, not the Mac's, so a gateway configured at127.0.0.1is unreachable from inside the container. Fullsend detects this automatically and redirects the containerized CLI to whichever ofhost.containers.internal(Podman) orhost.docker.internal(Docker) is actually reachable (fullsend-ai/fullsend#5261) — no manual steps needed. This depends on one of those names resolving inside the container; if neither does, see the Podman host-gateway note above. To override the detection yourself, setOPENSHELL_GATEWAY_ENDPOINT(e.g.https://host.containers.internal:17670) before running the container — an explicit value here is never overwritten. Always usehttps://: checkopenshell gateway list'sAUTHcolumn, and if it saysmtls, OpenShell will present your client certificate to whatever host this points at, so only point it at a gateway you trust. - Container image mounts: bind-mounting
/tmp/...paths fails withstatfs: no such file or directoryon macOS — Podman Desktop's VM shares/Users,/private, and/var/foldersvia virtiofs, but not the literal/tmppath, and Podman does not resolve the/tmp→/private/tmpsymlink before mounting. Use/private/tmp/...(and$(pwd -P)instead of$PWD). The container example above already accounts for this.
Linux
- Rootless Podman: Podman runs rootless by default. Ensure your user has subuids/subgids configured (
grep $USER /etc/subuid). If not, runsudo usermod --add-subuids 100000-165535 --add-subgids 100000-165535 $USER && podman system migrate. - Gateway connectivity: The sandbox does not move to Ready state and its logs say that it can't connect to the server (gateway). It is likely that you need to bind the gateway to
0.0.0.0. AddOPENSHELL_BIND_ADDRESSon$HOME/.config/openshell/gateway.envand restart theopenshell-gatewayservice. - SELinux: on Fedora/RHEL, bind-mounted volumes may need the
:zsuffix for standalonepodman run. OpenShell handles this automatically.
Troubleshooting
Sandbox creation fails immediately
- Check that
podman machine starthas been run (macOS only) - Verify OpenShell is installed:
openshell --version - Verify the gateway is running:
openshell gateway list
Gateway not running or no openshell gateway running
- Check the
openshell-gatewayservice. - Verify it's healthy:
curl -sf https://127.0.0.1:8081/healthz - Check that it's registered:
openshell gateway list
Syntax error: "(" unexpected inside sandbox
- The macOS Mach-O binary was injected instead of a Linux ELF. Update to fullsend 0.4.0+ which auto-resolves the correct binary, or provide one explicitly with
--fullsend-binary
Agent fails with missing environment variable
- Check your env file contains all variables listed in the agent's harness YAML (
harness/{agent}.yamlin the.fullsendconfig directory)
arm64 sandbox image pull fails
- The default
:latesttag is amd64-only. AddFULLSEND_SANDBOX_IMAGE=ghcr.io/fullsend-ai/fullsend-sandbox:devto your env file
unable to replace "host-gateway" on macOS
- Set
host_containers_internal_ip = "192.168.127.254"under[containers]in~/.config/containers/containers.confand restart the Podman machine
Debugging network policies locally
When customizing network policies, running agents locally lets you inspect sandbox artifacts directly instead of pushing changes and waiting for CI. This section describes what a local fullsend run produces and how to use the output to iterate on network policy allowlists.
Run directory structure
Every fullsend run creates a run directory. By default this is under /tmp/fullsend/; override it with --output-dir:
fullsend run triage \
--fullsend-dir /tmp/fullsend-agents/ \
--target-repo /tmp/target-repo/ \
--env-file fullsend-gcp.env \
--env-file fullsend-triage.env \
--output-dir /tmp/my-debug-outputThe run directory is printed at the end of every run under Run directory. Its layout:
<run-dir>/
logs/
openshell-sandbox.log # OCSF events: network, process, policy decisions
openshell-gateway.log # Gateway-side events
iteration-1/
output/ # Agent output files (agent-result.json, etc.)
transcripts/ # Agent conversation transcripts (.jsonl)
metrics.json # Behavioral metrics (tokens, cost, duration)
security/
findings.jsonl # Security scan findingsKey artifacts for network policy debugging
openshell-sandbox.log is the primary artifact. It contains OCSF events for every network connection, HTTP request, process launch, and policy evaluation that occurred inside the sandbox. Each event records whether the connection was allowed or denied and which policy rule applied.
Look for DENIED entries to find connections your policy rejected:
grep -i DENIED <run-dir>/logs/openshell-sandbox.logEach denied entry includes the destination host, port, and the binary that attempted the connection — enough to decide whether to add the endpoint to your policy.
openshell-gateway.log contains gateway-side events. Useful when a connection fails before reaching the sandbox (e.g., provider misconfiguration or gateway routing issues).
Debugging workflow
Start with a restrictive policy. Create or modify a policy YAML that blocks the endpoint you want to test. See Building custom agents — Sandbox policy for the policy format.
Run the agent locally with
--keep-sandbox:bashfullsend run <agent> \ --fullsend-dir /tmp/fullsend-agents/ \ --target-repo /tmp/target-repo/ \ --env-file fullsend-gcp.env \ --env-file fullsend-<agent>.env \ --keep-sandbox \ --no-post-script--keep-sandboxpreserves the sandbox container after the run finishes, letting you exec into it for further inspection.--no-post-scriptprevents side effects (issue comments, PR creation) while debugging.Inspect the sandbox log for denied connections:
bashgrep -i DENIED <run-dir>/logs/openshell-sandbox.logIf the analyze-transcript skill is available, you can use the network analysis commands for a structured view:
bashpython3 skills/analyze-transcript/analyze-transcript.py network \ <run-dir>/logs/openshell-sandbox.log python3 skills/analyze-transcript/analyze-transcript.py netsearch "DENIED" \ <run-dir>/logs/openshell-sandbox.logUpdate your policy to allow the blocked endpoints, then re-run. Each cycle takes only the time to start a sandbox and run the agent — no push or CI wait.
When done, clean up the kept sandbox:
bashopenshell sandbox delete <sandbox-name>The sandbox name is printed during the run and also shown in the
--keep-sandboxwarning message at the end.
Entering a kept sandbox
When you pass --keep-sandbox, the CLI prints a command to exec into the sandbox:
openshell sandbox exec --tty --name <sandbox-name> -- bashInside the sandbox you can inspect the workspace, re-run commands the agent tried, or verify that network access works as expected for a specific host:
curl -sf https://api.example.com/healthzTips
- Network summary:
openshell-sandbox.logcan be large. Usegrep -c DENIEDto get a count before reading individual entries. - Iterate fast: after updating your policy YAML, you do not need to reinstall or reconfigure OpenShell — just re-run
fullsend runwith the updated policy file. - Compare runs: diff two sandbox logs to confirm that a policy change resolved the denials:bash
diff <(grep DENIED run-1/logs/openshell-sandbox.log) \ <(grep DENIED run-2/logs/openshell-sandbox.log)
See also
- Agent runtimes — choosing a runtime and overriding runtime, model and effort per run or per agent
- Pi › Running it locally — what a local pi run needs, its models and troubleshooting
- fullsend run — the full flag reference
- Configuring agent behavior — harness configuration and
base:composition
