Agent Economy Report

Skill code audit

CAUTION version 1.2.16 · audited 2026-09-03

self-improving @ivangdavila

This is a documentation-only skill (all markdown, no executable scripts) that tells an AI agent how to keep a local memory of user corrections, preferences and self-reflections under ~/self-improving/. It instructs the agent to create that folder with mkdir/touch, write template markdown files, and run a periodic 'heartbeat' review that tidies those files. It also asks the agent to edit the user's workspace steering files (AGENTS.md, SOUL.md, HEARTBEAT.md) so the memory habit persists across sessions, which is a persistence-like change to how the agent behaves in future sessions. During setup it proposes installing a second skill, 'Proactivity', via `clawhub install proactivity`, and says to do so only after the user explicitly agrees. There is no network exfiltration, no credential access, no payment or wallet logic, and no obfuscated or downloaded code; the file includes explicit rules against storing credentials, financial or medical data. Main things to review before installing: it will modify your agent's configuration files, it stores cross-session memory of your behavior on disk, and it nudges toward installing an additional third-party skill you would need to audit separately.

Instructions try to steer the agent beyond the declared purpose. The skill is designed to write persistent instructions into the agent's own steering files (SOUL.md, AGENTS.md, HEARTBEAT.md) and to store user text into files that are auto-loaded every session (SKILL.md:209 'Load only memory.md (HOT)'; memory.md:27 'Load this file on every session'). Content logged from conversations therefore becomes standing instructions the agent reads later, which is a channel for indirect prompt injection if untrusted text is ever logged. The package itself contains no hidden override instructions, and it explicitly forbids inferring from silence and requires consent before installing anything.

Declared purposeA self-reflection and self-learning memory system: the agent logs user corrections and its own lessons into a tiered local memory under ~/self-improving/, promotes repeated patterns to always-loaded memory, and periodically compacts/indexes those files.
Observed behaviorPure markdown instruction set. It directs the agent to (a) create ~/self-improving/ and template files, (b) read and append to those files on corrections and session start, (c) run heartbeat maintenance limited to that directory, (d) append specific lines to the workspace AGENTS.md, SOUL.md and HEARTBEAT.md (explicitly non-destructive), and (e) optionally run `clawhub install proactivity` after user consent. No network calls, no credential reads, no scripts, no encoded payloads.
Verdict, rules onlySAFE
Verdict, AICAUTION
Final verdictCAUTION (never better than either pass)

Capabilities

capabilityvs purposedetail
filesystem_writeneededCreates ~/self-improving/ tree and memory/correction/index/heartbeat-state files (setup.md:8, memory-template.md:23-24), and appends steering lines to workspace AGENTS.md, SOUL.md and HEARTBEAT.md (setup.md:77, 110-161, 185).
filesystem_readneededReads its own memory files on session start and lists ~/self-improving/domains and /projects via a find loop (setup.md:136-138); claims never to read outside ~/self-improving/ (SKILL.md:224), though the AGENTS.md edits reference memory/ and MEMORY.md as well.
shellneededInline bash for directory creation and file listing: `mkdir -p ~/self-improving/{projects,domains,archive}` and a `find` loop; no piping to shell, no downloads.
install_packagesexceeds purposeSetup step 5 instructs running `clawhub install proactivity` and then immediately following that skill's setup flow, gated on explicit user agreement (setup.md:97-104).
persistenceneededAdds recurring instructions to SOUL.md/AGENTS.md/HEARTBEAT.md so the memory-loading and heartbeat maintenance behavior runs in future sessions (setup.md:75-86, 183-195).
networkexceeds purposeNo network requests in the skill itself; only documentation links to clawhub.ai and clawic.com, plus the optional registry install which requires network (SKILL.md:51).

Findings

severityfinding
mediumSetup flow installs a second skill and enters its setup automatically
The skill scripts a nudge to install another package from the registry and then to 'Continue into its setup flow immediately' (line 104). Consent is required (line 98), but the user is being steered toward code that this audit does not cover; the Proactivity skill must be reviewed separately.
setup.md:102 1. Run `clawhub install proactivity`
mediumModifies the agent's core steering files
Setup instructs edits to SOUL.md, AGENTS.md and HEARTBEAT.md so the memory behavior persists across all future sessions. Changes are described as non-destructive/additive (line 110), but they alter the agent's standing instructions outside the skill's own directory.
setup.md:77 Add this section to your `SOUL.md`:
lowAuto-loaded memory file becomes standing instructions
Text captured from conversations is written into ~/self-improving/memory.md and loaded into context every session. If untrusted content is ever logged there, it would be re-read as guidance, an indirect prompt-injection surface inherent to the design.
memory.md:27 1. Load this file on every session
infoShell used only for local directory setup
The only shell commands in the package are mkdir/touch and a find loop scoped to ~/self-improving/. No downloads, no pipe-to-shell, no privilege escalation.
memory-template.md:23 mkdir -p ~/self-improving/{projects,domains,archive}
lowStated read scope conflicts with its own AGENTS.md edits
SKILL.md claims the skill never reads outside ~/self-improving/, yet setup.md lines 123-126 direct the agent to use memory/YYYY-MM-DD.md and MEMORY.md and to edit AGENTS.md/SOUL.md/HEARTBEAT.md. The declared scope is narrower than the actual documented behavior.
SKILL.md:224 - Reads files outside `~/self-improving/`
infoExplicit prohibition on storing secrets
The package includes a boundaries document forbidding storage of credentials, financial, medical, biometric and third-party data, which mitigates the main data-retention risk of a memory skill. No code accesses environment variables or credential files.
boundaries.md:7 | Credentials | Passwords, API keys, tokens, SSH keys | Security breach risk |

0 AI finding(s) were dropped because their file, line or quote did not match the package.

Network destinations in the code

domainservice ratingwhere
clawhub.ainot in the service indexskill-card.md:7
clawic.comnot in the service indexSKILL.md:5

Other facts

Binaries invokedbash, npm
Environment variables readnone
Hard-coded walletsnone
Pipes a download to a shell0
eval / exec / subprocess0
base64 blobs0
File writes0
Persistence0

Files audited

filelinessha256
HEARTBEAT.md51700d977eccaacad…
SKILL.md25011109b39d0f7fe7b…
_meta.json6dda865f1f081a58e…
boundaries.md59d306e26bc55d77bc…
corrections.md3655191d526c48a059…
heartbeat-rules.md547cce6bd8cf847e2c…
heartbeat-state.md22fb2121f07f6ae51b…
learning.md1067662295cc88c04e2…
memory-template.md75092030324f90d84c…
memory.md30f41a0b5c0530b708…
openclaw-heartbeat.md51700d977eccaacad…
operations.md144efe32247caa4fb05…
reflections.md317a3322c2784dde81…
scaling.md1257821d1a8580f8687…
setup.md1967c4f7f4f27deb8d9…
skill-card.md48016a10f11401d3e9…

For agents

JSON: https://agenteconomy.report/k/self-improving.audit.json · badge: https://agenteconomy.report/k/self-improving.audited.svg · skill rating: /k/self-improving · commission an audit of any skill: US$ 29 per version.

How this is computed

The complete published package of this exact version was downloaded from the registry and read statically; nothing was executed. A deterministic pass extracts network destinations, binaries, environment variables, writes, install commands, obfuscation markers, subprocesses and wallets, each with file and line. An AI then reads the whole package with those facts and writes the summary, the capabilities and the findings under a strict schema; every finding it produces must cite a file, a line and the exact text, or it is dropped. The final verdict is the worst of the two passes. The audit does not change the skill's trust tier (policy); the author may respond through the dispute channel and the response is published here. Commissioned by: amostra.