Feat: Adding Arweave storage via AR.IO Network by kempsterrrr · Pull Request #12 · agent0lab/agent0-ts

kempsterrrr · 2025-11-20T16:40:09Z

Adds permanent storage option for agent registrations and feedback using Arweave via AR.IO Network's Turbo SDK.

What's new:

Agent.registerArweave() - Register agents with permanent Arweave storage
ArweaveClient - Upload and retrieve data from Arweave with parallel gateway fallback
Arweave-first feedback storage with IPFS fallback
Comprehensive tagging for searchability (12 tags for registrations, 7-14 for feedback)
Shared utilities - formatRegistrationFileForStorage() ensures consistent ERC-8004 formatting across both IPFS and Arweave

Usage

const sdk = new SDK({
  chainId: 11155111,
  rpcUrl: 'https://...',
  signer: privateKey,
  arweave: true, // Enable Arweave storage
});

await agent.registerArweave();

Key features

Free uploads <100KB via Turbo SDK (typical files: 1-4KB)
EVM signatures only (no Arweave JWK needed)
Parallel 4-gateway retrieval for reliability
Complete parity with IPFS implementation
No breaking changes (opt-in via config)
No code duplication between storage layers

Files changed

21 files: 5,807 additions, 288 deletions

6 new files (ArweaveClient, utilities, tests)
Updated SDK, Agent, FeedbackManager
46 unit tests added (all passing)

Dependencies

Added: @ardrive/turbo-sdk (^1.23.0)

Phase 1 of Arweave integration - DRY principle implementation. - Create src/utils/registration-format.ts with formatRegistrationFileForStorage() - Refactor IPFSClient.addRegistrationFile() to use shared utility - Reduces code duplication, preparing for ArweaveClient implementation - No functional changes, pure refactoring The shared utility will be used by both IPFSClient and ArweaveClient to ensure consistent ERC-8004 formatting across storage backends.

…rieval Phase 2 of Arweave integration - core client implementation. - Add ArweaveClient class with Turbo SDK for uploads and parallel gateway fallback for retrieval - Implement upload methods: add(), addJson(), addRegistrationFile() - Implement retrieval methods: get(), getJson(), getRegistrationFile() - Use EthereumSigner for EVM-based authentication - Match IPFSClient pattern with Promise.allSettled for gateway fallback - Add ARWEAVE_GATEWAYS constant with 4 gateway URLs - Add ARWEAVE_GATEWAY and ARWEAVE_UPLOAD timeout constants - Install @ardrive/turbo-sdk dependency (268 packages) - Export registration-format utility Files created: src/core/arweave-client.ts (177 lines) Files modified: src/utils/constants.ts, src/utils/index.ts, package.json

Add Arweave storage support to SDK class with configuration, initialization, and ar:// URI handling in registration file loading. Changes: - Add Arweave config fields to SDKConfig (arweave, arweavePrivateKey, arweaveToken, arweaveTestnet) - Add _arweaveClient property and initialization in constructor - Add _initializeArweaveClient() method (reuses signer or separate key) - Update _loadRegistrationFile() to handle ar:// URIs with parallel gateway fallback - Add arweaveClient getter for public access - Import ArweaveClient and ARWEAVE_GATEWAYS constants Implementation follows same pattern as IPFS integration for architectural consistency. Uses ArweaveClient for parallel gateway fallback when configured, falls back to direct arweave.net fetch otherwise.

- Add registerArweave() method to Agent class (lines 367-458) - Export ArweaveClient and ArweaveClientConfig in src/index.ts - Update ARWEAVE_INTEGRATION_PLAN.md with completion status Follows identical pattern to registerIPFS() for consistency. Handles both first-time registration and updates to existing agents.

Add test suite for Arweave storage functionality: - Unit tests for shared ERC-8004 formatting utility (10 tests) - Integration tests for Arweave registration (3 tests, mirrors IPFS pattern) - Update test configuration with Arweave settings - Update implementation plan with Phase 7 completion status Test files achieve parity with existing IPFS test coverage.

- Add generateArweaveTags() utility for ERC-8004 metadata tagging - Support 12 tag types: Essential, Capability Flags, Metadata - All tags cryptographically signed via EthereumSigner (Turbo SDK) - Update ArweaveClient to accept and apply tags on upload - Add SDK_VERSION constant for versioned App-Name tags - Add comprehensive unit tests (12/12 passing) TEMPORARY: GraphQL type fixes in sdk.ts and subgraph-client.ts for local testing - MUST BE REVERTED before final release See Pre-Merge Checklist in ARWEAVE_INTEGRATION_PLAN.md

ries9112 · 2025-11-21T17:25:34Z

Worked great for me! https://arweave.net/-2SgZvrwECOTPv3cNpbBSLJQuG0LrEiAOvbHFmGs3xk

But on the subgraph side would need to make sure everything is working correctly as well, currently I see this with null on the registrationFile:

{
  agents(where: {agentId: 1196}) {
    id
    chainId
    agentId
    agentURI
    createdAt
    owner
    totalFeedback
    updatedAt
    agentURIType
    registrationFile {
      a2aEndpoint
    }
    operators
    lastActivity
  }
}

But as far as the changes relating to the ts library I didn't run into any problems at all 👍

ries9112 · 2025-11-21T17:57:46Z

will try the subgraph PR as well and report back

ries9112 · 2025-11-22T02:05:28Z

Left an update on the subgraph PR, unfortunately not working for me, but would love to figure out the issue together

…ation

- Convert ArweaveClient to use dynamic imports matching IPFSClient pattern - Add error state checking for Turbo SDK initialization - Move from eager to lazy initialization in constructor - Reduces bundle size by ~500KB for read-only use cases

kempsterrrr · 2025-12-17T12:43:34Z

Shipped a few updates to this PR after chatting with @MarcoMetaMask

removes enum for ArweaveClient
updates Turbo package with reduce bundle size and addedd dynmic imports so only included when arweave is used
some small error handling fixes

Not fixed is the if/else flow for selecting storage providers for feedback, still favours Arweave if it's available will raise this separately and change if preferred.

Jerry confirmed separately in TG the subgraph is working

William Kempster added 20 commits November 17, 2025 16:23

creating plan

88699c8

updating plan to account for data sizes and 100kb free turbo

04e4f57

final plan

5f0ceb7

final plan

4f7777b

docs: update implementation checklist with Phase 3 completion

a850072

adding tagging plan + verifiability

9284fbf

summaring working in planning doc

573e28e

Remove temporary GraphQL type workarounds

4a18cd1

Simplify Arweave configuration by removing testnet and token parameters

01aa184

removing Arweave planning file

6a31471

Add documentation for Arweave storage integration

befec8b

feat: add Arweave feedback storage with comprehensive tagging

a97acf8

fix: handle Wallet and Signer types in ArweaveClient initialization

07927d9

adding arweave to package.json and updating comments in sdk

44acd32

William Kempster added 4 commits December 12, 2025 14:16

Removing Arweave enum in favour of arweavePrivateKey in SDK initializ…

b95130f

…ation

chore: bumping turbo version to reduce final build size

6aac7e2

fix: replacing .js extensions on imports

8f78c60

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Feat: Adding Arweave storage via AR.IO Network#12

Feat: Adding Arweave storage via AR.IO Network#12
kempsterrrr wants to merge 24 commits intoagent0lab:mainfrom
kempsterrrr:feat/ario-storage

kempsterrrr commented Nov 20, 2025

Uh oh!

ries9112 commented Nov 21, 2025 •

edited

Loading

Uh oh!

ries9112 commented Nov 21, 2025

Uh oh!

ries9112 commented Nov 22, 2025

Uh oh!

kempsterrrr commented Dec 17, 2025 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

kempsterrrr commented Nov 20, 2025

Uh oh!

ries9112 commented Nov 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

ries9112 commented Nov 21, 2025

Uh oh!

ries9112 commented Nov 22, 2025

Uh oh!

kempsterrrr commented Dec 17, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

ries9112 commented Nov 21, 2025 •

edited

Loading

kempsterrrr commented Dec 17, 2025 •

edited

Loading