r/ethdev • u/biryaniAssasin • 3h ago
My Project We paid 25,011 x402 API calls on Base with our own USDC and recorded what came back. 6.3% settled and failed the buyer. Data with transaction hashes.
x402 is the HTTP 402 flow: request, 402 with a USDC price, sign an EIP-3009 transfer, retry, facilitator settles. Nothing in it tells the buyer whether the seller will deliver or charge the listed price, so since October we have been the paying customer of every seller we could find in the Coinbase Bazaar.
Numbers as of today (live):
- 25,011 paid calls to 1,036 sellers, about 135 USDC in total
- 1,587 failed the buyer: 6.3%, 95% Wilson interval 6.0% to 6.7%
- 1,080 of those settled on-chain, then returned 4xx/5xx, an empty or wrong-typed body, or nothing within the seller's own declared timeout
- 507 quoted a price above the one the seller lists in the Bazaar; the official client has no expected price to compare with, so it paid every one; 428 were at 2x or more
- Of 312 sellers with at least 30 paid calls, 228 have never failed one; 27 are rated avoid
- The top 20 sellers by 30-day on-chain inflow fail at 10.3% [9.5%, 11.1%]; a random tail at 3.6% [3.1%, 4.0%]
The protocol finding: the exact scheme has no idempotency key. We sent one intent twice with fresh signatures to 10 sellers and 5 settled both. A plain retry after a dropped connection settled a second time at 5 of 10. Each new signature is a new payment, so a client that retries after a timeout or a paid 500 pays again unless it stores the nonce per intent and replays the stored result.
Method: u/x402/fetch 2.28, exact only, no retries, caps in code before any signature (0.50 USD a call, 20 a seller a day, 100 a day). Every settlement is matched to the AuthorizationUsed log for the nonce we signed. Wrong goods are unmeasured (no per-service schemas), so every rate is a lower bound. The sample is weighted to cheap calls; the dollar-weighted rate is 18.5% with an effective n of about 3,300, so treat it with care.
Harness, MIT: https://github.com/sarmadahsan/x402-audit Data, hourly, with hashes: https://github.com/sarmadahsan/paidfor-data Method and limitations: https://paidfor.dev/methodology
Disclosure: we run paidfor.dev, which publishes these as per-seller verdicts, and maintain two buyer-side clients on the official SDK. Sellers do not pay for ratings; every seller page has a reply route and one seller has already used it to get a correction published.