what a hackathon prototype can claim

2026-10

archipelago started at a hackathon: a layer where drones share what they’ve learned, not just what they’ve seen, with no central model in the loop. a convincing demo is easy to build in a weekend. what it’s allowed to claim is a different question.

the idea in one paragraph

each node trains its own policy. a node offers a model version to a neighbor; the neighbor validates it locally (shapes, finite values, size, age, provenance) before adopting, adapting or rejecting it. cut the link and everyone keeps acting on their own. the point is that useful behavior can spread across a fleet without a single point of failure.

what the experiments showed

learning beats idle, random and untrained policies on frozen test seeds, with a confidence interval that excludes zero. that’s real, and it’s also the weakest bar there is. hover the bars below.

does learning help? one-shot test, 20 unseen worlds
  • rule explorer50.7
  • learned policy34.9
  • random-29.5
  • idle-39.0
  • untrained net-180.1

source: archipelago experiments, T37 report. 10 training seeds, 2 drones, 16×16 world. confidence intervals are 95%, hierarchical.

it does not beat a simple rule-based explorer on return: 15.8 below, with an interval that stays below zero.

the live pilot

the pilot ran four real processes with real optimizer updates and real peer exchange, cutting the network in half during every episode and killing one node mid-run. the fleet that exchanged capabilities scored well above the isolated control. that’s the claim the project exists to make, so it’s the one to be most careful with: it comes from one training run per arm, and the intervals don’t include run-to-run variance, which the earlier study found to be large. the partition and crash-restart checks failed outright.

live pilot: four node processes, 20 test worlds
  • rule explorer28.8
  • fleet (exchanging)17.8
  • isolated nodes-24.9
  • idle-39.0

source: archipelago experiments, T30 report. one training run per arm, so run-to-run variance is not in the intervals. read it as a lead, not a replication.

so the honest summary is a promising signal, one run deep.

why say so

the reports state these limits next to the numbers. that’s the right default: write down what the evidence supports and what it doesn’t, then design the next experiment around the gap. the roadmap is terrain, richer candidate validation, and keeping capabilities alive as nodes drop out.

code and the devpost entry are linked from the project page.