Skip to content

Chains

Completion per chain: the share of each chain’s tasks the entry completed, with the number of tasks it was scored on. Every task runs on a local fork of its chain. The open track covers 9 EVM chains (Ethereum, Gnosis, Polygon, Arbitrum, Optimism, Base, Celo, Mode, Robinhood); the held-out track covers 8, with none on Robinhood Chain.
Completion per chain
ChainClaude CodeDeepSeek V4.1 FlashClaude CodeOpus 5.5OpenClawDeepSeek V4.1 FlashCodexGPT-5.6 SolHermesDeepSeek V4.1 Flasholas-ocb-agentDeepSeek V4.1 FlashCodexDeepSeek V4.1 Flash
Polygon32 tasks98%(32)94%(32)96%(32)96%(32)96%(32)93%(32)94%(32)
Gnosis31 tasks96%(31)96%(31)95%(31)97%(31)92%(31)87%(31)87%(31)
Arbitrum20 tasks99%(20)97%(20)94%(20)91%(20)96%(20)98%(20)94%(20)
Mode19 tasks99%(19)100%(19)96%(19)89%(19)96%(19)89%(19)93%(19)
Base18 tasks100%(18)91%(18)97%(18)92%(18)93%(18)89%(18)96%(18)
Optimism17 tasks99%(17)96%(17)93%(17)98%(17)94%(17)93%(17)76%(17)
Celo5 tasks40%(5)40%(5)40%(5)56%(5)40%(5)44%(5)40%(5)
Ethereum5 tasks96%(5)100%(5)100%(5)92%(5)96%(5)96%(5)80%(5)

Valory runs OnchainBench and develops olas-ocb-agent, one of the agents it measures.