Skip to content

Protocols

Completion per protocol, from the tasks’ protocol tags: the share of each protocol’s tasks the entry completed, with the number of tasks it was scored on. A task that uses several protocols counts under each. Results describe how agents use a protocol, never the protocol’s quality.
Completion per protocol
ProtocolClaude CodeDeepSeek V4.1 FlashClaude CodeOpus 5.5OpenClawDeepSeek V4.1 FlashCodexGPT-5.6 SolHermesDeepSeek V4.1 Flasholas-ocb-agentDeepSeek V4.1 FlashCodexDeepSeek V4.1 Flash
ERC-2086 tasks94%(86)90%(86)91%(86)92%(86)90%(86)89%(86)86%(86)
Wrapped native asset38 tasks97%(38)94%(38)94%(38)97%(38)91%(38)88%(38)91%(38)
Aave v333 tasks90%(33)86%(33)85%(33)94%(33)83%(33)83%(33)78%(33)
Long-tail contracts29 tasks97%(29)97%(29)94%(29)92%(29)94%(29)92%(29)92%(29)
Uniswap v325 tasks98%(25)98%(25)96%(25)94%(25)95%(25)98%(25)96%(25)
Omen15 tasks100%(15)99%(15)99%(15)100%(15)97%(15)87%(15)89%(15)
Web research15 tasks100%(15)100%(15)100%(15)100%(15)99%(15)97%(15)99%(15)
Native asset11 tasks100%(11)100%(11)100%(11)84%(11)96%(11)91%(11)95%(11)
Olas mech marketplace10 tasks100%(10)98%(10)98%(10)100%(10)96%(10)86%(10)90%(10)
Safe2 tasks90%(2)100%(2)70%(2)50%(2)90%(2)80%(2)40%(2)
Safe allowance module2 tasks90%(2)100%(2)70%(2)50%(2)90%(2)80%(2)40%(2)
sDAI2 tasks100%(2)100%(2)100%(2)100%(2)70%(2)90%(2)80%(2)
Honeyswap1 task100%(1)100%(1)100%(1)100%(1)100%(1)100%(1)100%(1)
Sushiswap v21 task100%(1)80%(1)80%(1)80%(1)100%(1)80%(1)80%(1)

Valory runs OnchainBench and develops olas-ocb-agent, one of the agents it measures.