• bitcoinBitcoin (BTC) $ 62,013.00
  • ethereumEthereum (ETH) $ 1,740.83
  • tetherTether (USDT) $ 0.999132
  • bnbBNB (BNB) $ 564.26
  • usd-coinUSDC (USDC) $ 0.999925
  • xrpXRP (XRP) $ 1.08
  • solanaSolana (SOL) $ 77.18
  • tronTRON (TRX) $ 0.327570
  • staked-etherLido Staked Ether (STETH) $ 2,265.05
  • figure-helocFigure Heloc (FIGR_HELOC) $ 1.03
  • hyperliquidHyperliquid (HYPE) $ 68.21
  • dogecoinDogecoin (DOGE) $ 0.071912
  • usdsUSDS (USDS) $ 0.999860
  • rainRain (RAIN) $ 0.014719
  • leo-tokenLEO Token (LEO) $ 9.44
  • wrapped-stethWrapped stETH (WSTETH) $ 2,779.67
  • zcashZcash (ZEC) $ 463.07
  • whitebitWhiteBIT Coin (WBT) $ 55.01
  • wrapped-bitcoinWrapped Bitcoin (WBTC) $ 76,243.00
  • cardanoCardano (ADA) $ 0.166882
  • binance-bridged-usdt-bnb-smart-chainBinance Bridged USDT (BNB Smart Chain) (BSC-USD) $ 0.998762
  • stellarStellar (XLM) $ 0.181576
  • wrapped-beacon-ethWrapped Beacon ETH (WBETH) $ 2,466.93
  • moneroMonero (XMR) $ 321.61
  • chainlinkChainlink (LINK) $ 7.60
  • canton-networkCanton (CC) $ 0.125995
  • wrapped-eethWrapped eETH (WEETH) $ 2,465.31
  • bitcoin-cashBitcoin Cash (BCH) $ 232.12
  • daiDai (DAI) $ 0.999578
  • susdssUSDS (SUSDS) $ 1.08
  • usd1-wlfiUSD1 (USD1) $ 0.998963
  • ethena-usdeEthena USDe (USDE) $ 0.998447
  • the-open-networkGram (prev. Toncoin) (GRAM) $ 1.59
  • coinbase-wrapped-btcCoinbase Wrapped BTC (CBBTC) $ 76,366.00
  • litecoinLitecoin (LTC) $ 43.66
  • global-dollarGlobal Dollar (USDG) $ 0.999846
  • hashnote-usycCircle USYC (USYC) $ 1.13
  • wethWETH (WETH) $ 2,268.37
  • hedera-hashgraphHedera (HBAR) $ 0.069047
  • suiSui (SUI) $ 0.705095
  • paypal-usdPayPal USD (PYUSD) $ 1.00
  • usdt0USDT0 (USDT0) $ 0.998824
  • avalanche-2Avalanche (AVAX) $ 6.41
  • crypto-com-chainCronos (CRO) $ 0.056823
  • tether-goldTether Gold (XAUT) $ 4,072.87
  • shiba-inuShiba Inu (SHIB) $ 0.000004
  • nearNEAR Protocol (NEAR) $ 1.87
  • blackrock-usd-institutional-digital-liquidity-fundBlackRock USD Institutional Digital Liquidity Fund (BUIDL) $ 1.00
  • ondo-us-dollar-yieldOndo US Dollar Yield (USDY) $ 1.13
  • ethena-staked-usdeEthena Staked USDe (SUSDE) $ 1.22
  • uniswapUniswap (UNI) $ 3.31
  • bittensorBittensor (TAO) $ 204.49
  • world-liberty-financialWorld Liberty Financial (WLFI) $ 0.058177
  • pax-goldPAX Gold (PAXG) $ 4,076.60
  • memecoreMemeCore (M) $ 1.34
  • aster-2Aster (ASTER) $ 0.619748
  • htx-daoHTX DAO (HTX) $ 0.000002
  • okbOKB (OKB) $ 77.64
  • ripple-usdRipple USD (RLUSD) $ 0.999985
  • ondo-financeOndo (ONDO) $ 0.317886
  • little-pepe-5Little Pepe (LILPEPE) $ 2.16
  • usddUSDD (USDD) $ 0.999189
  • syrupusdcsyrupUSDC (SYRUPUSDC) $ 1.15
  • falcon-financeFalcon USD (USDF) $ 0.996716
  • polkadotPolkadot (DOT) $ 0.829454
  • morphoMorpho (MORPHO) $ 2.11
  • mantleMantle (MNT) $ 0.415653
  • dexeDeXe (DEXE) $ 28.83
  • aaveAave (AAVE) $ 87.40
  • bfusdBFUSD (BFUSD) $ 0.998381
  • worldcoin-wldWorldcoin (WLD) $ 0.372382
  • skySky (SKY) $ 0.053435
  • internet-computerInternet Computer (ICP) $ 2.16
  • bitget-tokenBitget Token (BGB) $ 1.64
  • pi-networkPi Network (PI) $ 0.102112
  • ethereum-classicEthereum Classic (ETC) $ 6.93
  • pepePepe (PEPE) $ 0.000003
  • united-stablesUnited Stables (U) $ 0.999800
  • jupiter-perpetuals-liquidity-provider-tokenJupiter Perpetuals Liquidity Provider Token (JLP) $ 4.00
  • eutblSpiko EU T-Bills Money Market Fund (EUTBL) $ 1.20
  • blockchain-capitalBlockchain Capital (BCAP) $ 106.63
  • quant-networkQuant (QNT) $ 64.75
  • kucoin-sharesKuCoin (KCS) $ 6.80
  • janus-henderson-anemoy-treasury-fundJanus Henderson Anemoy Treasury Fund (JTRSY) $ 1.11
  • jito-staked-solJito Staked SOL (JITOSOL) $ 124.46
  • usdgoUSDGO (USDGO) $ 0.999983
  • stable-2​​Stable (STABLE) $ 0.035383
  • kelp-dao-restaked-ethKelp DAO Restaked ETH (RSETH) $ 2,404.69
  • superstate-short-duration-us-government-securities-fund-ustbInvesco Short Duration US Government Securities Fund (USTB) $ 11.14
  • justJUST (JST) $ 0.095539
  • binance-peg-wethBinance-Peg WETH (WETH) $ 2,262.26
  • polygon-ecosystem-tokenPOL (ex-MATIC) (POL) $ 0.075861
  • rocket-pool-ethRocket Pool ETH (RETH) $ 2,631.35
  • cosmosCosmos Hub (ATOM) $ 1.56
  • kaspaKaspa (KAS) $ 0.028830
  • binance-bridged-usdc-bnb-smart-chainBinance Bridged USDC (BNB Smart Chain) (USDC) $ 0.999945
  • render-tokenRender (RENDER) $ 1.53
  • algorandAlgorand (ALGO) $ 0.084334
  • wbnbWrapped BNB (WBNB) $ 759.61
  • adi-tokenADI (ADI) $ 5.90
  • ignition-fbtcFunction FBTC (FBTC) $ 76,389.00
  • beldexBeldex (BDX) $ 0.093312
  • usdtbUSDtb (USDTB) $ 1.00
  • nexoNEXO (NEXO) $ 0.725937
  • jupiter-exchange-solanaJupiter (JUP) $ 0.215434
  • labLAB (LAB) $ 2.32
  • syrupusdtsyrupUSDT (SYRUPUSDT) $ 1.11
  • spiko-amundi-overnight-swap-fund-eurSpiko Amundi Overnight Swap Fund (EUR) (EURSAFO) $ 1.15
  • bianrensheng币安人生 (BinanceLife) (币安人生) $ 0.705561
  • gatechain-tokenGate (GT) $ 6.58
  • binance-staked-solBinance Staked SOL (BNSOL) $ 108.24
  • ethenaEthena (ENA) $ 0.073517
  • audieraAudiera (BEAT) $ 2.22
  • janus-henderson-anemoy-aaa-clo-fundJanus Henderson Anemoy AAA CLO Fund (JAAA) $ 1.04
  • filecoinFilecoin (FIL) $ 0.750657
  • ghoGHO (GHO) $ 0.998302
  • pump-funPump.fun (PUMP) $ 0.001483
  • new-x-ceo-is-backNEW X CEO IS BACK (XFLOKI) $ 0.506041
  • bridged-usdc-polygon-pos-bridgePolygon Bridged USDC (Polygon PoS) (USDC.E) $ 0.999720
  • lighterLighter (LIT) $ 2.29
  • solv-btcSolv Protocol BTC (SOLVBTC) $ 76,461.00
  • flare-networksFlare (FLR) $ 0.006561
  • lombard-staked-btcLombard Staked BTC (LBTC) $ 76,491.00
  • usual-usdUsual USD (USD0) $ 0.998657
  • xdce-crowd-saleXDC Network (XDC) $ 0.027000
  • yldsYLDS (YLDS) $ 0.999724
  • clbtcclBTC (CLBTC) $ 76,920.00
  • midnight-3Midnight (NIGHT) $ 0.032032
  • hash-2Provenance Blockchain (HASH) $ 0.009411
  • usxUSX (USX) $ 0.999668
  • aptosAptos (APT) $ 0.604775
  • aerodrome-financeAerodrome Finance (AERO) $ 0.522375
  • venice-tokenVenice Token (VVV) $ 10.49
  • stakewise-v3-osethStakeWise Staked ETH (OSETH) $ 2,419.84
  • true-usdTrueUSD (TUSD) $ 0.997566
  • arbitrumArbitrum (ARB) $ 0.076722
  • kinetic-staked-hypeKinetiq Staked HYPE (KHYPE) $ 33.97
  • a7a5A7A5 (A7A5) $ 0.012377
  • tbtctBTC (TBTC) $ 70,942.00
  • injective-protocolInjective (INJ) $ 4.56
  • pancakeswap-tokenPancakeSwap (CAKE) $ 1.36
  • dashDash (DASH) $ 33.86
  • euro-coinEURC (EURC) $ 1.14
  • vechainVeChain (VET) $ 0.004689
  • ousgOndo Short-Term U.S. Government Bond Fund (OUSG) $ 115.82
  • pudgy-penguinsPudgy Penguins (PENGU) $ 0.006131
  • c8ntinuumc8ntinuum (CTM) $ 0.087592
  • hastra-primeHastra PRIME (PRIME) $ 1.05
  • mantle-staked-etherMantle Staked Ether (METH) $ 2,455.82
  • official-trumpOfficial Trump (TRUMP) $ 1.60
  • celestiaCelestia (TIA) $ 0.386443
  • polygon-pos-bridged-dai-polygon-posPolygon PoS Bridged DAI (Polygon POS) (DAI) $ 0.999983
  • ether-fiEther.fi (ETHFI) $ 0.387032
  • resolv-wstusrResolv wstUSR (WSTUSR) $ 1.13
  • fetch-aiArtificial Superintelligence Alliance (FET) $ 0.157593
  • cocaCOCA (COCA) $ 1.30
  • sun-tokenSun Token (SUN) $ 0.018324
  • bonkBonk (BONK) $ 0.000004
  • spx6900SPX6900 (SPX) $ 0.372338
  • doge-strategyDoge Strategy (DOGESTR) $ 0.288297
  • liquid-staked-ethereumLiquid Staked ETH (LSETH) $ 2,406.26
  • first-digital-usdFirst Digital USD (FDUSD) $ 0.996849
  • arbitrum-bridged-wbtc-arbitrum-oneArbitrum Bridged WBTC (Arbitrum One) (WBTC) $ 76,200.00
  • layerzeroLayerZero (ZRO) $ 0.977056
  • virtual-protocolVirtuals Protocol (VIRTUAL) $ 0.518977
  • pyth-networkPyth Network (PYTH) $ 0.041829
  • the9bitThe9bit (9BIT) $ 0.042627
  • terra-lunaTerra Luna Classic (LUNC) $ 0.000059
  • wrapped-flareWrapped Flare (WFLR) $ 0.009961
  • kinesis-goldKinesis Gold (KAU) $ 131.63
  • sei-networkSei (SEI) $ 0.046467
  • l2-standard-bridged-weth-baseL2 Standard Bridged WETH (Base) (WETH) $ 2,266.86
  • apxusdapxUSD (APXUSD) $ 0.832883
  • steakhouse-usdc-morpho-vaultSteakhouse USDC Morpho Vault (STEAKUSDC) $ 1.12
  • curve-dao-tokenCurve DAO (CRV) $ 0.202188
  • blockstackStacks (STX) $ 0.164500
  • jito-governance-tokenJito (JTO) $ 0.608739
  • monadMonad (MON) $ 0.023973
  • kite-2Kite (KITE) $ 0.116575
  • binance-peg-xrpBinance-Peg XRP (XRP) $ 1.59
  • gnosisGnosis (GNO) $ 104.57
  • ether-fi-liquid-ethEther.Fi Liquid ETH (LIQUIDETH) $ 2,443.47
  • tezosTezos (XTZ) $ 0.247455
  • renzo-restaked-ethRenzo Restaked ETH (EZETH) $ 2,421.84
  • lido-daoLido DAO (LDO) $ 0.316440
  • megausdMegaUSD (USDM) $ 0.999105
  • noonNoon (NOON) $ 0.751949
  • royal-dollarRoyal Dollar (RUSD) $ 0.998700
  • sbtc-2sBTC (SBTC) $ 77,039.00
  • apenftAINFT (NFT) $ 0.00000027
  • bittorrentBitTorrent (BTT) $ 0.00000027
  • bitcoin-svBitcoin SV (BSV) $ 13.10
  • jupiter-staked-solJupiter Staked SOL (JUPSOL) $ 115.56
  • pendlePendle (PENDLE) $ 1.51
  • savings-usddSavings USDD (SUSDD) $ 1.03
  • olympusOlympus (OHM) $ 17.21
  • doublezeroDoubleZero (2Z) $ 0.072265
  • plasmaPlasma (XPL) $ 0.092327
  • msolMarinade Staked SOL (MSOL) $ 133.18
  • fraxLegacy Frax Dollar (FRAX) $ 0.989341

Anthropic’s new AI leads freelance benchmarks, yet fails 58% of the tasks

0 0


Anthropic’s Fable 5.2 ranks first on the Remote Labor Index, a test of complete freelance projects, with 41.3% of its deliverables judged to meet a professional reference standard.

Scale’s Nov. 12 leaderboard lists Fable 5.2 at 41.3%, ahead of the next-highest model, Opus 5.5 at 21.25%. Anthropic reported the result in its Nov. 9 release announcement, labeling the RLI score “High effort” and indicating that safeguards were enabled.

The original RLI paper, submitted in October 2025 by researchers from the Center for AI Safety and Scale AI, describes a dataset of 240 projects across 23 freelance work categories. Each includes a brief, the files needed to complete the task, and a professional human-reference deliverable.

The selected projects include documents, audio, video, 3D models, and computer-aided design files. That range makes file production and finished-product quality part of the challenge, alongside understanding what the client requested.

The researchers’ original evaluation method uses trained human reviewers to inspect the AI’s work against the brief and reference deliverable.

Independent evaluations and majority voting determine outcomes, and a project passes when the AI’s deliverable satisfies the brief at least as well as the reference, at a quality a reasonable client would accept.

A useful prototype or a partial result can therefore fall below the pass threshold, even when it demonstrates relevant skills. Passing demands a deliverable that clears the professional reference standard.

What the Anthropic score leaves open

Fable 5.2’s score still leaves most evaluated projects below that acceptance threshold.

The original study excludes work that inherently requires client interaction, teamwork, or physical labor, as well as projects whose outcome must be awaited before it can be evaluated. Those exclusions limit how broadly the result can apply to the wider remote-work economy.

Anthropic’s release page specifies High effort, but does not establish the precise RLI execution setup, spending per project, or amount of human support.

RLI provides a demanding definition of success for a business assessing AI’s usefulness: carrying an assignment through to an inspectable product, with professional work setting the acceptance standard.



Source link

Leave A Reply

Your email address will not be published.