Scan to Download
Search "Benchmarks" has a total of4related results
Techhub News reports, Cloudflare has released its first models, Clef and Clef-flash, trained by its Workers AI team. They are decision models, not chatbots, capable of reading input states and a set of typed questions, and returning probabilities for each allowed answer without generating free text. Both models are available under the Apache 2.0 open-source license, compatible with TypeSafe AI's Jev API, and can now be deployed on the Workers AI platform, with weights uploaded to Hugging Face. According to Cloudflare's evaluation in decision model benchmarks, the Clef model scored the highest in 7 out of 10 benchmarks. For example, on the BANKING77 task, Clef's macro F1 score was 94.20, higher than Jev's 79.74. In a threat intelligence workflow, Clef took 2.2 seconds to classify a domain name, faster than gpt-oss-120b's 4.7 seconds. All data are self-reported by the vendor and have not been independently reproduced. (MarkTechPost)
Techub News reports that AI search company Perplexity has released its in-house developed Rust-based retrieval and ranking engine, Photon, to replace its previously forked open-source engine. Photon now handles all production traffic and supports the new "Fast Search" mode in its search API. Perplexity reports that its single-call p50 latency is 160 milliseconds, and p95 latency is 230 milliseconds. Photon has reduced the p99 latency for retrieval and ranking from approximately 800 milliseconds to about 65 milliseconds, while using approximately 20% fewer service machines compared to the old content nodes. The engine is provided as a managed API, and users can access it by setting search_type: "fast" in POST /search, with a cost of $1 per 1000 requests, although the engine itself is not open source. Perplexity has also launched a "Fast Search" mode optimized for agent workflows alongside Photon. In 3554 tasks across 6 benchmarks, this mode achieved a score of 64.3% with an estimated model and search cost of $59.73, while the default preset cost $187.60, making the former about 68% cheaper.(MarkTechPost)
Techub News reports that Elon Musk has explained in detail how his artificial intelligence company xAI is building data centers at a speed far exceeding the industry average. The specific methodology he outlined may set a new industry benchmark for the development efficiency of AI infrastructure globally. According to Crypto Briefing, the implementation of this data center construction strategy is expected to reshape the standards of global AI infrastructure development, potentially impacting the computing power race and the progress of model training.
Techub News: CME Group and cryptocurrency benchmark index provider CF Benchmarks announced plans to launch two new Bitcoin volatility indices on December 2, including the CME - CF Bitcoin Volatility Real-Time Index (BVX) and the CME - CF Bitcoin Volatility Settlement Index (BVXS). These indices are market-based forward-looking indicators designed to measure the market's expected Bitcoin price volatility over a fixed 30-day expiration period. These indices are not tradable futures products, but they can serve as transparent indicators reflecting the implied volatility in CME's regulated Bitcoin futures and Micro Bitcoin futures contract options.
Current search results fully loaded
