The llm-d project announced llm-d 1.0, an open source milestone designed to help organizations deploy and scale large language model inference more efficiently. Recent demonstrations showed cost reductions of up to five to 10 times for context-heavy agentic workloads and three times greater output throughput. The release adds multi-tenant quality of service, zero-downtime operations, coordinated management of prefill and decode replicas, a stable v1 configuration API, and agent-aware serving with session-aware routing. Founded in 2025 by Red Hat, IBM, Google Cloud, CoreWeave and NVIDIA and now governed by the CNCF, the project has more than 500 contributors from over 25 organizations. In one IBM Research use case, the setup achieved 11.5 times lower inference cost than an all-proprietary configuration, with a prefix-cache hit rate of about 98%.
Summary written by Upside AI from the original article. Read the source for full details.
Read the original on Yahoo Finance ↗
Keywords
artificial intelligencecloud computingNvidiaCoreWeave
Open a keyword to see other news on the same topic.
Related tickers and likely impact
NVDA
• NeutralNvidia
Relevance: low
| Market | US stocks |
|---|---|
| Sector | Information Technology |
| Industry | Semiconductors |
| Market cap | $5.2T |
| Close on 10/19/2026 | 217.09 |
| Change that session | +1.38% |
Impact is scored by AI from the headline and may be wrong. It is not investment advice.
Related news
- CoreWeave Stock Rally Fizzles Despite ARK's Wood, Nvidia Support
- European Equities Close Higher On AI Optimism
European stocks closed broadly higher on Friday, with several sectors gaining support ahead of quarterly earnings due early next week. Higher oil prices weighed slightly, but easing concerns about interest rates and AI-related investments kept the mood positive. Nvidia CEO Jensen Huang's comments defending the financial health of AI computing supplier CoreWeave Inc. also helped sentiment.
- Nscale, Anthropic Talks Point to Second $45bn Compute Deal
Nscale and Anthropic are reportedly in talks over a cloud-computing deal that could be worth about $45bn, according to Bloomberg's October 19, 2026 report. The new deal would be on top of an August 2026 agreement worth as much as $44.6bn, pushing total commitments between the two toward roughly $90bn. The talks concern a second facility at Nscale's Monarch campus in West Virginia, built around Nvidia Vera Rubin chips, but nothing has been signed and neither company has confirmed the terms. The August contract gave Anthropic about 460 megawatts of capacity over six years after Microsoft walked away from a 1.35-gigawatt commitment at the same campus. Nscale is also heading toward a stock market listing with a target valuation of about $30bn, while the talks rely on unnamed sources rather than filings or statements.
- Morgan Stanley favorite AI stock is 92 % exposed to the $1 . 6 trillion buildout it bullish on
Morgan Stanley estimates 91.7% of Nvidia's 2027 revenue is exposed to AI infrastructure demand, the highest on the bank's list, and calls Nvidia the best risk/reward in the sector. Hyperscalers and AI cloud providers are expected to spend $1.58 trillion in 2027, up roughly 60% from about $980 billion this year. About $1 trillion of that spending shows up as S&P 500 revenue, nearly $700 billion of it going to Nvidia, while SpaceX and Amazon Web Services make up about 54% of Nvidia's hyperscaler revenue in 2027. The report also flags risks including the largest cash flow deficit of its forecast period in 2027, about $255 billion of unsecured bonds sold this year, and a 32-gigawatt U.S. data center power shortfall through 2028.
- Morning Bid : Rain from the neocloud
French stocks and bonds have come under pressure after a week of street riots and protests, with French debt yields hitting fresh 24-year highs and risk spreads versus Germany nearing recent peaks. Tech stocks briefly recovered on Wall Street, but selling resumed in Asia, where South Korea's KOSPI slid again and local data center builder Elice's IPO plunged 30% on debut, refocusing attention on 'neocloud' firms after CoreWeave plummeted last week. Brent crude kept probing five-month highs above $111 per barrel amid Middle East violence, while European natural gas hit four-year highs on the Ukraine conflict. Trump's approval rating fell to a record low of 31% in a Reuters/Ipsos poll ahead of the November 3 midterm elections.
- Neoclouds : Goldman Sachs Upgrades CoreWeave . Microsoft Shelves Nscale Project .
Related markets
Latest news
- Russian President Putin unexpectedly proposes a Russia–US–China summit on ending the Ukraine conflict: How is China responding?
According to Beijing Daily, on October 19 a Bloomberg reporter asked China's Foreign Ministry about reports that Russian President Vladimir Putin proposed a summit with Chinese and U.S. leaders next month to discuss ending the Ukraine crisis. Foreign Ministry spokesperson Mao Ning said she had no information to provide. The Wall Street Journal, citing sources close to the matter, reported that the Kremlin proposed a three-way dialogue on the sidelines of an upcoming informal APEC leaders' meeting, and that the idea was raised in an October 9 call between Putin and Donald Trump. Kremlin spokesperson Dmitry Peskov confirmed the parties are discussing a possible meeting but said there is no clear consensus on the meeting or its agenda, although all three sides acknowledge it is theoretically feasible.
- Anthropic in talks with neocloud Nscale over second multibillion-dollar deal, source tells CNBC
According to a person familiar with the matter, Anthropic is in talks with U.K. neocloud Nscale for a second multibillion-dollar deal to lease computing capacity at a West Virginia site, covering another 460-megawatt data center. The deal could be worth around $45 billion, following a first deal that CNBC reported in August. Anthropic declined to comment, and CNBC has approached Nscale for comment. Rival neoclouds CoreWeave and Nebius have seen their shares fall 28% and 27% in the past month over borrowing concerns, while Nscale faces a report that Microsoft pulled out of a London data center deal over grid delays. Nscale said it remains committed to the project and is exploring alternative power sources, and it filed to list on the NYSE in September.
- Google's Former CEO Quietly Owns 1% of Anthropic
According to unnamed sources, former Google CEO Eric Schmidt owns about 1% of Anthropic, stemming from an investment of tens of millions of dollars in its 2021 Series A, when the company was valued at $461 million. At Anthropic's latest valuation of $965 billion, the stake could be worth about $10 billion, though neither Schmidt nor Anthropic has confirmed the figure. The IPO is discussed at a range of $1.8 trillion to $2 trillion; at the top of that range, the stake could reach $20 billion, lifting Schmidt's net worth from $57.5 billion to nearly $80 billion. Alphabet shares rose 1.05% to close at $344.18, and investors treated the report as a minor development. All figures remain estimates, as nothing has been signed or filed and the IPO timeline is only a plan.
- French Lawmakers Back Stablecoin Swap Tax by Just One Vote
France's National Assembly narrowly adopted budget amendment I-3898 by a single vote, which would treat swaps from crypto into MiCA-regulated stablecoins as taxable sales from January 1, 2027. Of the 100 deputies who voted, 38 backed the measure, 37 opposed it and 25 abstained. Gains would be calculated as the value of stablecoins received minus the purchase price of the coins given up, taxed at a flat rate that rose from 30% to 31.4% after social charges on capital income went from 17.2% to 18.6%. The government opposed the amendment, and Public Accounts Minister David Amiel asked for it to be withdrawn, arguing that stablecoins first need a legal definition. None of the measures is law yet, as the amendment still faces the rest of the budget process, and a separate proposal requiring holders to declare self-custodied crypto worth €100,000 or more has drawn backlash from the crypto industry.
- Elite Extends Elite Intelligence to Claude and Microsoft Copilot, Bringing Trusted Financial Context into the AI Experiences Law Firms Already Use
Elite, the AI financial operations platform for law firms, is launching Elite Intelligence connectors in the Claude and Microsoft marketplaces, powered by its secure Model Context Protocol (MCP) service. The read-only connection lets authorized users ask about clients, matters, invoices, budgets and billing, and get answers grounded in their firm's financial system of record. Existing Elite permissions remain in force, so firms can expand access to financial intelligence without granting additional visibility. The company says this reduces the steps finance teams take, such as switching systems, running reports and exporting data, to answer routine questions. Elite reports supporting more than $160 billion in billing transactions, about 60,000 monthly users and more than 10 million invoices processed in the last 12 months.
- BC-Gold Futures
The Associated Press table shows gold futures prices for 100 troy oz contracts on COMX as of 10:00 AM Tuesday, October 20, 2026. The December 2026 contract last traded at 4,147.00 dollars per troy oz, down 13.10, on volume of 93,310 contracts. Total open interest was 398,807 contracts, up 1,635.
Get the briefing on Telegram or Zalo
Join the Upside Telegram channel or Zalo group for the Vietnam stocks and gold briefing at 8:00 and 19:00 (Vietnam time) on trading days, plus a weekly wrap on Saturday morning.