Intel D270 GPU AI Accelerator–Up to 480 GB LPDDR5X

These are going to be so awesome to buy in 5-8 years!Right now I’m running 2x 3090 and 128 gb ram on 3.8 flash-next180b (the quant is 97gb) and it hums at120t/s. It’s really a surprisingly good model for general tasks, and I’m soon to see how it does with more agentic kit. For agentic work it does slow down quite a bit when the context fills up… but what do you want for running a 180b model on consumer hardware?Right now I have it set up as an administrator for our asterisk PBX and radius server, and it does higher level judgment on our cctv footage for notifications to security. It’s been really good so far. Agents are the new UI, everything just works over SSH now. reply: > (...) it hums at120t/s. It’s really a surprisingly good model for general tasks, and I’m soon to see how it does with more agentic kit.This is exactly why I interpret the aggressive price cutting by OpenAI on their Luna model line as a clear sign they are scared shitless of local models, and how they can trigger a "the king has no clothes" moment for AI companies like OpenAI.

With an impressive 1.5TB/s RAM bandwidth you'd think they'd advertise that more.Marketing department asleep at the wheel. reply: This is a very low number for a server GPU. My V100 from 2017 is 0.9 TB/s.A single B300 has almost 8 TB/s.AMD MI300x from 2023 is 5.3 TB/sEdit: my bad you are saying that this is an impressive number precisely because it is more or less normal RAM, not VRAM

Slop and placeholder text on the page, including this one. They should have reviewed their webpage."What software frameworks are relevant to Intel GPU D270?Intel GPU D270 messaging should reference familiar AI software and serving frameworks such as PyTorch, vLLM, SGLang, and OpenAI Triton, where approved. This helps developers and platform teams understand how the product fits into existing AI workflows." reply: Noticed this as well! Was looking for details on the software support and this FAQ entry didn't exactly instill confidence...

1.5 TB/s 1.3 PFLOPS with no fast multi-GPU, it's a consumer card that pretends to be a server card.It would work great on Qwen3.8-Flash-Next or GLM-5.3 as single user decode only hits a few experts, anything with concurrent users and you'd be sitting for a while. reply: That's the point I believe fast local 2-4 user service for cheap on very large models.You have to pretend it's for servers to keep investors happy, it would be banks and similar with in house servers that have to run local large models buying these for experiments and cybersecurity. Likely.

Can I actually buy this? Should I prefer it over Blackwell? reply: You can tell by the shape of the board that it's meant to go into a server chassis behind a stack of 80mm blower fans. It's not meant for consumers, but you will be able to buy it used for $200 off ebay in 7 years to put in your home lab.

Fun to see the LLMism on the product page: "A, not B"

Can intel gift me one?The cost of a 480gb ram video card seems preposterous to be even marketing at this point.Intel is going to make a card that costs $1 million dollars.. this is like industrial newsletters bleeding into a public forum> Commercial Scale Pricing: In the industrial data center sector, battery storage systems are priced per kilowatt-hour (kWh) or megawatt-hour (MWh). Industrial battery storage installations typically cost $300,000 to $450,000+ per MWh of capacity depending on software integration, cooling systems, and structural framing.Let's all get excited

Looks like Intel is choosing to title its new crescent island cards with the D prefix despite being Crescent Island.Kind of disappointed that Intel is (probably) not going to release consumer class GPUs. Intel's driver stack was seriously getting mature—both on Linux and Windows. It's always nice to have a third option available. reply: Agreed. I was really rooting for them to deliver that third iteration to consumers, and retain them as a competitive option in the low to mid range. Pretty sad to see.

How much is it expected to cost?

Seems incredibly little compute for this. Is it meant to be MoE specific?

They originally said it was going to be 120GB but that partners could ship bigger capacities. So much for that!I do hope this has a price point that makes it somewhat competitive with a Mac! Consumers have had nearly no choices available for mem capacity, and 20 channels of lpddr5 is one way to get that capacity! Go Intel!

> Efficient token serving Dense, air-cooled, standard PCIe infrastructure helps maximize tokens per rack and watt, scaling serving capacity and keeping costs in check.Next the tokens will be asking for tequila and caviar. Bow down to the new token overloads.

Yay more vaporware hardware I get to read about and never see or have a chance to buy.