Million GPU clusters, gigawatts of power – the scale of AI defies logic
Comment It's not just one hyperbolic billionaire – the entire industry is chasing the AI dragon
Systems19 Dec 2024 | 160
Datacenter
Cheat codes for LLM performance: An introduction to speculative decoding
Hands on Sometimes two models really are faster than one
AI + ML15 Dec 2024 | 46
Google thinks the grid can't support AI, so it's spending on solar for future datacenters
Deal with Intersect Power will see gigawatts of compute capacity come online
Off-Prem12 Dec 2024 | 59
Apple reportedly building AI server processor with help from Broadcom
Something called 'Baltra' expected to make its debut in 2026, perhaps with tech both already use
Systems12 Dec 2024 | 10
Day after nuclear power vow, Meta announces largest-ever datacenter powered by fossil fuels
Louisiana facility's three natural gas turbine plants to churn out 2,262 MW
On-Prem05 Dec 2024 | 41
Canada commits $1.4B to sovereign compute infrastructure as it joins the AI arms race
Project includes hundreds of millions of loonies for a national supercomputing facility
AI + ML05 Dec 2024 | 11
NARROWER TOPICS
RISC-V's AI champion just scored $693M cash infusion
Architecture may be good for more than cut-rate SoCs and high-volume microcontrollers after all
AI + ML04 Dec 2024 | 5
Investors just can't pull the plug despite datacenters facing AI power crunch
Even if 98% say they're worried about energy availability and reliability
The Future of the Datacenter - 2025 and Beyond27 Nov 2024 | 12
Datacenters could blow up your electric bill thanks to AI
Operators may have to pay more for energy if capacity cannot meet demand
The Future of the Datacenter - 2025 and Beyond22 Nov 2024 | 24
Supermicro hot-swaps auditor in hope of dodging Nasdaq delisting
Server maker tries accounting reboot amid reports of customers bailing
Systems19 Nov 2024 | 1
LLNL looks to make HPC a little cloudier with Oxide's rackscale compute platform
SC24 System to serve as a proof of concept for applying API-driven automation to scientific computing
HPC18 Nov 2024 | 1
Datacenters line up for 750MW of Oklo's nuclear-waste-powered small reactors
Out with the old, in with the nucleus ... if ever finished
On-Prem14 Nov 2024 | 15
AI's power trip will leave energy grids begging for mercy by 2027
Datacenter demand estimated to inflate by 160% over next two years
On-Prem13 Nov 2024 | 23
Continuity of CHIPS and Science Act questioned in a Trump presidency
Asia In Brief Plus: A premium minimum wage for Malaysian datacenter workers; N Koreans maybe discover spicy content; S Korea fines Meta for data misuse, and more
Systems11 Nov 2024 | 34
Euro execs extend net zero timescales amid energy cost and supply crunch
Environmental, social, and governance? Cutting money spent on power is CEOs' priority
On-Prem07 Nov 2024 | 37
Amazon's nuclear datacenter dreams stall as watchdog rejects power deal
Updated Federal Energy Regulatory Commission cites grid stability concerns
On-Prem04 Nov 2024 | 56
Fujitsu, AMD lay groundwork to pair Monaka CPUs with Instinct GPUs
Before you get too excited, Fujitsu's next-gen chips won't ship till 2027
Systems01 Nov 2024 | 7
Microsoft tries out wooden bit barns to cut construction emissions
The two hybrid datacenters promise 35% less embodied carbon than steel builds, 65% less than concrete
On-Prem01 Nov 2024 | 73
UK gov report to propose special zones for datacenters, 'AI visas'
Vendors not keen on 'lengthy bureaucracy,' and cost when they try to hire skilled foreigners
On-Prem31 Oct 2024 | 65
Meta spruiks benefits of open sourcing Llama models – to its own bottom line
It's not like Zuck needs the coin despite increased infrastructure spend, headcount, losses on VR
Off-Prem31 Oct 2024 | 10
Equinix to pad Thai coffers with $500 million investment
Another Asian country declares ambition to be a tech hub
Off-Prem31 Oct 2024 | 6
AMD teases its GPU biz 'approaching the scale' of CPU operations
Q3 profits jump 191 percent from last quarter on revenues of $6.2 billion, helped by accelerated interest in Instinct
Systems30 Oct 2024 | 5
Datacenter developer says power issues holding up new builds
'The single biggest constraint is access,' says exec looking to invest 'hundreds of millions'
On-Prem29 Oct 2024 | 49
Energy exec punts datacenter power options out to long term
Bit barns aren't going to hook up to nuclear in a rush
Systems25 Oct 2024 | 5
European datacenter energy consumption set to triple by end of decade
McKinsey warns an additional 25GW of mostly green energy will be needed
On-Prem25 Oct 2024 | 8
Hugging Face puts the squeeze on Nvidia's software ambitions
AI model repo promises lower costs, broader compatibility for NIMs competitor
AI + ML24 Oct 2024 | 16
Nvidia CEO whines Europeans aren’t buying enough GPUs
EU isn’t keeping up with US and China investments, AI arms dealer says
Systems24 Oct 2024 | 34
Tech giants set to pay through the nose for nuclear power that's still years away
Google, Amazon, Microsoft dive into costly deals that aren't generating anything yet
On-Prem18 Oct 2024 | 95
Infrastructure giant Schneider Electric powers up with $850M liquid cooling deal
Snags controlling stake in Motivair Corporation, rest to come by 2028
On-Prem17 Oct 2024 |
Datacenter CEO faked top-tier IT reliability cert to snag $10.7M SEC deal, DoJ claims
Updated The Uptime Institute rates availability. The 'Uptime Council' … apparently doesn't exist
Off-Prem17 Oct 2024 | 21
Amazon makes $500M bet on itty-bitty nuclear reactors to fuel cloud empire
The duo eyes a target of 5 GW online in US by 2039, assuming tech comes to fruition
Systems16 Oct 2024 | 38
AMD downplays risk of growing blast radius, licensing fees from manycore chips
House of Zen says it's done the analysis, and concerns are a 'little bit' unfounded
Systems15 Oct 2024 | 16
Norway datacenter dumps diesel diet, goes veggie with biofuel backup
Operator Stack Infrastructure is committed to reducing Scope 1 emissions from its facilities
On-Prem15 Oct 2024 | 33
Britain opens floodgates to US datacenter investment
Who needs climate goals and planning permission anyway?
Systems15 Oct 2024 | 20
Vietnam plans to convert all its networks to IPv6
Wants 'super-large capacity, super-wide bandwidth' datacenters – and more submarine cables
Public Sector14 Oct 2024 | 20
AI's thirst for power keeps coal fires burning bright
So much for reducing our reliance on fossil fuels
Systems14 Oct 2024 | 23
Energy companies told to recharge for AI datacenter surge
Demand for electricity to outstrip supply soon, warns Bain
On-Prem11 Oct 2024 | 34
AMD pumps Epyc core count to 192, clocks up to 5 GHz with Turin debut
Just not on the same chip, of course
Systems10 Oct 2024 | 18
AMD targets Nvidia H200 with 256GB MI325X AI chips, zippier MI355X due in H2 2025
Less VRAM than promised, but still gobs more than Hopper
Systems10 Oct 2024 | 5
Supermicro crams 18 GPUs into a 3U AI server that's a little slow by design
Can handle edge inferencing or run a 64 display command center
Systems09 Oct 2024 | 2
TensorWave bags $43M to pack its datacenter with AMD accelerators
Startup also set to launch an inference service in Q4
Systems08 Oct 2024 |
Eric Schmidt: Build more AI datacenters, we aren't going to 'hit climate goals anyway'
Perhaps the power-draining tech is the solution after all, posits former Google CEO
AI + ML08 Oct 2024 | 80
China reportedly tells local AI buyers to ignore Nvidia
In Brief Plus: Google, Oracle, spend $9.5 billion on Asia datacenters; Philippines to tax clouds; Vietnam infosec praised; and more
AI + ML08 Oct 2024 | 3
Why Cisco reportedly wants in on CoreWeave's rent-a-GPU racket
Analysis This may help Switchzilla hit $1B AI sales goal by FY25
Networks06 Oct 2024 |
AI’s energy appetite too big for Texas grid, regulators warn
Updated Datacenters coming online in the next 15 months will need to supply at least some of their own power
On-Prem04 Oct 2024 | 26
Submer dives into $55.5M funding to cool down hot-blooded AI datacenters
Tech's consumption of water and energy driving interest in liquid cooling
On-Prem03 Oct 2024 | 4
Blackstone invests £10B to build Europe's 'biggest AI datacenter' in UK
Construction slated to begin next year at site of failed BritishVolt plant
Systems26 Sep 2024 | 17
Altman reportedly asks Biden to back a slew of multi-gigawatt-scale AI datacenters
With 2.5 million Blackwell GPUs, would gobble enough energy to power millions of homes
Systems25 Sep 2024 | 26
With Granite Rapids, Intel is back to trading blows with AMD
And they didn't even need a bunch of skimpy E-cores to do it
Systems24 Sep 2024 | 21
Microsoft cash to help reignite Three Mile Island atomic plant
We'll have some fission chips, please
On-Prem20 Sep 2024 | 60
Datacenters bleed watts and cash – all because they're afraid to flip a switch
Activate OS-level governors and power profiles, cut energy use by '25 – 50 percent'
On-Prem20 Sep 2024 | 20
Alibaba Cloud claims its modular datacenter architecture shrinks build times by 50 percent
Also reveals boosted utilization rates, upgraded IaaS and more – all in the name of AI apps
Off-Prem20 Sep 2024 | 4
SiFive expands from RISC-V cores for AI chips to designing its own full-fat accelerator
Seems someone's looking for an Arm wrestle
AI + ML19 Sep 2024 | 4
Microsoft, BlackRock form fund to sink up to $100B into AI infrastructure
Tech is going to need datacenters and power sources, and a lot of 'em
AI + ML18 Sep 2024 | 6
Objections to datacenter builds may be overruled now they are 'Critical National Infrastructure'
Well you wouldn't get far protesting a water system or a power grid, right?
On-Prem17 Sep 2024 | 34
Alibaba Cloud waiting for hardware to dry out before trying to restore customer data
Digital Realty's Singapore disaster still complicating cloud after a week
Off-Prem17 Sep 2024 | 8
'Hyperscale customer' to take massive datacenter site near London
Exclusive 'Commercially sensitive' incognito buyer has a lot more support than last group that tried to build a bit barn near M25
On-Prem13 Sep 2024 | 52
AMD sharpens silicon swords to take on chip and AI rivals
Comment CEO Lisa Su sets sights on being best in GPUs, CPUs, FPGAs, everything... as Intel struggles
Systems12 Sep 2024 | 12
UK elevates datacenters to critical national infrastructure status
Dedicated support to be assembled to prevent cyberattacks, IT outages, and bad weather from affecting availability
On-Prem12 Sep 2024 | 16
Nvidia CEO to nervous buyers and investors: Chill out, Blackwell production is heating up
AI ROI? Jensen Huang claims infra providers make $5 for every dollar spent on GPUs
Systems12 Sep 2024 | 8
Amazon to pour £8B into UK datacenters through to 2028
How kind. Now how about looking at the corporation tax bill...
On-Prem11 Sep 2024 | 20
Oracle wants to power 1GW datacenter with trio of tiny nuclear reactors
Isn't saying how much they'll cost or when they'll fire up
Off-Prem11 Sep 2024 | 22
Biting the hand that feeds IT
