Explainers
A Plain-English Glossary of Data Center Cooling Terms
From adiabatic to wet-bulb, a handy glossary of the cooling and facilities terms that come up most often in discussions of AI infrastructure.
Data center cooling comes with its own vocabulary, and it can be hard to follow articles about the AI build-out without it. Here is a plain-English glossary of terms that appear often, grouped by theme.
Core concepts
- Heat load: The amount of heat equipment produces, roughly equal to the electrical power it consumes.
- Rack density: The power drawn by the equipment in one rack, usually in kilowatts. Higher density means more heat in less space.
- TDP: Thermal design power, a chip maker’s figure for how much heat a cooling solution should be designed to handle.
- Thermal throttling: A chip slowing itself down to avoid overheating.
- Setpoint: The target temperature or humidity a control system tries to maintain.
Air cooling terms
- Hot aisle and cold aisle: Alternating aisles where servers draw cool air from the front and exhaust warm air from the back.
- Containment: Physical barriers that keep hot and cold air from mixing.
- CRAC: Computer room air conditioner, a cooling unit with its own refrigeration cycle.
- CRAH: Computer room air handler, a cooling unit that uses chilled water from a central plant.
- Blanking panel: A plate that covers empty rack space to prevent air from bypassing equipment.
- Economizer: A system that uses outdoor air or water to cool without running refrigeration.
Liquid cooling terms
- Direct-to-chip: Liquid cooling using cold plates mounted on processors.
- Cold plate: A metal block with internal channels through which coolant flows.
- CDU: Coolant distribution unit, which pumps, filters and controls coolant and exchanges heat with facility water.
- Manifold: Piping in a rack that distributes coolant to servers.
- Quick disconnect: A fitting that seals automatically when a coolant line is unplugged.
- Immersion cooling: Submerging servers in non-conductive fluid.
- Single-phase and two-phase: Whether a coolant stays liquid or boils and condenses as it works.
- Dielectric fluid: A liquid that does not conduct electricity.
- Rear-door heat exchanger: A liquid-cooled coil mounted on the back of a rack.
Plant and heat rejection terms
- Chiller: A refrigeration machine that produces chilled water.
- Cooling tower: Equipment that cools water by evaporating part of it.
- Dry cooler: A fan-and-coil unit that rejects heat to air without evaporating water.
- Adiabatic cooling: Using evaporation to pre-cool air, often only on hot days.
- Wet-bulb temperature: Roughly the lowest temperature reachable by evaporative cooling in given conditions.
- Dew point: The temperature at which moisture in the air begins to condense.
- Thermal storage: Stored chilled water or ice used to supply cooling later.
- Heat reuse: Capturing waste heat for useful purposes, such as district heating.
Metrics and reliability
- PUE: Power Usage Effectiveness, total facility energy divided by IT energy.
- WUE: Water Usage Effectiveness, water used per unit of IT energy.
- N+1 and 2N: Redundancy levels describing spare capacity.
- Ride-through: The ability to maintain cooling during a brief power interruption.
- Commissioning: Structured testing of a facility before it goes live.
Keep this list handy, and most discussions of data center cooling will become much easier to follow.
Explainers
NVIDIA’s Modular AI Factories Put the Clock on Infrastructure
AP reports that NVIDIA is urging Europe to accelerate AI infrastructure. BOSSTOX examines what modular AI factories could change—and what constraints remain.
The AI infrastructure race is shifting from “who has the chips?” to “who can get a working factory online?” The Associated Press reports that NVIDIA CEO Jensen Huang used the company’s Berlin developer conference to urge Europe’s AI sector to move faster, while presenting tools intended to help accelerate data-center construction.
The most consequential piece is infrastructure, not marketing language. NVIDIA says its new DSX POD reference design packages computing, networking, rack-level power and liquid cooling into modular units that can be integrated and tested before arriving at a prepared site. The company says deployment at a ready location could fall from roughly six months to as little as 14 days.
Why the schedule matters
AI capacity is constrained by more than GPU supply. Operators still need power, interconnection, cooling, fiber, permitting, specialized labor and a site that can accept a dense load. A modular approach does not remove those constraints, but it changes where the work happens: more integration moves into a factory, while the site becomes a connection and commissioning problem.
That distinction matters for developers, utilities and investors. A project that reaches “first tokens” weeks earlier can begin serving customers sooner, but only if the supporting infrastructure is actually ready. A container full of compute does not create capacity without electricity, thermal management, network access and a reliable operating model.
What NVIDIA is claiming
NVIDIA says DSX POD is designed for Vera Rubin AI factories and is being developed with partners including Bull, Dell Technologies, HPE, Lenovo, Schneider Electric and Vertiv. The company also says partners are working toward global deliveries in early 2027. Those are vendor announcements, not independent measurements, and the real test will be how quickly a prepared site can move from delivery to production under local grid, permitting and operating conditions.
What to watch next
- Power access: whether sites have firm capacity and a realistic interconnection path.
- Cooling: whether closed-loop liquid systems reduce water use without creating new maintenance bottlenecks.
- Deployment evidence: whether the promised weeks-long schedule holds outside demonstration environments.
- Revenue timing: whether faster installation translates into paid inference and training workloads.
BOSSTOX tracks the physical and financial systems behind AI: power and grid access, cooling, custom silicon, optical networking, data-center capacity, and capital. The NVIDIA announcement is a useful signal because it connects several of those lanes at once. The strategic question is no longer simply how many accelerators a region can buy. It is how quickly that region can turn electricity, equipment and sites into dependable compute that customers can use.
Sources
Read the Associated Press report and review NVIDIA’s DSX POD announcement. For related infrastructure context, visit BOSSTOX.
This BOSSTOX analysis is original and distinguishes reported facts from company claims and editorial interpretation.
Explainers
October and Earnings Season: How the Quarterly Reporting Calendar Works
Mid-October typically kicks off reporting for the July through September quarter. Here is how earnings season works and how to follow infrastructure themes through it.
For anyone following public companies, October brings a familiar rhythm. Many companies with calendar fiscal years begin reporting results for the third quarter, covering July through September, in the middle of the month. Over the following weeks, a steady stream of earnings releases, calls and filings arrives. Knowing how the calendar works makes the flood of information easier to manage.
Why reporting clusters
Most large U.S. companies close their books at the end of each calendar quarter, then take a few weeks to finalize results. SEC rules set deadlines for quarterly 10-Q filings, generally within 40 days after quarter end for larger filers and 45 days for smaller ones. Annual 10-K deadlines are longer.
Because so many companies share the same quarter-end, their reports bunch together. Large banks often report early in the season, followed by many technology, industrial and consumer companies in the following weeks. Companies with different fiscal years report on their own schedules, so not everyone fits the pattern.
How companies announce dates
Most companies announce their earnings date in advance through a press release and on their investor relations website. The announcement usually includes the time of the release and a link to the conference call webcast. Many people find it helpful to note the dates of companies they want to follow and to check the investor relations page directly, rather than relying on third-party calendars that may be out of date.
Following infrastructure themes through the season
Because the AI build-out touches many industries, related information appears across many reports. A reader might track:
- Capital expenditure figures and commentary from large cloud and technology companies
- Order backlogs and lead-time comments from electrical and power equipment makers
- Leasing and development updates from data center REITs
- Demand commentary from chip and server suppliers
- Large-load discussions from utilities
Seeing the same theme from several angles, buyer, supplier, landlord and utility, gives a more balanced picture than any single report.
Keeping calm during the season
Earnings season can feel noisy. Headlines often summarize complex results in a word or two, and share prices can move sharply on small differences from expectations. A few habits help:
- Read the original release or filing before forming a view
- Focus on the same handful of measures each quarter
- Note what management says changed since the last report
- Give yourself time; filings and transcripts remain available long after the day of release
Where to find primary sources
Earnings releases are posted on company investor relations websites, and formal filings appear on the SEC’s EDGAR system at sec.gov. The SEC’s investor.gov site has plain-language explanations of quarterly and annual reports. These primary sources are the best foundation for understanding what companies actually reported, as opposed to what was said about them.
This article is general education about how the industry and financial reporting work. It is not investment advice and does not recommend buying or selling any security. For decisions about your own money, talk to a licensed financial advisor.
Explainers
AI Costs for Small Businesses: A Practical Model Before You Buy GPUs
The model call is the smallest line on the bill. Here is a simple way to price an AI feature before it becomes a permanent expense.
Key points
- Size the workload first: requests, input and output size, peak load and response-time target.
- Price every layer — tokens, storage, retrieval, logging, review — and add a peak allowance.
- Self-hosting only wins at high, steady utilization; otherwise managed services are usually cheaper.
Small businesses usually do not need to build an AI data center. They do need a way to estimate what an AI feature will cost before it becomes a permanent bill. The mistake is to price only the model call. Real cost includes data preparation, software, storage, networking, monitoring, security, people, and the cost of being wrong.
Step one: define the workload
Start with the workload. Count requests, average input size, average output size, peak requests per minute, and the response-time target. A document summarizer, a customer-service assistant, and an image inspection system have different requirements. A monthly request count is not enough if most requests arrive in one short daily peak.
Next decide whether the work needs a large model. Many business tasks are narrow. Routing, extraction, classification, drafting, and search may work with a smaller model or a hosted service. A larger model may be appropriate for difficult reasoning, but it should be selected because tests show a business benefit, not because it is the most famous option.
Step two: price every layer
Cloud pricing normally has several parts. There may be a charge for input and output tokens, a minimum service fee, storage, data transfer, logging, and a database for retrieval. If the company runs its own model, it pays for a machine or accelerator while it is reserved, even when the machine is idle. Some providers offer on-demand, committed, or spot capacity. Each shifts the balance between flexibility, discount, and availability.
A simple monthly model is useful. Estimate monthly requests, multiply by average input and output size, apply the provider’s rates, then add non-model services. Add a peak-capacity allowance rather than assuming the average is the same as the maximum. Finally, add a human-review budget for cases the model should not handle alone.
Self-hosting and the break-even point
Self-hosting can be economical at high and predictable volume, but the break-even point depends on utilization. A local or dedicated accelerator has a fixed cost. If it is used for only a few hours a week, a managed API may be cheaper. If it serves a steady workload every day, owning or reserving capacity may become attractive. The calculation should include electricity, cooling, maintenance, software updates, and replacement hardware.
Privacy and quality have costs too
Privacy can change the answer. A company may pay more for a private deployment because customer records, contracts, health information, or proprietary designs cannot be sent to a general service. This is a business and legal requirement, not just a technical preference. The cost model should include data classification, access controls, retention, and audit work.
Quality has a cost too. If an assistant produces a wrong answer, an employee may have to correct it. If an extraction pipeline mislabels invoices, accounting staff may repair the results. A small accuracy improvement may be worth more than a lower compute bill when the output is used in a high-value process.
Use caching and retrieval carefully. Reusing a stable answer can reduce repeated model calls. Retrieval can keep a model grounded in a smaller set of relevant documents, but the search index and documents still require maintenance. Poor retrieval creates confident answers from the wrong source, so evaluation must test both the model and the retrieval layer.
Start with one measurable project
The best first project is measurable. Choose one workflow with a known baseline, such as the time employees spend answering common questions. Run the AI system alongside the current process. Track response quality, employee editing time, escalations, and total cost. Do not count a demo as savings until people actually use it.
Cloud providers publish pricing and consumption choices, but prices change and performance varies by model and region. A small business should keep a simple spreadsheet of assumptions and revisit it when volume, model, or service terms change. The spreadsheet is more valuable than a single headline price.
AI is affordable when it is attached to a specific job. It becomes expensive when a company buys capacity before defining the workload. Start with the task, measure the demand, test a small model, and include the human and operational costs. The goal is not the cheapest model call. The goal is a reliable business result at a cost the company can defend.
What BOSSTOX is watching
- Price changes across providers for the same model class.
- Reserved versus on-demand capacity terms for small buyers.
- Tools that measure employee editing time on AI output.
Sources
- Google Cloud, TPU pricing and consumption options
- Google Cloud, planning TPU resources
- AWS, EC2 pricing and capacity choices
- AWS, GPU instances for inference and small-scale training
BOSSTOX Research articles are drafted with AI assistance and reviewed by our editors before publication. See our editorial standards.
-
Power & Grid2 weeks agoGas Turbines on Data-Center Campuses
-
Power & Grid2 weeks agoTransformer Lead Times Are Becoming a Data-Center Schedule Risk
-
Compute & Silicon3 weeks agoGPU Supply Chains: How AI Hardware Gets Made, Moved, and Bottlenecked
-
Power & Grid2 weeks agoBattery Storage at AI Sites
-
Cooling4 weeks agoWater Use and Dry Coolers: The Tradeoff AI Sites Cannot Avoid
-
Explainers1 month agoExplainer: What an AI Inference Stack Actually Does
-
Explainers1 month agoAI Costs for Small Businesses: A Practical Model Before You Buy GPUs
-
Compute & Silicon3 weeks agoHBM Is a Bottleneck Because AI Memory Is a Stack, Not a Chip
