Learn AI / Term Explorer /Data and Infrastructure
Data and Infrastructure
What models are built from and what they run on, including the parts that cost money and the parts that go stale.
Starter
Annotation and data labelling
People or software tools add task-relevant tags, notes or boundaries to data for model training, testing, analysis or monitoring.
Cloud computing
Using on-demand computing services over a network, instead of relying only on machines you manage directly.
Compute
Compute is the processing capacity used to train and run AI systems, with different needs before deployment and during everyday use.
Cost per token
The price charged for each small piece of text a model processes or generates, usually counted separately for input and output.
Data cleaning
The process of checking data, fixing problems, and putting it into a usable form for analysis or model training.
Data governance
Data governance is the set of rules, roles and checks that control how data is collected, stored, used, shared and corrected over time.
Deployment
Deployment means putting an AI system into real use so people or software can send it live inputs and receive live outputs.
Energy and water use of AI
Energy and water use of AI means the electricity and water consumed in building and running AI systems; emissions are a separate impact.
GPU, CPU and TPU
CPUs, GPUs and TPUs are different kinds of computer chips that run calculations, with each designed for different patterns of work, speed, cost and energy use.
Metadata
Information that describes other data, such as who created it, when, where, in what format, and under what rules it can be used.
Missing data
Some values that should be present in a dataset are absent, leaving blanks that can distort analysis and model behaviour.
Noisy data
Data that contains errors, irrelevant variation or unclear signals, making patterns harder for people or models to detect reliably.
Rate limit
A control that caps how many requests or how much use a service accepts within a set time, to keep systems available, fair and affordable.
Sampling (of data)
Choosing a smaller set of cases from a larger group so you can measure, inspect or train on it without using every case.
Scalability
The ability of a system to handle more users, data or tasks without a serious drop in speed, quality, reliability or cost control.
Structured data
Information organised into predefined fields, often in rows and columns, so software can process it predictably.
Unstructured data
Information whose main content is not organised into consistent, predefined fields, such as emails, documents, images, audio and messages, and usually needs extra processing for analysis.
Intermediate
Data distribution
The pattern of values, categories and frequencies in a dataset, including what appears often, rarely or not at all.
Data sovereignty and localisation
Rules and arrangements about where data is stored, processed and governed, and which laws and authorities apply to it.
Distribution shift and data drift
These terms describe mismatches between development and live data, including changed inputs, labels or relationships, which can reduce a system's reliability.
Edge AI
Running AI inference on a device at or near the data source, instead of sending each task to a remote server, which can reduce delay and network dependence.
Endpoint
A network address where software sends requests to a service and receives responses according to an API's rules.
Model hosting
The systems and services that keep an AI model available so it can receive requests, run on computing hardware, and return outputs reliably and securely.
Synthetic data
Artificially generated records designed to resemble data from a real population or process for uses such as testing, training or sharing.