Reference
AI training data glossary
The words that come up in AI training data deals, defined plainly: how models use data (pretraining, SFT, RLHF, RL environments, eval sets), how deals are structured (exclusive and non-exclusive licences, revenue shares, clawbacks) and how records are cleaned (pseudonymisation versus anonymisation).
Page updated 19 Oct 2026. Figures checked 18 Oct 2026 at their sources.

How models are trained
- Pretraining
The first, largest training stage, in which a model learns from very large amounts of general text, code or media. Most disclosed content licences (news archives, forums, books) feed this stage.
See: Deals database
- SFT (supervised fine-tuning)
Further training on worked examples: an input and the answer a capable person would give. A question in a support queue and the reply that resolved it has the same shape.
- RLHF (reinforcement learning from human feedback)
Training a model by having people rank or grade its outputs, then rewarding the outputs they prefer. The people doing the grading are often paid experts.
Example: Mercor lists software engineering experts at $70 to $150 an hour for grading model-written code. (Mercor job listing, checked 18 Oct 2026)
- RL environment (RL gym)
A simulated workplace in which an AI agent attempts real tasks and is scored on the result. Built from records of how work was actually done, so the agent can practise the same steps.
Example: Surge AI uses startup archives to build reinforcement-learning gyms for training AI agents. (MIT Technology Review, checked 18 Oct 2026)
- Digital twin (of a company)
An anonymised replica of a company's tools and records, used as the setting for an RL environment.
Example: Ooak Data describes turning Gmail, Slack, Notion and Jira data into an anonymised digital twin for agent training. (Y Combinator, checked 18 Oct 2026)
- Eval set (evaluation set)
Examples held back from training and used only to test a model. Because they must stay unseen, eval data is often licensed under stricter limits than training data.
- Expert data
Training material written or graded by specialists such as engineers, lawyers or doctors, usually paid per hour rather than per item.
How deals are structured
- Licence vs sale
A licence gives the buyer the right to use a copy on agreed terms while the owner keeps the original. A sale transfers the asset itself. Most programmes describe licences; SimpleClosure offers either.
- Exclusive licence
A licence that bars the owner from licensing the same material to anyone else, for a period or for good. It usually commands a higher price.
Example: Pewter lists some deals as a perpetual, exclusive licence. (Pewter, checked 18 Oct 2026)
- Non-exclusive licence
A licence that leaves the owner free to license the same material again. Common in large content deals.
Example: Calliope Networks says its AI model training licences are non-exclusive. (Calliope Networks, checked 18 Oct 2026)
- Perpetual licence
A licence with no end date. The buyer may use the material, and keep what a model learned from it, indefinitely.
- Net 30 / Net 60
Payment due 30 or 60 days after a trigger such as invoice or approval.
Example: Polyshares pays Net 30 to 60 once data is approved, shared and anonymised. (Polyshares, checked 18 Oct 2026)
- Clawback
A clause that lets the payer recover money already paid, for example if the data turns out incomplete or a downstream buyer rejects it.
- Indicative estimate
A figure shown before anyone has examined the records. It binds no one and is not an offer.
Example: Handshake AI labels its on-page estimate indicative and not an offer to purchase. (Handshake AI, checked 18 Oct 2026)
- Referral fee
Money a programme pays to whoever introduces a company that goes on to license data.
Example: Grepped pays 10% of the deal, up to $100K per referral. (Grepped, checked 18 Oct 2026)
- Marketplace, broker, direct buyer
A marketplace lists data for buyers to purchase; a broker places it with a buyer and is paid a fee; a direct buyer licenses it for itself and resells or uses it.
See: Programme directory
How records are cleaned and kept
- PII (personally identifiable information)
Anything that identifies a person directly, such as a name, email address or phone number, or indirectly in combination with other details.
- Pseudonymisation
Replacing identifiers with placeholders while a key to reverse it exists somewhere. Under the GDPR, pseudonymised data is still personal data.
- Anonymisation
Processing that leaves no reasonable way to identify anyone, with no key kept. Truly anonymous data falls outside the GDPR, which is why the distinction matters in licensing.
- De-identification
The umbrella term for removing or replacing identifiers before records leave a company. Programmes use it loosely; ask which of the two above they mean.
- Retention period
How long a software vendor keeps a customer's data after cancellation or non-payment before deleting it. Exports often stop working before deletion starts.
- Unit price
A price per item: per word, per image, per minute of video, per book. Common for media, rare for company records, which are priced per company.
See: Unit prices
Keep reading
Related pages
FAQ
Frequently asked questions
01What is the difference between SFT and RLHF?
SFT trains on worked examples of correct answers. RLHF trains by rewarding the outputs that people rate higher. Both rely on human judgement; they use it in different forms.
02What is an RL environment in AI training?
A simulated setting where an AI agent tries real tasks and is scored. Builders use records of how work was done, which is why some programmes buy company archives.
03Is pseudonymised data the same as anonymous data?
No. Pseudonymised data can be re-linked with a key and stays personal data under the GDPR. Anonymous data cannot reasonably be linked back to anyone.
04What does a non-exclusive licence allow?
The owner may license the same material to other buyers. An exclusive licence rules that out, for a set period or for good.
05What is an indicative estimate?
A number shown before any review of the records. Programmes such as Handshake AI and micro1 say theirs are not offers.
06What is a clawback clause?
A clause allowing money already paid to be taken back under set conditions, such as missing data or a rejected delivery. None of the programmes we track publishes one.
Stay current
Get the monthly price update
Once a month: deals that disclosed a value, programmes that changed their published figures, and corrections to this site. Free, and one click to leave.
Holding an offer already? Compare it with published ranges.