Skip to content

Reference

AI training data glossary

The words that come up in AI training data deals, defined plainly: how models use data (pretraining, SFT, RLHF, RL environments, eval sets), how deals are structured (exclusive and non-exclusive licences, revenue shares, clawbacks) and how records are cleaned (pseudonymisation versus anonymisation).

Page updated 19 Oct 2026. Figures checked 18 Oct 2026 at their sources.

A data scientist explaining terms written on a whiteboard to two colleagues at a meeting table

How models are trained

Pretraining

The first, largest training stage, in which a model learns from very large amounts of general text, code or media. Most disclosed content licences (news archives, forums, books) feed this stage.

See: Deals database

SFT (supervised fine-tuning)

Further training on worked examples: an input and the answer a capable person would give. A question in a support queue and the reply that resolved it has the same shape.

RLHF (reinforcement learning from human feedback)

Training a model by having people rank or grade its outputs, then rewarding the outputs they prefer. The people doing the grading are often paid experts.

Example: Mercor lists software engineering experts at $70 to $150 an hour for grading model-written code. (Mercor job listing, checked 18 Oct 2026)

RL environment (RL gym)

A simulated workplace in which an AI agent attempts real tasks and is scored on the result. Built from records of how work was actually done, so the agent can practise the same steps.

Example: Surge AI uses startup archives to build reinforcement-learning gyms for training AI agents. (MIT Technology Review, checked 18 Oct 2026)

Digital twin (of a company)

An anonymised replica of a company's tools and records, used as the setting for an RL environment.

Example: Ooak Data describes turning Gmail, Slack, Notion and Jira data into an anonymised digital twin for agent training. (Y Combinator, checked 18 Oct 2026)

Eval set (evaluation set)

Examples held back from training and used only to test a model. Because they must stay unseen, eval data is often licensed under stricter limits than training data.

Expert data

Training material written or graded by specialists such as engineers, lawyers or doctors, usually paid per hour rather than per item.

See: Expert hourly rates in the price table

How deals are structured

Licence vs sale

A licence gives the buyer the right to use a copy on agreed terms while the owner keeps the original. A sale transfers the asset itself. Most programmes describe licences; SimpleClosure offers either.

See: SimpleClosure profile

Exclusive licence

A licence that bars the owner from licensing the same material to anyone else, for a period or for good. It usually commands a higher price.

Example: Pewter lists some deals as a perpetual, exclusive licence. (Pewter, checked 18 Oct 2026)

Non-exclusive licence

A licence that leaves the owner free to license the same material again. Common in large content deals.

Example: Calliope Networks says its AI model training licences are non-exclusive. (Calliope Networks, checked 18 Oct 2026)

Perpetual licence

A licence with no end date. The buyer may use the material, and keep what a model learned from it, indefinitely.

Revenue share

Payment as a percentage of what an intermediary earns each time it licenses the data again, instead of or on top of an upfront sum.

Example: Replay pays upfront cash plus a perpetual revenue share; Troveo pays on every resale. (Replay, checked 18 Oct 2026)

Net 30 / Net 60

Payment due 30 or 60 days after a trigger such as invoice or approval.

Example: Polyshares pays Net 30 to 60 once data is approved, shared and anonymised. (Polyshares, checked 18 Oct 2026)

Clawback

A clause that lets the payer recover money already paid, for example if the data turns out incomplete or a downstream buyer rejects it.

See: Licence clauses compared

Indicative estimate

A figure shown before anyone has examined the records. It binds no one and is not an offer.

Example: Handshake AI labels its on-page estimate indicative and not an offer to purchase. (Handshake AI, checked 18 Oct 2026)

Referral fee

Money a programme pays to whoever introduces a company that goes on to license data.

Example: Grepped pays 10% of the deal, up to $100K per referral. (Grepped, checked 18 Oct 2026)

Marketplace, broker, direct buyer

A marketplace lists data for buyers to purchase; a broker places it with a buyer and is paid a fee; a direct buyer licenses it for itself and resells or uses it.

See: Programme directory

How records are cleaned and kept

PII (personally identifiable information)

Anything that identifies a person directly, such as a name, email address or phone number, or indirectly in combination with other details.

Pseudonymisation

Replacing identifiers with placeholders while a key to reverse it exists somewhere. Under the GDPR, pseudonymised data is still personal data.

Anonymisation

Processing that leaves no reasonable way to identify anyone, with no key kept. Truly anonymous data falls outside the GDPR, which is why the distinction matters in licensing.

De-identification

The umbrella term for removing or replacing identifiers before records leave a company. Programmes use it loosely; ask which of the two above they mean.

Retention period

How long a software vendor keeps a customer's data after cancellation or non-payment before deleting it. Exports often stop working before deletion starts.

See: SaaS retention reference

Unit price

A price per item: per word, per image, per minute of video, per book. Common for media, rare for company records, which are priced per company.

See: Unit prices

Keep reading

FAQ

Frequently asked questions

01What is the difference between SFT and RLHF?

SFT trains on worked examples of correct answers. RLHF trains by rewarding the outputs that people rate higher. Both rely on human judgement; they use it in different forms.

02What is an RL environment in AI training?

A simulated setting where an AI agent tries real tasks and is scored. Builders use records of how work was done, which is why some programmes buy company archives.

03Is pseudonymised data the same as anonymous data?

No. Pseudonymised data can be re-linked with a key and stays personal data under the GDPR. Anonymous data cannot reasonably be linked back to anyone.

04What does a non-exclusive licence allow?

The owner may license the same material to other buyers. An exclusive licence rules that out, for a set period or for good.

05What is an indicative estimate?

A number shown before any review of the records. Programmes such as Handshake AI and micro1 say theirs are not offers.

06What is a clawback clause?

A clause allowing money already paid to be taken back under set conditions, such as missing data or a rejected delivery. None of the programmes we track publishes one.

Stay current

Get the monthly price update

Once a month: deals that disclosed a value, programmes that changed their published figures, and corrections to this site. Free, and one click to leave.

One email a month: new deals, changed programme figures, corrections. See the data protection notice.

Holding an offer already? Compare it with published ranges.