Dataset
clinical-trials-embeddings
Vector embeddings of clinical-trial records, hundreds of thousands of entries in Parquet (Apache 2.0). Enables similarity and retrieval analysis of trial design, indication crowding and competitive positioning.
Data preview
Dataset card
Clinical Trials Embeddings is a public-records dataset that pairs ClinicalTrials.gov trial descriptions with vector representations generated by the minishlab/potion-base-8M embedding model. It is distributed in Parquet format on the Hugging Face Hub by publisher cyrilzakka, with a single train split of 535,475 rows.
What this dataset contains
Each row corresponds to a single clinical trial drawn from ClinicalTrials.gov (accessed 2 May 2025). The dataset covers key descriptive fields that describe trial objectives, eligibility criteria, and study design, making it suitable for text-classification, zero-shot-classification, and text-generation experiments. Its stated size category is between 100K and 1M records, and it is delivered in Parquet files compatible with the datasets and dask libraries.
Structure and fields
The schema exposes string columns nctId, briefTitle, briefSummary, detailedDescription, and eligibilityCriteria for every trial, followed by an embedding column stored as float32 features produced by the potion-base-8M model. The train split contains 535,475 rows, and the Apache-2.0 license tag is present in the metadata even though the top-level license field is listed as unstated.
How analysts use it
Because the rows are publicly registered trial records with pre-computed embeddings, healthcare and biotech analysts can treat the briefSummary, eligibilityCriteria, and detailedDescription text as a corpus for similarity search, trial-matching models, or thematic clustering of R&D activity. The nctId field provides a stable join key to other ClinicalTrials.gov or sponsor disclosures, which can support tracking of indications, sponsors, and study designs over time.
Documentation & references 1
Related datasets
Browse moreParsed eligibility criteria from 13,229 ClinicalTrials.gov studies representing the candidate pool gathered by two first-stage retrievers during TREC Clinical Trials 2021–2023, formatted as typed entity-relation graphs for reranking models.
The clinical-trials-patient-graphs dataset is a small tabular collection of patient-level clinical records distributed in Parquet format by the 2001jdev publisher. It organizes entities and relations extracted from trial data into structured rows spanning 2021 through 2023.
This dataset is a parsed snapshot of ClinicalTrials.gov records, distributed in Parquet format on the Hugging Face Hub under an unspecified license. It contains roughly 52,000 trial entries drawn from public registry filings.
clinical-trials-trec-qrels is a tabular relevance-judgment file distributed by the 2001jdev user on the Hugging Face Hub. It maps clinical-trial topic identifiers to NCT registry IDs with graded relevance scores.
The clinical-trials-trec-topics dataset is a small tabular collection of clinical-trial topic records distributed in Parquet format on the Hugging Face Hub. It appears to be derived from TREC clinical-trial retrieval topics, with rows partitioned by year.
SEC EDGAR 10-K & 10-Q financial statements for 2,600+ NASDAQ companies.
Discussion
Questions or observations about this dataset? Join the conversation on X.
No comments yet. Start the conversation on X.