Dataset

job-postings-raw

Jobs & Workforce Download 1 source

The job-postings-raw dataset is a large-scale tabular collection of scraped job postings distributed in Parquet format. It aggregates records across multiple sources and locales, with US coverage indicated in the dataset metadata.

Data preview

Loading preview...

Dataset card

What this dataset contains

The dataset holds roughly 2.6 million job posting records in a single train split, tagged in the 1M–10M size range. Rows include raw HTML of the original posting in job_posting_html alongside identifier fields such as document_id, company_id, and dataset_id. Sources appear to span multiple scraping feeds (for example, arbeitsagentur_de and facebook_de appear in the sample), with a US region tag also present in the metadata.

Structure and fields

The schema combines string identifiers with a few numeric fields. Identification and source columns include document_id, company_id, dataset_id, source, scraped_date, and dataset_url. Geographic and language context is captured by country, locale, language, city, detected_language, and detected_language_confidence. Posting-specific attributes include companyName, position_name, category, and the raw job_posting_html text, with dataset_type, dataset_license, dataset_source, and dataset_title describing the parent dataset record.

How analysts use it

Analysts can parse job_posting_html to extract skills, seniority, and compensation signals, joining them to position_name, category, and companyName for firm-level labor demand studies. The source, country, city, and detected_language fields support cross-source aggregation and coverage analysis of online recruitment markets. For investment workflows, the volume of postings by companyName or category over scraped_date can serve as a proxy for hiring momentum in thematic or single-stock monitoring models.

Documentation & references 1
  1. 2024-mcm-everitt-ryan/job-postings-raw: listing on Hugging Face

Further reading

All guides
  • What is alternative data?Alternative data in investment research: what the term covers, how it differs from data format, and why provenance, timing, access and validation matter.
  • Job postings as an investment signalWhy hiring data predicts fundamentals: growth intent, expansion geography, technology adoption and cost control, how postings are collected, structured and turned into tradeable indicators.
  • Web scraping and compliance in alternative dataHow scraped datasets are actually collected, where terms of service and computer-muse laws draw lines, what hiQ v. LinkedIn settled and did not, and the diligence checklist for legally fragile data.
  • Free alternative data sourcesThe practical list of free alternative-data sources for investors: public filings, official statistics, satellite and earth observation, on-chain data, web archives and open registries, what each covers, what it costs in engineering effort, and where free data falls short.
  • Alternative data for investingHow funds turn alternative data into an investment edge: signal families, evaluation, backtesting, compliance and the build-vs-buy decision, mapped to the datasets and providers indexed on this encyclopedia.
  • Job market data: datasets and providersThe datasets and providers behind labor-market signals: job postings, payroll, employee profiles and job-change data, what each source measures, its caveats and how to choose one.

Discussion

Questions or observations about this dataset? Join the conversation on X.

Discuss on X

No comments yet. Start the conversation on X.