Data & Methodology

Where Does the Data Come From?

We crawl public job listings daily from tech company career pages and job boards. We focus on software engineering roles across all experience levels. All data is aggregated and anonymized — we don't collect personal information from job listings.

Update Frequency

Job data is crawled daily. After each crawl, market aggregates are refreshed: salary percentiles, tech stack demand, hiring velocity, and remote work ratios. The newsletter is sent every Wednesday with the latest weekly data.

What Gets Extracted

From each job listing, we extract and normalize:

• Tech stacks — programming languages, frameworks, and tools
• Salary data — ranges, annualized and normalized to USD
• Location — remote, hybrid, onsite, and geographic eligibility
• Experience level — junior, mid, senior, staff, principal
• Benefits — health, equity, PTO, etc.
• Culture signals — async-first, pair programming, etc.

Methodology

Salary Percentiles

Salary percentiles (p25, p50, p75, p90) are computed monthly from jobs that disclose salary information. Only annualized, US-eligible salaries above $30K are included. Hourly, weekly, and monthly rates are annualized using standard multipliers.

Hiring Velocity

Hiring velocity measures the week-over-week change in job posting volume. A positive velocity means more jobs were posted this week compared to last week.

Data Quality

Every listing goes through deduplication (by URL and title+company), validation (minimum description length, valid salary ranges), and normalization (consistent company names, standardized skill taxonomies).