JobSpy is a job scraping library that aggregates jobs from popular job boards with one tool:
- Scrapes job postings from LinkedIn, Indeed, ZipRecruiter, Glassdoor, SEEK (with JobStreet & Jobsdb), Naukri, HelloWork, Bayt & BDJobs concurrently
- Aggregates the job postings in a dataframe
- Proxy support to bypass blocking
Installation
pip install -U python-jobspy
Python version >= 3.10 required
Usage
from jobspy import scrape_jobs
jobs = scrape_jobs(
site_name=["linkedin", "indeed", "zip_recruiter", "glassdoor"], # also "seek", "naukri", "hellowork", "bayt", "bdjobs"
search_term="software engineer",
location="San Francisco, CA",
results_wanted=20,
hours_old=72,
country_indeed="USA",
# fetch_description=True, # read each job's page on boards whose search results have no description (slower)
# proxies=["user:pass@host:port", "localhost"],
)
print(f"Found {len(jobs)} jobs")
print(jobs.head())
jobs.to_csv("jobs.csv", index=False)Output
SITE TITLE COMPANY LOCATION JOB_TYPE INTERVAL MIN_AMOUNT MAX_AMOUNT JOB_URL DESCRIPTION
indeed Software Engineer AMERICAN SYSTEMS Arlington, VA, USA None yearly 150000 200000 https://www.indeed.com/viewjob?jk=5e409e577046... THIS POSITION COMES WITH A 10K SIGNING BONUS!...
indeed Senior Software Engineer TherapyNotes.com Philadelphia, PA, USA fulltime yearly 110000 135000 https://www.indeed.com/viewjob?jk=da39574a40cb... About Us TherapyNotes is the national leader i...
linkedin Software Engineer - Early Career Lockheed Martin Sunnyvale, CA, USA fulltime yearly None None https://www.linkedin.com/jobs/view/3693012711 Description:By bringing together people that u...
linkedin Full-Stack Software Engineer Rain New York, NY, USA fulltime yearly None None https://www.linkedin.com/jobs/view/3696158877 Rain’s mission is to create the fastest and ea...
zip_recruiter Software Engineer - New Grad ZipRecruiter Santa Monica, CA, USA fulltime yearly 130000 150000 https://www.ziprecruiter.com/jobs/ziprecruiter... We offer a hybrid work environment. Most US-ba...
zip_recruiter Software Developer TEKsystems Phoenix, AZ, USA fulltime hourly 65 75 https://www.ziprecruiter.com/jobs/teksystems-0... Top Skills' Details• 6 years of Java developme...
Command line
The package installs a jobspy command whose options mirror the scrape_jobs() parameters below; jobspy -h lists them, the output fields and exit codes.
uv tool install python-jobspy
jobspy "software engineer" --site indeed,linkedin --location Chicago -n 20
jobspy nurse --site indeed,linkedin --hours-old 24 -o jobs.jsonl
jobspy "data analyst" --remote --fields title,company,job_url
MCP server
mcp-jobspy is an MCP server that runs with uvx mcp-jobspy@latest. See mcp/README.md for setup, tools and proxies.
Standard config works for most clients:
{
"mcpServers": {
"jobspy": {
"command": "uvx",
"args": ["mcp-jobspy@latest"]
}
}
}Parameters for scrape_jobs()
Optional
├── site_name (list|str):
| linkedin, indeed, zip_recruiter, glassdoor, seek, naukri, hellowork, bayt, bdjobs, google
| (default is all)
│
├── search_term (str)
|
├── google_search_term (str)
| search term for google jobs. This is the only param for filtering google jobs.
│
├── location (str)
│
├── distance (int):
| in miles, default 50
│
├── job_type (str):
| fulltime, parttime, contract, temporary, internship, perdiem, other, volunteer
│
├── proxies (list|str):
| in format ['user:pass@host:port', 'localhost'], or a single proxy as a string
| each job board scraper will round robin through the proxies
| socks proxies on LinkedIn, Indeed and BDJobs need pip install "requests[socks]"
|
├── is_remote (bool)
│
├── results_wanted (int):
| number of job results to retrieve for each site specified in 'site_name'
│
├── easy_apply (bool):
| filters for jobs that are hosted on the job board site
|
├── user_agent (str):
| override the default user agent which may be outdated
│
├── description_format (str):
| markdown, html, plain (Format type of the job descriptions. Default is markdown.)
│
├── offset (int):
| skips that many results (e.g. 25 skips the first 25 and starts from the 26th)
│
├── hours_old (int):
| filters jobs by the number of hours since the job was posted
| (Glassdoor filters by whole days, so it rounds up to the next day.)
│
├── verbose (int) {0, 1, 2}:
| Controls the verbosity of the runtime printouts
| (0 prints only errors, 1 is errors+warnings, 2 is all logs. Default is 1.)
│
├── fetch_description (bool):
| for boards whose search results don't include the job description: fetches each job's
| page for the description and other details (e.g. job type). Without it these are empty
| for those boards. Adds one request per job, so use proxies for larger searches
│
├── linkedin_fetch_description (bool):
| deprecated, use fetch_description (still works; removed in 2.0)
│
├── linkedin_company_ids (list[int]):
| searches for linkedin jobs with specific company ids
|
├── country_indeed (str):
| picks the country site on Indeed, Glassdoor & SEEK (default is usa; see below for the names)
|
├── enforce_annual_salary (bool):
| converts wages to annual salary
|
├── ca_cert (str)
| path to CA Certificate file for proxies
Supported Countries for Job Searching
LinkedIn searches worldwide. location takes any place.
Indeed
Indeed searches one country. location takes a place in that country, e.g. city & state.
country_indeed (default usa) picks the country:
| Argentina | Australia | Austria | Bahrain |
| Belgium | Brazil | Canada | Chile |
| China | Colombia | Costa Rica | Czech Republic |
| Denmark | Ecuador | Egypt | Finland |
| France | Germany | Greece | Hong Kong |
| Hungary | India | Indonesia | Ireland |
| Israel | Italy | Japan | Kuwait |
| Luxembourg | Malaysia | Mexico | Morocco |
| Netherlands | New Zealand | Nigeria | Norway |
| Oman | Pakistan | Panama | Peru |
| Philippines | Poland | Portugal | Qatar |
| Romania | Saudi Arabia | Singapore | South Africa |
| South Korea | Spain | Sweden | Switzerland |
| Taiwan | Thailand | Turkey | UK |
| Ukraine | United Arab Emirates | Uruguay | USA |
| Venezuela | Vietnam |
ZipRecruiter
ZipRecruiter searches the US & Canada. location takes a place in either.
Glassdoor
Glassdoor searches worldwide. location takes any place, in any country, e.g. "Berlin" or "Vietnam".
country_indeed (default usa) picks the Glassdoor site; with no location it searches that site's country:
| Argentina | Australia | Austria | Belgium |
| Brazil | Canada | France | Germany |
| Hong Kong | India | Ireland | Italy |
| Mexico | Netherlands | New Zealand | Singapore |
| Spain | Switzerland | UK | USA |
SEEK / JobStreet / Jobsdb
SEEK searches one country. location takes a suburb, city or region in that country, e.g. "Melbourne" or "Jakarta".
country_indeed picks the country; set it, as the default usa isn't one of them:
| Australia | Hong Kong | Indonesia | Malaysia |
| New Zealand | Philippines | Singapore | Thailand |
Naukri
Naukri searches India. location takes a city, e.g. "Pune".
HelloWork
HelloWork searches France. location takes a French city, postcode or region, e.g. "Lyon". Most jobs are posted in French, so French search terms find more.
Bayt
Bayt searches worldwide, with most of its jobs in the Middle East & India. location takes a country, or a city with its country, e.g. "Saudi Arabia" or "Dubai, UAE".
BDJobs
BDJobs searches Bangladesh. location takes a division or district, e.g. "Dhaka" or "Chattogram Division".
Notes
- Indeed is the best scraper currently with no rate limiting.
- Indeed's
date_postedis the day a job was added to Indeed, the same datehours_oldfilters on. - Most job board endpoints are capped at around 1000 jobs on a given search.
- LinkedIn rate limits bursts of requests with a 429, which clears within about a minute. Use proxies for larger searches.
- Glassdoor rate limits above about 2 requests a second.
Frequently Asked Questions
Q: How do I tell a blocked board from one with no jobs?
A: Failures and ignored options are logged as they happen, and the result's attrs carry the same messages so your code can read them:
jobs.attrs["errors"] # {"linkedin": "response status code 429 (blocked: use a proxy)"}
jobs.attrs["warnings"] # {"bdjobs": ["job_type internship isn't supported, ignoring it"]}Q: Why is Indeed giving unrelated roles?
A: Indeed searches the description too.
- use - to remove words
- "" for exact match
Example of a good Indeed query
search_term='"engineering intern" software summer (java OR python OR c++) 2025 -tax -marketing'This searches the description/title and must include software, summer, 2025, one of the languages, engineering intern exactly, no tax, no marketing.
Q: No results when using "google"?
A: Google Jobs is currently unavailable.
Q: Received a response code 429?
A: The board blocked you for sending too many requests. All of the job board sites are aggressive with blocking. We recommend:
- Wait some time between scrapes (site-dependent).
- Try using the proxies param to change your IP address.
JobPost Schema
JobPost
├── id
├── site
├── job_url
├── job_url_direct
├── title
├── company
├── location
├── date_posted
├── job_type: fulltime, parttime, internship, contract, temporary, ...
├── salary_source: direct_data, description (parsed from posting), estimated (Glassdoor's own estimate)
├── interval: yearly, monthly, weekly, daily, hourly
├── min_amount
├── max_amount
├── currency
├── is_remote
├── job_level
├── job_function
├── listing_type
├── emails
├── description
├── company_industry
├── company_url
├── company_logo
├── company_url_direct
├── company_addresses
├── company_num_employees
├── company_revenue
├── company_description
├── skills
├── experience_range
├── company_rating
├── company_reviews_count
├── vacancy_count
└── work_from_home_type
A column is empty when the job board doesn't provide it.