Is Scraping Public Data for Lead Generation Legal?
Scraping publicly available business data for lead generation is broadly lawful in the United States, but the constraints are Terms of Service, robots.txt and privacy law once personal data is involved. What the CFAA rulings actually say, where the CCPA changes the calculus, and how to keep a prospecting pipeline defensible.
By the ClawEngine team
July 2026 · 10 min read
Hit Extract to turn this page into clean, LLM-ready data.
robots.txt respected · public data only
The short answer
Scraping publicly available business data for lead generation is broadly lawful in the United States. US courts have repeatedly declined to treat access to public web data as unauthorized access under the Computer Fraud and Abuse Act, most notably in the hiQ v. LinkedIn litigation. The constraints that still bite are a site's Terms of Service, its robots.txt, copyright in the content, and privacy law once you collect personal data. Company-level firmographics are lower risk than personal contact details, which fall under the CCPA and similar rules. Stay on public pages, avoid logins, and minimize personal data, and a prospecting pipeline is defensible. This is general information, not legal advice.
The nervousness around scraping for sales is understandable, and mostly aimed at the wrong risk. The headline question, is it legal to access public data, has a fairly settled answer. The question that actually decides your exposure, what data you collect and how you use it, is the one most teams skip. This guide separates the two.
What the CFAA rulings actually say
The Computer Fraud and Abuse Act is the US anti-hacking law that scraping fears most, because it carries criminal penalties for accessing a computer "without authorization." The key question for scraping is whether reading a public web page counts as unauthorized access. The courts have increasingly said no.
In hiQ Labs v. LinkedIn, the Ninth Circuit held that scraping data that is publicly available, meaning no login is required, does not violate the CFAA, because there is no access barrier to breach. The Supreme Court's 2021 decision in Van Buren v. United States narrowed the CFAA further, reading "exceeds authorized access" to cover only areas of a system you are not permitted to enter at all, not misuse of data you were allowed to see. Together these mean that accessing genuinely public pages is very unlikely to be a CFAA violation. The moment a login, a paywall or a technical access control stands between you and the data, that analysis changes, which is exactly why a compliance-first tool stays off gated content.
The constraints that still apply
"Not a CFAA violation" is not the same as "no rules." Four separate bodies of law and contract still shape what you can do.
| Constraint | What it means for lead generation |
|---|---|
| Terms of Service | A site's ToS can prohibit scraping as a contract matter. Breaching it is not a CFAA crime, but it can support a breach-of-contract claim, especially where you agreed to the terms. |
| robots.txt | Not legally binding on its own, but ignoring it signals bad faith and undercuts a "we act responsibly" defense. Respect it. |
| Copyright | Facts are not copyrightable, but original text and compiled databases can be. Storing and republishing verbatim content is where copyright risk lives. |
| Privacy law (CCPA, GDPR) | The big one for lead gen. Once you collect data about identifiable people, consumer-privacy rules govern collection, notice, and deletion rights. |
Where the CCPA changes the calculus
The California Consumer Privacy Act, as amended by the CPRA, is the constraint most likely to touch a US prospecting pipeline, and it does not care whether the data was public. The CCPA defines personal information broadly and, importantly, does not exempt data just because it was publicly available when the "public" source is a scrape rather than a government record. If you collect information about identifiable individuals, business contacts included, you can trigger obligations around notice, purpose limitation, and honoring deletion and opt-out requests.
This is why the risk profile of company data and personal data diverges so sharply. Scraping a company's public firmographics, its industry, headquarters, size and the products it sells, involves no personal data and sits on the settled side of the law. Scraping a named individual's contact details pulls you into privacy-law territory where you need a lawful basis, a notice mechanism, and a way to handle deletion requests. Most of the qualification signal a sales team actually needs lives at the company level, so leaning there is both lower risk and usually more useful.
How to keep a prospecting pipeline defensible
Compliance here is mostly a set of habits, not a legal department. A few practical rules cover most of the risk:
Stay on public pages. No logins, no paywalls, no circumventing access controls. This keeps you clear of the CFAA and of most ToS-scraping claims tied to logged-in access.
Respect robots.txt and rate limits. Read the file, honor crawl-delay, and do not hammer a site. Acting like a considerate crawler is both good practice and good evidence if anyone ever asks.
Prefer company data over personal data. Build your schema around firmographics. Where you do collect personal business contacts, treat them under your privacy program: document the source and purpose, and be able to honor deletion and opt-out requests.
Do not republish verbatim content. Extract facts and structured fields, not wholesale copies of copyrighted text, which sidesteps most copyright exposure.
A tool built around these habits does the enforcement for you. ClawEngine works on public and permitted pages only, reads robots.txt, respects Terms of Service and honors crawl-delay, and does not target logins or private profiles. For the enrichment mechanics, our lead generation scraping API shows the exact schema-based call, and if you are choosing a vendor, the best web scraping API for lead generation compares the options.
When to bring in real counsel
General guidance covers the common case; some situations warrant a lawyer. If you plan to collect personal data at scale, operate in or target the EU or UK where the GDPR applies, work in a regulated industry, or build a product that resells scraped data, the stakes justify professional advice. For regulated teams, mapping these obligations to controls is its own discipline, and a compliance function that tracks obligations and enforces policy is worth having before the pipeline scales, not after. The pattern to avoid is treating "the data was public" as a complete answer. It answers the CFAA question and none of the others.
The bottom line
Scraping public business data for lead generation is broadly lawful in the US, and the CFAA is not the wall people imagine, provided you stay on genuinely public pages. The real work is downstream of access: respect Terms of Service and robots.txt, keep clear of copyrighted text, and treat any personal data under the CCPA and its cousins. Build on public firmographics, stay off logins, and run a tool that enforces those boundaries by default, and your prospecting engine is both effective and defensible.
See ClawEngine turn pages into clean data
Point ClawEngine at any public or permitted site and get back clean markdown, JSON, or typed structured fields in one call. Crawl at scale, render JavaScript, and feed your RAG pipelines and AI agents, robots.txt and Terms of Service respected.