API Docs/Content & LLM
POST

Plain Text Extractor API

Free Public API

Extract clean, human-readable plain text with boilerplate and script tag removal.

Try in Live Web Tool
POSThttps://api.headless-lender.com/api/v1/text
Public: No Key Needed•Highest Free Quota: 1,000 Req/Mo + 10h Browsers (No Card Required)

Overview & Architecture

Strip HTML tags, JavaScript scripts, CSS styles, navigation bars, and footers to produce clean, line-break preserved plain text ideal for NLP pipelines, embeddings, and word counting.

Zero boilerplate / Automatic nav and footer stripping
Normalized whitespace with preserved paragraph breaks
Instant word and character counts
Ready for embeddings vectorization
Playwright Execution & Valkey Caching Pipeline

Because this endpoint utilizes full headless Chromium rendering, dynamic JavaScript and single-page apps (SPAs) are executed completely before conversion:

1. Cold Scrape (Cache MISS)~800ms – 2.5s

Chromium initializes, fetches the URL, executes client JavaScript, resolves DOM mutations, and generates output.

2. Repeat Request (Cache HIT)~5ms – 15ms

Returned instantly from Valkey/Redis cache with header X-Lender-Cache: HIT (15-minute TTL).

Code Integration Examples

Instant Public Endpoint: Zero configuration, no API key needed. Want our highest free quota? Get 1,000 free requests/month + 10 hours of cloud browsers with a free key (No credit card required).
curl -X POST https://api.headless-lender.com/api/v1/text \
  -H "Content-Type: application/json" \
  -d '{
    "url": "https://en.wikipedia.org/wiki/Artificial_intelligence",
    "stripNavAndFooter": true,
    "preserveLinebreaks": true
  }'

Headers & Authentication Standard

1. Public Access (No Key)

No Authorization header required. Simply send a JSON POST request. Perfect for quick prototypes, small scripts, and low-volume scraping.

Content-Type: application/json

2. Free API Key (Highest Free Quota)

1,000 Req/Mo Free

Sign up in 10s with no credit card required. Unlocks 1,000 free monthly requests, 600 browser minutes (10 hours), 120 req/min burst limits, and cache-bypass controls.

Authorization: Bearer hl_live_your_api_key_here
Access ModeMonthly QuotaCloud Browser TimeBurst LimitCredit CardAction
Public AnonymousDaily IP Allowance5-min trial sandbox10 req/minNoneInstant (No Setup)
Free Account (Highest Quota)1,000 Req / Month600 Mins (10 Hours)120 req/minZero ($0 forever)Claim Free Key →

Request Body Parameters

FieldTypeRequiredDefaultDescription
urlstringrequired—Webpage URL to extract text from.
stripNavAndFooterbooleanoptionaltrueOmit navigation, header, and footer tags from output.
preserveLinebreaksbooleanoptionaltrueMaintain paragraph breaks and bullet item line breaks.
normalizeWhitespacebooleanoptionaltrueCollapse excessive tabs and multiple spaces into single spaces.
selectorstringoptional—CSS selector to restrict text extraction to a specific container.

Response Schema & Example

200 OK — application/jsonDuration: ~800ms (Cold) / ~8ms (Cached)
{
  "url": "https://en.wikipedia.org/wiki/Artificial_intelligence",
  "title": "Artificial intelligence - Wikipedia",
  "text": "Artificial intelligence (AI) is the intelligence of machines or software, as opposed to the intelligence of living beings...",
  "wordCount": 2150,
  "characterCount": 14200,
  "durationMs": 260
}