MENU navbar-image

🤖 ScrapeFlow

Web scraping API. Send a URL and get the page back as HTML, plain text, or markdown. JSON responses are returned parsed.

POST /v1/scraper

requires authentication

Fetches one URL and returns the page. By default the page is fetched over HTTP with a browser TLS fingerprint. A real browser is used when render_js or wait_for_selector is set, or when the plain fetch does not return HTTP 200.

A fetched page always returns HTTP 200, and the target site's own status code (for example 404) is in meta.status, along with its response headers and cookies. HTML is returned exactly as received unless you set output. Errors from ScrapeFlow itself (invalid request, blocked URL, page over 10 MB, page could not be loaded) use 4xx/5xx codes with success: false.

Example request:
import requests
import json

url = 'https://api.steadyapi.com/v1/scrapeflow/scraper'
payload = {
    "url": "https:\/\/api.steadyapi.com\/",
    "method": "GET",
    "headers": {
        "Accept-Language": "en-US"
    },
    "geo": "US",
    "render_js": false,
    "timeout": 10
}
headers = {
  'Authorization': 'Bearer YOUR_API_KEY',
  'Content-Type': 'application/json'
}

response = requests.request('POST', url, headers=headers, json=payload)
response.json()
$client = new \GuzzleHttp\Client();
$url = 'https://api.steadyapi.com/v1/scrapeflow/scraper';
$response = $client->post(
    $url,
    [
        'headers' => [
            'Authorization' => 'Bearer YOUR_API_KEY',
            'Content-Type' => 'application/json',
        ],
        'json' => [
            'url' => 'https://api.steadyapi.com/',
            'method' => 'GET',
            'headers' => [
                'Accept-Language' => 'en-US',
            ],
            'geo' => 'US',
            'render_js' => false,
            'timeout' => 10,
        ],
    ]
);
$body = $response->getBody();
print_r(json_decode((string) $body));
const url = new URL(
    "https://api.steadyapi.com/v1/scrapeflow/scraper"
);

const headers = {
    "Authorization": "Bearer YOUR_API_KEY",
    "Content-Type": "application/json",
    "Accept": "application/json",
};

let body = {
    "url": "https:\/\/api.steadyapi.com\/",
    "method": "GET",
    "headers": {
        "Accept-Language": "en-US"
    },
    "geo": "US",
    "render_js": false,
    "timeout": 10
};

fetch(url, {
    method: "POST",
    headers,
    body: JSON.stringify(body),
}).then(response => response.json());
curl --request POST \
    "https://api.steadyapi.com/v1/scrapeflow/scraper" \
    --header "Authorization: Bearer YOUR_API_KEY" \
    --header "Content-Type: application/json" \
    --data "{
    \"url\": \"https:\\/\\/api.steadyapi.com\\/\",
    \"method\": \"GET\",
    \"headers\": {
        \"Accept-Language\": \"en-US\"
    },
    \"geo\": \"US\",
    \"render_js\": false,
    \"timeout\": 10
}"

Example response (200, Success):


{
    "meta": {
        "version": "v1.0",
        "status": 200,
        "copywrite": "https://steadyapi.com",
        "status_code": 200,
        "headers": {
            "date": "Sat, 14 Feb 2026 19:57:52 GMT",
            "content-type": "application/json",
            "content-length": "136",
            "server": "cloudflare",
            "cache-control": "private, must-revalidate",
            "pragma": "no-cache",
            "expires": "-1",
            "set-cookie": "XSRF-TOKEN=eyJpdiI6ImhuQW1TVnl6RldDUkF4UElyQ3JnTWc9PSIsIn...",
            "content-encoding": "br",
            "x-frame-options": "SAMEORIGIN",
            "x-xss-protection": "1; mode=block",
            "x-content-type-options": "nosniff",
            "nel": "{\"report_to\":\"cf-nel\",\"success_fraction\":0.0,\"max_age\":604800}",
            "vary": "accept-encoding",
            "cf-cache-status": "DYNAMIC",
            "report-to": "{\"group\":\"cf-nel\",\"max_age\":604800,\"endpoints\":[{\"url\":\"https://a.nel.cloudflare.com/report/v4?s=WHSxhKns%2BOQEimKsvvZ7%2BcVbVhvMa4wnhvh3RF2Gr86blUaQB%2B5FRMPtoqIPSrGJHmH5aw8JXEh2gSDt4SrFFDn4wL79cy%2BBaiYGVM%2FdNebtrONlFbcybnUjRigd\"}]}",
            "cf-ray": "9cdf23146c4aea6c-DEN",
            "alt-svc": "h3=\":443\"; ma=86400"
        }
    },
    "body": {
        "message": "Welcome to SteadyAPI! Please refer to our API documentation to learn how to interact with our API: https://docs.steadyapi.com"
    }
}
 

Example response (401, Unauthenticated):


{
    "message": "Unauthenticated."
}
 

Example response (404, Not Found):


{
    "success": false,
    "message": "Resource Not Found"
}
 

Example response (422, Error Validations):


{
    "message": "The ticker field is required.",
    "errors": {
        "ticker": [
            "The ticker field is required."
        ]
    }
}
 

Request      

POST v1/scrapeflow/scraper

Headers

Authorization Bearer YOUR_API_KEY

Content-Type application/json

Body Parameters

url   string   

The page URL to fetch, up to 500 characters. Only public http and https addresses are allowed. Example: https://api.steadyapi.com/

method   string  optional  

HTTP method: GET, POST, or PUT. Default: GET. Example: GET

headers   object  optional  

Custom headers as key-value pairs, or a list of "Name: value" strings (up to 50). Transport headers such as Host and Content-Length are dropped.

data   string  optional  

Request data as a JSON string such as {"key":"value"} or a form-encoded string such as key=value. For POST and PUT it is sent as the body, with Content-Type set from the format if you did not send one. For GET it is appended to the URL as a query string.

geo   string  optional  

Country the request is sent from: US, GB, JP, BR, ZA, or AU. Default: US. Example: US

render_js   boolean  optional  

Load the page in a real browser and return the HTML after JavaScript runs. Slower than the default fetch. Default: false. Example: false

wait_for_selector   string  optional  

CSS selector to wait for before the page is returned. Setting it turns on render_js.

device   string  optional  

Device profile for JavaScript rendering: mobile or desktop. Default: mobile.

timeout   integer  optional  

Maximum wait in seconds, from 10 to 30. Default: 10. Example: 10

output   string  optional  

Format of body for HTML pages: html, text, or markdown. JSON responses are always returned parsed. Default: html.

extract   object  optional  

Up to 20 named CSS selectors, for example {"title": "h1"}. Matches (up to 100 per selector) are returned in extracted under the same names. Ignored for JSON responses.

extract_type   string  optional  

Return extracted matches as text or html. Default: text.

include_body   boolean  optional  

Set to false to return body as null and keep only meta and extracted. Default: true.