Raw page

Scrape's first name, kept working: the rendered HTML with the final URL and status, redirects, and optionally the page's XHR/fetch calls with their responses, cookies and console output. POST https://cdpfleet.com/v1/functions/rawpage → application/json.

curl -s https://cdpfleet.com/v1/functions/rawpage \
  -H "x-api-key: $CDPFLEET_API_KEY" -H "content-type: application/json" \
  -d '{"url":"https://example.com/","include":["html","requests","cookies"]}' -o page.json -D - | grep -i '^x-call-id'

// Node.js 18+: save as rawpage.mjs, run node rawpage.mjs
const res = await fetch('https://cdpfleet.com/v1/functions/rawpage', {
  method: 'POST',
  headers: { 'x-api-key': process.env.CDPFLEET_API_KEY, 'content-type': 'application/json' },
  body: JSON.stringify({
    url: 'https://example.com/',
    include: ['html', 'requests', 'cookies'],
  }),
  signal: AbortSignal.timeout(30000),
});
if (!res.ok) throw new Error(`${res.status} ${await res.text()}`); // 429: wait Retry-After seconds
console.log(await res.text());

# Python 3 with requests (pip install requests): save as rawpage.py, run python rawpage.py
import os
import requests

r = requests.post(
    "https://cdpfleet.com/v1/functions/rawpage",
    headers={"x-api-key": os.environ["CDPFLEET_API_KEY"]},
    json={
        "url": "https://example.com/",
        "include": ["html", "requests", "cookies"],
    },
    timeout=30,
)
if not r.ok:
    raise SystemExit(f"{r.status_code} {r.text}")  # 429: wait r.headers["Retry-After"] seconds
print(r.text)

// Java 17+: save as Main.java, run java Main.java
import java.net.URI;
import java.net.http.*;
import java.time.Duration;

public class Main {
  public static void main(String[] args) throws Exception {
    String body = """
        {
          "url": "https://example.com/",
          "include": ["html", "requests", "cookies"]
        }
        """;
    HttpResponse<byte[]> res = HttpClient.newHttpClient().send(
        HttpRequest.newBuilder(URI.create("https://cdpfleet.com/v1/functions/rawpage"))
            .header("x-api-key", System.getenv("CDPFLEET_API_KEY"))
            .header("content-type", "application/json")
            .timeout(Duration.ofSeconds(30))
            .POST(HttpRequest.BodyPublishers.ofString(body))
            .build(),
        HttpResponse.BodyHandlers.ofByteArray());
    if (res.statusCode() != 200) { // 429: wait Retry-After seconds
      throw new RuntimeException(res.statusCode() + " " + new String(res.body()));
    }
    System.out.writeBytes(res.body()); // UTF-8 as it came
    System.out.println();
  }
}

// .NET 8+: dotnet new console, replace Program.cs with this, run dotnet run
using System.Text;

using var http = new HttpClient { Timeout = TimeSpan.FromSeconds(30) };
http.DefaultRequestHeaders.Add("x-api-key", Environment.GetEnvironmentVariable("CDPFLEET_API_KEY"));
var body = """
    {
      "url": "https://example.com/",
      "include": ["html", "requests", "cookies"]
    }
    """;
var res = await http.PostAsync("https://cdpfleet.com/v1/functions/rawpage",
    new StringContent(body, Encoding.UTF8, "application/json"));
if (!res.IsSuccessStatusCode) // 429: wait Retry-After seconds
    throw new Exception($"{(int)res.StatusCode} {await res.Content.ReadAsStringAsync()}");
Console.WriteLine(await res.Content.ReadAsStringAsync());

// Go 1.21+: save as main.go, run go run main.go
package main

import (
	"fmt"
	"io"
	"log"
	"net/http"
	"os"
	"strings"
	"time"
)

func main() {
	body := `{
	  "url": "https://example.com/",
	  "include": ["html", "requests", "cookies"]
	}`
	req, _ := http.NewRequest("POST", "https://cdpfleet.com/v1/functions/rawpage", strings.NewReader(body))
	req.Header.Set("x-api-key", os.Getenv("CDPFLEET_API_KEY"))
	req.Header.Set("content-type", "application/json")
	res, err := (&http.Client{Timeout: 30 * time.Second}).Do(req)
	if err != nil {
		log.Fatal(err)
	}
	defer res.Body.Close()
	data, err := io.ReadAll(res.Body)
	if err != nil {
		log.Fatal(err)
	}
	if res.StatusCode != http.StatusOK { // 429: wait Retry-After seconds
		log.Fatalf("%s %s", res.Status, data)
	}
	fmt.Println(string(data))
}

Fields

Field	Type	Default	What it does
`url`	string	required	The page to load. A public `http` or `https` address: private, loopback, link-local, CGNAT and cloud-metadata addresses, `localhost`, `.local`/`.internal` names and names that resolve to them are refused (`400 invalid_url`).
`country`	string	`"random"`	Two-letter country for the exit IP and for the page's locale, timezone, geolocation and `Accept-Language` (see countries); `"random"` picks one. Unknown codes: `400 invalid_country`.
`max_wait`	number	`20`	Seconds to wait for the page to load, 1–60 (`400 invalid_option` otherwise). The whole call returns within about `max_wait` + 5 s, so a client timeout of `max_wait` + 10 s is safe. A page that is still loading then comes back partial (below); one that never started: `408 page_timeout`.
`proxy`	string or string[]	the Community proxy	Omit it to use the free Community proxy in `country`. Or: your own proxy URL (`http://`, `https://`, `socks5://`), a list (one is picked per call), a `cdpfleet-plan…` token, or a residential `cdpfleet-resi…` token (tier, country, device OS, sticky session) billed per GB to your residential balance (proxies). `proxy_rules` isn't supported yet (`400 invalid_option`).
`include`	string[]	`["html"]`	Any of `"html"`, `"requests"`, `"cookies"`, `"console"`.

Good to know

Response: url (final), status, redirects[] {url, status}, partial: true when the page hadn't finished loading within max_wait, and per include: html; requests[] {url, method, resource_type: "xhr"|"fetch", status, response_headers, body} with each body cut at 64 KB; cookies[] {name, value, domain, path, expires, httpOnly, secure, sameSite}; console[] {type, text}.
Only XHR and fetch calls are listed, not images, scripts or styles. Redirects are the server-side ones; a JavaScript redirect shows as the final url.

Billing, errors and countries: Functions.