How to set headers

[danfeihu]

Hello,

I tried to crawl data from e-commerce websites. I use a request to directly specify the header, which can capture data through an IP proxy. However, when switching to Firewall, I am not sure how to specify headers such as User Agent or Cookie. Can you guide me?

[p-harting]

If you’re using Python with Firecrawl/Playwright (local), you can set headers like this:
`
data = {
"url": "https://example-shop.com",
"pageOptions": {
"headers": {
"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64)",
"Cookie": "session_id=abc123; currency=USD"
}
}
}

response = requests.post(
"http://your-firecrawl-server/v0/scrape",
json=data,
headers={"Content-Type": "application/json"}
)
`

Hope this helps :)