Fetch (scrape) a URL using ScrapingAnt and return the web page content as HTML.
Args:
url: The URL of the page to extract (scrape).
browser: Whether to use browser rendering. Default: True.
proxy_type: Type of proxy to use. Default: 'datacenter'.
Use 'residential' if you encounter anti-bot detection, which improves anti-bot avoidance.
proxy_country: Optional ISO-3166 country code. Default: random worldwide proxy.
Use when facing geo-restrictions. Available country codes: ae, br, bz, ca, ch, cn, cz, de, es, fr, gb, hk, id, il, in, it, jp, kr, mx, my, nh, nl, ph, pk, pl, ro, ru, sa, sc, se, sg, th, tr, tw, uk, us, vn.
Parametersurlrequiredbrowserproxy_typeproxy_country
Fetch (scrape) a URL using ScrapingAnt and return the web page content as Markdown.
Args:
url: The URL of the page to extract (scrape).
browser: Whether to use browser rendering. Default: True.
proxy_type: Type of proxy to use. Default: 'datacenter'.
Use 'residential' if you encounter anti-bot detection, which improves anti-bot avoidance.
proxy_country: Optional ISO-3166 country code. Default: random worldwide proxy.
Use when facing geo-restrictions. Available country codes: ae, br, bz, ca, ch, cn, cz, de, es, fr, gb, hk, id, il, in, it, jp, kr, mx, my, nh, nl, ph, pk, pl, ro, ru, sa, sc, se, sg, th, tr, tw, uk, us, vn.
Parametersurlrequiredbrowserproxy_typeproxy_country
Fetch (scrape) a URL using ScrapingAnt and return the web page content as plain text.
Args:
url: The URL of the page to extract (scrape).
browser: Whether to use browser rendering. Default: True.
proxy_type: Type of proxy to use. Default: 'datacenter'.
Use 'residential' if you encounter anti-bot detection, which improves anti-bot avoidance.
proxy_country: Optional ISO-3166 country code. Default: random worldwide proxy.
Use when facing geo-restrictions. Available country codes: ae, br, bz, ca, ch, cn, cz, de, es, fr, gb, hk, id, il, in, it, jp, kr, mx, my, nh, nl, ph, pk, pl, ro, ru, sa, sc, se, sg, th, tr, tw, uk, us, vn.
Parametersurlrequiredbrowserproxy_typeproxy_country