Scrape
by brightdatae825f02fbcd7No license264 starsListed Oct 8, 2026Updated Oct 8, 2026Repository updated yesterday
Scrape web content as clean markdown/HTML/JSON via the Bright Data CLI (`bdata scrape`). Use when the user wants to fetch a page, extract content from a list of URLs, or crawl paginated listings. Hands off to `data-feeds` for supported platforms (Amazon, LinkedIn, TikTok, Instagram, YouTube, Reddit, etc.) and to `search` when URLs must be discovered first. Requires the Bright Data CLI; proactively guides install + login if missing.
Add to a SourceWeft workspace
- Open the skill in your dashboard and add it to a workspace.
- Enable it for the chats that should use it.
This skill is instructions only: it ships no scripts to execute.
Add to SourceWeftYou will be asked to sign in first, then taken straight to this skill.
Ask your agent to install it
Paste this prompt into Claude Code, Codex, Cursor or another agent that can run commands — or into SourceWeft chat. The agent reads this skill's install guide, shows you its source, license and scripts, and installs it with the SourceWeft CLI once you agree.
Read https://sourceweft.com/skills/gh-brightdata-skills-scrape/install.md and install the skill it describes. Before installing, show me its source, license and whether it ships scripts, and wait for my OK. Ask me before changing anything else on my machine.Install it yourself from a terminal
For Claude Code, Codex, Cursor and other local agents. The SourceWeft CLI fetches the skill from its source repository at the commit scanned here, and verifies every file against the hashes recorded when the skill was scanned. If anything differs, nothing is written.
npx @sourceweft/cli skills install gh-brightdata-skills-scrapeAdd --agent claude-code, codex, cursor or universal to choose which agent gets it (Claude Code by default).
Upstream installer — not verified by SourceWeft
The open-source skills installer fetches the same pinned commit, but does not check the files against the hashes SourceWeft recorded.
npx skills add https://github.com/brightdata/skills/tree/e825f02fbcd7a89087fd1053a57ddcd45113370f/skills/scrapeSource and attribution
Source:brightdata/skillsinskills/scrapeat commite825f02
License: No license
Content belongs to its original authors. SourceWeft indexes it from a public repository.
More from brightdata/skills
Search
brightdata
Guides web search and semantic discovery through the Bright Data CLI, returning SERP or intent-ranked results as JSON.
Brightdata Sdk
brightdata
Guides use of the Bright Data Python SDK for web scraping, search, datasets and browser automation.
Live Research
brightdata
Produces a cited, multi-source research brief by running intent-ranked web searches and synthesizing the retrieved page content.
Data Feeds
brightdata
Extracts structured JSON data from supported platform URLs using the Bright Data CLI pipelines command.
Bright Data Mcp
brightdata
Guides an agent to use Bright Data MCP tools for all web search, scraping and structured data tasks.
Brd Browser Debug
brightdata
Diagnoses Bright Data Scraping Browser sessions via the Browser Sessions API, triaging failures, bandwidth, captchas and empty scraper results.
More in Research & Analysis
Microsoft Docs
microsoft
Looks up official Microsoft documentation to explain concepts, tutorials, configuration, limits and best practices.
Wiki Researcher
microsoft
Conducts multi-turn, evidence-grounded deep research on how a specific system or pattern works inside a codebase.
Wiki Qa
microsoft
Answers questions about a code repository using source-file evidence and inline citations.
Notion Research Documentation
openai
Researches Notion pages and synthesizes findings into cited briefs, comparisons, or reports published back to Notion.
Notion Meeting Intelligence
openai
Prepares meeting agendas and pre-reads using Notion context and research, tailored to attendees and meeting type.
Customer Research
coreyhaines31
Guides customer research: analyzing transcripts, surveys and reviews, mining online communities, and running interviews and surveys.