✓ Verified 💻 Development ✓ Enhanced Data

Test Name Deniz

Universal AI-powered web scraper for any platform.

Rating
4.1 (385 reviews)
Downloads
1,915 downloads
Version
1.0.0

Overview

Universal AI-powered web scraper for any platform.

Key Features

1

Understand User Goal and Select Actor

2

Fetch Actor Schema

3

Ask User Preferences

4

Run the Script

5

Summarize Results and Offer Follow-ups

Complete Documentation

View Source →

Universal Web Scraper

AI-driven data extraction from 55+ Actors across all major platforms. This skill automatically selects the best Actor for your task.

Prerequisites

(No need to check it upfront)
  • .env file with APIFY_TOKEN
  • Node.js 20.6+ (for native --env-file support)
  • mcpc CLI tool: npm install -g @apify/mcpc

Workflow

Copy this checklist and track progress:

text
Task Progress:
- [ ] Step 1: Understand user goal and select Actor
- [ ] Step 2: Fetch Actor schema via mcpc
- [ ] Step 3: Ask user preferences (format, filename)
- [ ] Step 4: Run the scraper script
- [ ] Step 5: Summarize results and offer follow-ups

Step 1: Understand User Goal and Select Actor

First, understand what the user wants to achieve. Then select the best Actor from the options below.

#### Instagram Actors (12)

Actor IDBest For
apify/instagram-profile-scraperProfile data, follower counts, bio info
apify/instagram-post-scraperIndividual post details, engagement metrics
apify/instagram-comment-scraperComment extraction, sentiment analysis
apify/instagram-hashtag-scraperHashtag content, trending topics
apify/instagram-hashtag-statsHashtag performance metrics
apify/instagram-reel-scraperReels content and metrics
apify/instagram-search-scraperSearch users, places, hashtags
apify/instagram-tagged-scraperPosts tagged with specific accounts
apify/instagram-followers-count-scraperFollower count tracking
apify/instagram-scraperComprehensive Instagram data
apify/instagram-api-scraperAPI-based Instagram access
apify/export-instagram-comments-postsBulk comment/post export
#### Facebook Actors (14)

Actor IDBest For
apify/facebook-pages-scraperPage data, metrics, contact info
apify/facebook-page-contact-informationEmails, phones, addresses from pages
apify/facebook-posts-scraperPost content and engagement
apify/facebook-comments-scraperComment extraction
apify/facebook-likes-scraperReaction analysis
apify/facebook-reviews-scraperPage reviews
apify/facebook-groups-scraperGroup content and members
apify/facebook-events-scraperEvent data
apify/facebook-ads-scraperAd creative and targeting
apify/facebook-search-scraperSearch results
apify/facebook-reels-scraperReels content
apify/facebook-photos-scraperPhoto extraction
apify/facebook-marketplace-scraperMarketplace listings
apify/facebook-followers-following-scraperFollower/following lists
#### TikTok Actors (14)

Actor IDBest For
clockworks/tiktok-scraperComprehensive TikTok data
clockworks/free-tiktok-scraperFree TikTok extraction
clockworks/tiktok-profile-scraperProfile data
clockworks/tiktok-video-scraperVideo details and metrics
clockworks/tiktok-comments-scraperComment extraction
clockworks/tiktok-followers-scraperFollower lists
clockworks/tiktok-user-search-scraperFind users by keywords
clockworks/tiktok-hashtag-scraperHashtag content
clockworks/tiktok-sound-scraperTrending sounds
clockworks/tiktok-ads-scraperAd content
clockworks/tiktok-discover-scraperDiscover page content
clockworks/tiktok-explore-scraperExplore content
clockworks/tiktok-trends-scraperTrending content
clockworks/tiktok-live-scraperLive stream data
#### YouTube Actors (5)

Actor IDBest For
streamers/youtube-scraperVideo data and metrics
streamers/youtube-channel-scraperChannel information
streamers/youtube-comments-scraperComment extraction
streamers/youtube-shorts-scraperShorts content
streamers/youtube-video-scraper-by-hashtagVideos by hashtag
#### Google Maps Actors (4)

Actor IDBest For
compass/crawler-google-placesBusiness listings, ratings, contact info
compass/google-maps-extractorDetailed business data
compass/Google-Maps-Reviews-ScraperReview extraction
poidata/google-maps-email-extractorEmail discovery from listings
#### Other Actors (6)

Actor IDBest For
apify/google-search-scraperGoogle search results
apify/google-trends-scraperGoogle Trends data
voyager/booking-scraperBooking.com hotel data
voyager/booking-reviews-scraperBooking.com reviews
maxcopell/tripadvisor-reviewsTripAdvisor reviews
vdrmota/contact-info-scraperContact enrichment from URLs

#### Actor Selection by Use Case

Use CasePrimary Actors
Lead Generationcompass/crawler-google-places, poidata/google-maps-email-extractor, vdrmota/contact-info-scraper
Influencer Discoveryapify/instagram-profile-scraper, clockworks/tiktok-profile-scraper, streamers/youtube-channel-scraper
Brand Monitoringapify/instagram-tagged-scraper, apify/instagram-hashtag-scraper, compass/Google-Maps-Reviews-Scraper
Competitor Analysisapify/facebook-pages-scraper, apify/facebook-ads-scraper, apify/instagram-profile-scraper
Content Analyticsapify/instagram-post-scraper, clockworks/tiktok-scraper, streamers/youtube-scraper
Trend Researchapify/google-trends-scraper, clockworks/tiktok-trends-scraper, apify/instagram-hashtag-stats
Review Analysiscompass/Google-Maps-Reviews-Scraper, voyager/booking-reviews-scraper, maxcopell/tripadvisor-reviews
Audience Analysisapify/instagram-followers-count-scraper, clockworks/tiktok-followers-scraper, apify/facebook-followers-following-scraper

#### Multi-Actor Workflows

For complex tasks, chain multiple Actors:

WorkflowStep 1Step 2
Lead enrichmentcompass/crawler-google-places →vdrmota/contact-info-scraper
Influencer vettingapify/instagram-profile-scraper →apify/instagram-comment-scraper
Competitor deep-diveapify/facebook-pages-scraper →apify/facebook-posts-scraper
Local business analysiscompass/crawler-google-places →compass/Google-Maps-Reviews-Scraper
#### Can't Find a Suitable Actor?

If none of the Actors above match the user's request, search the Apify Store directly:

bash
export $(grep APIFY_TOKEN .env | xargs) && mcpc --json mcp.apify.com --header "Authorization: Bearer $APIFY_TOKEN" tools-call search-actors keywords:="SEARCH_KEYWORDS" limit:=10 offset:=0 category:="" | jq -r '.content[0].text'

Replace SEARCH_KEYWORDS with 1-3 simple terms (e.g., "LinkedIn profiles", "Amazon products", "Twitter").

Step 2: Fetch Actor Schema

Fetch the Actor's input schema and details dynamically using mcpc:

bash
export $(grep APIFY_TOKEN .env | xargs) && mcpc --json mcp.apify.com --header "Authorization: Bearer $APIFY_TOKEN" tools-call fetch-actor-details actor:="ACTOR_ID" | jq -r ".content"

Replace ACTOR_ID with the selected Actor (e.g., compass/crawler-google-places).

This returns:

  • Actor description and README
  • Required and optional input parameters
  • Output fields (if available)

Step 3: Ask User Preferences

Before running, ask:

  • Output format:
  • Quick answer - Display top few results in chat (no file saved)
  • CSV - Full export with all fields
  • JSON - Full export in JSON format
  • Number of results: Based on character of use case

Step 4: Run the Script

Quick answer (display in chat, no file):

bash
node --env-file=.env ${CLAUDE_PLUGIN_ROOT}/reference/scripts/run_actor.js \
  --actor "ACTOR_ID" \
  --input 'JSON_INPUT'

CSV:

bash
node --env-file=.env ${CLAUDE_PLUGIN_ROOT}/reference/scripts/run_actor.js \
  --actor "ACTOR_ID" \
  --input 'JSON_INPUT' \
  --output YYYY-MM-DD_OUTPUT_FILE.csv \
  --format csv

JSON:

bash
node --env-file=.env ${CLAUDE_PLUGIN_ROOT}/reference/scripts/run_actor.js \
  --actor "ACTOR_ID" \
  --input 'JSON_INPUT' \
  --output YYYY-MM-DD_OUTPUT_FILE.json \
  --format json

Step 5: Summarize Results and Offer Follow-ups

After completion, report:

  • Number of results found
  • File location and name
  • Key fields available
  • Suggested follow-up workflows based on results:
If User GotSuggest Next
Business listingsEnrich with vdrmota/contact-info-scraper or get reviews
Influencer profilesAnalyze engagement with comment scrapers
Competitor pagesDeep-dive with post/ad scrapers
Trend dataValidate with platform-specific hashtag scrapers

Error Handling

APIFY_TOKEN not found - Ask user to create .env with APIFY_TOKEN=your_token mcpc not found - Ask user to install npm install -g @apify/mcpc Actor not found - Check Actor ID spelling Run FAILED - Ask user to check Apify console link in error output Timeout - Reduce input size or increase --timeout

Installation

Terminal bash

openclaw install test-name-deniz
    
Copied!

💻Code Examples

- [ ] Step 5: Summarize results and offer follow-ups

----step-5-summarize-results-and-offer-follow-ups.txt
### Step 1: Understand User Goal and Select Actor

First, understand what the user wants to achieve. Then select the best Actor from the options below.

#### Instagram Actors (12)

| Actor ID | Best For |
|----------|----------|
| `apify/instagram-profile-scraper` | Profile data, follower counts, bio info |
| `apify/instagram-post-scraper` | Individual post details, engagement metrics |
| `apify/instagram-comment-scraper` | Comment extraction, sentiment analysis |
| `apify/instagram-hashtag-scraper` | Hashtag content, trending topics |
| `apify/instagram-hashtag-stats` | Hashtag performance metrics |
| `apify/instagram-reel-scraper` | Reels content and metrics |
| `apify/instagram-search-scraper` | Search users, places, hashtags |
| `apify/instagram-tagged-scraper` | Posts tagged with specific accounts |
| `apify/instagram-followers-count-scraper` | Follower count tracking |
| `apify/instagram-scraper` | Comprehensive Instagram data |
| `apify/instagram-api-scraper` | API-based Instagram access |
| `apify/export-instagram-comments-posts` | Bulk comment/post export |

#### Facebook Actors (14)

| Actor ID | Best For |
|----------|----------|
| `apify/facebook-pages-scraper` | Page data, metrics, contact info |
| `apify/facebook-page-contact-information` | Emails, phones, addresses from pages |
| `apify/facebook-posts-scraper` | Post content and engagement |
| `apify/facebook-comments-scraper` | Comment extraction |
| `apify/facebook-likes-scraper` | Reaction analysis |
| `apify/facebook-reviews-scraper` | Page reviews |
| `apify/facebook-groups-scraper` | Group content and members |
| `apify/facebook-events-scraper` | Event data |
| `apify/facebook-ads-scraper` | Ad creative and targeting |
| `apify/facebook-search-scraper` | Search results |
| `apify/facebook-reels-scraper` | Reels content |
| `apify/facebook-photos-scraper` | Photo extraction |
| `apify/facebook-marketplace-scraper` | Marketplace listings |
| `apify/facebook-followers-following-scraper` | Follower/following lists |

#### TikTok Actors (14)

| Actor ID | Best For |
|----------|----------|
| `clockworks/tiktok-scraper` | Comprehensive TikTok data |
| `clockworks/free-tiktok-scraper` | Free TikTok extraction |
| `clockworks/tiktok-profile-scraper` | Profile data |
| `clockworks/tiktok-video-scraper` | Video details and metrics |
| `clockworks/tiktok-comments-scraper` | Comment extraction |
| `clockworks/tiktok-followers-scraper` | Follower lists |
| `clockworks/tiktok-user-search-scraper` | Find users by keywords |
| `clockworks/tiktok-hashtag-scraper` | Hashtag content |
| `clockworks/tiktok-sound-scraper` | Trending sounds |
| `clockworks/tiktok-ads-scraper` | Ad content |
| `clockworks/tiktok-discover-scraper` | Discover page content |
| `clockworks/tiktok-explore-scraper` | Explore content |
| `clockworks/tiktok-trends-scraper` | Trending content |
| `clockworks/tiktok-live-scraper` | Live stream data |

#### YouTube Actors (5)

| Actor ID | Best For |
|----------|----------|
| `streamers/youtube-scraper` | Video data and metrics |
| `streamers/youtube-channel-scraper` | Channel information |
| `streamers/youtube-comments-scraper` | Comment extraction |
| `streamers/youtube-shorts-scraper` | Shorts content |
| `streamers/youtube-video-scraper-by-hashtag` | Videos by hashtag |

#### Google Maps Actors (4)

| Actor ID | Best For |
|----------|----------|
| `compass/crawler-google-places` | Business listings, ratings, contact info |
| `compass/google-maps-extractor` | Detailed business data |
| `compass/Google-Maps-Reviews-Scraper` | Review extraction |
| `poidata/google-maps-email-extractor` | Email discovery from listings |

#### Other Actors (6)

| Actor ID | Best For |
|----------|----------|
| `apify/google-search-scraper` | Google search results |
| `apify/google-trends-scraper` | Google Trends data |
| `voyager/booking-scraper` | Booking.com hotel data |
| `voyager/booking-reviews-scraper` | Booking.com reviews |
| `maxcopell/tripadvisor-reviews` | TripAdvisor reviews |
| `vdrmota/contact-info-scraper` | Contact enrichment from URLs |

---

#### Actor Selection by Use Case

| Use Case | Primary Actors |
|----------|---------------|
| **Lead Generation** | `compass/crawler-google-places`, `poidata/google-maps-email-extractor`, `vdrmota/contact-info-scraper` |
| **Influencer Discovery** | `apify/instagram-profile-scraper`, `clockworks/tiktok-profile-scraper`, `streamers/youtube-channel-scraper` |
| **Brand Monitoring** | `apify/instagram-tagged-scraper`, `apify/instagram-hashtag-scraper`, `compass/Google-Maps-Reviews-Scraper` |
| **Competitor Analysis** | `apify/facebook-pages-scraper`, `apify/facebook-ads-scraper`, `apify/instagram-profile-scraper` |
| **Content Analytics** | `apify/instagram-post-scraper`, `clockworks/tiktok-scraper`, `streamers/youtube-scraper` |
| **Trend Research** | `apify/google-trends-scraper`, `clockworks/tiktok-trends-scraper`, `apify/instagram-hashtag-stats` |
| **Review Analysis** | `compass/Google-Maps-Reviews-Scraper`, `voyager/booking-reviews-scraper`, `maxcopell/tripadvisor-reviews` |
| **Audience Analysis** | `apify/instagram-followers-count-scraper`, `clockworks/tiktok-followers-scraper`, `apify/facebook-followers-following-scraper` |

---

#### Multi-Actor Workflows

For complex tasks, chain multiple Actors:

| Workflow | Step 1 | Step 2 |
|----------|--------|--------|
| **Lead enrichment** | `compass/crawler-google-places` → | `vdrmota/contact-info-scraper` |
| **Influencer vetting** | `apify/instagram-profile-scraper` → | `apify/instagram-comment-scraper` |
| **Competitor deep-dive** | `apify/facebook-pages-scraper` → | `apify/facebook-posts-scraper` |
| **Local business analysis** | `compass/crawler-google-places` → | `compass/Google-Maps-Reviews-Scraper` |

#### Can't Find a Suitable Actor?

If none of the Actors above match the user's request, search the Apify Store directly:

export $(grep APIFY_TOKEN .env | xargs) && mcpc --json mcp.apify.com --header "Authorization: Bearer $APIFY_TOKEN" tools-call search-actors keywords:="SEARCH_KEYWORDS" limit:=10 offset:=0 category:="" | jq -r '.content[0].text'

export-grep-apifytoken-env--xargs--mcpc---json-mcpapifycom---header-authorization-bearer-apifytoken-tools-call-search-actors-keywordssearchkeywords-limit10-offset0-category--jq--r-content0text.txt
Replace `SEARCH_KEYWORDS` with 1-3 simple terms (e.g., "LinkedIn profiles", "Amazon products", "Twitter").

### Step 2: Fetch Actor Schema

Fetch the Actor's input schema and details dynamically using mcpc:

export $(grep APIFY_TOKEN .env | xargs) && mcpc --json mcp.apify.com --header "Authorization: Bearer $APIFY_TOKEN" tools-call fetch-actor-details actor:="ACTOR_ID" | jq -r ".content"

export-grep-apifytoken-env--xargs--mcpc---json-mcpapifycom---header-authorization-bearer-apifytoken-tools-call-fetch-actor-details-actoractorid--jq--r-content.txt
Replace `ACTOR_ID` with the selected Actor (e.g., `compass/crawler-google-places`).

This returns:
- Actor description and README
- Required and optional input parameters
- Output fields (if available)

### Step 3: Ask User Preferences

Before running, ask:
1. **Output format**:
   - **Quick answer** - Display top few results in chat (no file saved)
   - **CSV** - Full export with all fields
   - **JSON** - Full export in JSON format
2. **Number of results**: Based on character of use case

### Step 4: Run the Script

**Quick answer (display in chat, no file):**
example.txt
Task Progress:
- [ ] Step 1: Understand user goal and select Actor
- [ ] Step 2: Fetch Actor schema via mcpc
- [ ] Step 3: Ask user preferences (format, filename)
- [ ] Step 4: Run the scraper script
- [ ] Step 5: Summarize results and offer follow-ups
example.sh
node --env-file=.env ${CLAUDE_PLUGIN_ROOT}/reference/scripts/run_actor.js \
  --actor "ACTOR_ID" \
  --input 'JSON_INPUT'
example.sh
node --env-file=.env ${CLAUDE_PLUGIN_ROOT}/reference/scripts/run_actor.js \
  --actor "ACTOR_ID" \
  --input 'JSON_INPUT' \
  --output YYYY-MM-DD_OUTPUT_FILE.csv \
  --format csv
example.sh
node --env-file=.env ${CLAUDE_PLUGIN_ROOT}/reference/scripts/run_actor.js \
  --actor "ACTOR_ID" \
  --input 'JSON_INPUT' \
  --output YYYY-MM-DD_OUTPUT_FILE.json \
  --format json

Tags

#web_and-frontend-development #web

Quick Info

Category Development
Model Claude 3.5
Complexity One-Click
Author protoss70
Last Updated 3/10/2026
🚀
Optimized for
Claude 3.5
🧠

Ready to Install?

Get started with this skill in seconds

openclaw install test-name-deniz