✓ Verified 📊 Data Processing ✓ Enhanced Data

Douban Sync Skill

Export and sync Douban (豆瓣) book/movie/music/game collections.

Rating
4.1 (313 reviews)
Downloads
20,076 downloads
Version
1.0.0

Overview

Export and sync Douban (豆瓣) book/movie/music/game collections.

Complete Documentation

View Source →

Douban Sync

Export Douban collections (books, movies, music, games) to CSV and keep them in sync via RSS.

Two Modes

1. Full Export (first time)

Use the browser tool to scrape all collection pages. Requires the user to be logged into Douban.

text
browser → douban.com/people/{USER_ID}/{category}?start=0&sort=time&mode=list

Categories and URL paths:

  • Books: book.douban.com/people/{ID}/collect (读过), /do (在读), /wish (想读)
  • Movies: movie.douban.com/people/{ID}/collect (看过), /do (在看), /wish (想看)
  • Music: music.douban.com/people/{ID}/collect (听过), /do (在听), /wish (想听)
  • Games: www.douban.com/people/{ID}/games?action=collect (玩过), =do (在玩), =wish (想玩)
Each page shows up to 30 items in list mode (some pages may have fewer due to delisted entries). Paginate with ?start=0,30,60... — the script uses the paginator's "next" button to determine whether to continue.

Rate limiting: Wait 2-3 seconds between pages. If blocked, wait 30 seconds and retry.

Scripts:

  • scripts/douban-scraper.mjs — HTTP-only, no browser needed (may get rate-limited)
  • scripts/douban-browser-scraper.mjs — via Puppeteer CDP, needs a running browser
  • scripts/douban-extract.mjs — generates a browser console script for manual extraction

2. Incremental Sync (daily, via RSS)

Run scripts/douban-rss-sync.mjs — no login needed.

bash
node scripts/douban-rss-sync.mjs

Setup: Set environment variables:

  • DOUBAN_USER (required): Douban user ID
  • DOUBAN_OUTPUT_DIR (optional): Output root directory, default ~/douban-sync
Recommended: Add a daily cron job for automatic sync.

Output Format

Four CSV files per user in the output directory:

text
douban-sync/
└── {user_id}/
    ├── 书.csv
    ├── 影视.csv
    ├── 音乐.csv
    └── 游戏.csv

CSV columns:

csv
title,url,date,rating,status,comment
"书名","https://book.douban.com/subject/12345/","2026-01-15","★★★★★","读过","短评内容"
  • status: 读过/在读/想读, 看过/在看/想看, 听过/在听/想听, 玩过/在玩/想玩

Deduplication

Both full export and RSS sync deduplicate by Douban URL — safe to run multiple times.

Installation

Terminal bash

openclaw install douban-sync-skill
    
Copied!

💻Code Examples

browser → douban.com/people/{USER_ID}/{category}?start=0&sort=time&mode=list

browser--doubancompeopleuseridcategorystart0sorttimemodelist.txt
Categories and URL paths:
- Books: `book.douban.com/people/{ID}/collect` (读过), `/do` (在读), `/wish` (想读)
- Movies: `movie.douban.com/people/{ID}/collect` (看过), `/do` (在看), `/wish` (想看)
- Music: `music.douban.com/people/{ID}/collect` (听过), `/do` (在听), `/wish` (想听)
- Games: `www.douban.com/people/{ID}/games?action=collect` (玩过), `=do` (在玩), `=wish` (想玩)

Each page shows up to 30 items in list mode (some pages may have fewer due to delisted entries). Paginate with `?start=0,30,60...` — the script uses the paginator's "next" button to determine whether to continue.

**Rate limiting:** Wait 2-3 seconds between pages. If blocked, wait 30 seconds and retry.

**Scripts:**
- `scripts/douban-scraper.mjs` — HTTP-only, no browser needed (may get rate-limited)
- `scripts/douban-browser-scraper.mjs` — via Puppeteer CDP, needs a running browser
- `scripts/douban-extract.mjs` — generates a browser console script for manual extraction

### 2. Incremental Sync (daily, via RSS)

Run `scripts/douban-rss-sync.mjs` — no login needed.

node scripts/douban-rss-sync.mjs

node-scriptsdouban-rss-syncmjs.txt
**Setup:** Set environment variables:
- `DOUBAN_USER` (required): Douban user ID
- `DOUBAN_OUTPUT_DIR` (optional): Output root directory, default `~/douban-sync`

**Recommended:** Add a daily cron job for automatic sync.

## Output Format

Four CSV files per user in the output directory:
example.txt
douban-sync/
└── {user_id}/
    ├── 书.csv
    ├── 影视.csv
    ├── 音乐.csv
    └── 游戏.csv

Tags

#data_and-analytics

Quick Info

Category Data Processing
Model Claude 3.5
Complexity One-Click
Author cosformula
Last Updated 3/10/2026
🚀
Optimized for
Claude 3.5
🧠

Ready to Install?

Get started with this skill in seconds

openclaw install douban-sync-skill