GitHub Trending Scraper
Scrapes https://github.com/trending and outputs structured JSON.
Quick Start
# All languages, today, top 25
python3 scripts/github_trending.py
# Python repos, this week, top 10
python3 scripts/github_trending.py --language python --since weekly --top 10
# Save to file
python3 scripts/github_trending.py -o /tmp/github-trending.json
Options
| Flag | Short | Default | Description |
|---|---|---|---|
--language | -l | all | Filter by language (python, rust, go, javascript, etc.) |
--since | -s | daily | Time range: daily, weekly, monthly |
--top | -n | 25 | Number of repos to return |
--output | -o | stdout | Output file path |
--compact | Minified JSON output |
Output Schema
{
"source": "github-trending",
"scraped_at": "ISO-8601",
"language": "all|python|rust|...",
"since": "daily|weekly|monthly",
"count": 25,
"repos": [
{
"rank": 1,
"owner": "warpdotdev",
"name": "warp",
"full_name": "warpdotdev/warp",
"url": "https://github.com/warpdotdev/warp",
"description": "Warp is an agentic development environment...",
"language": "Rust",
"stars": 46667,
"forks": 2917,
"stars_period": 12822,
"stars_period_label": "today"
}
]
}
Integration with Trending Cards
Pipe output into the existing trending card generator:
python3 scripts/github_trending.py -o /tmp/github-trending.json
python3 ~/.openclaw/workspace/scripts/trending-card-gen.py \
--input /tmp/github-trending.json \
--output /tmp/trending-card.html \
--platform github --theme white --size hd
Notes
- No API key required; scrapes the public GitHub Trending page
- Rate limit: reasonable use only; avoid rapid repeated calls
- Some repos (e.g.
sponsors/username) may show 0 stars/forks due to GitHub page structure