agent/claude/issues/007-collect-market.md
Snider beb24f71d2 docs: add feature request issues for core CLI migration
12 issue files documenting features needed to replace shell scripts:

Claude Code hooks:
- 001: core ai session (state management)
- 002: core ai context (fact capture)
- 003: core ai hook (command validation)
- 004: core qa debug (debug statement detection)

Data collection:
- 005: core collect github (issues/PRs archive)
- 006: core collect bitcointalk (forum threads)
- 007: core collect market (CMC/CoinGecko)
- 008: core collect papers (whitepapers)
- 009: core collect excavate (project archaeology)
- 010: core collect process (HTML→MD)
- 011: core collect dispatch (event hooks)

000: Overview tracking issue

These will be submitted to host-uk/core when rate limit resets.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-02-01 18:49:35 +00:00

1.5 KiB

feat(collect): Add cryptocurrency market data collection

Summary

Add core collect market command to collect historical price/market data from CoinMarketCap, CoinGecko, etc.

Required Commands

core collect market <coin>                    # Collect current data
core collect market <coin> --historical       # Include historical data
core collect market <coin> --from=2018-01-01  # Date range
core collect market <coin1,coin2>             # Multiple coins
core collect market jobs <coin>               # Generate job list

Current Shell Scripts Being Replaced

  • claude/skills/coinmarketcap/generate-jobs.sh - Generates CMC collection jobs
  • claude/skills/coinmarketcap/process.sh - Processes collected CMC data

Data Sources

  1. CoinMarketCap

    • Main page (description, links)
    • Markets/exchanges
    • Historical data
    • News
    • API endpoints (where available)
  2. CoinGecko (backup)

    • Main page
    • API for historical data

Output Structure

market/{coin}/
├── INDEX.md
├── cmc/
│   ├── main.json
│   ├── markets.json
│   └── historical.json
├── coingecko/
│   ├── detail.json
│   └── history.json
└── summary.md

Job Format

For jobs subcommand (pipe to collector):

URL|FILENAME|TYPE|METADATA
https://coinmarketcap.com/currencies/lethean/|cmc-lethean-main.html|cmc-main|coin=lethean

Output Format

{
  "coin": "lethean",
  "sources": ["cmc", "coingecko"],
  "historical_days": 2190,
  "output": "market/lethean/"
}