goo-net-car-scraper

# Goo-net Japan Used Cars Scraper

Scrape used car listings from **[goo-net.com](https://www.goo-net.com/)** — one of Japan's largest used car portals — with prices, maker, and dealer information.

## Why This Data

- Japan exported a record **1.71 million used vehicles in 2025** (JUMVEA) — a massive global market
- Used car exporters (BE FORWARD, carused.jp, SBT Japan, etc.) constantly need fresh inventory and pricing data
- **JDM (Japanese Domestic Market)** models are highly valued worldwide
- Zero dedicated cross-listing competitor on Apify Store at launch

## Features

- ✅ Server-side rendered pages (no browser needed — fast & cheap)
- ✅ Nationwide inventory (47 prefectures) with pagination
- ✅ Model name, price (JPY), maker, image, dealer shop, and detail URL per listing
- ✅ Prefecture filter (e.g. `01` = Hokkaido, `13` = Tokyo, `47` = Okinawa)
- ✅ EUC-JP encoding handled automatically
- ✅ Runs on Apify proxy — no IP blocking issues

## Input

| Field | Type | Default | Description |
|---|---|---|---|
| `searchKeyword` | string | empty | Car model / brand keyword (e.g. `ハイエース`, `アクア`). Empty = full scan |
| `statsMode` | boolean | false | true = return aggregated price stats instead of listings |
| `statsKeyword` | string | empty | Model name to aggregate (e.g. `N-BOX`, `ハイエース`) |
| `prefecture` | string | empty | Prefecture code `01`–`47`. Empty = all Japan |
| `maxItems` | integer | 100 | Maximum number of listings to collect |
| `maxPages` | integer | 5 | Maximum number of pages to crawl |
| `proxyConfiguration` | object | auto | Apify proxy (auto) |

## Output

Each item contains: `itemId`, `title`, `maker`, `price` (JPY), `imageUrl`, `detailUrl`, `shop`, `source`, `scrapedAt`.

Example:
```json
{
  "itemId": "988026080400207235003",
  "title": "ハイエースバン スーパーGL",
  "maker": "トヨタ",
  "price": 2796000,
  "detailUrl": "https://www.goo-net.com/usedcar/spread/goo/15/988026080400207235003.html",
  "shop": "ハイエース／キャラバン専門店 ファイントラスト土岐店",
  "source": "goo-net"
}
```

## Use Cases

- 🚗 Used car exporters & importers (inventory tracking, pricing research)
- 📊 Market researchers (JDM market trends, price analysis)
- 🔍 JDM enthusiasts hunting specific models

## Price Stats API Mode (相場統計API)

Same Actor doubles as a **price stats API** for market research — returns aggregated price statistics for a car model without downloading the full listing data.

**Request** (Apify synchronous API):

```bash
curl -X POST "https://api.apify.com/v2/acts/bgm5Gxn4BeBmoO7xD/run-sync-get-dataset-items?token=YOUR_TOKEN&timeout=120" \
  -H "Content-Type: application/json" \
  -d '{"statsMode": true, "statsKeyword": "N-BOX", "maxItems": 30, "maxPages": 1}'
```

**Response** (JSON):

```json
{
  "statsType": "goo-net-car-price",
  "keyword": "N-BOX",
  "count": 5,
  "priceMin": 230000,
  "priceMax": 1907000,
  "priceAvg": 974400,
  "priceMedian": 596000,
  "sampleItems": [{"title": "...", "price": 230000, "detailUrl": "...", "shop": "..."}]
}
```

- `statsKeyword`: model name (e.g. `N-BOX`, `ハイエース`). Full-width/half-width matching handled automatically
- Combine with `bodyType` to narrow (e.g. `KEI`, `SUV`)
- Use cases: market research, dealer pricing benchmarks, export valuation

## Pricing

Pay per result: **$0.002 per item** ($2 per 1,000 listings).

## Legal

- Respects goo-net's robots.txt (search endpoints excluded; category pages allowed)
- For research and legitimate business use. Check goo-net's terms before commercial use.
- Rate-limited by design (3 retries, exponential backoff).

## Tech

- Python 3.11 + httpx + BeautifulSoup
- Apify Actor SDK v3
- EUC-JP decode support

## MCP Server & Registry

This scraper is also available as an MCP server for AI agents:

- **MCP Registry**: `io.github.atushi1841/japan-car-market-mcp`
- **Apify Store**: https://apify.com/fruitful_quintessence/goo-net-car-scraper
- **Gumroad**: https://atushi5.gumroad.com/l/kutuxe

Install via MCP: add to your MCP config:
```json
{"mcpServers": {"japan-car-market-mcp": {"command": "python3", "args": ["src/stdio_main.py"]}}}
```