Parts Scraper¶
Multi-instance web scraper for vehicle parts data.
Overview¶
| Property | Value |
|---|---|
| Script | scraper_v5.py (~1650+ lines) |
| Database | VPS2 MariaDB → vehicles_db |
| Technology | Python + Selenium + Chrome |
Features¶
- Multi-instance support (
--instance N) — run 12+ parallel instances - Proxy support (
--useproxy) with automatic rotation - Blocked proxy persistence in MariaDB (shared across instances)
- Configurable proxy limits (
--min-proxies,--max-proxies) - Auto-reconnecting database wrapper (
ReconnectingDB) - Series reset capability (
--reset-series) - Chrome automation with custom profiles
Usage¶
# Basic instance
python scraper_v5.py --instance 1
# With proxy
python scraper_v5.py --instance 2 --useproxy --max-proxies 10
# Reset series
python scraper_v5.py --instance 3 --reset-series
AutoScraper (.NET)¶
Desktop companion app in AutoScraper/ directory — C# Windows Forms application with:
MainForm.cs/Form1.cs— UI formsScraperEngine.cs— Core scraping logicDbService.cs— Database connectivity