Settings
Runtime configuration for the scraper API.
Browser
Controls which browser engine is used for scraping. Changes apply immediately without a restart. Remote uses the browserless service.
BROWSERLESS_ENABLED=true to enable it.System Chromium bundled with Playwright
Browserless cloud service
Delay profile
These values are baked in at startup via environment variables and cannot be changed at runtime.
Sites
Enable or disable sites globally. Disabled sites are excluded from default scrape runs.
stockx
Included in default scrape targets
grailed
Disabled for default scrape targets
nike
Disabled for default scrape targets
stadium
Disabled for default scrape targets
flightclub
Disabled for default scrape targets
hypebeast
Disabled for default scrape targets
goat
Disabled for default scrape targets
Feature toggles
Toggle scraper subsystems on or off at runtime without a restart.
cache
Global cache toggle — disables all caching when off
cache_reads
Skip cache on read operations
cache_writes
Skip writing results to cache
database_retrieval
Skip reading products from the database
database_saving
Skip writing scraped products to the database
database_request_logging
Skip logging scrape requests to the scrape_request table
search_indexing
Skip indexing scraped products in Meilisearch