jk navigate ars curate space select enter detail np page / search f filters ⌘K palette ⌘\ admin
Admin Dashboard
System configuration, data quality tools, and scrape management
Curator Lists
Named collections for seasonal campaigns, BTS, etc. Items can be filtered and exported by list.
Excluded Brands
Brands prohibited by contract. Items are still scraped but hidden from curation when the filter is active.
Spam Sellers
Known bad sellers hidden from exports. Auto-detect scans for sellers with 100+ listings, 0 reviews, across 3+ categories.
Price Drops
Items with sale price significantly below MSRP — Rollbacks, clearance deals.
Duplicate Detection
Find items sharing the same UPC. Helps identify and clean up catalog duplication.
Scrape Pipeline
Monitor runs, trigger scrapes, and manage automated schedules
Quick URL Scrape
Paste a Walmart product or category URL to scrape it immediately.
Search Scrape
Search Walmart for a term and scrape the results into the pipeline.
Automated Schedule
| Job | Schedule | Frequency | Details |
|---|---|---|---|
| Best Sellers | 0 */6 * * * |
Every 6 hours | Scrapes best seller rankings across all categories, then runs eko-import + rank refresh |
| Deep Scrape | 0 3 * * * |
Daily at 3:00 AM | Best sellers + sort variants + new arrivals, followed by eko-import + rank refresh |
| Stale Re-rank | 30 */12 * * * |
Every 12 hours | Re-enriches up to 5,000 items not seen in 3+ days to keep ranking history alive |
| Weekly Enrichment | 0 3 * * 0 |
Sundays at 3:00 AM | Full enrichment pass — up to 50,000 items via Eko API for brand, UPC, pricing, images |
| TTL Cleanup | 30 4 * * * |
Daily at 4:30 AM | Prunes scrape_task_log > 30 days, item_category_ranks > 90 days |