As the creators and current maintainers of Scrapy, the most popular screen scraping framework for Python (don’t take our word for it, just google “python screen scraping” or “python web scraping”), we take scraping very seriously.

We offer the following services (feel free to contact us for any questions)

Spiders development

We implement custom scrapers (Scrapy spiders) for scraping any kind of sites, as. The cost of a spider varies a lot depending on:

• how difficult the sites are to scrape
• how complex is the data you want to scrape (how many fields you want to scrape, etc)
• how precise and accurate you want to the data to be
• how many sites you want to scrape (we always give volume discounts)

Request free quote

Please contact us to request a free quote by filling this form on Scrapinghub, our sister company.

Infrastructure

We provide fine-tuned infrastructure for running spiders, and assistance with deploying your crawlers in production.

We also offer a very powerful and intuitive web interface to:

• monitor and launch your spiders with a convenient point and click UI
• schedule spider runs, either manually or periodically
• analyze the scraped data to assert its quality
• get notified when spiders get broken

Consulting

Our experts can help you and your team to find the best solution for your web crawling architecture, and assist you in deploying it.

Be it single-host or distributed, large or small, real-time of bulk updated, we can help you and your team decide what’s the best architecture for your needs and resources.