Zyte

Avantages

We use Crawlera to scrape data and provide data analytics and limited search results to some of our customers that want data from their competitors, as well as the price changes of their competitors on product price comparing platforms. Fortunately we don't have to worry about proxies because Crawler handles all that for us.

Inconvénients

The prices are not affordable for smaller companies. For a big company that manages big data the prices are fine.

Avantages

Very easy to use. Great dashboards for monitoring jobs. Very competitive pricing. Friendly customer service.

Inconvénients

There's very little to complain about with Scrapinghub - it's genuinely a really great product!

Avantages

Crawlera makes it really easy for me to process thousands of requests without worrying about rate-limits. I love that I don't have to worry about retry policies or IP blacklisting because Crawlera takes care of that for me! Plus, by charging by requests instead of bandwidth, it's much easier for me to estimate my expenses based on my needs.

Inconvénients

I don't like that the usage numbers are delayed by so many hours.

The pricing is also a little high. I wish there was some way to bring that down or get more value into the plans.

Avantages

The best out there for any kind of scraping need. They new AI based scraping api is a game changer

Inconvénients

Nothing bad about it. Beats the competition out of the water

Avantages

Scrapinghub is so easy to use. With few setups you're ready to build your first spider. The integration with github and other addons (such as crawlera) makes things even easier to manage code deploy and proxy network management. Support for Python 3 is also a great improvement

Inconvénients

I'm still in early days with scrapinghub and at the moment did not see any big issues to take into account. One things that comes in my mind to be improved is the documentation.

Avantages

Simplicity, no-bullsh*t services, modular services & addons, very low service downtime. I can keep going and still won't do these guys justice

Inconvénients

Payment platform wasn't a walk in the park. Guides and knowledge base are not outdated but can use a 2019 refresh

Avantages

it helps a lot to avoid the self-hosted spiders, this is the primary reason I like it.

and I know it is developing to make it more ease to use, like github integration, however I have set up the CI tools to publish the spider automatically for every code change, so I don't use it.

Inconvénients

however it is always a pain that it is more difficult to bypass the bot detection, especially for big website, like amazon, and the other websites protected by Distil. I know this is not the fault of scrapinghub, but it is a big pain. and I know you have a service Crawlera for this purpose, but it is quite expensive.

Avantages

Able to deploy my scrapers and also to debug using logs it's very helpful.

Inconvénients

It's pretty confusing sometimes while scheduling jobs as the timezone is in UTC. Even debugging logs gets harder.

Avantages

The effectiveness - it simply works better and is more consistent than other proxies.

Inconvénients

The monthly limit on requests and how there is no intermediary plan between C10 and C50.

Avantages

Your reliability an trust about proxy ip list.

Inconvénients

You payment method just accept international credit cards. I used it from Brazil.

Avantages

As a business once you hit a certain size it makes sense outsourcing webscraping. Scrapinghub has the required specialism to do a good job.

Inconvénients

Still needs involved work from the client side to ensure data quality and consistency.

Avantages

we have used scrapinghub for generating proxy ip's to mine company web data and career page information. has been very useful in assisting us to stand up our own skill vertical search engine.

Inconvénients

needs a lot of customization if the scripts run into issues. overall a good product for its use cases

Avantages

the dashboards ...it's easy to follow your progression. You can also leave your task run by themselves and do otherthing

Inconvénients

Pricing... its not cheap... but it's also the game

Avantages

Scraping hub is quite easy to use and plugs in really nicely with whatever scraping project you have going.

Inconvénients

Scraping hub was giving me a significant amount of errors and Scraping hub doesn't really have great support to help me figure out what was going on.

Avantages

Ease of use with the Portia addon combined with the job queue make a gratifying experience.

Inconvénients

Sometimes the UI is clunky and you are no sure if you aren't interfering with the current scrapers while editing a spider.

Avantages

It was very easy to start creating crawlers and launching them on scrapinghub. Plug and play. Ready to start launching a fleet of crawlers to move my project to the next level.

Inconvénients

The price was a bit hefty for running multiple crawlers.

Avantages

· Scraping situation is easy to see visually
· Can be finely implemented such as time to activate scraping
· Ease of deployment

Inconvénients

· I try to deploy from github, but I can select only my own repository (Can not deploy from organization's repository?

Avantages

Ease of use to download and manage various crawlers

Inconvénients

Too much data that requires a lot of cleanup activities. It would be great if the data can be cleaned and presented in ready to use form