My next Udemy course is coming up! Help decide what it’ll be about!

We’ve hit the ~10K+ students on the Scraping and Data Mining for Beginners and Pros Udemy course. The reviews have been fantastic:


Since creating the course, a few new technologies came up that are worth mentioning:


A Python-based visual scraper, similar to how works, but locally on your machine with no fees attached. It has a few dependencies, but once you go past the installation hoopla, using it is quite straight forward.


A client-side scraping companion. This is great for quick scrapes from sites you’re visiting in the browser. It’s a utility belt for the browser console, so you visit a page, pop the JavaScript console open and with a few lines of code, you can save data into json. Great for quick jobs.



These are the guys who open-sourced Portia, and they at least get a mention because of it. They also have a service that’s similar to that’s worth checking out. The way they describe it is:

Scrapy Cloud bridges the highly efficient Scrapy development environment with a robust, fully-featured production environment to deploy and run your crawls. It’s like a Heroku for Scrapy, although other technologies will be supported in the near future. It runs on top of the Scrapinghub platform, which means your project can scale on demand, as needed.



I’m glad you guys are enjoying the course – I’ll keep updating you with interesting tidbits from the Data Mining world!