Blog

Is web scraping easy? No. Is it Profitable? It can with a great scheduling, monitoring, and maintenance plan. Learn how!

Your Python skills are not too bad, and it’s not your first time dealing with tech. In fact, technology is part of your daily life. You see the world goes around, and you’ve heard how web scraping could help automate your business. So, you start looking for the best scrapers and web scraping tools, hoping maybe to boost your e-commerce sales.

Download our cheat sheet of what to keep in mind when using external or third party data

Following recent discussions with several OpenRefine community members, I realized that there were some confusions and misunderstanding regarding RefinePro intentions regarding the OpenRefine project.

Starting today, we are sunsetting RefinePro’s OpenRefine hosting. We are not accepting new registration and new subscriptions. Existing users can continue to access the service until the end of their subscription or trial phase.

In September 2015, we submitted the following application to the Knight News Challenge: How might we make data work for individuals and communities? We are cross posting it here for archive. You can also consult it directly on the Knight Challenge website.

In our effort to engage with local OpenRefine community and foster peer-to-peer connections, the latest Toronto OpenRefine Meet-Up (on November 17) focused on actual use cases, presented by OpenRefine user from various backgrounds. The goal to demonstrate how OpenRefine plays in a specific contexts and data environment, rather than drilling down on specific functionality. This article provides a summary of the night and highlight of each talk.

This course is no longer available.

Stefan Urbanek when laying the foundation for the school of data program at the Open Knowledge, presented the following Data Processing Pipeline going from:

The main motivation behind RefinePro is being able to commit developer time to OpenRefine (since I am not a developer myself) and have the project leave its stagnant stage. RefinePro motivation isn’t to make millions or get some prestige by stealing other people work – there is faster and less risky way to do that than creating a start-up on a niche market.