Posts tagged with 'openrefine'

Following recent discussions with several OpenRefine community members, I realized that there were some confusions and misunderstanding regarding RefinePro intentions regarding the OpenRefine project.

In September 2015, we submitted the following application to the Knight News Challenge: How might we make data work for individuals and communities? We are cross posting it here for archive. You can also consult it directly on the Knight Challenge website.

In our effort to engage with local OpenRefine community and foster peer-to-peer connections, the latest Toronto OpenRefine Meet-Up (on November 17) focused on actual use cases, presented by OpenRefine user from various backgrounds. The goal to demonstrate how OpenRefine plays in a specific contexts and data environment, rather than drilling down on specific functionality. This article provides a summary of the night and highlight of each talk.

Learn the basics of OpenRefine with our Foundation course available on the tranzform course platform.

Stefan Urbanek when laying the foundation for the school of data program at the Open Knowledge, presented the following Data Processing Pipeline going from:

Following my article on enabling parallel processing for OpenRefine: Spark vs Akka, I drafted a road map to integrate OpenRefine with Akka.

Andrey from SpazioDati developed Refine on Spark in an attempt to process larger dataset which is good. However it fell short in some areas and I wanted to benchmark it with an other parallelism engine like Akka.

The last five weeks have been full of learning and surprises (good and bad). We have a better understanding on how Refine is used and how it behaves with different browsers and data set sizes. Some things worked as expected, other completely broke. This post highlights the coming technical points we plan to address to improve RefinePro.

Over the last five years, OpenRefine has built a robust platform, to which many developers have contributed plugins and extensions useful for their own audiences. That list of plugins and reconciliation services grows month after month, demonstrating that the community is active and thriving, with a healthy and expanding user base.