Explaining outputs in modern data analytics

February 1, 2017November 11, 2019 ~ Adrian Colyer ~ 9 Comments

Explaining outputs in modern data analytics Chothia et al. ETH Zurich Technical Report, 2016 Yesterday we touched on some of the difficulties of explanation in the context of machine learning, and last week we looked at some of the extensions to ExSPAN to track network provenance. Lest you be under any remaining misapprehension that explanation ... Continue Reading

Data provenance at internet scale: architecture, experiences, and the road ahead

January 24, 2017November 11, 2019 ~ Adrian Colyer ~ 5 Comments

Data provenance at Internet scale: Architecture, experiences, and the road ahead Chen et al., CIDR 2017 Provenance within the context of a single database has been reasonably well studied. In this paper though, Chen et al., explore what happens when you try to trace provenance in a distributed setting and at larger scale. The context ... Continue Reading

Goods: organizing Google’s datasets

July 12, 2016 ~ Adrian Colyer ~ 9 Comments

Goods: organizing Google’s datasets Havely et al. SIGMOD 2016 You can (try and) build a data cathedral. Or you can build a data bazaar. By data cathedral I’m referring to a centralised Enterprise Data Management solution that everyone in the company buys into and pays homage to, making a pilgrimage to the EDM every time ... Continue Reading

the morning paper

a random walk through Computer Science research, by Adrian Colyer
Made delightfully fast by strattic

Provenance

Explaining outputs in modern data analytics

Data provenance at internet scale: architecture, experiences, and the road ahead

Goods: organizing Google’s datasets