Probabilistically Bounded Staleness for Practical Partial Quorums

August 31, 2015 ~ Adrian Colyer ~ 4 Comments

Probabilistically Bounded Staleness for Practical Partial Quorums - Bailis et al. 2012, and Quantifying Eventual Consistency with PBS - Bailis et al. 2014 'Probabilistically Bounded Staleness... ' was the original VLDB '12 paper, and then the authors were invited to submit an extended version to the VLDB Journal ('Quantifying Eventual Consistency...') which was published in ... Continue Reading

Mining and Summarizing Customer Reviews

August 28, 2015 ~ Adrian Colyer ~ Leave a comment

Mining and Summarizing Customer Reviews - Hu and Liu 2004 This is the third of the three 'test-of-time' award winners from KDD'15. From the awards page: The paper introduces the problem of summarizing customer reviews and decomposes the problem into the three steps of (1) mining product features (aspects), (2) identifying opinion sentences and their ... Continue Reading

Optimizing Search Engines using Clickthrough Data

August 27, 2015 ~ Adrian Colyer ~ Leave a comment

Optimizing Search Engines using Clickthrough Data - Joachims, 2002 Today's choice is another KDD 'test-of-time' winner. The paper introduced the problem of ranking documents w.r.t. a query using not explicit user feedback but implicit user feedback in the form of clickthrough data. The author presented the Ranking SVM Algorithm to solve the proposed ranking problem. ... Continue Reading

Mining High-Speed Data Streams

August 26, 2015 ~ Adrian Colyer ~ Leave a comment

Mining High-Speed Data Streams - Domingos & Hulten 2000 This paper won a 'test of time' award at KDD'15 as an 'outstanding paper from a past KDD Conference beyond the last decade that has had an important impact on the data mining community.' Here's what the test-of-time committee have to say about it: This paper ... Continue Reading

A Machine Learning Framework to Identify Students at Risk of Adverse Academic Outcomes

August 24, 2015 ~ Adrian Colyer ~ Leave a comment

A Machine Learning Framework to Identify Students at Risk of Adverse Academic Outcomes - Lakkaraju et al. 2015 This is the first of a series of papers from the Knowledge Discovery and Data Mining (KDD'15) conference that we'll look at this week. Today's paper is all about helping high school students in the US who ... Continue Reading

MillWheel: Fault-Tolerant Stream Processing at Internet Scale

August 21, 2015 ~ Adrian Colyer ~ 4 Comments

MillWheel: Fault-Tolerant Stream Processing at Internet Scale - Akidau et al. (Google) 2013 Earlier this week we looked at the Google Cloud Dataflow model which is implemented on top of FlumeJava (for batch) and MillWheel (for streaming): We have implemented this model internally in FlumeJava, with MillWheel used as the underlying execution engine for streaming ... Continue Reading

Virtual Time

August 20, 2015 ~ Adrian Colyer ~ 2 Comments

Virtual Time - Jefferson 1985 Justin LaPre sent me a tweet last week, "I think you would enjoy reading 'Virtual Time' by David Jefferson. Give it a read if you find yourself with some down time. " Thank you Justin, I did read it and I thought it was absolutely wonderful! This paper has time ... Continue Reading

Asynchronous Distributed Snapshots for Distributed Dataflows

August 19, 2015 ~ Adrian Colyer ~ 1 Comment

Asynchronous Distributed Snapshots for Distributed Dataflows - Carbone et al. 2015 The team behind Apache Flink and data Artisans are a smart group of folks. Their recent blog post on High-throughput, low-latency, and exactly-once stream processing with Apache Flink is well worth reading and has a good description of the evolution of streaming architectures, the ... Continue Reading

The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing

August 18, 2015 ~ Adrian Colyer ~ 10 Comments

The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing - Akidau et al. (Google) - 2015 With thanks to William Vambenepe for suggesting this paper via twitter. Google Cloud Dataflow reached GA last week, and the team behind Cloud Dataflow have a paper accepted at VLDB'15 ... Continue Reading

the morning paper

a random walk through Computer Science research, by Adrian Colyer

Month: August 2015