End of Term, and the power of compound interest

July 22, 2016November 11, 2019 ~ Adrian Colyer ~ 6 Comments

Schools where I live are now breaking up for summer, and it’s time for The Morning Paper summer recess too. Over the last term, we’ve covered 67 papers and a broad range of topics. InfoQ are kindly working on another “Quarterly Review” publication (see here for the previous edition). As ever it’s hard to choose ... Continue Reading

Time-adaptive sketches (Ada sketches) for summarizing data streams

July 21, 2016November 11, 2019 ~ Adrian Colyer ~ 2 Comments

Time-adaptive sketches (Ada Sketches) for Summarizing Data Streams Shrivastava et al. SIGMOD 2016 More algorithm fun today, and again in the context of data streams. It’s the 3 V’s of big data, but not as you know it: Volume, Velocity, and Var… Volatility. Volatility here refers to changing patterns in the data over time, and ... Continue Reading

Range thresholding on streams

July 20, 2016November 11, 2019 ~ Adrian Colyer ~ Leave a comment

Range thresholding on streams Qiao et al. SIGMOD 2016 It’s another streaming paper today, also looking at how to efficiently handle a large volume of concurrent queries over a stream, and also claiming a significant performance breakthrough of several orders of magnitude. We’re looking at a different type of query though, known as a range ... Continue Reading

Sharing-aware outlier analytics over high-volume data streams

July 19, 2016November 11, 2019 ~ Adrian Colyer ~ 1 Comment

Sharing-aware outlier analytics over high-volume data streams Cao et al. SIGMOD 2016 With yesterday’s preliminaries on skyline queries out of the way, it’s time to turn our attention to the Sharing-aware Outlier Processing (SOP) algorithm of Cao et al. The challenge that SOP addresses is that of building a stream-based outlier detection system that can ... Continue Reading

Progressive skyline computation in database systems

July 18, 2016November 11, 2019 ~ Adrian Colyer ~ 8 Comments

Progressive skyline computation in database systems Papadias et al. SIGMOD 2003 I’m still working through some of the papers from SIGMOD 2016 (as some of you spotted, that was the unifying them for last week). But today I’m jumping back to 2003 to provide some context for a streaming analytics paper we’ll be looking at ... Continue Reading

Spheres of influence for more effective viral marketing

July 15, 2016November 11, 2019 ~ Adrian Colyer ~ 1 Comment

Spheres of influence for more effective viral marketing Mehmood et al. SIGMOD ’16 In viral marketing the idea is to spread awareness of a brand or campaign by exploiting pre-existing social networks. The received wisdom is that by targeting a few influential individuals, they will be able to spread your marketing message to a large ... Continue Reading

DBSherlock: A performance diagnostic tool for transactional databases

July 14, 2016November 11, 2019 ~ Adrian Colyer ~ 5 Comments

DBSherlock: A performance diagnostic tool for transactional databases Yoon et al. SIGMOD ’16 …tens of thousands of concurrent transactions competing for the same resources (e.g. CPU, disk I/O, memory) can create highly non-linear and counter-intuitive effects on database performance. If you’re a DBA responsible for figuring out what’s going on, this presents quite a challenge. ... Continue Reading

Ambry: LinkedIn’s scalable geo-distributed object store

July 13, 2016 ~ Adrian Colyer ~ 2 Comments

Ambry: LinkedIn’s scalable geo-distributed object store Noghabi et al. SIGMOD ’16 Ambry is LinkedIn’s blob store, designed to handle the demands of a modern social network: Hundreds of millions of users continually upload and view billions of diverse massive media objects, from photos and videos to documents. These large media objects, called blobs, are uploaded ... Continue Reading

Goods: organizing Google’s datasets

July 12, 2016 ~ Adrian Colyer ~ 9 Comments

Goods: organizing Google’s datasets Havely et al. SIGMOD 2016 You can (try and) build a data cathedral. Or you can build a data bazaar. By data cathedral I’m referring to a centralised Enterprise Data Management solution that everyone in the company buys into and pays homage to, making a pilgrimage to the EDM every time ... Continue Reading

Realtime data processing at Facebook

July 11, 2016 ~ Adrian Colyer ~ 4 Comments

Realtime Data Processing at Facebook Chen et al. SIGMOD 2016 ‘Realtime Data Processing at Facebook’ provides us with a great high-level overview of the systems Facebook have built to support real-time workloads. At the heart of the paper is a set of five key design decisions for building such systems, together with an explanation of ... Continue Reading

the morning paper

a random walk through Computer Science research, by Adrian Colyer
Made delightfully fast by strattic

Month: July 2016