Distributed Futures

Exoshuffle-CloudSort: The 2022 CloudSort Benchmark Winner

Winner of the 2022 CloudSort Benchmark (Indy category) for sorting 100TB data at $0.97/TB.

Frank Sifei Luan, Samyukta Yagati, Stephanie Wang, Sean Kim, Kenneth Lien, Isaac Ong, Tony Hong, SangBin Cho, Eric Liang, Ion Stoica

Exoshuffle: Large-Scale Shuffle at the Application Level

Shuffle at the application level can reach state-of-the-art performance and scalability, and provide unprecedented flexibility.

Frank Sifei Luan, Samyukta Yagati, Stephanie Wang, Sean Kim, Kenneth Lien, Isaac Ong, SangBin Cho, Eric Liang, Ion Stoica

Ownership: A Distributed Futures System for Fine-Grained Tasks

A decentralized object metadata ownership system for fine-grained distributed tasks.

Stephanie Wang, Eric Liang, Edward Oakes, Ben Hindman, Frank Sifei Luan, Audrey Cheng, Ion Stoica