Distributed Futures

Exoshuffle: An Extensible Shuffle Architecture
An extensible shuffle architecture that offers competitive performance and scalability as well as greater flexibility than monolithic shuffle systems.
PDF DOI Talk
Exoshuffle-CloudSort: The 2022 CloudSort Benchmark Winner
Winner of the 2022 CloudSort Benchmark (Indy category) for sorting 100TB data at $0.97/TB.
PDF Code Project Blog
Ownership: A Distributed Futures System for Fine-Grained Tasks
A decentralized object metadata ownership system for fine-grained distributed tasks.
PDF