Testing distributed systems at scale is typically a costly yet necessary process. At Alluxio we take testing very seriously as
organizations across the world rely on our technology, therefore, a problem we want to solve is how to test at scale without
breaking the bank. In this blog we are going to show how the maintainers of the Alluxio open source project build and test
our system at scale cost-effectively using public cloud infrastructure. We test with the most popular frameworks, such as
Spark and Hive, and pervasive storage systems, such as HDFS and S3. Using Amazon AWS EC2, we are able to test 1000+
worker clusters, at a cost of about $16 per hour.