Maximizing Efficiency By Trading Storage for Computation

usenix09_button.jpgIan F. Adams, Darrell D.E. Long, Ethan L. Miller, Shankar Pasupathy, and Mark W. Storer.

We detail the user knowledge and system knowledge needed to construct a comprehensive cost model for analyzing the trade-off between storing a result and regenerating a result.

Traditionally, computing has meant calculating results and then storing those results for later use. Unfortunately, committing large volumes of rarely used data to storage wastes space and energy, making it a very expensive strategy. Cloud computing, with its readily available and flexibly allocatable computing resources, suggests an alternative: storing the provenance data, and means to recomputing results as needed.

While computation and storage are equivalent, finding the balance between the two that maximizes efficiency is difficult. One of the fundamental challenges of this issue is rooted in the knowledge gap separating the users and the cloud administrators—neither has a completely informed view. Users have a semantic understanding of their data, while administrators have an understanding of the cloud’s underlying structure. We detail the user knowledge and system knowledge needed to construct a comprehensive cost model for analyzing the trade-off between storing a result and regenerating a result, allowing users and administrators to make an informed cost-benefit analysis.

In Proceedings of the Workshop on Hot Topics in Cloud Computing 2009 (HotCloud ’09)

Resources

  • A copy of the paper is attached to this posting.

trading-storage-hotcloud09.pdf