Memory hierarchy Smaller capacity but faster access memory acts as a subset of storage for larger capacity but slower access memory Generalization of the concept of "cache" Why does memory hierarchy work?   Locality of access: Programs tend to access data higher up in the hierarchy much more often   Intelligent caching algorithms   Net effect: Large capacity of memory with very fast access