Module 5: Performance Issues in Shared Memory and Introduction to Coherence
  Lecture 10: Introduction to Coherence
 

 

Four Organizations

  • Dancehall

  • Better scalability compared to previous two designs
  • The difference from bus-based SMP is that the interconnect is a scalable point-to-point network (e.g. crossbar or other topology)
  • Memory is still symmetric from all processors
  • Drawback: a cache miss may take a long time since all memory banks too far off from the processors (may be several network hops)

  • Distributed shared memory

  • The most popular scalable organization
  • Each node now has local memory banks
  • Shared memory on other nodes must be accessed over the network
    • Remote memory access
  • Non-uniform memory access (NUMA)
    • Latency to access local memory is much smaller compared to remote memory
  • Caching is very important to reduce remote memory access