Module 3: Fundamentals of Parallel Computers: ILP vs TLP
  Lecture 5: Communication Architectures and Communication Costs
 


Shared Address

  • Communication takes place through a logically shared portion of memory
    • User interface is normal load/store instructions
    • Load/store instructions generate virtual addresses
    • The VAs are translated to PAs by TLB or page table
    • The memory controller then decides where to find this PA
    • Actual communication is hidden from the programmer
  • The general communication hw consists of multiple processors connected over some medium so that they can talk to memory banks and I/O devices
    • The architecture of the interconnect may vary depending on projected cost and target performance
  • Communication medium
    • Interconnect could be a crossbar switch so that any processor can talk to any memory bank in one “hop” (provides latency and bandwidth advantages)
    • Scaling a crossbar becomes a problem: cost is proportional to square of the size
    • Instead, could use a scalable switch-based network; latency increases and bandwidth decreases because now multiple processors contend for switch ports