Does the RAM being closed to CPU actually matter?

My friend told me that macbooks have their RAMs behind the CPU (or something along those lines) and it got me wondering. Does the distance between CPU and memory really make that much difference? 🤔