The hierarchy of computer memory is designed to provide faster access to frequently used data by storing it in smaller, faster, and more expensive memory levels closer to the CPU.