Fighting Latency for Data Fetches: Two approaches
Make application data fetches more cache-friendly by rewriting the algorithms such that their memory accesses are more block structured
- Has been proven to work, takes programmer effort
- No extra hardware required
Add extra hardware that makes cache-unfriendly access patterns work better
- Requires programmer assistance to identify accesses that will take advantage of extra hardware