Does caching work only with databases?

Caching is not limited to databases. It can be used to speed up access to any data that requires significant time or resource expenditure.

Examples of caching beyond databases:

• Results of external API calls: Caching responses from third-party services to reduce network traffic and delays.
• Results of resource-intensive computations: Saving the results of costly calculations to avoid re-executing them with the same input data.
• Files and static resources: Caching images, CSS, JavaScript on the client side (browser) or proxy server for faster page loading.
• User sessions: Storing user session data in cache for quick access without querying the session store (e.g., database).
• DNS records: Caching resolved domain names in the operating system or DNS server.

Caching mechanisms can be implemented at various levels:

• Within the application (in-memory cache): Data is stored directly in the application's RAM. Examples of libraries: Ehcache, Guava Cache.

  // Example of using Guava Cache
  LoadingCache<String, DataObject> dataCache = CacheBuilder.newBuilder()
      .expireAfterWrite(10, TimeUnit.MINUTES) // Element lifetime after write
      .maximumSize(1000) // Max number of elements in cache
      .build(
           new CacheLoader<String, DataObject>() {
               @Override
               public DataObject load(String key) throws AnyException {
                   // Method called on cache miss. Here, data is fetched from source (e.g., DB or API)
                   return fetchDataFromSource(key);
               }
           });
  
  // Getting data from cache (or loading on miss)
  try {
      DataObject data = dataCache.get("someKey");
      // Using data
  } catch (ExecutionException e) {
      // Handling data load error
  }
  

• Distributed caches: Data is stored on dedicated servers and accessible to multiple application instances. Examples: Redis, Memcached, Apache Ignite.

  // Example of connecting to Redis (using Jedis client)
  Jedis jedis = new Jedis("localhost");
  // Saving data to cache
  jedis.set("user:123", "{\"name\":\"John Doe\"}");
  // Retrieving data from cache
  String userDataJson = jedis.get("user:123");
  // Processing retrieved data
  

• Operating system level caches: For example, filesystem caching.
• Hardware caches: CPU cache (L1, L2, L3).

Thus, caching is a general performance optimization principle applicable to a wide range of data sources, not just databases.