A caching DNS server is one that caches results of queries. Note that a master or slave DNS server can be caching.
The main purpose of caching is to redirect repetitive DNS traffic mostly to the caching DNS server instead of other “upstream” DNS servers. In some cases, this can help to significantly reduce traffic to the Internet if the caching DNS server is a LAN resource.