Add option to cache and prefetch records about nextdns HOT 15 CLOSED

The caching part is planned. Prefetching might be tricky to do right, and I doubt an unbound-like prefetch would benefit local LAN without enough clients to amortize it. A knot-resolver type of prefetch with prediction could be interesting, but far more complex.

We'll start with simple caching :)

from nextdns.

Fixed by 0e2dc7a. Please play the new cache-size configuration option.

from nextdns.

How long are results cached for?

If the whitelist/blacklist is updated is the cache cleared? If not, it might be handy to have the client invalidate the cache if a configuration change is made.

from nextdns.

It is an AST cache, it will keep the most popular entries until the size of the cache is reached, replacing least popular entries by new ones then. When a query is performed, if the minimum TTL of the cached entry is still valid, the entry is used, otherwise, a request is performed to the upstream. If the upstream can't be reached, the stale cache entry is used instead of returning a SERVFAIL.

Blocked entries have a TTL of 5 min set by NextDNS, they will then be invalidated after 5 min. Note that your OS is also performing the same kind of caching, so clearing one cache and not the other won't have much effect.

from nextdns.

@rs -cache-size is in byte size, not TTL?
I would prefer to say to cache 30 seconds , for example

from nextdns.

Please read my message above.

It does not make sense to force the eviction of a cached entry if there is still space available in the cache. Those entries can be useful in case of upstream reachability issue. The AST eviction algorithm will make sure that least popular entries give up space for most popular ones.

from nextdns.

Great work. This is great, thank you so much for providing this feature.

I have a question since cache will depends on original TTL for unblocked by NEXTDNS dashboard. If there is a website that has TTL for 1 year for example and already cached in the client of NEXTDNS then later from NEXTDNS dashboard I have blocked it by category or specifically. I think it will not be blocked until it got purged from NEXTDNS client, right?

from nextdns.

@rs I am thrilled to see the progress on this! Many thanks!

I did log two new issues based on testing I have been doing. If you would prefer I log issues in this thread instead of opening new issues, let me know and I will move the details over to this thread.

from nextdns.

@gam-phon that is correct. We can provide a max-ttl option to cap the TTL of entries to workaround that.

from nextdns.

@Fail-Safe new issues are better.

from nextdns.

Blocked entries have a TTL of 5 min set by NextDNS, they will then be invalidated after 5 min. Note that your OS is also performing the same kind of caching, so clearing one cache and not the other won't have much effect.

Thanks for the update. I've noticed that devices on my network respond much faster than 5 minutes when unblocking a site. Does restarting the NextDNS client flush the cache?

from nextdns.

Our clients flushes the DNS cache of the host yes. It's actually a side effect, but a convenient one.

from nextdns.

Any way to get statistics of how the cache is performing?

from nextdns.

Yes, can you open a ticket?

from nextdns.

Done, see #154

from nextdns.