Hello.
Do you have net.ipv6 = false in your settings? This sounds very much like a recent fix that isn't in a release yet: https://gitlab.nic.cz/knot/knot-resolver/-/merge_requests/1470
--Vladimir