Bus error (core dumped)

When knot is running as a primary with DNSSEC singing the process randomly crashes with "Bus error (core dumped)". This behaviour is not seen on secondary servers with otherwise near identical bar not singing the zone for DNSSEC.

I have core dumps but I'm hesitant to attach them here as they likely contain DNSSEC keys, I'll be happy to share them with CZ.NIC directly.

The configs are as follows;

Primary:

    server:
        identity: "HexDNS"
        listen: 0.0.0.0@53
        listen: ::@53

    database:
        journal-db-mode: asynchronous

    log:
      - target: stdout
        any: info
    
    key:
      - id: secondary-xfr
        algorithm: hmac-sha256
        secret: (xfr-secret)
    
    acl:
      - id: secondary-xfr
        action: transfer
        key: secondary-xfr
    
    remote:
      - id: unbound-no-dns64
        address: unbound-no-dns64@5053
      - id: notify-sidecar
        address: 127.0.0.1@5353
    
    submission:
      - id: zone
        parent: unbound-no-dns64
        check-interval: 15m

    policy:
      - id: zone
        signing-threads: 4
        algorithm: ecdsap256sha256
        ksk-shared: on
        dnskey-ttl: 86400
        reproducible-signing: on
        nsec3: on
        cds-cdnskey-publish: always
        zsk-lifetime: 30d
        ksk-submission: zone
        nsec3-iterations: 10
    
      - id: zone-cds-disable
        signing-threads: 4
        algorithm: ecdsap256sha256
        ksk-shared: on
        dnskey-ttl: 86400
        reproducible-signing: on
        nsec3: on
        cds-cdnskey-publish: delete-dnssec
        zsk-lifetime: 30d
        ksk-submission: zone
        nsec3-iterations: 10

    template:
      - id: zone
        storage: /zones
        file: %s.zone
        journal-content: none
        dnssec-signing: on
        dnssec-policy: zone
        acl: secondary-xfr
        notify: notify-sidecar

    template:
      - id: zone-cds-disable
        storage: /zones
        file: %s.zone
        journal-content: none
        dnssec-signing: on
        dnssec-policy: zone-cds-disable
        acl: secondary-xfr
        notify: notify-sidecar

    template:
      - id: zone-secondary
        storage: /zones
        file: %s.zone
        journal-content: none
        dnssec-signing: off
        acl: secondary-xfr
        notify: notify-sidecar

    zone:
      - domain: catalog.dns.as207960.ltd.uk.
        file: /zones/catalog.zone
        catalog-role: interpret
        catalog-template: [ zone, zone-cds-disable, zone-secondary ]
        acl: secondary-xfr
        notify: notify-sidecar
    
      - domain: cds-always.dns.as207960.ltd.uk.
        template: zone
        file: /zones/cds-always.dns.as207960.ltd.uk.zone
    
      - domain: cds-delete.dns.as207960.ltd.uk.
        template: zone-cds-disable
        file: /zones/cds-delete.dns.as207960.ltd.uk.zone

Secondary:

    server:
        identity: "HexDNS"
        listen: 0.0.0.0@53
        listen: ::@53
        nsid: (nsid)

    database:
        journal-db-mode: asynchronous

    log:
      - target: stdout
        any: info
    
    key:
      - id: secondary-xfr
        algorithm: hmac-sha256
        secret: (xfr-secret)
    
    remote:
      - id: primary
        address: (primary-address)
        key: secondary-xfr
      - id: ddns-primary
        address: (ddns-primary-address)
    
    mod-updateproxy:
      - id: default
        remote: ddns-primary
        timeout: 5000

    mod-queryignoretsig:
      - id: default

    mod-stats:
      - id: custom
        flag-presence: on
        reply-nodata: on
        query-size: on
        reply-size: on
        edns-presence: on
        query-type: on

    acl:
      - id: notify
        address: 127.0.0.1
        action: notify

    template:
      - id: default
        global-module: mod-stats/custom

      - id: zone
        journal-content: none
        master: primary
        module: [ mod-updateproxy/default, mod-queryignoretsig/default ]
        acl: notify

    zone:
      - domain: catalog.dns.as207960.ltd.uk.
        master: primary
        catalog-role: interpret
        catalog-template: zone
        acl: notify

I've attached a log of one of the crashes: log.txt

Thanks for the report!

Could you try disabling journal-db-mode: asynchronous?

What is the Knot version, your OS, and package source?

I see Knot DNS 3.2.dev. Which commit?

The commit is a85e5a70, I'm running within docker on Kubernetes, host OS NixOS 21.05. The docker image was build locally using the Dockerfile in git.

I'll change the journal mode and get back to you if I see any more crashes.

I've updated to commit 6704e4df and set the config option, but I still see the crash.

Hello. We would really like to get the core dumps. We have a secure server for uploading. Do you have a Gitter account or similar secure channel to communicate the details? Maybe I can use email?

You can send the details to me at q@magicalcodewit.ch

@TheEnbyperor Did you get my e-mail?

Ah yes, just found it in spam.

All the core dumps I have and my server binary should now be in the FTP server.

Thanks. But there is a little obstacle that the knotd binary has its symbols stripped. Did you strip it manually? If you could rebuild the binary again without stripping it and then make some core files, that would help us a lot. Or if you had the original binary before stripping.

That's weird, file reports the binary as not stripped for me. knotd: ELF 64-bit LSB pie executable, x86-64, version 1 (SYSV), dynamically linked, interpreter /lib64/ld-linux-x86-64.so.2, BuildID[sha1]=a4bb1c761aeda336b418b5bb71acc96e38d1358f, for GNU/Linux 3.2.0, with debug_info, not stripped

I used the Dockerfile in git which has this line in it: CFLAGS="-g -O2 -DNDEBUG -D_FORTIFY_SOURCE=2 -fstack-protector-strong"

For the knotd file we are getting the following sha256sum output. Could you verify it please? fa97706298e9349e861f2c6e4138e70e7ec3a46e0c80ee0c2692e0b322f929da knotd

@TheEnbyperor are you able to upload your docker image to for example dockerhub? My knotd differs from yours significantly

Yep, its on docker at https://hub.docker.com/r/as207960/knotd, tag 3.

Thanks! That helped a lot. The zone scanner crashes when parsing zone file for 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa.. Could you provide us this file, please?

Sure, its:

;; Zone dump (Knot DNS 3.2.dev)
1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	SOA	ns1.as207960.net. noc.as207960.net. 1661337025 86400 3600 3600000 3600
1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	NS	ns1.as207960.net.
1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	NS	ns2.as207960.net.
1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	DNSKEY	256 3 13 Wv5iiw5PRU91oasQoZWlR5saAPWhq9nYD9kQMm41jQ0gpu2Hf71ZpITGVYWZtPuFsxpxTZpdSp4lE9ocQbgKDg==
1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	DNSKEY	257 3 13 UIh8VQuVXbUQwCjV4d+ptxKCvtbI6XcAdf9qnL1f21663JotyeXU/sNF6GUz5jutm1nmcrRbKS8DDGRz0fzoHA==
1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3PARAM	1 0 10 05BD17EF2A88510C
1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 0	CDS	6687 13 2 ABBB89614C58D718B5091610B6EC946749632DBC85BE88FB47AF6E2F5A75BE6C
1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 0	CDNSKEY	257 3 13 UIh8VQuVXbUQwCjV4d+ptxKCvtbI6XcAdf9qnL1f21663JotyeXU/sNF6GUz5jutm1nmcrRbKS8DDGRz0fzoHA==
1.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	ns1.as207960.net.
3.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	rpki-repo.as207960.net.
4.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	kube-dns.as207960.net.
6.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	mx.postal.as207960.net.
7.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	kube-ingress.as207960.net.
8.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	whois.as207960.net.
a.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	smime-relay.as207960.ltd.uk.
c.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	mx2.postal.as207960.net.
d.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	orps.as207960.ltd.uk.
e.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	ns2.as207960.net.
0.1.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	znc.magicalcodewit.ch.
2.1.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	mx.as207960.ltd.uk.
3.1.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	orps.transtechtent.com.
8.1.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	postal-pod.as207960.ltd.uk.
9.1.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	postal-pod.as207960.ltd.uk.
a.1.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	postal-pod.as207960.ltd.uk.
b.1.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	postal-pod.as207960.ltd.uk.
c.1.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	postal-pod.as207960.ltd.uk.
d.1.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	postal-pod.as207960.ltd.uk.
e.1.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	postal-pod.as207960.ltd.uk.
f.1.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	postal-pod.as207960.ltd.uk.
0.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	orps1.as207960.ltd.uk.
1.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	orps2.as207960.ltd.uk.
2.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	orps3.as207960.ltd.uk.
3.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	orps4.as207960.ltd.uk.
4.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	orps5.as207960.ltd.uk.
5.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	orps6.as207960.ltd.uk.
6.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	orps7.as207960.ltd.uk.
7.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	orps8.as207960.ltd.uk.
8.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	orps1.transtechtent.com.
9.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	orps2.transtechtent.com.
a.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	orps3.transtechtent.com.
b.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	orps4.transtechtent.com.
c.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	orps5.transtechtent.com.
d.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	orps6.transtechtent.com.
e.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	orps7.transtechtent.com.
f.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	PTR	orps8.transtechtent.com.
;; DNSSEC signatures
1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	NS 13 14 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. udY1myEsUhA5MwjGt7g2t4WxSh+92qYEiChIHjjBY1Gyzd6MU6mo329+YTP2znTcFbV+jSZbafZEUO4nWI4iKw==
1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	SOA 13 14 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. XWmMyPj6GuKtBSr2q6oJ0Jxe8WYxDha6jGi6L4/zianPG3E3u4qfFqMqGNdwVa/YOIzwCvaDCls8DSsKpqezbQ==
1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	DNSKEY 13 14 86400 20220907103046 20220824090046 6687 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. gjg2+aNrebAvxYBavbD+ouZhfFJgMWldpPt1KGNzf7jP7IJNyHUcwxWTU6GOGFIS1LkmECz2xjHCe0DV0ZPTqg==
1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3PARAM 13 14 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. YQyVbVFMTBfG4B2xhL5H+TVdiNcrEUUqiRFeeSrQRmz2eXG38EwrLGv/LQskU+nlCC5JZSpQ5ID9sXdwl9mngg==
1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 0	RRSIG	CDS 13 14 0 20220907103046 20220824090046 6687 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. xfFZQwhLwBsBRXuY6n6OaMW4qRJ73/ZI7MT9CLBDCtbK+QUUdEwVDT7J8kKkSMIP00iLnrX+u8GRa4+8qjqSBA==
1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 0	RRSIG	CDNSKEY 13 14 0 20220907103046 20220824090046 6687 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. kbInf3RTZRfTyt0epxksJnsh0RHs0fnivbJYBxj+zJF2AqNfo1dH62USBAOMJpA4fStbC/LxKtp8sXqvjbZCFw==
1.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. WEmoJ8kPnY8oOEDg6abqhTcATJR2Nl0T2gT31cNvfTysX4264fi7GJAX3I0KQzMekijVd9DPPKB0Q3oCMf8srw==
3.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. IqCDDKXW53HLlvHT+9i6T2P2TpsrSBHAoJ7j1MXLoeBS5Qs+PXmaVJg7zzL6HCtOrGddeLVboBrGT8RgMHcoxA==
4.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. YR65tCapWGg+KB4BXHwn/2vN+iG+nInMMkCFESys+smub+hFT+4s4AMO/F5WlVobmoBr0SZ2i6OQMukPDDWOQQ==
6.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. soVKZNZUniAffsgJFiAZWqFLnmRleyQury2ILtQmKevwMSAwSdh+4Bbq+SW4u+4/HhrAn55PiZ6ROTq460hurg==
7.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. sP39diVn6x7pZoOZ0huVPMXVgS2Vlt2DtiD0y6aW6I74/0cPBHCegxMyTd2HvGqLev94XoRgiHoBSPplr6/3IQ==
8.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. eIHXUG7gEOD1SMNncZwJT/vFhUehxA2KLnVOVG84eBimrA2RyF8KjxmuXuqFgspSl4UHUIasSCs1vAuwQfv1sg==
a.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. WFqVtngiqDp/BVRki8m9MRYHRwcusLIG8Nn/cQZFe+M5wMxrrj/qYyxOxjrt0EjaSuYqmymBm63ixMaawIN4rg==
c.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. RWOu+WwqQB4VOcEtL6K5lCtBAcgF+alnSzmghlxG6v2lUlg9y16l4NCEEgZ29uhEkbCcvxembP60vA+1cF7MTA==
d.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. riO6++Nbt7xn6QyuBRR5kRHaAN7PSA2NniFwB64fQPTJ3Y/PUTRlaCp+isNSzaS1jcqcNo8utulN2QtH8lfR4g==
e.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 2oTFEkVa9hoeDbe6+obro+lmg08F3FHr4e7WLhdBSUCRSht59xWKUJ7EN5fbBowFsJMG0Y/j1lwiAbilYEP7qQ==
0.1.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. J+rD38tvB1YwEKlZzk8iU0Mm32ihGx65/7ffvtSBvHkNDGhSdmHxoof87Bn3HeqCdm3/j74f8qKhT5Ag5+KKEQ==
2.1.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. crfgLMqlSP/omzOPk79rUxbjMo8Hpm/9/LkBqePLfWC+O0yNj1BBarZOXQjhXb5ohAP7DqWUDrnqkvikFYKrgw==
3.1.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. HPuEab6EEvAnPm6ntskddr7pBMRGZFQVI6h8KiEkvk1W35nJRpb8/wQxGjuEzdYWwwejlDY6rfAhlQPs9eIXjQ==
8.1.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. J2QVvncJZc35CiEnbtQEqn8sIDAB3FEW1oTt03jKphblcApUT/oTsHy3dG8ezZrsU4pXlU+Eu0IG27EpiUGzGQ==
9.1.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 1jUafooOdxnuPHN6q4qktnF6hV4Ass3tR1yNK8bM+VgwNFle7IiS8TW3iD7H4lKRowLgWrKkjIMbJfYKn3HYxQ==
a.1.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. rgsuAVhF77LBL74Tg81rxre7V9c1fTLYgLx+EAz8rYnqSSU8yXq0UmKXl5NWOllcOOgsFqVqA4BVzfsAZBUjXQ==
b.1.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. xjdKst6JFnCLcEQPvLvZW+7JzpeOM6qFmBHMOBmuv0ple7tivL1c4xNRkZPu01ldydeZDWztkMb0ODPoehinEQ==
c.1.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 78HF16cMRKgs+wvMdMrjd9YHk2fYeB5PU3WjtC37u0lvpTh2dSU80Q3ImPvOKK0wXfDs3kUV/ER8YwYBf84HXQ==
d.1.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. nMel3kMhZfKSHHjhgcvkmUQ/DcGS+To/Huk4apnwuHGx+JFwi7i5/5V8dN1Aagzodin2CpBb/JclKMTZmfmDGw==
e.1.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. ljfqvyTrb1tbnVHEhDt9AdhqfeC/g6uzq4zrVBdahLH1qFl4EylKSxO+46aWnu8Cb30p1LRrix/SrKUippP0/Q==
f.1.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. ouR4r6cS3eHjYk3oEYFDfV/jgYchVY6YURjtJFqp53PNcOoD0s2iX6GnBi1hGmJ2mnifrSyDl7h8lv+91HNfXw==
0.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 2VpqnDiXnhlD9ZhLQ6C2GltYfp8sXSOaEN1+HVBMCs2mZKWM10mG3pQ+NRd7xxColPEaFdXUWAgypNi3Y9CxKQ==
1.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. +3u1AE54VtjDUpMoOVOy/yhzA1enJZmaEycZ3tHNguSVsA0p3O5XD8sHR29dBJVvL++vXhW8V8UhisCipCFvLg==
2.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. dtOj7t1oxMG32mcfdN7PfPWpGPR5ExbzZKQE5ld6l2c6cB9Jp0dpPCUW19zlyjmZ+5Dtu6eW/bfj9itW42zIOg==
3.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. mOL1xZGBqFHfeTrRzvkA3aMv7XBQT4bCDCKLK75qMoVQt6AQD7U4d1IA5QX/Wj4kz9CFOiq9DEhOFZs/cG7W6g==
4.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. FnZqxt9BrMj57/1gHCTF/EuaS1TmydU5ILaTGAXzJ4pNXeEOw/KpRF1+q1Rsr98ddkdn9rFttCPvUvQ0I+ZdEA==
5.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. puarrlWNS5LH3ECQFwkho3OONKDxcLLFcP/+VL8gwZl4hXBOCge8tmP/IgvjUOJNxPT0HujY142TDpEtt2bFqA==
6.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 9+ITQp9lTzR9SS7RRMi4ICx7sU9/rV+fGKxj5ajl77E34TWmidyqbtSGK5BuAiQP9Dtpbzw2XP+l+P+JV+gOMA==
7.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. Mzf4blJTT1phrs/jBgkIYNcaMiA4oG8OJfIUTR1aT5TCNouQ4EsfReG5zozUyFcFdvH2EShF44sThL5LgXMNFA==
8.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. fT2D1Q/Immxmuj9jBNCPIh8rbHI4qQELoyzoJPuWXMkGtxvlaEGb6MYjFkjOhj2ami40vatcSsQ3Gz+dDWSdbw==
9.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 0Z8OysUZk+Bn463s1lPbXJkpY7jeugTygRlpezgkiPR2eJAana9X8VvDQXA+nFJ1iiBxGVGGaI8roThFGdToLw==
a.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. tF5izwkMkftNmq8LlSKSPqDU5QfZ1jlJPhTsiwPx2vTJ0t8gQ2K5/HBQ7aX55yqfntuvB/0kgbENpNq3lLFxyw==
b.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. jtsydvVGWI1z95iz1DL23FoM1YpRwbH3jAvDWO0SY1eqpKfj3Cn3r+tnNA6Fmq40cWS3UtyfCpDVi8UtiDGs8g==
c.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. QssjnVhVbZlHpT0cCzWS349DhfMDW+1xBRpmXQVI1atOjp8FAOaTTZTeupksHXAfJ/cZcbq6FvWXIbZlyq117A==
d.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. r7rvAYEbzIrvejrkif+jIrp9QAfUTNSXat7K7N9zlX88QiacY4cz87FNm6N5mL+xe8G3qNk2tCl2E3KUC3MApQ==
e.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. r/Y/rQhh0r9FEc/Zwr6F9zn2KskEvlDvxk7IcZFq9UqCNHntqLasoK+tEn5g27xgnETYE2dUQ0c1A9fSPD5aOw==
f.2.f.f.f.f.f.f.f.f.f.f.f.f.f.7.0.0.0.0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 86400	RRSIG	PTR 13 34 86400 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. BqHs3giKGkbFe+z1s3HFpybz7a+3UmNrT2ll3HVJCbd6qzd3AqHHB1hMlFfFPPqVJFbBzRQcwGUfGg/F+WIzcQ==
;; DNSSEC NSEC3 chain
01ugset41bc2tn5hbe6k50dd7jagiinc.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 0p5l9fh6umfv0p9roccq3cn1i9h0qn4n 
0p5l9fh6umfv0p9roccq3cn1i9h0qn4n.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 0sg47djmr74tieoq73dkd0os72l6fj24 PTR RRSIG
0sg47djmr74tieoq73dkd0os72l6fj24.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 0u8t7dkdrjofu037nmn9ajo9rkngesvr PTR RRSIG
0u8t7dkdrjofu037nmn9ajo9rkngesvr.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 1aa1no9belp6ffcn4qchlc5tvgj91i0e 
1aa1no9belp6ffcn4qchlc5tvgj91i0e.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 1gni5tiv7ctuvgjmc38egm27vhg6856a PTR RRSIG
1gni5tiv7ctuvgjmc38egm27vhg6856a.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 25hnf83k20tglnagmflldscb0q2rqjnq 
25hnf83k20tglnagmflldscb0q2rqjnq.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 2b4ugfi9q10taghcadngoerqpjsblgg5 
2b4ugfi9q10taghcadngoerqpjsblgg5.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 2dctqhdpf9vnl1tcctog9kmamjq3v2kh PTR RRSIG
2dctqhdpf9vnl1tcctog9kmamjq3v2kh.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 2dh10gp5a7q12hnq2ppoljvcr0gio14h PTR RRSIG
2dh10gp5a7q12hnq2ppoljvcr0gio14h.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 2lvfveldqnvfar2oh21a4mdd4vhtmi22 
2lvfveldqnvfar2oh21a4mdd4vhtmi22.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 3r0hdfp3golngc707p4u69ktqdo8tptp PTR RRSIG
3r0hdfp3golngc707p4u69ktqdo8tptp.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 4ceptgiiv4vfsgiu13d8g6o2aivr6rp7 
4ceptgiiv4vfsgiu13d8g6o2aivr6rp7.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 50mud8qntenqn5a1fu1sraekjp3rr3bf PTR RRSIG
50mud8qntenqn5a1fu1sraekjp3rr3bf.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 58mk0gv4se3lph9qdbtb766rbp3g55v1 
58mk0gv4se3lph9qdbtb766rbp3g55v1.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 5brtifd2dpfduh3bseut73l1npad4goc PTR RRSIG
5brtifd2dpfduh3bseut73l1npad4goc.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 5ctbg53gthfi2jvqb5i4b0q58jfuhdtp PTR RRSIG
5ctbg53gthfi2jvqb5i4b0q58jfuhdtp.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 5q2ndjva7co6cbt1h4p365agj03fu8vg PTR RRSIG
5q2ndjva7co6cbt1h4p365agj03fu8vg.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 5uno228k0cjjk0hq1q1mignp6pfoskjb PTR RRSIG
5uno228k0cjjk0hq1q1mignp6pfoskjb.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 7lson3bo4f31dh902kdk7d6keha31vip PTR RRSIG
7lson3bo4f31dh902kdk7d6keha31vip.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 7p7i2lmn1cdehs6h19jqq8ov12bb9isf PTR RRSIG
7p7i2lmn1cdehs6h19jqq8ov12bb9isf.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 7pkb3l0i4gj2u6651u2lg3q7s7p67s7f 
7pkb3l0i4gj2u6651u2lg3q7s7p67s7f.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 7q687nhldvvq6embih6l812rue6vm6if PTR RRSIG
7q687nhldvvq6embih6l812rue6vm6if.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 829j2obnn37rdcpk9jeckmispqav0n91 PTR RRSIG
829j2obnn37rdcpk9jeckmispqav0n91.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 89gg85jek4i04l7c1j2hm11l2a8uhu4v PTR RRSIG
89gg85jek4i04l7c1j2hm11l2a8uhu4v.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 8oeau4lseu8csg64b1glmllkdk1bg7l7 
8oeau4lseu8csg64b1glmllkdk1bg7l7.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 8qdehflpqkpgv7ihqe7qcmoj14mnh2jn 
8qdehflpqkpgv7ihqe7qcmoj14mnh2jn.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 9bf9ogjopqnosusqije0om4teivih6r5 PTR RRSIG
9bf9ogjopqnosusqije0om4teivih6r5.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 9l94n7snt9hotfn0ja1590kvhoacmsrk PTR RRSIG
9l94n7snt9hotfn0ja1590kvhoacmsrk.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C ac9dm5tlant1beu3e3tftaa3796fj22d 
ac9dm5tlant1beu3e3tftaa3796fj22d.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C ain1tibqgklsjfdkmhe33ev6ph42tmi5 NS SOA RRSIG DNSKEY NSEC3PARAM CDS CDNSKEY
ain1tibqgklsjfdkmhe33ev6ph42tmi5.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C c13cot2i84abeg6r43kndn1sshtaig64 PTR RRSIG
c13cot2i84abeg6r43kndn1sshtaig64.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C ch3lv8r0h37nrv423j36vmd4hq5qtf66 PTR RRSIG
ch3lv8r0h37nrv423j36vmd4hq5qtf66.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C d2eq6smlrlmlkecrkudj22umn5uu2ai5 PTR RRSIG
d2eq6smlrlmlkecrkudj22umn5uu2ai5.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C d4ir9qvd0a56ep3qp97dmhps1hav0u97 
d4ir9qvd0a56ep3qp97dmhps1hav0u97.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C dbmejeg6oic6ncsvd1sg0md5qpc6fj3a 
dbmejeg6oic6ncsvd1sg0md5qpc6fj3a.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C ehnu7hepdcjqgb93uemsvfd41eq9884i 
ehnu7hepdcjqgb93uemsvfd41eq9884i.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C etgqftjm5dgnmklrck8tlustjp8j4fl5 
etgqftjm5dgnmklrck8tlustjp8j4fl5.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C fuftddfo999inhdffvh2c3aqucu2haht PTR RRSIG
fuftddfo999inhdffvh2c3aqucu2haht.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C gf7d8fc7m25qctraraum8vi355ifeqtv 
gf7d8fc7m25qctraraum8vi355ifeqtv.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C hjn7qs3ndlqnv1akbfmb5d0a7b8cfpt0 
hjn7qs3ndlqnv1akbfmb5d0a7b8cfpt0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C hkbisqab5tsmpsbqo31eoae8n3svckd0 PTR RRSIG
hkbisqab5tsmpsbqo31eoae8n3svckd0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C hm9i9i966lrjc2mvbj0belel9mrphv56 
hm9i9i966lrjc2mvbj0belel9mrphv56.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C i7739dc8r8tgs3164nshdfmu93j6h49f 
i7739dc8r8tgs3164nshdfmu93j6h49f.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C irn56rj24vjahcob9in0lq2m7009tc1i PTR RRSIG
irn56rj24vjahcob9in0lq2m7009tc1i.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C j2bccg0udlfan00nh9384hs1t3q2qp6l 
j2bccg0udlfan00nh9384hs1t3q2qp6l.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C jdjrl6bfelsg8v31luam0mrifsc3u438 
jdjrl6bfelsg8v31luam0mrifsc3u438.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C jnu9akpeathv0um9gbjcdt7sjo0rg10t PTR RRSIG
jnu9akpeathv0um9gbjcdt7sjo0rg10t.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C jqfl9ogr8n7regbejep83c16fdpsnq31 
jqfl9ogr8n7regbejep83c16fdpsnq31.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C kjsngs6jlt871l3h689o08r047r23cii 
kjsngs6jlt871l3h689o08r047r23cii.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C ko10dl67nalb30679r55uagvmeuu991p PTR RRSIG
ko10dl67nalb30679r55uagvmeuu991p.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C lf8urjbotpt6lplddshjvn3cqm27sivr PTR RRSIG
lf8urjbotpt6lplddshjvn3cqm27sivr.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C ln8kspka2l3aq69grvncbv2kcmn0c57m PTR RRSIG
ln8kspka2l3aq69grvncbv2kcmn0c57m.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C lp3s1kld0d3mgtfmvmfsjo121r6qrd88 PTR RRSIG
lp3s1kld0d3mgtfmvmfsjo121r6qrd88.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C naf9o2jd0nu6fd1nhhpsm1c2p6alr28u PTR RRSIG
naf9o2jd0nu6fd1nhhpsm1c2p6alr28u.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C njevf6f4kd278fbshbp1n8080m78pd68 PTR RRSIG
njevf6f4kd278fbshbp1n8080m78pd68.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C o9tc33mo8p17cpgk53asusio688ms4d3 
o9tc33mo8p17cpgk53asusio688ms4d3.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C p2e8rc1p9n1f31mb02v8q44qnstiff0q 
p2e8rc1p9n1f31mb02v8q44qnstiff0q.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C p3ae6gecjb01thm4vd7rqfmdhmqc84b0 PTR RRSIG
p3ae6gecjb01thm4vd7rqfmdhmqc84b0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C pf4u2kge482vmo8d3jfonjn9nrq5s0vs 
pf4u2kge482vmo8d3jfonjn9nrq5s0vs.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C pus0a8t6e9evo9cenmvdkeb5gquspfkj 
pus0a8t6e9evo9cenmvdkeb5gquspfkj.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C qjvbo502g2heia68sf9o2enombsm5kk6 
qjvbo502g2heia68sf9o2enombsm5kk6.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C rgcti3is6r2b82kkl7e8kdrkn94388lm 
rgcti3is6r2b82kkl7e8kdrkn94388lm.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C rhje28ndc2vbhcbuk6iv8kd2s6de8504 
rhje28ndc2vbhcbuk6iv8kd2s6de8504.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C rjftcd1013j3gsre5h7cmk58g1pfuan5 
rjftcd1013j3gsre5h7cmk58g1pfuan5.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C rmjvg90js43p601cucal38egvk8g4q02 
rmjvg90js43p601cucal38egvk8g4q02.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C s6tcrqoo13oj43mfrorsbcqrls83h7g4 PTR RRSIG
s6tcrqoo13oj43mfrorsbcqrls83h7g4.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C t5004effe0ctrgv5vkbvdhk63tndvnf3 
t5004effe0ctrgv5vkbvdhk63tndvnf3.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C u6lc0bduhnpq8q7j849oucd61g9p9sob PTR RRSIG
u6lc0bduhnpq8q7j849oucd61g9p9sob.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C uh23q80olioeg3k19jqqfnaolsk69sjn PTR RRSIG
uh23q80olioeg3k19jqqfnaolsk69sjn.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C umtkb45mlbhnc9hfgaik9fmh1o3ri5es PTR RRSIG
umtkb45mlbhnc9hfgaik9fmh1o3ri5es.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C uoiin51unbd1mfj3fvcpqoe12n0skdm4 
uoiin51unbd1mfj3fvcpqoe12n0skdm4.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C v8nafoasc63h3gujbhbr0p088nn4ri4t 
v8nafoasc63h3gujbhbr0p088nn4ri4t.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C vbdcs3f58p2sdni4s18bohv8pv7giisk 
vbdcs3f58p2sdni4s18bohv8pv7giisk.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	NSEC3	1 0 10 05BD17EF2A88510C 01ugset41bc2tn5hbe6k50dd7jagiinc PTR RRSIG
;; DNSSEC NSEC3 signatures
01ugset41bc2tn5hbe6k50dd7jagiinc.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. Mb+Ja4dDGWesPZ0RCkIny7nFeWyRtk7ccuTwz2O5y9qDR6d1Nmz9qec8zR20LoQzBY9SsvaUY5sKYErycOu0qA==
0p5l9fh6umfv0p9roccq3cn1i9h0qn4n.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. KxbOF9F+cGhDPyDFMnzjdS9f38R2EhCRLoeaIvRLNJrUCwJc31c+KwP4IyFmEy0bAs3gPqTvNlGBLhM72G6VCw==
0sg47djmr74tieoq73dkd0os72l6fj24.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. oiTHwxg7WXRS+dtDs9/FvMP6grv2fWxkyngrobSK/hb3/kLJxs/zXUGpkyO8pHhaNgqEAfk0WN2nG9ljM5pItw==
0u8t7dkdrjofu037nmn9ajo9rkngesvr.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. BzFkXlbbdQjx9rfdHJ/mmpgr56k07c6ZiFYsB6uy2r+40ZlsaatWdIYJjiI7Jpy5QyRUzkpr5IjZReMAps/wTA==
1aa1no9belp6ffcn4qchlc5tvgj91i0e.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. BLT6heSwqWuh08LJexBU1JiVHGRfX8LQdjbRaujR6P1jjdMfUotNdYzSLWnGjV+cv6n7bJ9FFhUFhikbpN9/3A==
1gni5tiv7ctuvgjmc38egm27vhg6856a.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 1pZk8/UumFozkLNjvilh/Dey5OQzyF2USAYKD4giNMSdnftr3mqCJTNdHIFSnOI07T03NDoLwde5XP42piCj4A==
25hnf83k20tglnagmflldscb0q2rqjnq.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. x07ydhySMvl+Tlotl3dfQAzG/MOTA159fj2cz36cMBqBx2PSOVlR+mGbIwdI5D1jawnF8Tyq0yJWQPlKTQESiw==
2b4ugfi9q10taghcadngoerqpjsblgg5.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 4rhElTYo16QGLHsK6N4LTQEjwFO/U6G872kg/uXhVrUlipcDroyM07QWwblzokrWS1VyeO7rbj+W1U6xs4Rb5Q==
2dctqhdpf9vnl1tcctog9kmamjq3v2kh.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. H55s6W1dUwGIWzdMm4HnZt0DjPATsk/+TZRrxDougrJ4KbLTv5FMoQqV7997CHevQjt7ha1OtWevKk5ojOfrFg==
2dh10gp5a7q12hnq2ppoljvcr0gio14h.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. J/RtloIdtyv7inEv89uCY2m2CYtiAmEXLeDxUNfLwA7w1jJaCtJPAy9IzqpIHQLWFrd0vFO7q+OBmkLEpTH2hA==
2lvfveldqnvfar2oh21a4mdd4vhtmi22.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 8HKRQdRjxQE0BEvFajGl501lb+FThRDLpKJU1HzCxAilSRwAPuBqkKx9GcH7xttwfJqcoDNPAlhQVtxMAT/Twg==
3r0hdfp3golngc707p4u69ktqdo8tptp.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. PAELdcNwZbdpCp3NeLH2noLxZfhLjxFBlunuaUekvRgqijpv+/KNMH9pez46mwfVL7hB7tyrx3kmCyi7A4hk+A==
4ceptgiiv4vfsgiu13d8g6o2aivr6rp7.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. qJycuYyaq8dxQx6KreLb1XaCNKLHOvTI96plqO2UHKxqv4lslTjYK7pY8BKOdkZgB59i+yZ32hXSABPQ6msPHA==
50mud8qntenqn5a1fu1sraekjp3rr3bf.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. JG7Zle3QKMUgSKeUaiMHp6pCP9C06KqzhZw9E/0p9a4DN3JUJoJ1K404S8o/mKW6Mr0MmSQBPnYlCwxzKFv1xA==
58mk0gv4se3lph9qdbtb766rbp3g55v1.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. Y94ORey1xfUZugcvivMzRBxHq2CxLB5tqE52YJp53nQKh0+WfUqrSzFQmE8M+7x3gkH47faKd/5de27qyxi11A==
5brtifd2dpfduh3bseut73l1npad4goc.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. vU0zPMjfbvFOR/eIyE7xbg+aVckmk7qhtRP24TcOKTo7kBI78JWhcWRyxIc+LOM8s7kaxNtm1C119fSdDn5lxA==
5ctbg53gthfi2jvqb5i4b0q58jfuhdtp.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. AycmevOOpsspBs4O/tGmaAqlKXb5Cv4lnMQ+5p9m/s2E68AG2BZrPEUKZN0pzol5tKbd2iJmh4/XK0nQAOdaqg==
5q2ndjva7co6cbt1h4p365agj03fu8vg.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. Yk0mwquPnLVnVI6HYwi3gUU+ke133CPh6LB1fWt/91Qm6pQOLNRDjn/LCxKCkVxCJLqwUvy9TlAjUQxp9pn4qQ==
5uno228k0cjjk0hq1q1mignp6pfoskjb.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 9xBgub27/SmgjsspWs3RYDI8P4cmqJrMaqvw8TU1uC4i3IcKxLHvw2jPsanWo3AQ9aX/WoXBh3sfXFKs5rY1AQ==
7lson3bo4f31dh902kdk7d6keha31vip.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 1Qhf8zUAhYLlzQKC/BQFO2XZnsv8HaqbnBQ+MFYmN7WBGOP2duMJaYaiGnQY1DpefOHnxYjt6P8pGNAlZYH/jw==
7p7i2lmn1cdehs6h19jqq8ov12bb9isf.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. AOeYozoPt9sXQRmG5NkuGCIM/FCs3Eep3p+aA4ht1OdDh20kXpRXJQOA9a7nyArGYHf8BLgH7YrATMnNNRVa5w==
7pkb3l0i4gj2u6651u2lg3q7s7p67s7f.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. vtqcw4RKKUe1TBMUKswgrdjZS73ury1ipFQclVCgEbX87KtGsAxnJwlMvHk/kgs93RgCi/7Awr5nEfHsWB8yag==
7q687nhldvvq6embih6l812rue6vm6if.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. x8w/PFN39tVSiZG0BM0LXju0i3L6o1AVSqOXyn1AHQG9CWSC37Hp7ysI0/7725fNqgcx/AzZlWZdfBdm9ltTfQ==
829j2obnn37rdcpk9jeckmispqav0n91.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. rV/hazh8Grl4Ydbfwty5JOCHRy7BIV7tb45+3Yktx6UyLPhjzsS6ONKgHsf+LiVnu3/KE4487APHcb/3oDzXnw==
89gg85jek4i04l7c1j2hm11l2a8uhu4v.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. gbJz4u0li5YyO3WzmSZt+nQcbGtH/TAVxy+j2zZBCPIHb1TeoxUhlzjCjWUTxW/mhhb573r2tI/7hIwpjaVXuQ==
8oeau4lseu8csg64b1glmllkdk1bg7l7.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 6E5GfPB+65HMtwkTMxuKnYRo/y9jpSFtC08JXjGdDDJYykce+cXw/9ZvK5gYCMUbnbqmOBfPoBF+exjxUZ+gFw==
8qdehflpqkpgv7ihqe7qcmoj14mnh2jn.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. pqu39KLolTOt211RtOrX5X1U14EksAoczGUempi9Isdbygmrh7efza4h6veMHSFnHrcxlN6pSfqJz3WCgc8JSw==
9bf9ogjopqnosusqije0om4teivih6r5.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. uQ9eMak9+t1XJoqKWH+BeoD6gPxi/8wLZI6Sea1QDnUrXEK5P17Cc8Xva20GN8q+hkHkni1zy4IyBmX6RtPnhQ==
9l94n7snt9hotfn0ja1590kvhoacmsrk.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. bOPzUvS9nVZpaxmAIctB8zrH0nR9wa4wgyiuhclEM6/C8aXMIVw6hDGHKua5RqsWCOFJzUIyyBkDrnd+jmNXag==
ac9dm5tlant1beu3e3tftaa3796fj22d.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. njfahq5w6Z8GKQMkxqO331ZLONyMfMW6KmJTzasnXAfzRQEL/AWKW1ztHu5uju6Uv15EDG4FsRowS83ao633Ew==
ain1tibqgklsjfdkmhe33ev6ph42tmi5.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. IARcoHQHeO23iHq4fHh8uxHNUgscaKOQGnK0QUKwYGuIjshxSL1msAHHAN+RUnn9D26F7N6umR76TUYrJGr7PQ==
c13cot2i84abeg6r43kndn1sshtaig64.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. RV1rGv79/enscYgQ+m6/F6veJYWUNzvMhTwP0s0ERfXBh8L6BpuAh3dAYxPXO2jjcVTa3dFg8XIJHHxnBt1tPw==
ch3lv8r0h37nrv423j36vmd4hq5qtf66.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 5OtCMNi/Psw1yhR9ZU5gGbr8aEnnGg4Cd9vBAT8I5EAczejGscBhu+wXeNMl9El11/8r5PKHaz9tyo1+XRdsYg==
d2eq6smlrlmlkecrkudj22umn5uu2ai5.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 9VlHc4QliwQdMubAiHa0edts4UCwn3yuoR3tNCz3GFjZ89KS58a71IQ6h81kT5nqelIE39jxG0AkD8dLrzHRYQ==
d4ir9qvd0a56ep3qp97dmhps1hav0u97.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. RN+i0ZZp7TSrYa7WfoHArKCAvU7rWoc3itmXN0WKb4h3L3NNo/21011b0SHTyI1DaFddB5kW4rxf5CPXJr2C/g==
dbmejeg6oic6ncsvd1sg0md5qpc6fj3a.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 0nTR3qXKmQqLCPCz6cjsf8PHNpLpFap9kGf+3E827QV+tl2oQcKsvmFQiPOIFav30XnkeEpfWXU5I3+/bgJAAg==
ehnu7hepdcjqgb93uemsvfd41eq9884i.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. FaV2kyTy5v8pWo+9fm8HcdFEOvoxveu+REyGPThQN3rlU8ZuQZXHAag1WVfdvqGppVjTnDU7t1wt80fANKiY6g==
etgqftjm5dgnmklrck8tlustjp8j4fl5.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 73Hsfiru2dQwLCfHS0UP7tnW09gSRg7eNHfnfqx55U1LALo4dBt/lhXAlSjYKLQOvfyMLq3FF0PNZm+imV/BfQ==
fuftddfo999inhdffvh2c3aqucu2haht.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. ItP7Z+9tFLmuzostmo6AhGFqUqugo8RR4d+raNvQR2kchz1HupTUWVGCn7MOswCN+eWJOFYt4viblue0m8fDyw==
gf7d8fc7m25qctraraum8vi355ifeqtv.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 9r6RerohNsJVsaRHzdqlRUwlvdjnYEBrugAsYt/0P9OyCDgCEo0YiHz/KDSfvQBUQ2YH7czpoqHQJjjnhCTzvQ==
hjn7qs3ndlqnv1akbfmb5d0a7b8cfpt0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. jPKue/8MFSyMqm44Z/qaRri+tOcf7n/itA8I6WAS1iT1Aury6TrAPFhL1IWKrnjrGRDS71uvbfYMOj4+Db6q3w==
hkbisqab5tsmpsbqo31eoae8n3svckd0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 5y4+h7aK31zhUCQ7+EauJ4KKbZMOt/AzM1Ors5R880yDdw2+spJdvvXbk/7eIu8bcPLmsy+NDji6xLVW6sT12g==
hm9i9i966lrjc2mvbj0belel9mrphv56.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. fYvHKxlZiu8bt48ah3qfjVa4qe5BrKl++UU1NXgtVzNDO6z1aE7jtpEPUUe+D/GuLd4amUx7v4l/pWhvVmK9YQ==
i7739dc8r8tgs3164nshdfmu93j6h49f.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. uRMKy/96InG7KOIg9MtBAWETLmtpS5ipkxVJm5xWtETWT8aisNgi7zG8OIzeE0f+fGSxgoKXDhiaDqoL67/Kvg==
irn56rj24vjahcob9in0lq2m7009tc1i.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. w8OQC78Jrp5m595TNBnKtl66Bxw88LtBJWsduD/oYwz6+F06AgiOD/oM4IdOpEsUliuGhmW7LUvPIswj9i/3vA==
j2bccg0udlfan00nh9384hs1t3q2qp6l.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. kcMVim3v/e1jVtjMucvU9mBiMs/rUfu7lWGdyZcoTm1hVsGI9LnnOfOrZigOTVsHwOdfeEaZKr9hRsa+Rg8Cbg==
jdjrl6bfelsg8v31luam0mrifsc3u438.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. sAEI2eZiJHBQ/wtUaa86pzdgSqqOdZYM4NrrIgeOrJUaGpti8fooEg8owWyMQBpLOglBLIbzSRWTqaTEtdB6/w==
jnu9akpeathv0um9gbjcdt7sjo0rg10t.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. BTXKElvoXXTSSHj5QRYK3Hal7xJuH64CIgghOgT8TP8uLk4QQf03cAvuxCD4c5cco6o6D3ceLFhkpsrhxRtRpg==
jqfl9ogr8n7regbejep83c16fdpsnq31.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. GHeUDnewGJLbNXORw7qAbQ4dGaUKEi1y4hHrWkikTVX8rUjxYXMjxTUFgjZMorRLpmqExlNW8wT/N/jGaXFieQ==
kjsngs6jlt871l3h689o08r047r23cii.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. jCW38JqljX9rOjUJCNJ2UF9XPLYkyQN0ChpwbDT2R98GjqixgUUoaWZtBYQMv5R0Cb9NZYHuqtEGDA9H+3Qd1w==
ko10dl67nalb30679r55uagvmeuu991p.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. Zkld39QQHcvitq1AV5/0l9Zb/TnmE4CCR/8HjCKiqISTGQ+8UOvo1K9xt0TH96KZ6xGC4ODEeVaxCnpHLN22xg==
lf8urjbotpt6lplddshjvn3cqm27sivr.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. Yhrs3cERBpphlehbO5l4RNSgMdReN5CluLZKPYCJPZms1JMJT8BbtmHYkdGepLGLzu1Rx8RD5tp1GmpVTlWTQg==
ln8kspka2l3aq69grvncbv2kcmn0c57m.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. Hetjro1q4v+3GJzTPGkew8aCulD5wCBB4skHwvxYeoW7NG5X8KzqpSTzZdMkb3BAxnwVA51iu1fh564Jj/Pv/w==
lp3s1kld0d3mgtfmvmfsjo121r6qrd88.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. tZEwChbMolUUNHKtT6lQVTWDFmGR8ZkhqMRONKYGfaC7ZpqHRklDbeGR2naf82vx6CmsbH927/78aVDheTC6Sw==
naf9o2jd0nu6fd1nhhpsm1c2p6alr28u.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. U3nfeqZSrAg7CV2NfTTpH4LgQ6wZnP0GReuYd6wxqvdnolCyzRvpthZV0Rl01gZgMbWgoTMDrX8KW+yeMC+h9g==
njevf6f4kd278fbshbp1n8080m78pd68.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. qLQ/nnuPHS09JcBHZCW1TF2wQCX8gYfLVfzrpjiX5XFoUj7newXxQBivba6v5xC46d9v4sOWeihU3AdnH3Racw==
o9tc33mo8p17cpgk53asusio688ms4d3.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. szj+rhB9enH8w7zrTUlXuEDu5jVZkflIo/yorMSoVuhO5MVmp0Z5mAwZ/r+I3kEx0wtnYvWquco08GqDrzNxRw==
p2e8rc1p9n1f31mb02v8q44qnstiff0q.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. CYtGWj6L85Q2jslD8CNn6b1JZwqw3ylPdaFGP7t4Ly0hnmuY6soM+dtTwFmbdO1TSOMXH80Sr/5Se1G3mASJ7A==
p3ae6gecjb01thm4vd7rqfmdhmqc84b0.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. lQcLGFExC/XZlNMGjU0IKGIlR18OYRTPNfuamO7nlMMflpTvfuEWuaYs+S4ad5dmjGll1OglV9fqOiTAPImZNQ==
pf4u2kge482vmo8d3jfonjn9nrq5s0vs.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. LWrZ4yymbv61IAZiV06HJyY6BlDIgwbVpj3Z+bt4alMgeNHRB9IkRPhS994cGy0ZrAkyp4vIYBtkxx9eCiCyMA==
pus0a8t6e9evo9cenmvdkeb5gquspfkj.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. t8xeY1TjK42zXxdli3ZXJb95ASXOjXfToqOpGLSvE12yLSvGSbIEt49gwaSFYU+Hh9qemNSGrwropXEKbHSzJA==
qjvbo502g2heia68sf9o2enombsm5kk6.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 1k9aYGurF9i9j2VjB4/C7qBzfM4CQVptSLTVojTYCXISAysVJs51zftqTI6dlpKtKOzwGhws0dApU9Jty8KGdA==
rgcti3is6r2b82kkl7e8kdrkn94388lm.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. frZrZtm1OOOZ2bze+9tSuddxDvwgD3qtxTZDuDbXDcLiL9hsC6y7i+38CS1wg0WLdE2YlUvAunvG+HJ5F0VTbQ==
rhje28ndc2vbhcbuk6iv8kd2s6de8504.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. PYGuDC3jL9r9GxKxUqAyZqj0iQhkp7iAV/QvoQ66p0oLmCun38erVnpOywAMm+9dR55YG9bOM1/IlyhOUnIe9A==
rjftcd1013j3gsre5h7cmk58g1pfuan5.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. ohsSZELoT8yX77ZPfXBO1DVanZ9vI4mGTbwE9kwlnNge+fc/82Xlgtp2Ugjf2sNmA5ExoVMQmk/+i/ny5ALhMg==
rmjvg90js43p601cucal38egvk8g4q02.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. AaooK2HlrkMRX55K4Q0Tu9rijFpa+Hj7NVnz11PulzPngSK4nZY44a1JobtoZbd4tjzqjMhIy3A9GoFaudg/UA==
s6tcrqoo13oj43mfrorsbcqrls83h7g4.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. OSR838hd9DXIg6dEw5OcQqJNnq1pIIdYUX8aD1M1+krKZPw+DTDeIId1f9ZuUcNZwDWfaC5QDm5JdEURoTEJnQ==
t5004effe0ctrgv5vkbvdhk63tndvnf3.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. UX4LoNFOh2q0g6JxU6479hQ6AldfborHfqx9VxyBHGAx4RXUrrLSu/tE8Yu+IfXwkE3WCujM2pWquV2vtAmnYQ==
u6lc0bduhnpq8q7j849oucd61g9p9sob.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. DPt0rMSv8FGybsDRG5xBnTg87v/mgPhht49NuxkWr96WjIuXpVWLIKBxV/KepnA3fTWAEvYwxwhWWmYr2ePHwg==
uh23q80olioeg3k19jqqfnaolsk69sjn.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. OL6YTuWOWDIkpS/3apP7/rimO1GN4rY7qCKd7yX6lYGFxUQLr3G5yhNOuaNhU5wWgVfeyTR/eBDquKy+Mp2Gmw==
umtkb45mlbhnc9hfgaik9fmh1o3ri5es.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. P/0kAgzta4kXU0lJ6DrVn7/ShIoNUYeMOtlgbdXxak8YIjY27ExvLXWpMG8lacHUiJD7qaHoHDpLSEdVL25dnA==
uoiin51unbd1mfj3fvcpqoe12n0skdm4.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. bbPDFNuLGZQshWsEr2tvAXz0ru9ysG/tuW6s1881zJyuCCbdEe9o73h1wFTAdFoGZs0NtMDVzBu16c+sSyv2jA==
v8nafoasc63h3gujbhbr0p088nn4ri4t.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. nDiwL6DWZzBkvgxzQFlTX3Z/yk+LtOH2zSaVHFweF8SY3jblI1ix8DEypmRrXlqAGYJufhGTz8poGvbWUUWxxA==
vbdcs3f58p2sdni4s18bohv8pv7giisk.1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. 3600	RRSIG	NSEC3 13 15 3600 20220907103046 20220824090046 23319 1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa. NujeNX8LsRzEbNB0dzQN2HNhfEronKTYvw1o8ktJr/jHIuUB1y40hblN2pWjwlDeQ04VZSP7Jo1oRSmCsH4VQQ==
;; Written 236 records
;; Time 2022-08-24 10:30:46 UTC

Hi Q, could you please also share (publicly or privately) your log file(s)? It could help us see in which occasions did your knotd crashed each time. Most of the activity, except from normal query answering, is usually logged under different log levels. It might also help to set the log level low enough (e.g. debug) and try to trigger several more crashes ;) Thank you!

@TheEnbyperor Unfortunately, it's still unclear why it crashes. The zone file is correct and knotd doesn't crash in my case :-/

How long have you been using Knot? Have you ever used any older version (3.1)?

I've only started using it recently but did start on 3.1.

It seems that something changes the zone file when it's beeing parsed (it's mmaped).

Zone load (includes parsing) was called twice in short time period:

2022-08-12T11:10:11+0000 info: [1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa.] control, received command 'zone-reload'
2022-08-12T11:10:12+0000 info: [1.0.0.0.1.c.c.1.e.0.a.2.ip6.arpa.] control, received command 'zone-reload'

Could you check the logs if there is a similar pattern before server crash?

I have just noticed that you have journal disabled on both servers. On primary I would switch to this mode https://www.knot-dns.cz/docs/3.2/singlehtml/index.html#example-4 But don't know your deployment.

That seems to make sense, I'll try and report back.

Unfortunately: no luck

@TheEnbyperor, do you mean that knotd crashes with this configuration too?

Yes

Just an idea: does the issue disappear if you run Docker with --shm-size=8G ?

On the servers this is running in containerd so I have no idea what the equivalent option would be

@TheEnbyperor Could you describe in more details how you modify the zone files? Are the zone files replaced with fully generated ones or just edited? Is the zone updating process inside another Docker container?

I would like to simulate your environment.

The docker container has shared storage with another that handles updating the zone files. They're regenerated completely with the following python code:

with open(f"zones/{zone_name}zone", "w", encoding="utf8", newline='\n') as f:
    f.write(zone_contents)

If the zone files are memory mapped, and the zone file is updated during reading I could see how this may cause a memory error (although a bus error and not a segmentation fault still confuses me). It might be worth my time trying to find a way to update zone files then instantaneously swapping them so that knot doesn't try reading past the end of the file if the file is emptied then written again as I think is currently happening.

Perfect, we can reproduce it from now on

What about this version:

import os                                                                       
import tempfile                                                                 
with tempfile.NamedTemporaryFile("w", encoding="utf8", newline='\n', dir=f"zones", delete=False) as f:
    f.write(zone_contents)                                                      
    os.rename(f.name, f"zones/{zone_name}zone")

?

That code makes sense, I'll try it shortly.

Any news?

Still seeing the same errors. In all the crashes I've seen they haven't been after two zone reload commands in quick succession either.

Hmm, that surprises me. If it's the same error, we know what is wrong. My python code solved it in my case. So still there must be some concurrent zone file access

Hi Q,

could you elaboreate on your recend findings? Do you know for sure that Daniel's python snippet prevents any more write operations into the zone file after it's renamed? I suspect it's renamed first and subsequently closed => flushed.

When this issue persists even when we make sure there are no write operations into the zone file, we would have to investigate from the beginning, because it would be probably caused by other aspect that we are not yet aware of.

Thanks for your cooperation!

added bug discussion knot libraries labels

Hi Q, do you have any news?

removed bug label

I'm sorry, we cannot change how zscanner accesses zone files.

closed

mentioned in issue #871 (closed)