Configuration defaults not working
Contrary to what README says, defaults for configuration variables (or at least some of them) don't work. For example, commenting out http_timeout
in the config file results in the following traceback:
(dns-crawler) $ dns-crawler domain-list.txt
Traceback (most recent call last):
File "/home/lhotka/Projects/dns-crawler/bin/dns-crawler", line 11, in <module>
load_entry_point('dns-crawler==1.0.3', 'console_scripts', 'dns-crawler')()
File "/home/lhotka/Projects/dns-crawler/lib/python3.8/site-packages/pkg_resources/__init__.py", line 489, in load_entry_point
return get_distribution(dist).load_entry_point(group, name)
File "/home/lhotka/Projects/dns-crawler/lib/python3.8/site-packages/pkg_resources/__init__.py", line 2852, in load_entry_point
return ep.load()
File "/home/lhotka/Projects/dns-crawler/lib/python3.8/site-packages/pkg_resources/__init__.py", line 2443, in load
return self.resolve()
File "/home/lhotka/Projects/dns-crawler/lib/python3.8/site-packages/pkg_resources/__init__.py", line 2449, in resolve
module = __import__(self.module_name, fromlist=['__name__'], level=0)
File "/home/lhotka/Projects/dns-crawler/lib/python3.8/site-packages/dns_crawler/controller.py", line 30, in <module>
from .crawl import process_domain
File "/home/lhotka/Projects/dns-crawler/lib/python3.8/site-packages/dns_crawler/crawl.py", line 23, in <module>
from .dns_utils import (annotate_dns_algorithm, check_dnssec,
File "/home/lhotka/Projects/dns-crawler/lib/python3.8/site-packages/dns_crawler/dns_utils.py", line 27, in <module>
dns_timeout = int(config["http_timeout"])
KeyError: 'http_timeout'