intelmq.bots.collectors.http package¶
Submodules¶
intelmq.bots.collectors.http.collector_http module¶
HTTP collector bot
| param http_url: | |
|---|---|
| type http_url: | string |
| param http_header: | |
| default: {} | |
| type http_header: | |
| dictionary | |
| param http_verify_cert: | |
| default: True | |
| type http_verify_cert: | |
| boolean | |
| param extract_files: | |
| value used to extract files from downloaded compressed file default: None all: True; some: string with file names separated by , | |
| param http_url_formatting: | |
| to turn on time formatting (and to specify delta to current time) | |
| type http_url_formatting: | |
| bool|json | |
| param http_username: | |
| type http_username: | |
| string | |
| param http_password: | |
| type http_password: | |
| string | |
| param http_proxy: | |
| type http_proxy: | |
| string | |
| param https_proxy: | |
| type https_proxy: | |
| string | |
| param http_timeout_sec: | |
| tuple of two floats or float | |
| param http_timeout_max_tries: | |
| an integer depicting how often a connection attempt is retried | |
| type http_timeout_max_tries: | |
| int | |
| param verify_pgp_signatures: | |
| whether to download and check file signatures default: False | |
| type verify_pgp_signatures: | |
| bool | |
| param signature_url: | |
| type signature_url: | |
| string | |
| param signature_url_formatting: | |
| the same as http_url_formatting | |
| param gpg_keyring: | |
| none (defaults to user’s GPG keyring) or string (path to keyring file) | |
-
intelmq.bots.collectors.http.collector_http.BOT¶ alias of
intelmq.bots.collectors.http.collector_http.HTTPCollectorBot
-
class
intelmq.bots.collectors.http.collector_http.HTTPCollectorBot(*args, **kwargs)¶ Bases:
intelmq.lib.bot.CollectorBot,intelmq.lib.mixins.http.HttpMixinFetch reports from an URL
-
extract_files= False¶
-
format_url(url: str, formatting) → str¶
-
gpg_keyring= None¶
-
http_password= None¶
-
http_url= '<insert url of feed>'¶
-
http_url_formatting= False¶
-
http_username= None¶
-
init()¶
-
process()¶
-
rate_limit= 3600¶
-
signature_url= None¶
-
signature_url_formatting= False¶
-
ssl_client_certificate= None¶
-
verify_pgp_signatures= False¶
-
verify_signature(data: bytes)¶ Download signature file and verify the report data.
-
intelmq.bots.collectors.http.collector_http_stream module¶
HTTP collector bot
| param http_url: | string |
|---|---|
| param http_header: | |
| dictionary default: {} | |
| param http_verify_cert: | |
| boolean default: True | |
| param http_username, http_password: | |
| string | |
| param http_proxy, https_proxy: | |
| string | |
| param strip_lines: | |
| boolean | |
| param http_timeout_sec: | |
| tuple of two floats or float | |
-
intelmq.bots.collectors.http.collector_http_stream.BOT¶ alias of
intelmq.bots.collectors.http.collector_http_stream.HTTPStreamCollectorBot
-
class
intelmq.bots.collectors.http.collector_http_stream.HTTPStreamCollectorBot(*args, **kwargs)¶ Bases:
intelmq.lib.bot.CollectorBot,intelmq.lib.mixins.http.HttpMixinOpen a streaming connection to the URL and process data per line
-
http_password= None¶
-
http_url= '<insert url of feed>'¶
-
http_username= None¶
-
init()¶
-
process()¶
-
rate_limit= 3600¶
-
ssl_client_certificate= None¶
-
strip_lines= True¶
-