multi_static_website/web_scraper.log
2025-12-23 13:06:25 +01:00

219 lines
19 KiB
Text

07:57:22 | INFO | MainThread | [1/100] https://www.composerize.com
07:57:22 | DEBUG | MainThread | Starting new HTTPS connection (1): www.composerize.com:443
07:57:22 | DEBUG | MainThread | https://www.composerize.com:443 "GET / HTTP/1.1" 200 867
07:57:22 | DEBUG | MainThread | Created directory sites/mio
07:57:22 | DEBUG | MainThread | Saved page sites/mio/index.html
07:57:22 | DEBUG | DL-2 | Starting new HTTPS connection (2): www.composerize.com:443
07:57:22 | DEBUG | DL-1 | Starting new HTTPS connection (3): www.composerize.com:443
07:57:22 | DEBUG | DL-4 | Starting new HTTPS connection (4): www.composerize.com:443
07:57:22 | DEBUG | DL-3 | https://www.composerize.com:443 "GET /favicon.ico HTTP/1.1" 200 None
07:57:22 | DEBUG | DL-3 | Saved resource -> sites/mio/favicon.ico
07:57:22 | DEBUG | DL-4 | https://www.composerize.com:443 "GET /manifest.json HTTP/1.1" 200 288
07:57:22 | DEBUG | DL-4 | Saved resource -> sites/mio/manifest.json
07:57:22 | DEBUG | DL-1 | https://www.composerize.com:443 "GET /static/css/main.757d3484.css HTTP/1.1" 200 None
07:57:22 | DEBUG | DL-1 | Created directory sites/mio/static/css
07:57:22 | DEBUG | DL-1 | Saved resource -> sites/mio/static/css/main.757d3484.css
07:57:22 | DEBUG | DL-2 | https://www.composerize.com:443 "GET /static/js/main.623047e0.js HTTP/1.1" 200 None
07:57:22 | DEBUG | DL-2 | Created directory sites/mio/static/js
07:57:23 | DEBUG | DL-2 | Saved resource -> sites/mio/static/js/main.623047e0.js
07:57:23 | INFO | MainThread | Crawl finished: 1 pages in 1.03s (1.03s avg)
08:00:47 | INFO | MainThread | [1/100] https://www.composerize.com
08:00:47 | DEBUG | MainThread | Starting new HTTPS connection (1): www.composerize.com:443
08:00:47 | DEBUG | MainThread | https://www.composerize.com:443 "GET / HTTP/1.1" 200 867
08:00:47 | DEBUG | MainThread | Saved page sites/mio/index.html
08:00:47 | INFO | MainThread | Crawl finished: 1 pages in 0.14s (0.14s avg)
08:11:57 | INFO | MainThread | [1/100] https://www.composerize.com
08:11:57 | DEBUG | MainThread | Starting new HTTPS connection (1): www.composerize.com:443
08:11:57 | DEBUG | MainThread | https://www.composerize.com:443 "GET / HTTP/1.1" 200 867
08:11:57 | DEBUG | MainThread | Saved page sites/mio/index.html
08:11:57 | INFO | MainThread | Crawl finished: 1 pages in 0.12s (0.12s avg)
08:23:16 | INFO | MainThread | [1/100] https://www.composerize.com
08:23:16 | DEBUG | MainThread | Starting new HTTPS connection (1): www.composerize.com:443
08:23:16 | DEBUG | MainThread | https://www.composerize.com:443 "GET / HTTP/1.1" 200 867
08:23:16 | DEBUG | MainThread | Created directory home/sites/mio
08:23:16 | DEBUG | MainThread | Saved page home/sites/mio/index.html
08:23:16 | DEBUG | DL-3 | Starting new HTTPS connection (2): www.composerize.com:443
08:23:16 | DEBUG | DL-2 | Starting new HTTPS connection (3): www.composerize.com:443
08:23:16 | DEBUG | DL-1 | Starting new HTTPS connection (4): www.composerize.com:443
08:23:16 | DEBUG | DL-4 | https://www.composerize.com:443 "GET /favicon.ico HTTP/1.1" 200 3430
08:23:16 | DEBUG | DL-4 | Saved resource -> home/sites/mio/favicon.ico
08:23:16 | DEBUG | DL-1 | https://www.composerize.com:443 "GET /manifest.json HTTP/1.1" 200 288
08:23:16 | DEBUG | DL-1 | Saved resource -> home/sites/mio/manifest.json
08:23:16 | DEBUG | DL-3 | https://www.composerize.com:443 "GET /static/css/main.757d3484.css HTTP/1.1" 200 1761
08:23:16 | DEBUG | DL-3 | Created directory home/sites/mio/static/css
08:23:16 | DEBUG | DL-3 | Saved resource -> home/sites/mio/static/css/main.757d3484.css
08:23:16 | DEBUG | DL-2 | https://www.composerize.com:443 "GET /static/js/main.623047e0.js HTTP/1.1" 200 176652
08:23:16 | DEBUG | DL-2 | Created directory home/sites/mio/static/js
08:23:16 | DEBUG | DL-2 | Saved resource -> home/sites/mio/static/js/main.623047e0.js
08:23:16 | INFO | MainThread | Crawl finished: 1 pages in 0.39s (0.39s avg)
08:25:06 | INFO | MainThread | [1/100] https://www.composerize.com
08:25:06 | DEBUG | MainThread | Starting new HTTPS connection (1): www.composerize.com:443
08:25:06 | DEBUG | MainThread | https://www.composerize.com:443 "GET / HTTP/1.1" 200 867
08:25:06 | DEBUG | MainThread | Created directory home/sites/mio
08:25:06 | DEBUG | MainThread | Saved page home/sites/mio/index.html
08:25:06 | DEBUG | DL-1 | Starting new HTTPS connection (2): www.composerize.com:443
08:25:06 | DEBUG | DL-2 | Starting new HTTPS connection (3): www.composerize.com:443
08:25:06 | DEBUG | DL-4 | Starting new HTTPS connection (4): www.composerize.com:443
08:25:06 | DEBUG | DL-3 | https://www.composerize.com:443 "GET /manifest.json HTTP/1.1" 200 288
08:25:06 | DEBUG | DL-3 | Saved resource -> home/sites/mio/manifest.json
08:25:06 | DEBUG | DL-1 | https://www.composerize.com:443 "GET /favicon.ico HTTP/1.1" 200 3430
08:25:06 | DEBUG | DL-2 | https://www.composerize.com:443 "GET /static/js/main.623047e0.js HTTP/1.1" 200 176652
08:25:06 | DEBUG | DL-2 | Created directory home/sites/mio/static/js
08:25:06 | DEBUG | DL-1 | Saved resource -> home/sites/mio/favicon.ico
08:25:06 | DEBUG | DL-4 | https://www.composerize.com:443 "GET /static/css/main.757d3484.css HTTP/1.1" 200 1761
08:25:06 | DEBUG | DL-4 | Created directory home/sites/mio/static/css
08:25:06 | DEBUG | DL-4 | Saved resource -> home/sites/mio/static/css/main.757d3484.css
08:25:07 | DEBUG | DL-2 | Saved resource -> home/sites/mio/static/js/main.623047e0.js
08:25:07 | INFO | MainThread | Crawl finished: 1 pages in 0.30s (0.30s avg)
08:54:46 | INFO | MainThread | [1/100] https://www.composerize.com
08:54:46 | DEBUG | MainThread | Starting new HTTPS connection (1): www.composerize.com:443
08:54:46 | DEBUG | MainThread | https://www.composerize.com:443 "GET / HTTP/1.1" 200 867
08:54:46 | DEBUG | MainThread | Created directory home/sites/mio
08:54:46 | DEBUG | DL-3 | Starting new HTTPS connection (2): www.composerize.com:443
08:54:46 | DEBUG | DL-1 | Starting new HTTPS connection (3): www.composerize.com:443
08:54:46 | DEBUG | DL-4 | Starting new HTTPS connection (4): www.composerize.com:443
08:54:46 | DEBUG | MainThread | Saved page home/sites/mio/index.html
08:54:46 | DEBUG | DL-2 | https://www.composerize.com:443 "GET /manifest.json HTTP/1.1" 200 288
08:54:46 | DEBUG | DL-2 | Saved resource -> home/sites/mio/manifest.json
08:54:46 | DEBUG | DL-4 | https://www.composerize.com:443 "GET /static/js/main.623047e0.js HTTP/1.1" 200 176652
08:54:46 | DEBUG | DL-1 | https://www.composerize.com:443 "GET /favicon.ico HTTP/1.1" 200 3430
08:54:46 | DEBUG | DL-4 | Created directory home/sites/mio/static/js
08:54:46 | DEBUG | DL-1 | Saved resource -> home/sites/mio/favicon.ico
08:54:46 | DEBUG | DL-3 | https://www.composerize.com:443 "GET /static/css/main.757d3484.css HTTP/1.1" 200 1761
08:54:46 | DEBUG | DL-3 | Created directory home/sites/mio/static/css
08:54:46 | DEBUG | DL-3 | Saved resource -> home/sites/mio/static/css/main.757d3484.css
08:54:46 | DEBUG | DL-4 | Saved resource -> home/sites/mio/static/js/main.623047e0.js
08:54:46 | INFO | MainThread | Crawl finished: 1 pages in 0.49s (0.49s avg)
08:57:24 | INFO | MainThread | [1/100] https://www.composerize.com
08:57:24 | DEBUG | MainThread | Starting new HTTPS connection (1): www.composerize.com:443
08:57:24 | DEBUG | MainThread | https://www.composerize.com:443 "GET / HTTP/1.1" 200 867
08:57:24 | DEBUG | MainThread | Created directory home/sites/mio
08:57:24 | DEBUG | MainThread | Saved page home/sites/mio/index.html
08:57:24 | DEBUG | DL-3 | Starting new HTTPS connection (2): www.composerize.com:443
08:57:24 | DEBUG | DL-4 | Starting new HTTPS connection (3): www.composerize.com:443
08:57:24 | DEBUG | DL-1 | Starting new HTTPS connection (4): www.composerize.com:443
08:57:24 | DEBUG | DL-2 | https://www.composerize.com:443 "GET /static/js/main.623047e0.js HTTP/1.1" 200 176652
08:57:24 | DEBUG | DL-2 | Created directory home/sites/mio/static/js
08:57:24 | DEBUG | DL-3 | https://www.composerize.com:443 "GET /favicon.ico HTTP/1.1" 200 3430
08:57:24 | DEBUG | DL-3 | Saved resource -> home/sites/mio/favicon.ico
08:57:24 | DEBUG | DL-2 | Saved resource -> home/sites/mio/static/js/main.623047e0.js
08:57:24 | DEBUG | DL-4 | https://www.composerize.com:443 "GET /manifest.json HTTP/1.1" 200 288
08:57:24 | DEBUG | DL-4 | Saved resource -> home/sites/mio/manifest.json
08:57:24 | DEBUG | DL-1 | https://www.composerize.com:443 "GET /static/css/main.757d3484.css HTTP/1.1" 200 1761
08:57:24 | DEBUG | DL-1 | Created directory home/sites/mio/static/css
08:57:24 | DEBUG | DL-1 | Saved resource -> home/sites/mio/static/css/main.757d3484.css
08:57:24 | INFO | MainThread | Crawl finished: 1 pages in 0.30s (0.30s avg)
09:00:47 | INFO | MainThread | [1/100] https://www.composerize.com
09:00:47 | DEBUG | MainThread | Starting new HTTPS connection (1): www.composerize.com:443
09:00:47 | DEBUG | MainThread | https://www.composerize.com:443 "GET / HTTP/1.1" 200 867
09:00:47 | DEBUG | DL-4 | Starting new HTTPS connection (2): www.composerize.com:443
09:00:47 | DEBUG | DL-2 | Starting new HTTPS connection (3): www.composerize.com:443
09:00:47 | DEBUG | MainThread | Created directory home/sites/mio
09:00:47 | DEBUG | MainThread | Saved page home/sites/mio/index.html
09:00:47 | DEBUG | DL-1 | Starting new HTTPS connection (4): www.composerize.com:443
09:00:47 | DEBUG | DL-3 | https://www.composerize.com:443 "GET /favicon.ico HTTP/1.1" 200 3430
09:00:47 | DEBUG | DL-3 | Saved resource -> home/sites/mio/favicon.ico
09:00:47 | DEBUG | DL-4 | https://www.composerize.com:443 "GET /static/css/main.757d3484.css HTTP/1.1" 200 1761
09:00:47 | DEBUG | DL-4 | Created directory home/sites/mio/static/css
09:00:47 | DEBUG | DL-4 | Saved resource -> home/sites/mio/static/css/main.757d3484.css
09:00:47 | DEBUG | DL-2 | https://www.composerize.com:443 "GET /manifest.json HTTP/1.1" 200 288
09:00:47 | DEBUG | DL-2 | Saved resource -> home/sites/mio/manifest.json
09:00:47 | DEBUG | DL-1 | https://www.composerize.com:443 "GET /static/js/main.623047e0.js HTTP/1.1" 200 176652
09:00:47 | DEBUG | DL-1 | Created directory home/sites/mio/static/js
09:00:47 | DEBUG | DL-1 | Saved resource -> home/sites/mio/static/js/main.623047e0.js
09:00:47 | INFO | MainThread | Crawl finished: 1 pages in 0.40s (0.40s avg)
09:41:16 | INFO | MainThread | [1/100] https://www.composerize.com
09:41:16 | DEBUG | MainThread | Starting new HTTPS connection (1): www.composerize.com:443
09:41:16 | DEBUG | MainThread | https://www.composerize.com:443 "GET / HTTP/1.1" 200 867
09:41:16 | DEBUG | MainThread | Created directory home/sites/composterize
09:41:16 | DEBUG | MainThread | Saved page home/sites/composterize/index.html
09:41:16 | DEBUG | DL-4 | Starting new HTTPS connection (2): www.composerize.com:443
09:41:16 | DEBUG | DL-1 | Starting new HTTPS connection (3): www.composerize.com:443
09:41:16 | DEBUG | DL-2 | Starting new HTTPS connection (4): www.composerize.com:443
09:41:16 | DEBUG | DL-3 | https://www.composerize.com:443 "GET /favicon.ico HTTP/1.1" 200 3430
09:41:16 | DEBUG | DL-3 | Saved resource -> home/sites/composterize/favicon.ico
09:41:16 | DEBUG | DL-4 | https://www.composerize.com:443 "GET /manifest.json HTTP/1.1" 200 288
09:41:16 | DEBUG | DL-4 | Saved resource -> home/sites/composterize/manifest.json
09:41:16 | DEBUG | DL-2 | https://www.composerize.com:443 "GET /static/js/main.623047e0.js HTTP/1.1" 200 176652
09:41:16 | DEBUG | DL-2 | Created directory home/sites/composterize/static/js
09:41:16 | DEBUG | DL-1 | https://www.composerize.com:443 "GET /static/css/main.757d3484.css HTTP/1.1" 200 1761
09:41:16 | DEBUG | DL-1 | Created directory home/sites/composterize/static/css
09:41:16 | DEBUG | DL-1 | Saved resource -> home/sites/composterize/static/css/main.757d3484.css
09:41:16 | DEBUG | DL-2 | Saved resource -> home/sites/composterize/static/js/main.623047e0.js
09:41:16 | INFO | MainThread | Crawl finished: 1 pages in 0.44s (0.44s avg)
09:46:06 | INFO | MainThread | [1/100] https://www.composerize.com
09:46:06 | DEBUG | MainThread | Starting new HTTPS connection (1): www.composerize.com:443
09:46:06 | DEBUG | MainThread | https://www.composerize.com:443 "GET / HTTP/1.1" 200 867
09:46:06 | DEBUG | MainThread | Created directory home/sites/composerize
09:46:06 | DEBUG | MainThread | Saved page home/sites/composerize/index.html
09:46:06 | DEBUG | DL-2 | Starting new HTTPS connection (2): www.composerize.com:443
09:46:06 | DEBUG | DL-1 | Starting new HTTPS connection (3): www.composerize.com:443
09:46:06 | DEBUG | DL-4 | Starting new HTTPS connection (4): www.composerize.com:443
09:46:06 | DEBUG | DL-3 | https://www.composerize.com:443 "GET /manifest.json HTTP/1.1" 200 288
09:46:06 | DEBUG | DL-3 | Saved resource -> home/sites/composerize/manifest.json
09:46:06 | DEBUG | DL-4 | https://www.composerize.com:443 "GET /static/js/main.623047e0.js HTTP/1.1" 200 176652
09:46:06 | DEBUG | DL-4 | Created directory home/sites/composerize/static/js
09:46:06 | DEBUG | DL-2 | https://www.composerize.com:443 "GET /favicon.ico HTTP/1.1" 200 3430
09:46:06 | DEBUG | DL-2 | Saved resource -> home/sites/composerize/favicon.ico
09:46:06 | DEBUG | DL-1 | https://www.composerize.com:443 "GET /static/css/main.757d3484.css HTTP/1.1" 200 1761
09:46:06 | DEBUG | DL-1 | Created directory home/sites/composerize/static/css
09:46:06 | DEBUG | DL-1 | Saved resource -> home/sites/composerize/static/css/main.757d3484.css
09:46:06 | DEBUG | DL-4 | Saved resource -> home/sites/composerize/static/js/main.623047e0.js
09:46:06 | INFO | MainThread | Crawl finished: 1 pages in 0.31s (0.31s avg)
10:17:29 | INFO | MainThread | [1/100] https://www.composerize.com
10:17:29 | DEBUG | MainThread | Starting new HTTPS connection (1): www.composerize.com:443
10:17:29 | DEBUG | MainThread | https://www.composerize.com:443 "GET / HTTP/1.1" 200 867
10:17:29 | DEBUG | MainThread | Created directory home/sites/composerize
10:17:29 | DEBUG | MainThread | Saved page home/sites/composerize/index.html
10:17:29 | DEBUG | DL-1 | Starting new HTTPS connection (2): www.composerize.com:443
10:17:29 | DEBUG | DL-3 | Starting new HTTPS connection (3): www.composerize.com:443
10:17:29 | DEBUG | DL-2 | Starting new HTTPS connection (4): www.composerize.com:443
10:17:29 | DEBUG | DL-4 | https://www.composerize.com:443 "GET /favicon.ico HTTP/1.1" 200 3430
10:17:29 | DEBUG | DL-4 | Saved resource -> home/sites/composerize/favicon.ico
10:17:29 | DEBUG | DL-3 | https://www.composerize.com:443 "GET /manifest.json HTTP/1.1" 200 288
10:17:29 | DEBUG | DL-3 | Saved resource -> home/sites/composerize/manifest.json
10:17:29 | DEBUG | DL-2 | https://www.composerize.com:443 "GET /static/js/main.623047e0.js HTTP/1.1" 200 176652
10:17:29 | DEBUG | DL-1 | https://www.composerize.com:443 "GET /static/css/main.757d3484.css HTTP/1.1" 200 1761
10:17:29 | DEBUG | DL-2 | Created directory home/sites/composerize/static/js
10:17:29 | DEBUG | DL-1 | Created directory home/sites/composerize/static/css
10:17:29 | DEBUG | DL-1 | Saved resource -> home/sites/composerize/static/css/main.757d3484.css
10:17:30 | DEBUG | DL-2 | Saved resource -> home/sites/composerize/static/js/main.623047e0.js
10:17:30 | INFO | MainThread | Crawl finished: 1 pages in 0.41s (0.41s avg)
10:23:58 | INFO | MainThread | [1/100] https://www.composerize.com
10:23:58 | DEBUG | MainThread | Starting new HTTPS connection (1): www.composerize.com:443
10:23:58 | DEBUG | MainThread | https://www.composerize.com:443 "GET / HTTP/1.1" 200 867
10:23:58 | DEBUG | DL-3 | Starting new HTTPS connection (2): www.composerize.com:443
10:23:58 | DEBUG | MainThread | Created directory home/sites/composerize
10:23:58 | DEBUG | MainThread | Saved page home/sites/composerize/index.html
10:23:58 | DEBUG | DL-4 | Starting new HTTPS connection (3): www.composerize.com:443
10:23:58 | DEBUG | DL-1 | Starting new HTTPS connection (4): www.composerize.com:443
10:23:58 | DEBUG | DL-2 | https://www.composerize.com:443 "GET /manifest.json HTTP/1.1" 200 288
10:23:58 | DEBUG | DL-2 | Saved resource -> home/sites/composerize/manifest.json
10:23:58 | DEBUG | DL-3 | https://www.composerize.com:443 "GET /favicon.ico HTTP/1.1" 200 3430
10:23:58 | DEBUG | DL-3 | Saved resource -> home/sites/composerize/favicon.ico
10:23:59 | DEBUG | DL-4 | https://www.composerize.com:443 "GET /static/js/main.623047e0.js HTTP/1.1" 200 176652
10:23:59 | DEBUG | DL-4 | Created directory home/sites/composerize/static/js
10:23:59 | DEBUG | DL-1 | https://www.composerize.com:443 "GET /static/css/main.757d3484.css HTTP/1.1" 200 1761
10:23:59 | DEBUG | DL-1 | Created directory home/sites/composerize/static/css
10:23:59 | DEBUG | DL-1 | Saved resource -> home/sites/composerize/static/css/main.757d3484.css
10:23:59 | DEBUG | DL-4 | Saved resource -> home/sites/composerize/static/js/main.623047e0.js
10:23:59 | INFO | MainThread | Crawl finished: 1 pages in 0.31s (0.31s avg)
10:27:36 | INFO | MainThread | [1/100] https://www.composerize.com
10:27:36 | DEBUG | MainThread | Starting new HTTPS connection (1): www.composerize.com:443
10:27:36 | DEBUG | MainThread | https://www.composerize.com:443 "GET / HTTP/1.1" 200 867
10:27:36 | DEBUG | MainThread | Created directory home/sites/composerize
10:27:36 | DEBUG | MainThread | Saved page home/sites/composerize/index.html
10:27:36 | DEBUG | DL-1 | Starting new HTTPS connection (2): www.composerize.com:443
10:27:36 | DEBUG | DL-2 | Starting new HTTPS connection (3): www.composerize.com:443
10:27:36 | DEBUG | DL-4 | Starting new HTTPS connection (4): www.composerize.com:443
10:27:37 | DEBUG | DL-3 | https://www.composerize.com:443 "GET /manifest.json HTTP/1.1" 200 288
10:27:37 | DEBUG | DL-3 | Saved resource -> home/sites/composerize/manifest.json
10:27:37 | DEBUG | DL-4 | https://www.composerize.com:443 "GET /static/css/main.757d3484.css HTTP/1.1" 200 1761
10:27:37 | DEBUG | DL-4 | Created directory home/sites/composerize/static/css
10:27:37 | DEBUG | DL-4 | Saved resource -> home/sites/composerize/static/css/main.757d3484.css
10:27:37 | DEBUG | DL-1 | https://www.composerize.com:443 "GET /favicon.ico HTTP/1.1" 200 3430
10:27:37 | DEBUG | DL-1 | Saved resource -> home/sites/composerize/favicon.ico
10:27:37 | DEBUG | DL-2 | https://www.composerize.com:443 "GET /static/js/main.623047e0.js HTTP/1.1" 200 176652
10:27:37 | DEBUG | DL-2 | Created directory home/sites/composerize/static/js
10:27:37 | DEBUG | DL-2 | Saved resource -> home/sites/composerize/static/js/main.623047e0.js
10:27:37 | INFO | MainThread | Crawl finished: 1 pages in 0.39s (0.39s avg)