Python web crawler

Simple web crawler with HTML scraping with multi-threading and SQLite database.

GitHub

mateusz@dell .../PythonCrawler (git)-[release-1.0] % python -m index
||||                 24% Urls: 123, Responses: 29, Parsed: 36
encoding error : input conversion failed due to input error, bytes 0x9E 0x44 0x6F 0x20
encoding error : input conversion failed due to input error, bytes 0x9E 0x44 0x6F 0x20
|||||||||||||||||    85% Urls: 123, Responses: 104, Parsed: 148