exoskeleton

    A Python framework to build polite, but tenacious crawlers / scrapers with a MariaDB backend

    Language: python

    Author: Pedro Kaya (@thepedro46)

    0 stars · 274 views

    Files

    • CHANGELOG.md (markdown)
    • Database-Scripts ()
    • Generate-Database-Schema-MariaDB.sql (sql)
    • README.md (markdown)
    • README.md (markdown)
    • contributing.md (markdown)
    • documentation ()
    • README.md (markdown)
    • avoiding-duplicates.md (markdown)
    • behavior-settings.md (markdown)
    • blocklist.md (markdown)
    • create-a-bot.md (markdown)
    • database-schema.md (markdown)
    • handling-pages.md (markdown)
    • installation.md (markdown)
    • parse-search-results.md (markdown)
    • progress-reports-via-email.md (markdown)
    • versions-and-labels.md (markdown)
    • exoskeleton ()
    • __init__.py (python)
    • __main__.py (python)
    • _version.py (python)
    • actions.py (python)
    • blocklist_manager.py (python)
    • database_connection.py (python)
    • database_schema_check.py (python)
    • err.py (python)
    • error_manager.py (python)
    • exo_url.py (python)
    • file_manager.py (python)
    • helpers.py (python)
    • job_manager.py (python)
    • label_manager.py (python)
    • notification_manager.py (python)
    • queue_manager.py (python)
    • remote_control_chrome.py (python)
    • statistics_manager.py (python)
    • time_manager.py (python)
    • salted-linkcheck.ini (plaintext)
    • setup.py (python)
    • LICENSE (plaintext)
    • ATTRIBUTION.md (markdown)

    Loading code snippet…