Scrapegraph-ai
Python scraper based on AI. python code snippet by @github-repos on Codeshare. 0 stars, 4 views.
Language: python
Author: GitHub Repos (@github-repos)
0 stars · 4 views
Viewing path: docker-compose.yml
Files
- server.py (py)
- csv_scraper_graph_multi_openai.py (py)
- histogram.png (image)
- example.json (json)
- CODE_OF_CONDUCT.md (md)
- pyproject.toml (toml)
- chromium.py (py)
- code_generator_graph.py (py)
- smart_scraper_graph.py (py)
- smart_scraper_lite_graph.py (py)
- smart_scraper_multi_batch_graph.py (py)
- speech_graph.py (py)
- parse_node.py (py)
- smart_scraper_multi_concat_openai.py (py)
- html_mode.py (py)
- search_graph_schema_openai.py (py)
- ATTRIBUTION.md (markdown)
- xml_scraper_ollama.py (py)
- script_multi_generator_ollama.py (py)
- text_detection.py (py)
- rag_caching.py (py)
- scriptcreatorgraph.png (image)
- omni_search_openai.py (py)
- code_error_analysis.py (py)
- screenshot_preparation.py (py)
- README.md (md)
- scrape_do.py (py)
- get_probable_tags_node.py (py)
- helpers.py (py)
- german.md (md)
- portuguese.md (md)
- spanish.md (md)
- turkish.md (md)
- script_generator_openai.py (py)
- docs (txt)
- chinese.md (md)
- japanese.md (md)
- timeout_configuration.md (md)
- russian.md (md)
- assets (txt)
- omnisearchgraph.png (image)
- apikey_4.png (image)
- omniscrapergraph.png (image)
- apikey_2.png (image)
- sgai-hero.png (image)
- browserbase_logo.png (image)
- project_overview_diagram.png (image)
- codespaces-badge.png (image)
- searchgraph.png (image)
- smartscrapergraph.png (image)
- italian.md (md)
- french.md (md)
- README.md (md)
- docker-compose.yml (yml)
- .releaserc.yml (yml)
- .gitattributes (gitattributes)
- LICENSE (txt)
- examples (txt)
- depth_search_graph (txt)
- ollama (txt)
- openai (txt)
- depth_search_graph_openai.py (py)
- json_scraper_graph (txt)
- README.md (md)
- ollama (txt)
- json_scraper_multi_ollama.py (py)
- inputs (txt)
- openai (txt)
- omni_scraper_openai.py (py)
- json_scraper_openai.py (py)
- json_scraper_multi_openai.py (py)
- inputs (txt)
- markdownify (txt)
- markdownify_scrapegraphai_v3.py (py)
- readme.md (md)
- markdownify_scrapegraphai.py (py)
- custom_graph (txt)
- ollama (txt)
- custom_graph_ollama.py (py)
- openai (txt)
- csv_scraper_graph (txt)
- README.md (md)
- ollama (txt)
- csv_scraper_ollama.py (py)
- inputs (txt)
- openai (txt)
- csv_scraper_openai.py (py)
- inputs (txt)
- search_graph (txt)
- README.md (md)
- ollama (txt)
- search_graph_ollama.py (py)
- openai (txt)
- scrapegraphai (txt)
- searchscraper_scrapegraphai.py (py)
- searchscraper_scrapegraphai_v3.py (py)
- xml_scraper_graph (txt)
- README.md (md)
- ollama (txt)
- xml_scraper_graph_multi_ollama.py (py)
- inputs (txt)
- openai (txt)
- xml_scraper_graph_multi_openai.py (py)
- xml_scraper_openai.py (py)
- inputs (txt)
- books.xml (xml)
- omni_scraper_graph (txt)
- README.md (md)
- speech_graph (txt)
- README.md (md)
- document_scraper_graph (txt)
- README.md (md)
- ollama (txt)
- document_scraper_ollama.py (py)
- inputs (txt)
- plain_html_example.txt (txt)
- openai (txt)
- document_scraper_openai.py (py)
- inputs (txt)
- markdown_example.md (md)
- code_generator_graph (txt)
- ollama (txt)
- openai (txt)
- code_generator_graph_openai.py (py)
- readme.md (md)
- extras (txt)
- custom_prompt.py (py)
- screenshot_scaping.py (py)
- reasoning.py (py)
- browser_base_integration.py (py)
- proxy_rotation.py (py)
- load_yml.py (py)
- force_mode.py (py)
- example.yml (yml)
- conditional_usage.py (py)
- undected_playwright.py (py)
- no_cut.py (py)
- slow_mo.py (py)
- Savedscreenshots (txt)
- authenticated_playwright.py (py)
- script_generator_graph (txt)
- README.md (md)
- ollama (txt)
- script_generator_ollama.py (py)
- openai (txt)
- smart_scraper_graph (txt)
- ollama (txt)
- smart_scraper_multi_ollama.py (py)
- smart_scraper_multi_lite_ollama.py (py)
- smart_scraper_ollama.py (py)
- nvidia (txt)
- openai (txt)
- smart_scraper_multi_openai.py (py)
- smart_scraper_multi_lite_openai.py (py)
- scrapegraphai (txt)
- smartscraper_scrapegraphai_v3.py (py)
- .github (github)
- workflows (txt)
- release.yml (yml)
- test-suite.yml (yml)
- ISSUE_TEMPLATE (txt)
- custom.md (md)
- feature_request.md (md)
- bug_report.md (md)
- TESTING_INFRASTRUCTURE.md (md)
- Dockerfile (txt)
- media (txt)
- .gitignore (gitignore)
- tests (txt)
- README_TESTING.md (md)
- fixtures (txt)
- benchmarking.py (py)
- mock_server (txt)
- __init__.py (py)
- conftest.py (py)
- graphs (txt)
- smart_scraper_fireworks_test.py (py)
- xml_scraper_openai_test.py (py)
- smart_scraper_multi_lite_graph_openai_test.py (py)
- depth_search_graph_openai_test.py (py)
- search_graph_openai_test.py (py)
- search_link_ollama.py (py)
- smart_scraper_ernie_test.py (py)
- scrape_plain_text_mistral_test.py (py)
- smart_scraper_ollama_test.py (py)
- smart_scraper_openai_test.py (py)
- abstract_graph_test.py (py)
- script_generator_test.py (py)
- smart_scraper_clod_test.py (py)
- inputs (txt)
- books.xml (xml)
- username.csv (csv)
- inputs (txt)
- pytest.ini (ini)
- codebeaver.yml (yml)
- PullRequests (txt)
- PR_1027_reviews.md (md)
- CONTRIBUTING.md (md)
- scrapegraphai (txt)
- models (txt)
- xai.py (py)
- minimax.py (py)
- __init__.py (py)
- deepseek.py (py)
- openai_tts.py (py)
- atlascloud.py (py)
- openai_itt.py (py)
- clod.py (py)
- oneapi.py (py)
- nvidia.py (py)
- utils (txt)
- screenshot_scraping (txt)
- parse_state_keys.py (py)
- __init__.py (py)
- batch_api.py (py)
- llm_callback_manager.py (py)
- data_export.py (py)
- tokenizers (txt)
- tokenizer_mistral.py (py)
- tokenizer_ollama.py (py)
- sys_dynamic_import.py (py)
- proxy_rotation.py (py)
- save_code_to_file.py (py)
- model_costs.py (py)
- custom_callback.py (py)
- convert_to_md.py (py)
- save_audio_from_bytes.py (py)
- __init__.py (py)
- telemetry (txt)
- telemetry.py (py)
- integrations (txt)
- scrapegraph_py_compat.py (py)
- __init__.py (py)
- indexify_node.py (py)
- docloaders (txt)
- browser_base.py (py)
- plasmate.py (py)
- __init__.py (py)
- scrape_do.py (py)
- nodes (txt)
- fetch_node_level_k.py (py)
- search_internet_node.py (py)
- graph_iterator_node.py (py)
- generate_answer_from_image_node.py (py)
- search_node_with_context.py (py)
- reasoning_node.py (py)
- markdownify_node.py (py)
- merge_generated_scripts_node.py (py)
- generate_answer_csv_node.py (py)
- generate_answer_omni_node.py (py)
- parse_node_depth_k_node.py (py)
- prompt_refiner_node.py (py)
- generate_answer_node_k_level.py (py)
- html_analyzer_node.py (py)
- rag_node.py (py)
- concat_answers_node.py (py)
- merge_answers_node.py (py)
- description_node.py (py)
- batch_generate_answer_node.py (py)
- helpers (txt)
- nodes_metadata.py (py)
- schemas.py (py)
- default_filters.py (py)
- robots.py (py)
- models_tokens.py (py)
- graphs (txt)
- document_scraper_graph.py (py)
- smart_scraper_multi_graph.py (py)
- smart_scraper_multi_concat_graph.py (py)
- document_scraper_multi_graph.py (py)
- __init__.py (py)
- xml_scraper_multi_graph.py (py)
- script_creator_multi_graph.py (py)
- json_scraper_multi_graph.py (py)
- example.json (json)
- screenshot_scraper_test.py (py)
- api-banner.png (image)
- banner.png (image)
- codeql.yml (yml)
- smart_scraper_multi_concat_ollama.py (py)
- research_web.py (py)
- search_graph_openai.py (py)
- apikey_3.png (image)
- base_node.py (py)
- FUNDING.yml (yml)
- .pre-commit-config.yaml (yaml)
- fetch_node.py (py)
- apikey_1.png (image)
- speech_graph_openai.py (py)
- smart_scraper_openai.py (py)
- generate_code_node.py (py)
- cleanup_html.py (py)
- search_link_node.py (py)
- readme.md (md)
- api_banner.png (image)
- __init__.py (py)
- SECURITY.md (md)
- cond_smartscraper_usage.py (py)
- scrapegraphai_logo.svg (image)
- README.md (md)
- markdownify_graph.py (py)
- books.xml (xml)
- Readme.md (md)
- conditional_node.py (py)
- robots_node.py (py)
- fetch_screen_node.py (py)
- dict_content_compare.py (py)
- cleanup_code.py (py)
- README.md (md)
- search_link_graph_openai.py (py)
- tokenizer_openai.py (py)
- code_error_correction.py (py)
- chromium_selenium.py (py)
- smart_scraper_lite_openai.py (py)
- script_generator_schema_openai.py (py)
- smart_scraper_schema_openai.py (py)
- speechgraph.png (image)
- search_graph_schema_ollama.py (py)
- __init__.py (py)
- username.csv (csv)
- __init__.py (py)
- smart_scraper_lite_ollama.py (py)
- base_graph.py (py)
- custom_graph_openai.py (py)
- scrape_xml_ollama_test.py (py)
- dependency-review.yml (yml)
- burr_bridge.py (py)
- books.xml (xml)
- depth_search_graph_ollama.py (py)
- json_scraper_graph.py (py)
- text_to_speech_node.py (py)
- username.csv (csv)
- md_scraper_openai.py (py)
- copy.py (py)
- smartscraper_scrapegraphai.py (py)
- plain_html_example.txt (txt)
- plain_html_example.txt (txt)
- csv_scraper_graph_multi_ollama.py (py)
- generate_scraper_node.py (py)
- example.json (json)
- smart_scraper_schema_ollama.py (py)
- script_generator_multi_openai.py (py)
- code_generator_graph_openai_test.py (py)
- example.json (json)
- script_creator_graph.py (py)
- code_generator_graph_ollama.py (py)
- __init__.py (py)
- tokenizer.py (py)
- image_to_text_node.py (py)
- Makefile (txt)
- plain_html_example.txt (txt)
- prettify_exec_info.py (py)
- smart_scraper_nvidia.py (py)
- serch_graph_scehma.py (py)
- depth_search_graph.py (py)
- test_image.jpeg (image)
- omni_scraper_graph.py (py)
- korean.md (md)
- scrapegraphai_logo.png (image)
- split_text_into_chunks.py (py)
- json_scraper_ollama.py (py)
- QUICKSTART.md (md)
- logging.py (py)
- username.csv (csv)
- schema_trasform.py (py)
- CHANGELOG.md (md)
- generate_answer_node.py (py)
- output_parser.py (py)
- AGENTS.md (md)
- SEMANTIC_COMMITS.md (md)
- nodemaven-banner.png (image)
- builders (txt)
- __init__.py (py)
- graph_builder.py (py)
- abstract_graph.py (py)
- csv_scraper_graph.py (py)
- csv_scraper_multi_graph.py (py)
- omni_search_graph.py (py)
- screenshot_scraper_graph.py (py)
- search_graph.py (py)
- search_link_graph.py (py)
- smart_scraper_multi_lite_graph.py (py)
- xml_scraper_graph.py (py)
- prompts (txt)
- __init__.py (py)
- description_node_prompts.py (py)
- generate_answer_node_csv_prompts.py (py)
- generate_answer_node_omni_prompts.py (py)
- generate_answer_node_pdf_prompts.py (py)
- generate_answer_node_prompts.py (py)
- generate_code_node_prompts.py (py)
- get_probable_tags_node_prompts.py (py)
- html_analyzer_node_prompts.py (py)
- merge_answer_node_prompts.py (py)
- merge_generated_scripts_prompts.py (py)
- prompt_refiner_node_prompts.py (py)
- reasoning_node_prompts.py (py)
- robots_node_prompts.py (py)
- search_internet_node_prompts.py (py)
- search_link_node_prompts.py (py)
- search_node_with_context_prompts.py (py)
