sdk

    Universal Python SDK to run AI workloads on Kubernetes

    Language: python

    Author: Alyssa Gray (@alyssa)

    5 stars · 306 views

    Files

    • tests (txt)
    • types (txt)
    • types.py (py)
    • options.py (py)
    • CHANGELOG-0.4.md (md)
    • CHANGELOG-0.3.md (md)
    • __init__.py (py)
    • __init__.py (py)
    • types_test.py (py)
    • options_test.py (py)
    • api (txt)
    • __init__.py (py)
    • __init__.py (py)
    • common.py (py)
    • docs (txt)
    • proposals (txt)
    • 107-spark-client (txt)
    • README.md (md)
    • 125-kfp-client (txt)
    • README.md (md)
    • kep.yaml (yaml)
    • 2-trainer-local-execution (txt)
    • README.md (md)
    • high-level-arch.svg (image)
    • detailed-workflow.svg (image)
    • 46-hyperparameter-optimization (txt)
    • optimization-job.drawio.svg (image)
    • README.md (md)
    • source (txt)
    • spark (txt)
    • train (txt)
    • conf.py (py)
    • optimize (txt)
    • getting-started (txt)
    • hub (txt)
    • _static (txt)
    • custom.css (css)
    • kubeflow-icon.svg (image)
    • images (txt)
    • CHANGELOG (txt)
    • CHANGELOG-0.2.md (md)
    • CHANGELOG-0.1.md (md)
    • RELEASE.md (md)
    • Makefile (txt)
    • test (txt)
    • e2e (txt)
    • spark (txt)
    • README.md (md)
    • run_in_cluster.py (py)
    • cluster_watcher.py (py)
    • test_spark_examples.py (py)
    • ROADMAP.md (md)
    • AGENTS.md (md)
    • README.md (md)
    • pyproject.toml (toml)
    • .readthedocs.yaml (yaml)
    • kubeflow (txt)
    • spark (txt)
    • test (txt)
    • __init__.py (py)
    • backends (txt)
    • base.py (py)
    • __init__.py (py)
    • kubernetes (txt)
    • constants.py (py)
    • utils_test.py (py)
    • __init__.py (py)
    • backend.py (py)
    • backend_test.py (py)
    • utils.py (py)
    • spark_client_test.py (py)
    • spark_client.py (py)
    • __init__.py (py)
    • common (txt)
    • constants.py (py)
    • types.py (py)
    • utils.py (py)
    • optimizer (txt)
    • constants (txt)
    • constants.py (py)
    • __init__.py (py)
    • backends (txt)
    • base.py (py)
    • __init__.py (py)
    • kubernetes (txt)
    • utils_test.py (py)
    • __init__.py (py)
    • backend.py (py)
    • backend_test.py (py)
    • utils.py (py)
    • types (txt)
    • constants.py (py)
    • utils_test.py (py)
    • backend.py (py)
    • algorithm_types.py (py)
    • search_types.py (py)
    • __init__.py (py)
    • optimization_types.py (py)
    • api (txt)
    • optimizer_client.py (py)
    • hub (txt)
    • storage_test.py (py)
    • __init__.py (py)
    • storage.py (py)
    • types (txt)
    • backend_test.py (py)
    • utils.py (py)
    • types (txt)
    • types.py (py)
    • types.py (py)
    • __init__.py (py)
    • api (txt)
    • __init__.py (py)
    • model_registry_client.py (py)
    • model_registry_client_test.py (py)
    • trainer (txt)
    • test (txt)
    • common.py (py)
    • constants (txt)
    • constants.py (py)
    • __init__.py (py)
    • backends (txt)
    • localprocess (txt)
    • constants.py (py)
    • types.py (py)
    • backend.py (py)
    • job.py (py)
    • backend_test.py (py)
    • utils.py (py)
    • base.py (py)
    • container (txt)
    • utils_test.py (py)
    • types.py (py)
    • adapters (txt)
    • base.py (py)
    • docker.py (py)
    • podman.py (py)
    • runtime_loader.py (py)
    • backend.py (py)
    • backend_test.py (py)
    • runtime_loader_test.py (py)
    • utils.py (py)
    • kubernetes (txt)
    • types_test.py (py)
    • options (txt)
    • kubernetes_test.py (py)
    • __init__.py (py)
    • localprocess.py (py)
    • kubernetes.py (py)
    • common.py (py)
    • api (txt)
    • __init__.py (py)
    • trainer_client.py (py)
    • PULL_REQUEST_TEMPLATE.md (md)
    • trainer_client_test.py (py)
    • cliff.toml (toml)
    • LICENSE (txt)
    • examples (txt)
    • spark (txt)
    • spark-connect-local-testing.md (md)
    • README.md (md)
    • demo_existing_sparkconnect.py (py)
    • connect_existing_session.py (py)
    • test_connect_url.py (py)
    • spark_connect_simple.py (py)
    • spark_advanced_options.py (py)
    • README.md (md)
    • .github (github)
    • workflows (txt)
    • welcome-new-contributors.yaml (yaml)
    • ISSUE_TEMPLATE (txt)
    • feature_request.yaml (yaml)
    • github-stale.yaml (yaml)
    • test-spark-examples.yaml (yaml)
    • validate-lockfile.yaml (yaml)
    • docs.yaml (yaml)
    • check-pr-title.yaml (yaml)
    • bug_report.yaml (yaml)
    • scripts (txt)
    • test-python.yaml (yaml)
    • osv-scanner.yaml (yaml)
    • test-e2e.yaml (yaml)
    • check-owners.yaml (yaml)
    • cleanup-overrides.yaml (yaml)
    • release.yaml (yaml)
    • gh-workflow-approve.yaml (yaml)
    • dependabot.yml (yml)
    • config.yml (yml)
    • update_overrides.py (py)
    • extract_version.py (py)
    • README.md (md)
    • test_scripts.py (py)
    • compare_versions.py (py)
    • copilot-instructions.md (md)
    • CONTRIBUTING.md (md)
    • hack (txt)
    • crds (txt)
    • sparkoperator.k8s.io_sparkconnects.yaml (yaml)
    • kind-config.yaml (yaml)
    • e2e-setup-cluster.sh (sh)
    • .pre-commit-config.yaml (yaml)
    • ATTRIBUTION.md (markdown)

    Loading code snippet…