API Reference

This section contains the auto-generated API reference for the ascii_library.

Orchestration

• Base Cloud Pipes Client
  • _PipesBaseCloudClient
• Databricks Pipes Client
  • _PipesDatabricksClient
• EMR Pipes Client
  • _PipesEmrClient
• Spark Pipes Resource
  • SparkPipesResource
• ascii_library.orchestration.pipes.exceptions module
  • CustomPipesException
• ascii_library.orchestration.pipes.instance_config module
  • CloudInstanceConfig
• ascii_library.orchestration.pipes.spark_pipes_factory module
  • get_libs_dict()
  • update_spot_bid_price_percent()
  • generate_uploaded_script_paths()
  • get_engine_from_config()
  • spark_pipes_asset_factory()
  • BaseConfig
• ascii_library.orchestration.pipes.spark_script_abc module
  • SparkScriptPipes
• ascii_library.orchestration.pipes.utils module
  • library_to_cloud_paths()
  • library_from_dbfs_paths()
  • empty_dir()
  • ensure_empty()
  • package_library()
  • get_input_path()
  • calculate_parallelism()
  • configure_spark()

Utilities

• ascii_library.utils.asset_loader module
  • load_assets()
• ascii_library.utils.determine_env module
  • get_env()
  • get_dagster_deployment_environment()