1 data_handling.atek_downloads.downloader

data_handling.atek_downloads.downloader

Download orchestration for ASE ground-truth meshes and ATEK shards.

This module owns CLI/config dispatch, manifest filtering, mesh checksum verification, and calls into ATEK’s WebDataset downloader. ATEK archives carry the tensorized ASE/VRS/MPS-derived streams consumed by the EFM adaptor; ASE meshes are acquired separately as oracle supervision and evaluation assets.

1.1 Classes

Name Description
ASEDownloader Acquire manifest-selected ASE meshes and ATEK WebDataset shards.
ASEDownloaderConfig Configuration for ASE downloader with CLI support.

1.1.1 ASEDownloader

data_handling.atek_downloads.downloader.ASEDownloader(config)

Acquire manifest-selected ASE meshes and ATEK WebDataset shards.

The instance owns parsed ASEMetadata, download destinations, and console state for one run. Mesh ZIPs are SHA-1 verified and extracted into the ASE mesh cache; ATEK shard acquisition is delegated to the upstream downloader using a temporary filtered manifest that is removed afterward.

1.1.1.1 Methods

Name Description
download_scenes Download meshes + ATEK data for scenes.
download_meshes Download GT meshes for selected scenes after applying overwrite policy.
download_atek Download ATEK shards for selected ASE scenes.
download_scenes_with_meshes Download scenes that have meshes and at least min_shards shards for a given config.
1.1.1.1.1 download_scenes
data_handling.atek_downloads.downloader.ASEDownloader.download_scenes(
    scenes=None,
    scene_ids=None,
    download_meshes=True,
    download_atek=True,
)

Download meshes + ATEK data for scenes.

1.1.1.1.1.1 Parameters
Name Type Description Default
scenes list[SceneMetadata] | None Explicit scene records to acquire. None
scene_ids list[str] | None Additional scene IDs resolved through the parsed manifest. None
download_meshes bool Whether to acquire ASE GT meshes. True
download_atek bool Whether to acquire ATEK WebDataset shards. True
1.1.1.1.2 download_meshes
data_handling.atek_downloads.downloader.ASEDownloader.download_meshes(
    scene_ids=None,
    overwrite=False,
)

Download GT meshes for selected scenes after applying overwrite policy.

1.1.1.1.2.1 Parameters
Name Type Description Default
scene_ids list[str] | None Optional ASE scene allowlist; None selects all scenes. None
overwrite bool Whether existing archive/download state may be replaced. False
1.1.1.1.3 download_atek
data_handling.atek_downloads.downloader.ASEDownloader.download_atek(
    scene_ids=None,
)

Download ATEK shards for selected ASE scenes.

1.1.1.1.3.1 Parameters
Name Type Description Default
scene_ids list[str] | None Optional ASE scene allowlist; None selects all scenes. None
1.1.1.1.4 download_scenes_with_meshes
data_handling.atek_downloads.downloader.ASEDownloader.download_scenes_with_meshes(
    min_shards,
    config,
    overwrite,
)

Download scenes that have meshes and at least min_shards shards for a given config.

1.1.2 ASEDownloaderConfig

data_handling.atek_downloads.downloader.ASEDownloaderConfig()

Configuration for ASE downloader with CLI support.

Supports two CLI modes (explicitly selected via positional mode): 1. Download mode: Download N scenes with meshes + ATEK shards 2. List mode: List available scenes

Example (CLI - Download): $ python -m aria_nbv.data_handling.atek_downloads.downloader download –n_scenes=5 –max_shards=2 $ python -m aria_nbv.data_handling.atek_downloads.downloader download –ns=10 –skip_meshes

Example (CLI - List): $ python -m aria_nbv.data_handling.atek_downloads.downloader list –n=10

1.1.2.1 Attributes

Name Description
target_type Return ASEDownloader for config-as-factory construction.
mode CLI operation: acquire selected assets or list manifest scene coverage.
list_n Optional maximum scene rows printed by list mode.
paths Project path resolver for URL manifests, ATEK shards, and ASE meshes.
output_dir Optional requested output root; concrete destinations are resolved from paths.
verbosity Structured console verbosity used by download and listing operations.
is_debug Enable debug logging (forces max verbosity).
prefer_scenes_with_max_shards Prefer scenes with maximum shards when limiting number of scenes.
mesh_json_filename Filename of the mesh download URLs JSON in url_dir. Relative to paths.url_dir.
atek_json_filename Filename of the ATEK download URLs JSON in url_dir. Relative to paths.url_dir.
atek_config_name ATEK configuration name.
n_scenes Number of scenes to download (0 = all available scenes).
max_shards Maximum shards per scene (None = all shards).
skip_meshes Skip downloading GT meshes (only download ATEK data).
skip_atek Skip downloading ATEK WDS data (only download meshes).
train_val_split_ratio Train-validation split ratio for ATEK data.
random_seed Random seed for shuffling ATEK data sequences.
download_wds_to_local Download WebDataset files to local storage (vs streaming URLs).
overwrite Always overwrite existing ATEK files (re-download even if present).

1.1.2.2 Methods

Name Description
from_cli Instantiate config using pydantic-settings CLI parser (explicit opt-in).
settings_customise_sources Order explicit init, CLI, environment, dotenv, and secret settings sources.
1.1.2.2.1 from_cli
data_handling.atek_downloads.downloader.ASEDownloaderConfig.from_cli()

Instantiate config using pydantic-settings CLI parser (explicit opt-in).

1.1.2.2.2 settings_customise_sources
data_handling.atek_downloads.downloader.ASEDownloaderConfig.settings_customise_sources(
    settings_cls,
    init_settings,
    env_settings,
    dotenv_settings,
    file_secret_settings,
    cli_settings=None,
)

Order explicit init, CLI, environment, dotenv, and secret settings sources.

1.1.2.2.2.1 Returns
Name Type Description
Pydantic-settings sources in decreasing precedence order.

1.2 Functions

Name Description
cli_download CLI entry point for downloading scenes.
cli_list CLI entry point for listing scenes.
main Main CLI entry point with mode-based dispatching.

1.2.1 cli_download

data_handling.atek_downloads.downloader.cli_download(config=None)

CLI entry point for downloading scenes.

1.2.1.1 Usage

python -m aria_nbv.data_handling.atek_downloads.downloader download –n_scenes=5 –max_shards=2 python -m aria_nbv.data_handling.atek_downloads.downloader download –ns=10 –skip_meshes

1.2.2 cli_list

data_handling.atek_downloads.downloader.cli_list(config, n=None)

CLI entry point for listing scenes.

1.2.2.1 Parameters

Name Type Description Default
n int | None Number of scenes to list (None = all) None

1.2.2.2 Usage

python -m aria_nbv.data_handling.atek_downloads.downloader list python -m aria_nbv.data_handling.atek_downloads.downloader list –n=10

1.2.3 main

data_handling.atek_downloads.downloader.main()

Main CLI entry point with mode-based dispatching.

Back to top