1 data_handling.atek_downloads.downloader
data_handling.atek_downloads.downloader
Download orchestration for ASE ground-truth meshes and ATEK shards.
This module owns CLI/config dispatch, manifest filtering, mesh checksum verification, and calls into ATEK’s WebDataset downloader. ATEK archives carry the tensorized ASE/VRS/MPS-derived streams consumed by the EFM adaptor; ASE meshes are acquired separately as oracle supervision and evaluation assets.
1.1 Classes
| Name | Description |
|---|---|
| ASEDownloader | Acquire manifest-selected ASE meshes and ATEK WebDataset shards. |
| ASEDownloaderConfig | Configuration for ASE downloader with CLI support. |
1.1.1 ASEDownloader
data_handling.atek_downloads.downloader.ASEDownloader(config)Acquire manifest-selected ASE meshes and ATEK WebDataset shards.
The instance owns parsed ASEMetadata, download destinations, and console state for one run. Mesh ZIPs are SHA-1 verified and extracted into the ASE mesh cache; ATEK shard acquisition is delegated to the upstream downloader using a temporary filtered manifest that is removed afterward.
1.1.1.1 Methods
| Name | Description |
|---|---|
| download_scenes | Download meshes + ATEK data for scenes. |
| download_meshes | Download GT meshes for selected scenes after applying overwrite policy. |
| download_atek | Download ATEK shards for selected ASE scenes. |
| download_scenes_with_meshes | Download scenes that have meshes and at least min_shards shards for a given config. |
1.1.1.1.1 download_scenes
data_handling.atek_downloads.downloader.ASEDownloader.download_scenes(
scenes=None,
scene_ids=None,
download_meshes=True,
download_atek=True,
)Download meshes + ATEK data for scenes.
1.1.1.1.1.1 Parameters
| Name | Type | Description | Default |
|---|---|---|---|
| scenes | list[SceneMetadata] | None | Explicit scene records to acquire. | None |
| scene_ids | list[str] | None | Additional scene IDs resolved through the parsed manifest. | None |
| download_meshes | bool | Whether to acquire ASE GT meshes. | True |
| download_atek | bool | Whether to acquire ATEK WebDataset shards. | True |
1.1.1.1.2 download_meshes
data_handling.atek_downloads.downloader.ASEDownloader.download_meshes(
scene_ids=None,
overwrite=False,
)Download GT meshes for selected scenes after applying overwrite policy.
1.1.1.1.2.1 Parameters
| Name | Type | Description | Default |
|---|---|---|---|
| scene_ids | list[str] | None | Optional ASE scene allowlist; None selects all scenes. |
None |
| overwrite | bool | Whether existing archive/download state may be replaced. | False |
1.1.1.1.3 download_atek
data_handling.atek_downloads.downloader.ASEDownloader.download_atek(
scene_ids=None,
)Download ATEK shards for selected ASE scenes.
1.1.1.1.3.1 Parameters
| Name | Type | Description | Default |
|---|---|---|---|
| scene_ids | list[str] | None | Optional ASE scene allowlist; None selects all scenes. |
None |
1.1.1.1.4 download_scenes_with_meshes
data_handling.atek_downloads.downloader.ASEDownloader.download_scenes_with_meshes(
min_shards,
config,
overwrite,
)Download scenes that have meshes and at least min_shards shards for a given config.
1.1.2 ASEDownloaderConfig
data_handling.atek_downloads.downloader.ASEDownloaderConfig()Configuration for ASE downloader with CLI support.
Supports two CLI modes (explicitly selected via positional mode): 1. Download mode: Download N scenes with meshes + ATEK shards 2. List mode: List available scenes
Example (CLI - Download): $ python -m aria_nbv.data_handling.atek_downloads.downloader download –n_scenes=5 –max_shards=2 $ python -m aria_nbv.data_handling.atek_downloads.downloader download –ns=10 –skip_meshes
Example (CLI - List): $ python -m aria_nbv.data_handling.atek_downloads.downloader list –n=10
1.1.2.1 Attributes
| Name | Description |
|---|---|
| target_type | Return ASEDownloader for config-as-factory construction. |
| mode | CLI operation: acquire selected assets or list manifest scene coverage. |
| list_n | Optional maximum scene rows printed by list mode. |
| paths | Project path resolver for URL manifests, ATEK shards, and ASE meshes. |
| output_dir | Optional requested output root; concrete destinations are resolved from paths. |
| verbosity | Structured console verbosity used by download and listing operations. |
| is_debug | Enable debug logging (forces max verbosity). |
| prefer_scenes_with_max_shards | Prefer scenes with maximum shards when limiting number of scenes. |
| mesh_json_filename | Filename of the mesh download URLs JSON in url_dir. Relative to paths.url_dir. |
| atek_json_filename | Filename of the ATEK download URLs JSON in url_dir. Relative to paths.url_dir. |
| atek_config_name | ATEK configuration name. |
| n_scenes | Number of scenes to download (0 = all available scenes). |
| max_shards | Maximum shards per scene (None = all shards). |
| skip_meshes | Skip downloading GT meshes (only download ATEK data). |
| skip_atek | Skip downloading ATEK WDS data (only download meshes). |
| train_val_split_ratio | Train-validation split ratio for ATEK data. |
| random_seed | Random seed for shuffling ATEK data sequences. |
| download_wds_to_local | Download WebDataset files to local storage (vs streaming URLs). |
| overwrite | Always overwrite existing ATEK files (re-download even if present). |
1.1.2.2 Methods
| Name | Description |
|---|---|
| from_cli | Instantiate config using pydantic-settings CLI parser (explicit opt-in). |
| settings_customise_sources | Order explicit init, CLI, environment, dotenv, and secret settings sources. |
1.1.2.2.1 from_cli
data_handling.atek_downloads.downloader.ASEDownloaderConfig.from_cli()Instantiate config using pydantic-settings CLI parser (explicit opt-in).
1.1.2.2.2 settings_customise_sources
data_handling.atek_downloads.downloader.ASEDownloaderConfig.settings_customise_sources(
settings_cls,
init_settings,
env_settings,
dotenv_settings,
file_secret_settings,
cli_settings=None,
)Order explicit init, CLI, environment, dotenv, and secret settings sources.
1.1.2.2.2.1 Returns
| Name | Type | Description |
|---|---|---|
| Pydantic-settings sources in decreasing precedence order. |
1.2 Functions
| Name | Description |
|---|---|
| cli_download | CLI entry point for downloading scenes. |
| cli_list | CLI entry point for listing scenes. |
| main | Main CLI entry point with mode-based dispatching. |
1.2.1 cli_download
data_handling.atek_downloads.downloader.cli_download(config=None)CLI entry point for downloading scenes.
1.2.1.1 Usage
python -m aria_nbv.data_handling.atek_downloads.downloader download –n_scenes=5 –max_shards=2 python -m aria_nbv.data_handling.atek_downloads.downloader download –ns=10 –skip_meshes
1.2.2 cli_list
data_handling.atek_downloads.downloader.cli_list(config, n=None)CLI entry point for listing scenes.
1.2.2.1 Parameters
| Name | Type | Description | Default |
|---|---|---|---|
| n | int | None | Number of scenes to list (None = all) | None |
1.2.2.2 Usage
python -m aria_nbv.data_handling.atek_downloads.downloader list python -m aria_nbv.data_handling.atek_downloads.downloader list –n=10
1.2.3 main
data_handling.atek_downloads.downloader.main()Main CLI entry point with mode-based dispatching.