1 data_handling.atek_downloads.metadata

data_handling.atek_downloads.metadata

Parse ASE mesh and ATEK shard download manifests into scene records.

This module owns the acquisition-time metadata boundary: CDN mesh URLs and hashes identify oracle assets, while ATEK config/shard entries identify the tensorized ASE snippets later adapted into EFM views. It does not read VRS/MPS payload tensors or decide training splits.

1.1 Classes

Name Description
ASEMetadata Parse mesh + ATEK URL JSONs to expose scene-level metadata.
SceneMetadata Describe one ASE scene for a specific ATEK acquisition variant.

1.1.1 ASEMetadata

data_handling.atek_downloads.metadata.ASEMetadata(
    url_dir,
    mesh_json_filename='ase_mesh_download_urls.json',
    atek_json_filename='AriaSyntheticEnvironment_ATEK_download_urls.json',
)

Parse mesh + ATEK URL JSONs to expose scene-level metadata.

1.1.1.1 Methods

Name Description
get_scenes_with_meshes Return scenes that have GT meshes.
filter_scenes Filter scene records by ATEK variant, shard count, and GT-mesh availability.
get_scenes Return scene records in stable ID order with an optional shard cap.
save Persist the aggregate scene inventory as compact JSON.
load Load an aggregate scene snapshot while retaining its manifest directory.
1.1.1.1.1 get_scenes_with_meshes
data_handling.atek_downloads.metadata.ASEMetadata.get_scenes_with_meshes(
    config=None,
)

Return scenes that have GT meshes.

1.1.1.1.1.1 Parameters
Name Type Description Default
config str | None Optional ATEK config name. If provided, scenes are returned for that specific ATEK config. None
1.1.1.1.1.2 Returns
Name Type Description
list[SceneMetadata] List of scenes that have GT meshes.
1.1.1.1.2 filter_scenes
data_handling.atek_downloads.metadata.ASEMetadata.filter_scenes(
    min_shards=0,
    require_mesh=False,
    config=None,
)

Filter scene records by ATEK variant, shard count, and GT-mesh availability.

1.1.1.1.2.1 Parameters
Name Type Description Default
min_shards int Minimum number of manifest shards required. 0
require_mesh bool Whether to keep only scenes with a GT mesh URL. False
config str | None Optional ATEK variant; None uses the aggregate scene view. None
1.1.1.1.2.2 Returns
Name Type Description
list[SceneMetadata] Matching scene records without mutating the parsed manifests.
1.1.1.1.3 get_scenes
data_handling.atek_downloads.metadata.ASEMetadata.get_scenes(
    n=None,
    max_shards=None,
)

Return scene records in stable ID order with an optional shard cap.

1.1.1.1.3.1 Parameters
Name Type Description Default
n int | None Optional maximum number of scenes. None
max_shards int | None Optional per-scene shard limit applied to returned copies. None
1.1.1.1.3.2 Returns
Name Type Description
list[SceneMetadata] Sorted scene records; the parser-owned records remain unchanged.
1.1.1.1.4 save
data_handling.atek_downloads.metadata.ASEMetadata.save(path)

Persist the aggregate scene inventory as compact JSON.

The snapshot records mesh-scene membership and aggregate SceneMetadata values; URL-manifest files remain the authority for per-config reconstruction.

1.1.1.1.5 load
data_handling.atek_downloads.metadata.ASEMetadata.load(path)

Load an aggregate scene snapshot while retaining its manifest directory.

1.1.1.1.5.1 Parameters
Name Type Description Default
path Path JSON snapshot produced by ASEMetadata.save. required
1.1.1.1.5.2 Returns
Name Type Description
'ASEMetadata' Parsed metadata with aggregate scene records replaced by the snapshot.

1.1.2 SceneMetadata

data_handling.atek_downloads.metadata.SceneMetadata(
    scene_id,
    has_gt_mesh,
    mesh_url,
    mesh_sha,
    shard_count,
    shard_ids,
    atek_config,
    total_frames,
)

Describe one ASE scene for a specific ATEK acquisition variant.

1.1.2.1 Attributes

Name Description
scene_id Stable ASE scene identifier used by shard directories and mesh pairing.
has_gt_mesh Whether the URL manifest exposes an ASE ground-truth mesh for evaluation.
mesh_url Optional CDN URL for the zipped GT mesh; not actor-visible sample data.
mesh_sha Optional expected SHA-1 digest used to verify the downloaded mesh archive.
shard_count Number of ATEK WebDataset shards selected for atek_config.
shard_ids Normalized shard identifiers with the manifest’s _tar suffix removed.
atek_config ATEK payload variant, such as efm or efm_eval.
total_frames Manifest frame count when available; zero for shard-only entries.
Back to top