1 VinOfflineShardSpec

data_handling._offline_format.VinOfflineShardSpec(
    shard_id,
    relative_dir,
    row_start,
    num_rows,
    blocks=dict(),
)

Descriptor for one immutable dataset shard.

1.1 Attributes

Name Type Description
shard_id str Stable shard identifier, for example "shard-000003".
relative_dir str Relative directory containing the shard files.
row_start int Global row offset covered by the shard.
num_rows int Number of samples stored in the shard.
blocks dict[str, VinOfflineBlockSpec] Stored block descriptors keyed by logical block name.