1 VinOfflineIndexRecord
data_handling._offline_format.VinOfflineIndexRecord(
sample_index,
sample_key,
scene_id,
snippet_id,
split,
shard_id,
row,
)Global sample-index entry for VIN offline random access.
1.1 Attributes
| Name | Type | Description |
|---|---|---|
| sample_index | int | Global zero-based sample index. |
| sample_key | str | Stable dataset sample key. |
| scene_id | str | ASE scene identifier. |
| snippet_id | str | ASE snippet identifier. |
| split | str | Canonical split membership: all, train, or val. |
| shard_id | str | Shard that stores the sample. |
| row | int | Zero-based row offset inside the shard. |
1.2 Methods
| Name | Description |
|---|---|
| read_many | Read the global sample index. |
| write_many | Write the global sample index. |
1.2.1 read_many
data_handling._offline_format.VinOfflineIndexRecord.read_many(path)Read the global sample index.
1.2.1.1 Parameters
| Name | Type | Description | Default |
|---|---|---|---|
| path | Path | sample_index.jsonl path. |
required |
1.2.1.2 Returns
| Name | Type | Description |
|---|---|---|
| list[Self] | Parsed sample-index records. |
1.2.2 write_many
data_handling._offline_format.VinOfflineIndexRecord.write_many(path, records)Write the global sample index.
1.2.2.1 Parameters
| Name | Type | Description | Default |
|---|---|---|---|
| path | Path | Destination sample_index.jsonl path. |
required |
| records | list[Self] | Global sample-index records to persist. | required |