1 vin.backbones

vin.backbones

Backbone adapters used by VIN scorer architectures.

The package owns wrappers around large external perception models. Current VIN scorers use the EVL adapter in aria_nbv.vin.backbones.evl to expose actor-visible voxel evidence and feature volumes.

1.1 Classes

Name Description
EvlBackbone Run EVL and expose actor-visible feature volumes in their voxel frame.
EvlBackboneConfig Select the EVL model assets, device, and exported feature families.

1.1.1 EvlBackbone

vin.backbones.EvlBackbone(config)

Run EVL and expose actor-visible feature volumes in their voxel frame.

freeze controls gradients, but inference always executes under torch.no_grad and puts EVL in evaluation mode. The wrapper retains the resolved asset paths on config; returned tensors carry no independent checkpoint or config identity.

1.1.1.1 Methods

Name Description
forward Run EVL and return the feature volumes needed by VIN.
1.1.1.1.1 forward
vin.backbones.EvlBackbone.forward(efm)

Run EVL and return the feature volumes needed by VIN.

1.1.1.1.1.1 Parameters
Name Type Description Default
efm Mapping[str, Any] Raw EFM snippet dict (unbatched T×... or batched B×T×...). required
1.1.1.1.1.2 Returns
Name Type Description
EvlBackboneOutput Actor-visible EvlBackboneOutput whose voxel tensors are
EvlBackboneOutput Tensor["B C D H W"]-like fields aligned to
EvlBackboneOutput PoseTW["B 12"] world-from-voxel poses. Exact feature semantics
EvlBackboneOutput remain local to this config/checkpoint pair.

1.1.2 EvlBackboneConfig

vin.backbones.EvlBackboneConfig()

Select the EVL model assets, device, and exported feature families.

The resolved model_cfg and model_ckpt paths jointly determine the learned evidence semantics for one run. Paths are not immutable provenance: callers that persist outputs must also capture config and checkpoint hashes.

1.1.2.1 Attributes

Name Description
target_type Factory target for BaseConfig.setup_target.
paths Project path resolver.
model_cfg Resolved Hydra YAML used to instantiate efm3d.model.evl.EVL.
model_ckpt Resolved checkpoint containing an EVL state_dict payload.
device Torch device to run EVL on (auto-selects CUDA if available).
freeze Disable gradients for all EVL parameters when True.
features_mode Which EVL features to expose.
free_input_mode Source of free-space input: native EVL output or explicit derivation.

1.2 Functions

Name Description
filter_backbone_output_for_features_mode Apply EvlBackboneConfig.features_mode to an EVL output container.

1.2.1 filter_backbone_output_for_features_mode

vin.backbones.filter_backbone_output_for_features_mode(output, *, features_mode)

Apply EvlBackboneConfig.features_mode to an EVL output container.

1.2.1.1 Parameters

Name Type Description Default
output EvlBackboneOutput Full EVL output container before feature-family filtering. required
features_mode Literal['heads', 'neck', 'both'] Feature family requested by the caller. required

1.2.1.2 Returns

Name Type Description
EvlBackboneOutput Filtered output with unsupported feature families set to None or
EvlBackboneOutput empty dictionaries.
Back to top