Evaluation Types

Types used to define a robot policy and submit it for evaluation.

policy defines the policy lifecycle; job combines a policy and concrete episode tasks into a request. task defines instructions and scoring; definition samples task parameters and initial layouts. station, arm, and camera describe the hardware and its observations and actions. repository contains predefined station specifications.

These types can also be imported directly from se3labs.interface.eval:

from se3labs.interface.eval import JobRequest, Policy, Task_Spec

Modules

• Robot Policies
• Evaluation Requests
• Tasks and Scoring
• Task Definitions
• Stations
• Arms
• Cameras
• Station Repository