Evaluation Types

Types used to define a robot policy and submit it for evaluation.

policy defines the policy lifecycle; job combines a policy, task, and episode count into a request. task defines instructions and scoring. station, arm, and camera describe the hardware and its observations and actions. repository contains predefined station specifications.

These types can also be imported directly from se3labs.interface.eval:

from se3labs.interface.eval import JobRequest, Policy, Task_Spec

Modules

• Robot Policies
• Evaluation Requests
• Tasks and Scoring
• Stations
• Arms
• Cameras
• Station Repository