Figure 2: The relationship between physics and control. State transition is determined by external input; previous state; and action input from controller.