Autonomous Pixel Art Builder
In this project, I led a team of 4 to build a pixel art builder robot.
The setup is as follow, the Panda arm takes building blocks from picking area and stack them inside building area to form a pixel art. The robot can generate a plan for a predefined target pixel art. After it execute each action, it will check the current building state using the webcam. If the state is not as expected, the robot will plan the recovery behavior using symbolic planning.
The figure below shows the building process.
In the midway, we swapped the blocks.
The robot can sense the difference and replan the plan to get to the goal
Here is another example. The robot expect the block on top left corner should be green but it’s actually black, and there is a black block out of nowhere but satisfy to the plan.
The robot can directly move blocks that’s already in the art to save the number of actions.