Get our free extension to see links to code for papers anywhere online!Free add-on: code for papers everywhere!Free add-on: See code for papers anywhere!

Add to Chrome

Add to Firefox

Add to Edge

Sumit Patidar

Hierarchical Diffusion Policy for Kinematics-Aware Multi-Task Robotic Manipulation

Mar 06, 2024
Xiao Ma, Sumit Patidar, Iain Haughton, Stephen James

Figure 1 for Hierarchical Diffusion Policy for Kinematics-Aware Multi-Task Robotic Manipulation

Figure 2 for Hierarchical Diffusion Policy for Kinematics-Aware Multi-Task Robotic Manipulation

Figure 3 for Hierarchical Diffusion Policy for Kinematics-Aware Multi-Task Robotic Manipulation

Figure 4 for Hierarchical Diffusion Policy for Kinematics-Aware Multi-Task Robotic Manipulation

This paper introduces Hierarchical Diffusion Policy (HDP), a hierarchical agent for multi-task robotic manipulation. HDP factorises a manipulation policy into a hierarchical structure: a high-level task-planning agent which predicts a distant next-best end-effector pose (NBP), and a low-level goal-conditioned diffusion policy which generates optimal motion trajectories. The factorised policy representation allows HDP to tackle both long-horizon task planning while generating fine-grained low-level actions. To generate context-aware motion trajectories while satisfying robot kinematics constraints, we present a novel kinematics-aware goal-conditioned control agent, Robot Kinematics Diffuser (RK-Diffuser). Specifically, RK-Diffuser learns to generate both the end-effector pose and joint position trajectories, and distill the accurate but kinematics-unaware end-effector pose diffuser to the kinematics-aware but less accurate joint position diffuser via differentiable kinematics. Empirically, we show that HDP achieves a significantly higher success rate than the state-of-the-art methods in both simulation and real-world.

* Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2024). Videos and code: https://yusufma03.github.io/projects/hdp/

Via

Access Paper or Ask Questions

In-Hand Cube Reconfiguration: Simplified

Aug 23, 2023
Sumit Patidar, Adrian Sieler, Oliver Brock

Figure 1 for In-Hand Cube Reconfiguration: Simplified

Figure 2 for In-Hand Cube Reconfiguration: Simplified

Figure 3 for In-Hand Cube Reconfiguration: Simplified

Figure 4 for In-Hand Cube Reconfiguration: Simplified

We present a simple approach to in-hand cube reconfiguration. By simplifying planning, control, and perception as much as possible, while maintaining robust and general performance, we gain insights into the inherent complexity of in-hand cube reconfiguration. We also demonstrate the effectiveness of combining GOFAI-based planning with the exploitation of environmental constraints and inherently compliant end-effectors in the context of dexterous manipulation. The proposed system outperforms a substantially more complex system for cube reconfiguration based on deep learning and accurate physical simulation, contributing arguments to the discussion about what the most promising approach to general manipulation might be. Project website: https://rbo.gitlab-pages.tu-berlin.de/robotics/simpleIHM/

* Accepted at 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

Via

Access Paper or Ask Questions