Add to Chrome
Add to Firefox
Add to EdgeUtku Culha
Swarm-GPT: Combining Large Language Models with Safe Motion Planning for Robot Choreography Design
Dec 02, 2023
This paper presents Swarm-GPT, a system that integrates large language models (LLMs) with safe swarm motion planning - offering an automated and novel approach to deployable drone swarm choreography. Swarm-GPT enables users to automatically generate synchronized drone performances through natural language instructions. With an emphasis on safety and creativity, Swarm-GPT addresses a critical gap in the field of drone choreography by integrating the creative power of generative models with the effectiveness and safety of model-based planning algorithms. This goal is achieved by prompting the LLM to generate a unique set of waypoints based on extracted audio data. A trajectory planner processes these waypoints to guarantee collision-free and feasible motion. Results can be viewed in simulation prior to execution and modified through dynamic re-prompting. Sim-to-real transfer experiments demonstrate Swarm-GPT's ability to accurately replicate simulated drone trajectories, with a mean sim-to-real root mean square error (RMSE) of 28.7 mm. To date, Swarm-GPT has been successfully showcased at three live events, exemplifying safe real-world deployment of pre-trained models.
Dual-Material 3D-Printed PaCoMe-Like Fingers for Flexible Biolaboratory Automation
Feb 07, 2023
Robotic automation in life science research is a paradigm that has gained increasing relevance in recent years. Current solutions in this area often have limited scope, such as pick-and-place tasks for a specific object. Thus, each new process requires a separate toolset, which prevents the realization of more complex workflows and reduces the acceptance of robotic automation tools. Here, we present a novel finger system for a parallel gripper for biolaboratory automation that can handle a wide range of liquid containers. This flexibility is enabled by developing the fingers as a dual-extrusion 3D print. The coating with a soft material from the second extruder in one seamless print and the fingertip design are key features to enhance grasping capabilities. By employing a passive compliant mechanism that was previously presented in a finger called ``PaCoMe'', a simple actuation system and a low weight are maintained. The ability to resist chemicals and high temperatures and the integration with a tool exchange system make the fingers usable for daily laboratory use and complex workflows. We present their task suitability in several experiments showing the wide range of vessels that can be handled as well as their tolerance against displacements and grasp stability.