Ludovic Righetti
Source: https://engineering.nyu.edu/faculty/ludovic-righetti Parent: https://engineering.nyu.edu/academics/departments/mechanical-and-aerospace-engineering
- Professor
Electrical and Computer Engineering
Mechanical and Aerospace Engineering
Center for Advanced Technology in Telecommunications (CATT)
Center for Urban Science + Progress
Connect
Ludovic Righetti is jointly appointed in the Electrical and Computer Engineering Department and in the Mechanical and Aerospace Engineering Department at the Tandon School of Engineering of New York University. He is also holder of an International Chair at the Artificial and Natural Intelligence Toulouse Institute. He co-created and co-directs the Center for Robotics and Embodied Intelligence. He is also a member of the Center for Responsible AI, Center for Urban Science and Progress and Center for Advanced Technology in Telecommunications.
He leads the Machines in Motion Laboratory, where his research focuses on the planning and control of movements for autonomous robots, with a special emphasis on legged locomotion and manipulation. He is more broadly interested in questions at the intersection of decision-making, automatic control, optimization, applied dynamical systems and machine learning and their application to physical systems. He also cares about the societal implications of his work and more broadly he is interested in use of technology that can empower people, improve quality of life and help create more just, open and equal societies.
He studied at the Ecole Polytechnique Fédérale de Lausanne (Switzerland) where he received an engineering diploma in Computer Science (eq. M.Sc.) and a Doctorate in Science under the supervision of Professor Auke Ijspeert. He was a postdoctoral fellow at the Computational Learning and Motor Control Lab with Professor Stefan Schaal (University of Southern California) and a independent research group leader at the Max-Planck Institute for Intelligent Systems in Tübingen, Germany. He moved to New York University in September 2017.
He has received several awards, most notably the 2010 Georges Giralt PhD Award given by the European Robotics Research Network (EURON) for the best robotics thesis in Europe, the 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) Best Paper Award, the 2016 IEEE Robotics and Automation Society Early Career Award, the 2016 Heinz Maier-Leibnitz Prize from the German Research Foundation and NYU's 2024 Jacobs Excellence in Education Innovation Award.
Research Interests
Robotics and applications, optimal control, reinforcement learning, robotics societal/ethical issues, legged robots, robotic manipulation
2008 Doctorate in Science, Robotics, Ecole Polytechnique Fédérale de Lausanne, Switzerland
2004 Engineering Diploma in Computer Science, Ecole Polytechnique Fédérale de Lausanne, Switzerland
Please refer to the Machines in Motion Laboratory website or the Google Scholar page
### Selected Honors and Awards
- 2024 NYU Tandon's Jacobs Excellence in Education Innovation Award
- 2023 Finalist for the Best Paper Award on Mobile Manipulation at the IEEE-RSJ International Conference on Intelligent Robots and Systems (Efficient Object Manipulation Planning with Monte Carlo Tree Search, H. Zhu, A. Meduri and L. Righetti)
- 2022 Best Paper Award by the IEEE Robotics and Automation Society’s Technical Committee on Model-Based Optimization for Robotics (Efficient Multi-Contact Pattern Generation with Sequential Convex Approximations of the Centroidal Dynamics, B. Ponton, M. Khadiv, A. Medu and L. Righetti)
- 2016 Heinz Maier-Leibnitz Prize
- 2016 IEEE Robotics and Automation Society Early Career Award “for contributions to the theory of, and experiments in, robot locomotion and manipulation”
- 2016 Finalist for the best interactive session award at the International Conference on Humanoid Robots (A convex model of humanoid momentum dynamics for multi-contact motion generation, B. Ponton, A. Herzog, S. Schaal and L. Righetti)
- 2012 Finalist for the best paper award at the International Conference on Humanoid Robots (Encoding of Periodic and their Transient Motions by a Single Dynamic Movement Primitive, J. Ernesti, L. Righetti, M. Do, T. Asfour and S. Schaal)
- 2011 Best paper award at the IEEE/RSJ International Conference on Intelligent Robots and Systems (Online movement adaptation based on previous sensor experiences, P. Pastor, L. Righetti, M. Kalakrishnan, S. Schaal)
- 2010 Georges Giralt PhD Award for the best PhD thesis in Europe in the field of robotics
- 2006 Finalist for the best student paper award at the IEEE International Conference on Robotics and Automation (Programmable central pattern generators: an application to biped locomotion control, L. Righetti, A.J. Ijspeert)
Research News
Efficient object manipulation planning with Monte Carlo Tree Search
This paper was a finalist for the Best Paper Award on Mobile Manipulation at IROS 2023. It is one of 5 finalists out of 2760 submitted papers at one of the largest robotics conferences in the world.
In the field of robotics, the intricate dance of planning how machines touch and maneuver objects is a linchpin for granting them the autonomy to execute intricate tasks. However, this endeavor remains a challenge. The pursuit of identifying dynamically viable sequences of contacts between robotic manipulators and objects often unravels into a web of formidable combinatorial and nonlinear complications.
Consider the ostensibly simple act of reorienting an object nestled on a table using a two-fingered robotic hand. The strategic planning of contacts necessitates a thoughtful consideration of interaction forces. For instance, a cube succumbs to rotation through forces applied from its sides. In stark contrast, when faced with a slender plate, the robotic fingers must exert a downward pressure — initiating a frictional interplay — to achieve a comparable outcome.
The crux of the challenge lies in the nuanced orchestration of interaction forces and judicious contact switches. As the robotic fingers approach their kinematic limits, a process of breaking and re-establishing contacts becomes imperative to propel the object into further rotation. These twin challenges, encapsulated in interaction forces and contact switches, underscore the complexity inherent in planning the manipulation of objects.
Over the past decade, trajectory optimization has emerged as the favored approach for orchestrating multi-contact motion planning. This methodology holds sway due to its capacity to construct efficient formulations for navigating the intricate terrain of interaction forces. Yet, a lingering problem persists—the effective integration of planning for contact modes remains elusive, primarily attributed to its discrete nature, injecting a disruptive discontinuity into the dynamics at the crucial juncture of contact switches.
Now, a team of NYU researchers led by Ludovic Righetti, Associate Professor of Electrical and Computer Engineering Department and Mechanical and Aerospace Engineering, as well as a member of the Center for Urban Science + Progress, have developed a strategy for planning object manipulation, leveraging the power of Monte Carlo Tree Search (MCTS) to discern optimal contact sequences. Complementing this, an adept trajectory optimization algorithm, rooted in Alternating Direction Method of Multipliers (ADMM), evaluates the dynamic feasibility of potential contact sequences. The algorithm was previously developed by Righetti’s group, The Machines in Motion Laboratory.
The team, including Ph.D. students Huaijiang Zhu and Avadesh Meduri, made a key innovation in expediting MCTS involving the development of a goal-conditioned policy-value network, guiding the search toward promising nodes. Additionally, manipulation-specific heuristics prove instrumental in markedly shrinking the search space.
The efficacy of the approach is underscored through a series of meticulous object manipulation experiments conducted both in a physics simulator and on tangible hardware. The methodology exhibits a favorable scalability for protracted manipulation sequences, a testament to the learned policy-value network.
This advancement substantially elevates the planning success rate, marking a significant stride in the realm of object manipulation planning.
Zhu, H., Meduri, A., & Righetti, L. (2023, March 19). Efficient object manipulation planning with Monte Carlo Tree Search. arXiv.org. https://arxiv.org/abs/2206.09023
October 11, 2023
Enabling Remote Whole-Body Control with 5G Edge Computing
Huaijiang Zhu, a Ph.D. student in electrical and computer engineering was lead author.
There are many real-world — and, someday, off-world — applications for light-weight, energy-efficient, fully autonomous robots. Yet the more autonomous a robot is, the greater its computational requirements. Onboarding the components to handle this computational function adds weight, cost and reduces potential for applications in hostile environments.
It might thus be desirable to offload intensive computation--not only sensing and planning, but also low-level whole-body control--to remote servers in order to reduce on-board computational needs. Fifth Generation (5G) wireless cellular technology, with its low latency and high bandwidth capabilities, has the potential to unlock cloud-based high performance control of complex robots. However, state-of-the-art control algorithms for legged robots can only tolerate very low control delays, which even ultra-low latency 5G edge computing can sometimes fail to achieve.
In this work, the investigators, led by Ludovic Righetti, associate professor of electrical and computer engineering and mechanical and aerospace engineering, and a member of NYU WIRELESS, investigate the problem of cloud-based whole-body control of legged robots over a 5G link. Their novel approach consists of a standard optimization-based controller on the network edge and a local linear, approximately optimal controller that significantly reduces on-board computational needs while increasing robustness to delay and possible loss of communication. Simulation experiments on humanoid balancing and walking tasks that includes a realistic 5G communication model demonstrate significant improvement of the reliability of robot locomotion under jitter and delays likely to experienced in 5G wireless links.
The team included Kai Pfeiffer, a postdoctoral researcher, and Manali Sharma, a master's student in the Department of Electrical and Computer Engineering; Sundeep Rangan, professor of electrical and computer engineering and associate director of NYU WIRELESS; and Marco Mezzavilla, a research scientist at NYU WIRELESS.
The project, funded in part by the National Science Foundation National Robotics Initiative and OPPO Mobile Telecommunications, will be presented at the IEEE/RSJ International Conference on Intelligent Robots and Systems in October, 2020.
September 14, 2020
Research Centers, Labs, and Groups
Machines in Motion
We try to understand the fundamental principles for robot locomotion and manipulation that will endow robots with the robustness and adaptab...
Center for Advanced Technology in Telecommunications (CATT)
Creating economic impact through research, technology transfer, and faculty entrepreneurship.
Center for Responsible AI
Our goal is to build a future in which responsible AI is synonymous with AI. Our work centers around interdisciplinary research, technology...
Center for Urban Science + Progress (CUSP)
The Center for Urban Science and Progress (CUSP) is an interdisciplinary research center dedicated to the application of science, technology...
NYU Center for Robotics and Embodied Intelligence (CREO)
We strive to advance research, education, and innovation at the intersection of AI and robotics to enhance everyone’s quality of ...