IK
For rotational joint
Notation
- Joint configurations: , where each is called joint angle.
- where end effectors represented as , and each .
- Target positions for end effectors
- , where each
- Joint angles represented as column vector
- End effector positions can be represented as a function:
- IK problem: find ‘s such that
Jacobian represents the instantaneous linear approximation of position as a function of as
For an initial position and target position , we seek to find the value of for updating the value of joint angles as . We define the instantaneous velocities of end effectors as . Applying Taylor’s expansion to initial position , we obtain .
Jacobian (instantaneous rate of change in end effectors), thus gives an iterative method to approximate the movement in the end effectors as a function of change of angle joints. Next question: How do we compute the Jacobian?
- Write end effector coordinates as a function of by multiplying transformation matrices successively for each joint, and then take the partial derivative with respect to each joint angle , and evaluating at current value of angle joints.
- Use the dot product to obtain the tangent vector to the direction of rotation. Let be a unit vector pointing to along current axis of rotation, and be the position of the joint, then the instantaneous rate of change of position of end-effector with respect to joint is obtained by the cross product .
Final step is to compute the inverse of the Jacobian to get , but generally Jacobian is neither a square matrix or non-singular, and even if inverse is available, may have numerical errors if J is nearly singular. Alternate formulation for jacobian is obtained by setting . This can be interpreted as trying to move the target positions towards the end effectors, rather than moving the end effectors towards the target position.
When does the alternate Jacobian formulation give an advantage?
“To reduce oscillations or overshoot when target positions are too far away to be reached by end effectors.” - Introduction to Inverse Kinematics with Jacobian Transpose, Pseudoinverse and Damped Least Squares methods
Why does Jacobian reach near singularity when arms stretch out to try to reach target position too far away?
Solution is to move the target positions closer to end effector position by clamping the value to a maximum, , where if , otherwise .
Choosing value ofdis another heuristic, that changes with the inverse methods.
Inverse Methods
- Jacobian Transpose
- Pseudoinverse method
- Damped Least Squares
- Selectively Damped Least Squares
Resources
- Introduction to Inverse Kinematics with Jacobian Transpose, Pseudoinverse and Damped Least Squares methods
- Selectively Damped Least Squares for Inverse Kinematics
- Inverse kinematics using the Jacobian inverse, part 2 • Najam R. Syed
- Inverse Kinematics and Foot Locking
Motors & Sensors
- image sensor, ultrasound sensor
- Sonair
- How does ultrasound sensor work?
- how does lidar work?
- why is lidar so expensive?
- can you make ultrasound work at the same accuracy as lidar?
- what pixxel is doing is creating imaging sensors to map earth for satellites? doesn’t on-ground robots require same setup?
- Actuators, motors
- What kind of motors are needed by current robots?
- what kind will be required by future robots?
- Will all sensors and motors be manufactured inhouse by these robot startups or exported to a manufacturer?
- what’s the role of opensource drivers here?
Resources
- Packages and papers in robotics
- [2306.03310] LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learning
- Installation — robosuite 1.5 documentation
- GitHub - Genesis-Embodied-AI/genesis-world: Simulation platform for general-purpose robotics & embodied AI learning. · GitHub
- [2605.02881] MolmoAct2: Action Reasoning Models for Real-world Deployment
- [2506.07530] BitVLA: 1-bit Vision-Language-Action Models for Robotics Manipulation
- GitHub - RLinf/RLinf: RLinf: Reinforcement Learning Infrastructure for Embodied and Agentic AI · GitHub
- GitHub - mani-skill/ManiSkill: Manipulation Skill Framework, an open source GPU parallelized robotics simulator and benchmark · GitHub
- GitHub - Physical-Intelligence/openpi · GitHub
- phospho starter pack documentation
- GitHub - kscalelabs/ksim: RL training library for humanoid locomotion and manipulation. Built on top of MuJoCo and JAX. · GitHub
- Ask HN: How do I learn robotics in 2025? | Hacker News
- Hand: open-source Robot Hand | Hacker News
- GitHub - pollen-robotics/AmazingHand: Code and model to control the AH!
- pen_plotter_robot/story.md at main · Robertleoj/pen_plotter_robot · GitHub
- GitHub - hello-robot/stretch_ai
- GitHub - dartsim/dart: DART: Dynamic Animation and Robotics Toolkit
- GitHub - kiloreux/awesome-robotics: A list of awesome Robotics resources
- GitHub - knmcguire/best-of-robot-simulators: A Best-of-list of Robot Simulators, re-generated weekly on Wednesdays
- GitHub - Vector-Wangel/XLeRobot: XLeRobot: Autonomous Household Dual-Arm Mobile Robot for $660
- GitHub - yash-goel/reading-list: For Robotics and Robot Learning Resources
- GitHub - linchangyi1/Awesome-Touch: Tactile Sensing • Simulation • Representation • Manipulation • RL/IL/VLA • Open Source
- GitHub - GT-RIPL/Awesome-LLM-Robotics: A comprehensive list of papers using large language/multi-modal models for Robotics/RL, including papers, codes, and related websites
- GitHub - showlab/Awesome-Robotics-Diffusion: A curated list of recent robot learning papers incorporating diffusion models for robotics tasks.
Teleop - GitHub - NVIDIA/IsaacTeleop: The unified framework for sim & real robot teleoperation · GitHub
- [2307.04577] AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation System
- [2509.02437] U-ARM : Ultra low-cost general teleoperation interface for robot manipulation
- [2602.01632] A Closed-Form Geometric Retargeting Solver for Upper Body Humanoid Robot Teleoperation
- [2606.29940] WARP: Whole-Body Retargeting for Learning from Offline Human Demonstrations
MuJoCo
- GitHub - sjchoi86/yet-another-mujoco-tutorial-v3 · GitHub
- GitHub - google-deepmind/mujoco: Multi-Joint dynamics with Contact. A general purpose physics simulator. · GitHub
- MuJoCo Bootcamp
- GitHub - tayalmanan28/MuJoCo-Tutorial: Tutorial on how to get started with MuJoCo Simulation Platform
Physical Engineering
- Tech Tree · Back to Engineering
- tldr robotics — core map prototype
- 16-848 Hands: Design and Control for Dexterous Manipulation, Spring 2024
Graphics
Robot planning and Perception and Machine Learning
- ECE 531/COS 531: Robot Planning Meets Machine Learning, Princeton University, Fall 2025
- Kevin M. Lynch and Frank C. Park, “MODERN ROBOTICS: MECHANICS, PLANNING, AND CONTROL”
- Robotic Systems, by Kris Hauser
- Welcome — Modeling and Control of Robots
- Inverse Kinematics – Modeling, Motion Planning, and Control of Manipulators and Mobile Robots
- Robotic Manipulation, MIT 6.4210/6.4212 - Robotic Manipulation, Robotic Manipulation, Fall 2023 - YouTube
- Underactuated Robotics, Underactuated Robotics, Spring 2024 - YouTube, MIT 6.8210 - Underactuated Robotics | Assignments
- 16-350 Planning Techniques for Robotics, 16-782 Planning and Decision-making in Robotics, 16-832 Integrated Planning and Learning
- Introduction to Motion Planning for Continuum Robots - Part 1 -
- CS 3630: Introduction to Robotics and Perception, CS 8803RMP: Robot Motion Planning
- intro-to-robotics | IRoM-Lab
- Intro to Robotics - YouTube
- CS 294-277, Robots That Learn (Spring 2026)
- Welcome to Robotic Imaging Reading Group | ImgRG
RL in robotics
Simulator
- Mujoco
- GitHub - mani-skill/ManiSkill: Manipulation Skill Framework, an open source GPU parallelized robotics simulator and benchmark · GitHub
- GitHub - Genesis-Embodied-AI/genesis-world: Simulation platform for general-purpose robotics & embodied AI learning. · GitHub
- GitHub - kscalelabs/ksim: RL training library for humanoid locomotion and manipulation. Built on top of MuJoCo and JAX. · GitHub
- Installation — robosuite 1.5 documentation
Datasets
- datasets.bot: 41,885+ hours of open robot data
- GitHub - worldbench/awesome-embodied-data-pyramid: 🔥 Data Pyramid for Embodied Manipulation: A Survey · GitHub
- [2306.03310] LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learning
- GitHub - sylvestf/LIBERO-plus: Official repository of LIBERO-plus, a generalized benchmark for in-depth robustness analysis of vision-language-action models. · GitHub
- GitHub - Zxy-MLlab/LIBERO-PRO: LIBERO-PRO is the official repository of the LIBERO-PRO — an evaluation extension of the original LIBERO benchmark · GitHub
- RoboArena
- DROID: A Large-Scale In-the-Wild Robot Manipulation Dataset
- GitHub - RoboVerseOrg/RoboVerse: RoboVerse: Towards a Unified Platform, Dataset and Benchmark for Scalable and Generalizable Robot Learning · GitHub
Packages
- GitHub - allenai/vla-evaluation-harness: One framework to evaluate any VLA model on any robot simulation benchmark. · GitHub
- GitHub - starVLA/starVLA: StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing · GitHub
- GitHub - RLinf/RLinf: RLinf: Reinforcement Learning Infrastructure for Embodied and Agentic AI · GitHub
- NeMo Gym | NeMo Gym
- Overview — NeMo-RL
- phospho starter pack documentation
- GitHub - starVLA/starVLA: StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing · GitHub
- RL Post-Training for VLA Models
- GitHub - allenai/vla-evaluation-harness: One framework to evaluate any VLA model on any robot simulation benchmark. · GitHub
VLA
WAM
- World Action Models (WAM): A Survey — Taxonomy & Paper List
- GitHub - dreamzero0/dreamzero: Code to pretrain, fine-tune, and evaluate DreamZero and run sim & real-world evals · GitHub
- Dyna-2: A 1-Million-Hour Scaling Law for World-Action Models — DYNA
Foundation models
- [2604.15395] Foundation Models in Robotics: A Comprehensive Review of Methods, Models, Datasets, Challenges and Future Research Directions
- GitHub - Physical-Intelligence/openpi · GitHub
- GitHub - NVIDIA/Isaac-GR00T: NVIDIA Isaac GR00T N1.7 - A Foundation Model for Generalist Robots. · GitHub
- [2605.02881] MolmoAct2: Action Reasoning Models for Real-world Deployment
Papers
- [2607.18236] Patch Policy: Efficient Embodied Control via Dense Visual Representations
- B-spline Policy
- [2605.24934] HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos
- [2602.07322] Action-to-Action Flow Matching
Companies
- Unitree
- Generalist
- Sunday Robotics
- Dyna robotics
- Tesla robotics
- Figure
- NVIDIA Gear Lab
Academic Labs