VISUAL POSITIONING OF A DELTA ROBOT
|
|
- Jody Barber
- 5 years ago
- Views:
Transcription
1 VISUAL POSITIONING OF A DLTA ROBOT Warin Poomarin, Kamol Chuengsatiansup, and Ratchatin Chancharoen Mechanical ngineering Department, Chulalongkorn University, Bangkok, 10330, Thailand mail: Ratchatin.C@chula.ac.th ABSTRACT An uncalibrated dynamic look and move visual servoing is successfully implemented on a light weight Delta robot to position it relative to an object which its position is sensed by a USB camera and is driven by Dynamixel motors. The online estimated Jacobian is proposed to map the deference in joint space to the difference of parameters in image space. The paper demonstrates that the estimated Jacobian is accurate and can be used for a dynamic look and move visual servoing in this case. The experiment demonstrates that the robot is three dimensional point to point position controlled in image space with its accuracy is defined in this space as well. KY WORDS Visual Servoing, Delta Robot. 1. Introduction An accuracy of a robot manipulator does not exceed its repeatability if the pose of its end effector is determined based on a robot s kinematic model. The kinematic model is a map between the joint positions and the pose of the manipulator in Catesian space, containing a lot of robot parameters including link lengths, link twists, joint offsets, and joint angles [1]. The accuracy of the kinematic model, thus, depends on the accuracy of these parameters. Normally, these parameters have nonlinear uncertainties that are affected by the environment factors (especially temperature), load conditions, and inherent dynamic properties from backlash and friction. One technique to design a high accuracy robot manipulator is to use highly rigid links and joints such that all the parameters in the kinematic model are constant and static calibration is used to determine all the parameters. This technique results in a heavy robot manipulator and still requires calibration which is normally time consuming and expensive. In this project, the digital CCD camera is used as a sensory feedback at the end effector and an uncalibrated position based visual servoing technique [2, 3, 4] is used to control a Delta robot [5] such that the accuracy can be defined in image space. The low cost and light weight Delta robot is designed and built with the web camera installed at its end plate. The robot is driven by three USB Dynamixel motors which is point to point (PTP) positioned control at 1024 resolution step by Dynamixel e electronics. The aim is to position the Delta robot relative to an object which its relative position is sensed by the camera. The challenge is the control technique that is flexible and robust for this task. An inverse Jacobian control [1] where the Jacobian is online estimated is successfully implemented to control the robot such that the robot is positioned controlled relative to an object. The experiment demonstrates that the robot can be PTP position controlled in image space which the accuracy is also defined in this space. 2. Image Processing Technique 2.1 Feature xtraction In this paper, the objects are assumed to be in circular shape and in different color with the background. Color based tracking technique [6] is used to filter the background. The digital camera gives an RGB image that contains the objects as in Fig. 1a. The RGB image is a three-dimensional image including red, green and blue images. To simplify the work, the objects are in red, green, and blue which are primary colors. The RGB image is processed to construct the gray image. To extract the red object, the red image is subtracted with the gray image. The resulting image is a one dimensional image that the red object is enhanced as shown in Fig. 1b. The thresholding [7] is then used to convert the resulting image into black and white image as shown in Fig. 1c. Then, Blob analysis [8] is used to determine the object s parameters including the centroid and the bounding box. These parameters are further processed to determine the Catesian position of an object. a. An original RGB image c. BW image by Thresholding technique b. RD enhancement by color analysis d. Centroid of a white object by Blob analysis Fig 1. Centroid of a RD circle in RGB image.
2 2.2 Camera Calibration In the paper, the technique, to positioning the robot to the target, is based on the Catesian position. Thus, camera calibration is required to convert the information in 2D image into the 3D positions of the monitored object. Basically, there are three categories of calibration techniques including Photogrammetric calibration [9], Self-calibration [10], and the hybrid technique [9, 11]. In Photogrammetric calibration, the calibration object is a specially designed three dimensional object which its geometry is precisely known. Thus, the actual geometry and its shape in image view are then used to determine the camera model. This requires an expensive hardware and also effort to setup. In Self-calibration, calibration object is not required. The camera takes a number of images at its various positions with a static object and background. The correspondences between the images are used to determine the camera model. Although the technique is flexible, the resulting camera model is not reliable due to many parameters involved. In this work, the technique proposed by Zhang [11] is used. In this technique, the object is a planar chess like pattern (see Fig. 3 for an example) and multiple views of the planar pattern are used to determine the camera model. Thus, it combines the advantage of the Photogrammetric calibration and Self-calibration such that it is flexible and the resulting camera model is reliable. In the project, Logitech HD Pro Webcam C920 is used. The camera s intrinsic parameters are determined as Resulting Intrinsic parameters: Focal Length: fc = [ ] Principal point: cc = [ ] Skew: alpha_c = [ ] Distortion: kc = [ ] Fig 4. Calibration images Fig 2. Calibration procedure In this paper, the calibration object is a chess like pattern as in Fig. 3 and six views from various positions (Fig. 2) of the camera are used to determine the camera model. The resulting images are shown in Fig. 4. The calibration toolbox [12, 13] is used to determine the camera intrinsic parameters including the focal length, the principal point, the skew coefficient, and distortion coefficient. Fig 3. Calibration pattern Fig 5. stimated camera positions from captured images Once the camera s model is determined, the model is capable of mapping the image coordinate (u,v) to normalized projection, (u n,v n ), by taken focal length, principal point, skew, and distortion into account. 2.3 Catesian Position of an object The Catesian position of an object relative to the camera is determined using camera projection model. The perspective projection [14] is used to map the normalize projection, (u n,v n ), into the Catesian position, C X, relative to the camera. The projection model in Fig. 6 shows the relation between the actual position in three dimensional space and its projection in image plane, (u n,v n ). The equation that maps the image coordinate to the Catesian
3 position is given in equation (1). The z-position of an object can be estimated from the relation between the actual size of a circular object and its size in the image plane. However, the actual size of an object is unknown in this project. Thus, the z-position is estimated from the relative positions of the camera poses which is determined from forward kinematic of the robot. proposed such that those homogeneous transforms are not required. The technique is an enhance version of the previously proposed online estimation of the image Jacobian as in [2] such that the estimated Jacobian is stable during the small step motion of the robot towards the goal. U B X T B X Fig 6. Projection model n u x ( xyz,, ) n v z y (1) Fig 7. Pose stimation Actually, the camera s intrinsic parameters can be used to estimate the pose of a point in the calibration pattern as shown in Fig. 7. The resulting pose (shown in green in Fig. 7) in this case is determined as T X C C x T Fig 8. Relevant coordinate frames between world, end-effector, camera and target frames 3. Delta Robot The Delta robot consists of three parallel mechanisms to constrain the end effector such that it parallel to the base at all time. Three motors sit on the base where their joints, called Hip joints, connect to the rigid link called Thigh. The Thigh link connects to the parallelogram mechanism called Shin using two spherical joints where the other side of Shin connect to the end plate via the other two spherical joints. In this way, the rotation of the three motors relates to the three translational position of the end plate. The torques from the motors can be transmitted to the end effector via low inertia rigid link. Thus, the robot is very rigid with very low inertia. In total, there are eleven links, twelve spherical joints, and three active rotational joints that are driven by three motors. Resulting xtrinsic parameters: Translation vector: Transl=[ ] Rotation vector: [ ] Rotation matrix: R= [ ] A technique to map the position of an object in an image into the three dimensional position of the object relative to the camera is already mentioned. Once C x, is T determined, this position can be mapped further to the object position relative to the end effector, to the base, and to the universal frame via uniform homogeneous transforms [1], T, B T C, and U BT respectively. Although these transforms can be determined by calibration technique, they are not a priori known in this project. An advance online estimation of the image Jacobian is Fig 9. The model of the CHULA parallel delta robot.
4 3.1 Kinematics of the Delta robot The kinematics of a Delta robot is the mathematics that maps the three actuator s positions to the three dimensional position of the end effector. The map is nonlinear three-dimensional space. However, there are twelve passive spherical joints involved which causing a complicated solutions to the inverse kinematics. Passing joint s variables must be eliminated to map the actuator s positions to the end effector s position in the closed form kinematics solution. Several techniques to solve kinematics of a Delta robot are proposed including [15, 16, 17, 18, 19, 20]. In this paper, a technique described in [5] is used to determine the inverse kinematic solution. 3. Hardware Setup Fig 10. Hardware Setup. The Delta robot in this project is driven by three USB dynamixel motors which is 1024 step position controlled by the dynamixel s electronics. The position command is updated at 0.2 second update rate. The actual motor s positions are read at the same rate. The Logitech HD Pro Webcam C920 is installed at the end effector to give a video feedback at about 30 Hz refresh rate. The Bluetooth gamepad is also used as human machine interface to control the flow of the program. In this way, USB is used as a bus in real time control. The objects are the printed color circles on the planar paper including red, green, and blue objects with different sizes. The overall system is simple and low cost and the position of the web camera that fixed to the end plate is not precisely known. The challenge is the control technique that can complete the task which is robust enough for this system. 5. Control Law Dynamic position based look and move (DPLM) [14] with online estimation of Jacobian is used to control the robot. The camera is in eye in hand configuration [14] and can sense the position of the object relative to the camera. The different between the proposed control law and the DPLM mentioned in [14] is that 1) the pose estimation is relative to the camera and the desire position is also defined relative to the camera. Thus, the error signal is relative to the camera. 2) The inverse kinematics [1] is used to convert the command Catesian position of the robot into the command joint s positions. In this way, the Jacobian maps the change in the error to the change in command Catesian position. This will uniform the Jacobian over the entire space and ease an online estimation of Jacobian. Although the Jacobian is uniform, it is updated at every step the robot move. This causes the technique to be more flexible and less sensitive to all of the system parameters. The performance of the technique is then relied on the accuracy of the Jacobian. C x ref T C x T 1 J Fig 11. Dynamic position-based look-and-move. Since the Jacobian can map the change of the commanded end effector s position, B X, to the change of the target position, C x, its inverse can map the error signal back to the change of the commanded end effector s position such that the robot move to a goal in the next step. The is introduced in the control law to control the maximum distant of the walk. The control law is thus designed as B X J ˆ[ C x ref C x ] (2) 6. Online estimation of jacobian The performance of the proposed visual positioning technique relies on the accuracy of the Jacobian that maps the change of the commanded end effector s position, B X, to the change of the target position, C x, relative to the camera frame. The Position based servoing technique is used to give the Jacobian uniform over the entire space. Thus, the camera calibration technique mentioned in section 2 is used only to gives the Jacobian uniform and aids the online estimation of the Jacobian. Although the Jacobian is mathematically uniform, it is updated at every step the robot move to increase the accuracy of the Jacobian using new information from the movement. Consider three step motions, at j-2, j-1, and j steps, of the Delta robot that the changes in end effector s positions, B X, [X x X y X z ] T, at each step are stacked in matrix as B B j2 B j1 B j D X X X X (3) As the robot moves with the change of end effector s positions, B X, the position of the target, C x, changes correspondingly. The changes of the C x, [ C x x C x y C x z ] T, in the past three steps are stacked and written in matrix form as C j2 j1 j D xx x x as (4) These two matrices are used to estimate the Jacobian ˆ C B 1 D x D X (5) J This technique is very simple but efficient [2]. A technique to estimate the Jacobian in realtime is a key for
5 uncalibrated dynamic vusual servoing as seen in [3, 4]. In this work, both end effector s positions, B X, and the target positions, C x, are monitored and recorded at every time step. Thus, the Jacobian is updated at every time step as well. However, the robot moves in the same direction causes matrix D B X to lose its rank as the column vector of D B X are parallel. One of the main contributions of the paper is a technique to estimate the Jacobian in realtime without losing its rank. When the robot is commanded to incremental move by B X, the perpendicular direction to X B is determined and noted it as X 1. Then, the perpendicular direction to both B X and X 1 is determined by cross product of those two vectors and noted it as X 2. X 1 and X 2 are then used to estimate C x if the robot moves in these two directions by C 1 ˆ 1 x J X C 2 ˆ 2 x J X (6) When the robot moves by X B, C x is sensed corresponding to the move. However, the Jacobian estimates C x as C* ˆ B x J X The x C that is actually sensed is used to update the C* x by C* x (new) = (0.9) C* x (old) + (0.1) C x. Then set DX B and Dx C as D B X = [ B X X 1 X 2 ] D C x = [ C* x C x 1 C x 2 ] In this way, the Jacobian is smoothly updated without losing its rank. 7. Task Performance valuation The task to evaluate the performance of the proposed technique is designed as point to point control in image space. There are three objects in different colors, i.e., red, green, and blue and in different sizes, i.e., 30, 25, and 35 mm respectively. The Delta robot is controlled such that the object is seen in the image by USB camera and its position is at the center of the image and its size is as marked by blue circle in Fig. 13 which is equivalent to z=-250 for red object. This is a three dimensional task. Starting at any position, the robot is to move to the red object and position itself such that the error is within the specified accuracy. Since the error is defined in image space, the task is to move the robot such that the object fits in the blue circle as seen in Fig 13. Once the positioning on the red object is complete, the robot moves to the green and then the blue object. Since the sizes of the objects are different, the robot will have to move in three-dimensional space to complete the task. (7) (8) Fig 12. Blue, green, and red targets. 8. Result The result shown in Fig. 13 demonstrates that the proposed technique can complete the task. In this result, the robot took 22 step moves to go from the start point as seen in Fig 13a to the position at the red object. Noted that in the last 7 steps to the red object, the robot moved around the object (see Table 1) until the error is within the specified limit (5 mm in this case). The robot took 11 and 7 steps to move to the green and blue objects respectively. Images, taken when the robot is positioning on the objects, are shown in Fig 13 to demonstrate that the robot can complete the task. The PTP trajectory is defined in image space. a. Start position b. Positioning at red target c. Positioning at green target d. Positioning at blue target Fig 13. PTP in image space positioning results.
6 The task can be designed as connect the dots game to control the robot to follow the trajectory that is defined in image plane. The accuracy is also defined based on end point feedback directly. The control performance is less sensitive to the robot kinematic. Table 1 Trajectory relative to camera during positioning. Step Target position in image space Note x y z Start Fig 13a Red Pos Fig 13b Green Pos Fig 13c Blue Pos Fig 13d 9. Conclusion The Position based dynamic look and move is successfully implemented on the low cost Delta robot system that is driven by USB dynamixel motors with a visual feedback by a USB web cam camera. The motors are positioned control by dynamixel electronics with 1024 step per revolution. The Logitech Web Camera is operated in VGA mode at about 30 Hz refresh rate. The camera is rigidly fixed on the end effector but its position is not precisely known. The proposed Position based look and move that estimate the Jacobian in realtime is able to control the robot to position itself to the objects. The robot is successfully controlled PTP in image space. References [1] John J. Craig (1989), Introduction to ROBOTICS: mechanics and control, Addison-Wesley, USA. [2] V. Sangveraphunsiri, R. Chancharoen, A Hybrid Force/Visual Servo Control for Industrial Robots, JSA Spring Convention, [3] J. A. Piepmeier, G.V. McMurray, H. Lipkin, Uncalibrated Dynamic Visual Servoing, I Trans on ROBOTICS AND AUTOMATION, [4] A. Shademan, A. Farahmand, M. Jagersand, Robust Jacobian stimation for Uncalibrated Visual Servoing, I International Conference on Robotics and Automation, Alaska, USA, [5] Olsson, A. (2009). Modeling and Control of a Delta-3 robot, Lund University, Sweden. [6] J. Weijer, C. Schmid, Coloring Local Feature xtraction, The 9 th uropean conference on Computer Vision, [7] M. Sezgi, B. Sankur, Survey over image thresholding techniques and quantitative performance evaluation, Journal of lectronic Imaging 13(1), pp , [8] A. Ming, H. Ma, A blob detector in color images, The 6 th ACM international conference on Image and video retrieval, New York, USA, [9] F. Remondino, C. Fraser, DIGITAL CAMRA CALIBRATION MTHODS: CONSIDRATIONS AND COMPARISONS, Image ngineering and Vision Metrology, [10] C. S. Fraser, Invited Review Paper Digital camera selfcalibration, ISPRS Journal of Photogrammetry & Remote Sensing 52 (1997) [11] Z Zhang, Flexible camera calibration by viewing a plane from unknown orientations, The Proceedings of the 7 th I International Conference on Computer Vision, [12] J. Heikkilä O. Silvén, A Four-step Camera Calibration Procedure with Implicit Image Correction, Computer Vision and Pattern Recognition, [13] P. F. Sturm S. J. Maybank On Plane-Based Camera Calibration: A General Algorithm, Singularities, Applications, Computer Vision and Pattern Recognition, [14] S. Hutchinson, G. D. Hager, P. I. Corke, A tutorial on Visual Servo Control, I Trans on ROBOTICS AND AUTOMATION, [15] M.A. Laribi, L. Romdhane, S. Zeghloul, Analysis and dimensional synthesis of the DLTA robot for a prescribed workspace, Mechanism and Machine Theory 42 (2007) [16] P.J. Zsombor-Murray, Descriptive Geometric Kinematic Analysis of Clavel s Delta Robot, Centre of Intelligent Machines, McGill University [17] M Lopez, Castillo, G Garcıa, and A Bashir, Delta robot: inverse, direct, and intermediate Jacobians, Proceedings of the I MCH Part C Journal of Mechanical ngineering Science, Vol. 220, No. 1. (2006), pp [18] Miller, K., xperimental verification of modeling of DLTA robot dynamics by direct application of Hamilton's principle, I conference on Robotics and Automation, [19] M.A. Laribia, L. Romdhanea, and S. Zeghloulb, Analysis and dimensional synthesis of the DLTA robot for a prescribed workspace, Mechanism and Machine Theory 42 (2007) [20] Staicu, St., Dynamic analysis of Clavel's Delta parallel robot, I conference on Robotics and Automation, 2003.
Automatic Docking with Obstacle Avoidance of a Differential Wheel Mobile Robot
Automatic Docking with Obstacle Avoidance of a Differential Wheel Mobile Robot Warin Poomarin, Ratchatin Chancharoen, and Viboon Sangveraphunsiri Chulalongkorn University, Bangkok, Thailand Email: warren.rice.ca@gmail.com,
More informationRobot Vision Control of robot motion from video. M. Jagersand
Robot Vision Control of robot motion from video M. Jagersand Vision-Based Control (Visual Servoing) Initial Image User Desired Image Vision-Based Control (Visual Servoing) : Current Image Features : Desired
More informationProf. Fanny Ficuciello Robotics for Bioengineering Visual Servoing
Visual servoing vision allows a robotic system to obtain geometrical and qualitative information on the surrounding environment high level control motion planning (look-and-move visual grasping) low level
More informationMCE/EEC 647/747: Robot Dynamics and Control. Lecture 1: Introduction
MCE/EEC 647/747: Robot Dynamics and Control Lecture 1: Introduction Reading: SHV Chapter 1 Robotics and Automation Handbook, Chapter 1 Assigned readings from several articles. Cleveland State University
More informationLUMS Mine Detector Project
LUMS Mine Detector Project Using visual information to control a robot (Hutchinson et al. 1996). Vision may or may not be used in the feedback loop. Visual (image based) features such as points, lines
More informationTable of Contents. Chapter 1. Modeling and Identification of Serial Robots... 1 Wisama KHALIL and Etienne DOMBRE
Chapter 1. Modeling and Identification of Serial Robots.... 1 Wisama KHALIL and Etienne DOMBRE 1.1. Introduction... 1 1.2. Geometric modeling... 2 1.2.1. Geometric description... 2 1.2.2. Direct geometric
More informationRobot vision review. Martin Jagersand
Robot vision review Martin Jagersand What is Computer Vision? Computer Graphics Three Related fields Image Processing: Changes 2D images into other 2D images Computer Graphics: Takes 3D models, renders
More information1. Introduction 1 2. Mathematical Representation of Robots
1. Introduction 1 1.1 Introduction 1 1.2 Brief History 1 1.3 Types of Robots 7 1.4 Technology of Robots 9 1.5 Basic Principles in Robotics 12 1.6 Notation 15 1.7 Symbolic Computation and Numerical Analysis
More informationInverse Kinematics. Given a desired position (p) & orientation (R) of the end-effector
Inverse Kinematics Given a desired position (p) & orientation (R) of the end-effector q ( q, q, q ) 1 2 n Find the joint variables which can bring the robot the desired configuration z y x 1 The Inverse
More informationÉCOLE POLYTECHNIQUE DE MONTRÉAL
ÉCOLE POLYTECHNIQUE DE MONTRÉAL MODELIZATION OF A 3-PSP 3-DOF PARALLEL MANIPULATOR USED AS FLIGHT SIMULATOR MOVING SEAT. MASTER IN ENGINEERING PROJET III MEC693 SUBMITTED TO: Luc Baron Ph.D. Mechanical
More information10/25/2018. Robotics and automation. Dr. Ibrahim Al-Naimi. Chapter two. Introduction To Robot Manipulators
Robotics and automation Dr. Ibrahim Al-Naimi Chapter two Introduction To Robot Manipulators 1 Robotic Industrial Manipulators A robot manipulator is an electronically controlled mechanism, consisting of
More informationRobot mechanics and kinematics
University of Pisa Master of Science in Computer Science Course of Robotics (ROB) A.Y. 2016/17 cecilia.laschi@santannapisa.it http://didawiki.cli.di.unipi.it/doku.php/magistraleinformatica/rob/start Robot
More informationKinematic Synthesis. October 6, 2015 Mark Plecnik
Kinematic Synthesis October 6, 2015 Mark Plecnik Classifying Mechanisms Several dichotomies Serial and Parallel Few DOFS and Many DOFS Planar/Spherical and Spatial Rigid and Compliant Mechanism Trade-offs
More informationResearch Subject. Dynamics Computation and Behavior Capture of Human Figures (Nakamura Group)
Research Subject Dynamics Computation and Behavior Capture of Human Figures (Nakamura Group) (1) Goal and summary Introduction Humanoid has less actuators than its movable degrees of freedom (DOF) which
More informationCentre for Digital Image Measurement and Analysis, School of Engineering, City University, Northampton Square, London, ECIV OHB
HIGH ACCURACY 3-D MEASUREMENT USING MULTIPLE CAMERA VIEWS T.A. Clarke, T.J. Ellis, & S. Robson. High accuracy measurement of industrially produced objects is becoming increasingly important. The techniques
More informationProceedings of the 8th WSEAS Int. Conference on Automatic Control, Modeling and Simulation, Prague, Czech Republic, March 12-14, 2006 (pp )
Dynamic Learning-Based Jacobian Estimation for Pan-Tilt-Verge Head Control SILA SORNSUJITRA and ARTHIT SRIKAEW Robotics and Automation Research Unit for Real-World Applications (RARA) School of Electrical
More informationDesign of Visual Servo Robot Tracking System Based on Image Feature
3rd International Conference on Mechatronics, Robotics and Automation (ICMRA 2015) Design of Visual Servo Robot Tracking System Based on Image Feature Yue Guo 1,a, Xiaolan Yao 2,b, Wei Li 3,c 1, 2, 3 School
More informationChapter 1: Introduction
Chapter 1: Introduction This dissertation will describe the mathematical modeling and development of an innovative, three degree-of-freedom robotic manipulator. The new device, which has been named the
More informationRobot mechanics and kinematics
University of Pisa Master of Science in Computer Science Course of Robotics (ROB) A.Y. 2017/18 cecilia.laschi@santannapisa.it http://didawiki.cli.di.unipi.it/doku.php/magistraleinformatica/rob/start Robot
More informationKeeping features in the camera s field of view: a visual servoing strategy
Keeping features in the camera s field of view: a visual servoing strategy G. Chesi, K. Hashimoto,D.Prattichizzo,A.Vicino Department of Information Engineering, University of Siena Via Roma 6, 3 Siena,
More informationMCE/EEC 647/747: Robot Dynamics and Control. Lecture 3: Forward and Inverse Kinematics
MCE/EEC 647/747: Robot Dynamics and Control Lecture 3: Forward and Inverse Kinematics Denavit-Hartenberg Convention Reading: SHV Chapter 3 Mechanical Engineering Hanz Richter, PhD MCE503 p.1/12 Aims of
More informationResolution of spherical parallel Manipulator (SPM) forward kinematic model (FKM) near the singularities
Resolution of spherical parallel Manipulator (SPM) forward kinematic model (FKM) near the singularities H. Saafi a, M. A. Laribi a, S. Zeghloul a a. Dept. GMSC, Pprime Institute, CNRS - University of Poitiers
More informationDynamic Analysis of Manipulator Arm for 6-legged Robot
American Journal of Mechanical Engineering, 2013, Vol. 1, No. 7, 365-369 Available online at http://pubs.sciepub.com/ajme/1/7/42 Science and Education Publishing DOI:10.12691/ajme-1-7-42 Dynamic Analysis
More information3D Geometry and Camera Calibration
3D Geometry and Camera Calibration 3D Coordinate Systems Right-handed vs. left-handed x x y z z y 2D Coordinate Systems 3D Geometry Basics y axis up vs. y axis down Origin at center vs. corner Will often
More informationFully Automatic Endoscope Calibration for Intraoperative Use
Fully Automatic Endoscope Calibration for Intraoperative Use Christian Wengert, Mireille Reeff, Philippe C. Cattin, Gábor Székely Computer Vision Laboratory, ETH Zurich, 8092 Zurich, Switzerland {wengert,
More informationParallel Robots. Mechanics and Control H AMID D. TAG HI RAD. CRC Press. Taylor & Francis Group. Taylor & Francis Croup, Boca Raton London NewYoric
Parallel Robots Mechanics and Control H AMID D TAG HI RAD CRC Press Taylor & Francis Group Boca Raton London NewYoric CRC Press Is an Imprint of the Taylor & Francis Croup, an informs business Contents
More informationOn Evolving Fuzzy Modeling for Visual Control of Robotic Manipulators
On Evolving Fuzzy Modeling for Visual Control of Robotic Manipulators P.J.S. Gonçalves 1,2, P.M.B. Torres 2, J.R. Caldas Pinto 1, J.M.C. Sousa 1 1. Instituto Politécnico de Castelo Branco, Escola Superior
More informationProjector Calibration for Pattern Projection Systems
Projector Calibration for Pattern Projection Systems I. Din *1, H. Anwar 2, I. Syed 1, H. Zafar 3, L. Hasan 3 1 Department of Electronics Engineering, Incheon National University, Incheon, South Korea.
More informationA 3-D Scanner Capturing Range and Color for the Robotics Applications
J.Haverinen & J.Röning, A 3-D Scanner Capturing Range and Color for the Robotics Applications, 24th Workshop of the AAPR - Applications of 3D-Imaging and Graph-based Modeling, May 25-26, Villach, Carinthia,
More informationJane Li. Assistant Professor Mechanical Engineering Department, Robotic Engineering Program Worcester Polytechnic Institute
Jane Li Assistant Professor Mechanical Engineering Department, Robotic Engineering Program Worcester Polytechnic Institute We know how to describe the transformation of a single rigid object w.r.t. a single
More informationUNIVERSITY OF OSLO. Faculty of Mathematics and Natural Sciences
Page 1 UNIVERSITY OF OSLO Faculty of Mathematics and Natural Sciences Exam in INF3480 Introduction to Robotics Day of exam: May 31 st 2010 Exam hours: 3 hours This examination paper consists of 5 page(s).
More informationTracking of Human Body using Multiple Predictors
Tracking of Human Body using Multiple Predictors Rui M Jesus 1, Arnaldo J Abrantes 1, and Jorge S Marques 2 1 Instituto Superior de Engenharia de Lisboa, Postfach 351-218317001, Rua Conselheiro Emído Navarro,
More informationImage Based Visual Servoing Using Algebraic Curves Applied to Shape Alignment
The 29 IEEE/RSJ International Conference on Intelligent Robots and Systems October 11-15, 29 St. Louis, USA Image Based Visual Servoing Using Algebraic Curves Applied to Shape Alignment Ahmet Yasin Yazicioglu,
More informationDRC A Multi-Camera System on PC-Cluster for Real-time 3-D Tracking. Viboon Sangveraphunsiri*, Kritsana Uttamang, and Pongsakon Pedpunsri
The 23 rd Conference of the Mechanical Engineering Network of Thailand November 4 7, 2009, Chiang Mai A Multi-Camera System on PC-Cluster for Real-time 3-D Tracking Viboon Sangveraphunsiri*, Kritsana Uttamang,
More informationSelf-Calibration of a Camera Equipped SCORBOT ER-4u Robot
Self-Calibration of a Camera Equipped SCORBOT ER-4u Robot Gossaye Mekonnen Alemu and Sanjeev Kumar Department of Mathematics IIT Roorkee Roorkee-247 667, India gossayemekonnen@gmail.com malikfma@iitr.ac.in
More information[2] J. "Kinematics," in The International Encyclopedia of Robotics, R. Dorf and S. Nof, Editors, John C. Wiley and Sons, New York, 1988.
92 Chapter 3 Manipulator kinematics The major expense in calculating kinematics is often the calculation of the transcendental functions (sine and cosine). When these functions are available as part of
More informationWritten exams of Robotics 2
Written exams of Robotics 2 http://www.diag.uniroma1.it/~deluca/rob2_en.html All materials are in English, unless indicated (oldies are in Year Date (mm.dd) Number of exercises Topics 2018 07.11 4 Inertia
More informationThis week. CENG 732 Computer Animation. Warping an Object. Warping an Object. 2D Grid Deformation. Warping an Object.
CENG 732 Computer Animation Spring 2006-2007 Week 4 Shape Deformation Animating Articulated Structures: Forward Kinematics/Inverse Kinematics This week Shape Deformation FFD: Free Form Deformation Hierarchical
More informationPartial Calibration and Mirror Shape Recovery for Non-Central Catadioptric Systems
Partial Calibration and Mirror Shape Recovery for Non-Central Catadioptric Systems Abstract In this paper we present a method for mirror shape recovery and partial calibration for non-central catadioptric
More informationPin Hole Cameras & Warp Functions
Pin Hole Cameras & Warp Functions Instructor - Simon Lucey 16-423 - Designing Computer Vision Apps Today Pinhole Camera. Homogenous Coordinates. Planar Warp Functions. Motivation Taken from: http://img.gawkerassets.com/img/18w7i1umpzoa9jpg/original.jpg
More informationSIMULATION ENVIRONMENT PROPOSAL, ANALYSIS AND CONTROL OF A STEWART PLATFORM MANIPULATOR
SIMULATION ENVIRONMENT PROPOSAL, ANALYSIS AND CONTROL OF A STEWART PLATFORM MANIPULATOR Fabian Andres Lara Molina, Joao Mauricio Rosario, Oscar Fernando Aviles Sanchez UNICAMP (DPM-FEM), Campinas-SP, Brazil,
More informationControl of a Robot Manipulator for Aerospace Applications
Control of a Robot Manipulator for Aerospace Applications Antonella Ferrara a, Riccardo Scattolini b a Dipartimento di Informatica e Sistemistica - Università di Pavia, Italy b Dipartimento di Elettronica
More informationInverse Kinematics Analysis for Manipulator Robot With Wrist Offset Based On the Closed-Form Algorithm
Inverse Kinematics Analysis for Manipulator Robot With Wrist Offset Based On the Closed-Form Algorithm Mohammed Z. Al-Faiz,MIEEE Computer Engineering Dept. Nahrain University Baghdad, Iraq Mohammed S.Saleh
More informationSurvey on Visual Servoing for Manipulation
Survey on Visual Servoing for Manipulation Danica Kragic and Henrik I Christensen Centre for Autonomous Systems, Numerical Analysis and Computer Science, Fiskartorpsv. 15 A 100 44 Stockholm, Sweden {danik,
More informationCALCULATING TRANSFORMATIONS OF KINEMATIC CHAINS USING HOMOGENEOUS COORDINATES
CALCULATING TRANSFORMATIONS OF KINEMATIC CHAINS USING HOMOGENEOUS COORDINATES YINGYING REN Abstract. In this paper, the applications of homogeneous coordinates are discussed to obtain an efficient model
More informationAn Efficient Method for Solving the Direct Kinematics of Parallel Manipulators Following a Trajectory
An Efficient Method for Solving the Direct Kinematics of Parallel Manipulators Following a Trajectory Roshdy Foaad Abo-Shanab Kafr Elsheikh University/Department of Mechanical Engineering, Kafr Elsheikh,
More informationIntroduction to Robotics
Université de Strasbourg Introduction to Robotics Bernard BAYLE, 2013 http://eavr.u-strasbg.fr/ bernard Modelling of a SCARA-type robotic manipulator SCARA-type robotic manipulators: introduction SCARA-type
More informationA comparison between Position Based and Image Based Visual Servoing on a 3 DOFs translating robot
A comparison between Position Based and Image Based Visual Servoing on a 3 DOFs translating robot Giacomo Palmieri 1, Matteo Palpacelli 2, Massimiliano Battistelli 2 1 Università degli Studi e-campus,
More informationOutline. ETN-FPI Training School on Plenoptic Sensing
Outline Introduction Part I: Basics of Mathematical Optimization Linear Least Squares Nonlinear Optimization Part II: Basics of Computer Vision Camera Model Multi-Camera Model Multi-Camera Calibration
More informationIndustrial Robots : Manipulators, Kinematics, Dynamics
Industrial Robots : Manipulators, Kinematics, Dynamics z z y x z y x z y y x x In Industrial terms Robot Manipulators The study of robot manipulators involves dealing with the positions and orientations
More informationINTRODUCTION CHAPTER 1
CHAPTER 1 INTRODUCTION Modern mechanical and aerospace systems are often very complex and consist of many components interconnected by joints and force elements such as springs, dampers, and actuators.
More informationTheory of Robotics and Mechatronics
Theory of Robotics and Mechatronics Final Exam 19.12.2016 Question: 1 2 3 Total Points: 18 32 10 60 Score: Name: Legi-Nr: Department: Semester: Duration: 120 min 1 A4-sheet (double sided) of notes allowed
More informationNew shortest-path approaches to visual servoing
New shortest-path approaches to visual servoing Ville Laboratory of Information rocessing Lappeenranta University of Technology Lappeenranta, Finland kyrki@lut.fi Danica Kragic and Henrik I. Christensen
More informationCamera Models and Image Formation. Srikumar Ramalingam School of Computing University of Utah
Camera Models and Image Formation Srikumar Ramalingam School of Computing University of Utah srikumar@cs.utah.edu VisualFunHouse.com 3D Street Art Image courtesy: Julian Beaver (VisualFunHouse.com) 3D
More informationBasilio Bona ROBOTICA 03CFIOR 1
Kinematic chains 1 Readings & prerequisites Chapter 2 (prerequisites) Reference systems Vectors Matrices Rotations, translations, roto-translations Homogeneous representation of vectors and matrices Chapter
More informationCamera Calibration. Schedule. Jesus J Caban. Note: You have until next Monday to let me know. ! Today:! Camera calibration
Camera Calibration Jesus J Caban Schedule! Today:! Camera calibration! Wednesday:! Lecture: Motion & Optical Flow! Monday:! Lecture: Medical Imaging! Final presentations:! Nov 29 th : W. Griffin! Dec 1
More informationPin Hole Cameras & Warp Functions
Pin Hole Cameras & Warp Functions Instructor - Simon Lucey 16-423 - Designing Computer Vision Apps Today Pinhole Camera. Homogenous Coordinates. Planar Warp Functions. Example of SLAM for AR Taken from:
More informationAutonomous Sensor Center Position Calibration with Linear Laser-Vision Sensor
International Journal of the Korean Society of Precision Engineering Vol. 4, No. 1, January 2003. Autonomous Sensor Center Position Calibration with Linear Laser-Vision Sensor Jeong-Woo Jeong 1, Hee-Jun
More informationRobotics kinematics and Dynamics
Robotics kinematics and Dynamics C. Sivakumar Assistant Professor Department of Mechanical Engineering BSA Crescent Institute of Science and Technology 1 Robot kinematics KINEMATICS the analytical study
More informationStructure from motion
Structure from motion Structure from motion Given a set of corresponding points in two or more images, compute the camera parameters and the 3D point coordinates?? R 1,t 1 R 2,t R 2 3,t 3 Camera 1 Camera
More informationCOPYRIGHTED MATERIAL INTRODUCTION CHAPTER 1
CHAPTER 1 INTRODUCTION Modern mechanical and aerospace systems are often very complex and consist of many components interconnected by joints and force elements such as springs, dampers, and actuators.
More informationVisual Tracking of a Hand-eye Robot for a Moving Target Object with Multiple Feature Points: Translational Motion Compensation Approach
Visual Tracking of a Hand-eye Robot for a Moving Target Object with Multiple Feature Points: Translational Motion Compensation Approach Masahide Ito Masaaki Shibata Department of Electrical and Mechanical
More informationUAV Position and Attitude Sensoring in Indoor Environment Using Cameras
UAV Position and Attitude Sensoring in Indoor Environment Using Cameras 1 Peng Xu Abstract There are great advantages of indoor experiment for UAVs. Test flights of UAV in laboratory is more convenient,
More informationDIMENSIONAL SYNTHESIS OF SPATIAL RR ROBOTS
DIMENSIONAL SYNTHESIS OF SPATIAL RR ROBOTS ALBA PEREZ Robotics and Automation Laboratory University of California, Irvine Irvine, CA 9697 email: maperez@uci.edu AND J. MICHAEL MCCARTHY Department of Mechanical
More informationEE Kinematics & Inverse Kinematics
Electric Electronic Engineering Bogazici University October 15, 2017 Problem Statement Kinematics: Given c C, find a map f : C W s.t. w = f(c) where w W : Given w W, find a map f 1 : W C s.t. c = f 1
More informationMatlab Simulator of a 6 DOF Stanford Manipulator and its Validation Using Analytical Method and Roboanalyzer
Matlab Simulator of a 6 DOF Stanford Manipulator and its Validation Using Analytical Method and Roboanalyzer Maitreyi More 1, Rahul Abande 2, Ankita Dadas 3, Santosh Joshi 4 1, 2, 3 Department of Mechanical
More information10/11/07 1. Motion Control (wheeled robots) Representing Robot Position ( ) ( ) [ ] T
3 3 Motion Control (wheeled robots) Introduction: Mobile Robot Kinematics Requirements for Motion Control Kinematic / dynamic model of the robot Model of the interaction between the wheel and the ground
More informationFlexible Calibration of a Portable Structured Light System through Surface Plane
Vol. 34, No. 11 ACTA AUTOMATICA SINICA November, 2008 Flexible Calibration of a Portable Structured Light System through Surface Plane GAO Wei 1 WANG Liang 1 HU Zhan-Yi 1 Abstract For a portable structured
More informationFace Recognition At-a-Distance Based on Sparse-Stereo Reconstruction
Face Recognition At-a-Distance Based on Sparse-Stereo Reconstruction Ham Rara, Shireen Elhabian, Asem Ali University of Louisville Louisville, KY {hmrara01,syelha01,amali003}@louisville.edu Mike Miller,
More informationCamera calibration. Robotic vision. Ville Kyrki
Camera calibration Robotic vision 19.1.2017 Where are we? Images, imaging Image enhancement Feature extraction and matching Image-based tracking Camera models and calibration Pose estimation Motion analysis
More informationGeometric Modeling of Parallel Robot and Simulation of 3-RRR Manipulator in Virtual Environment
Geometric Modeling of Parallel Robot and Simulation of 3-RRR Manipulator in Virtual Environment Kamel BOUZGOU, Reda HANIFI EL HACHEMI AMAR, Zoubir AHMED-FOITIH Laboratory of Power Systems, Solar Energy
More informationAdvanced Vision Guided Robotics. David Bruce Engineering Manager FANUC America Corporation
Advanced Vision Guided Robotics David Bruce Engineering Manager FANUC America Corporation Traditional Vision vs. Vision based Robot Guidance Traditional Machine Vision Determine if a product passes or
More informationA COMPREHENSIVE SIMULATION SOFTWARE FOR TEACHING CAMERA CALIBRATION
XIX IMEKO World Congress Fundamental and Applied Metrology September 6 11, 2009, Lisbon, Portugal A COMPREHENSIVE SIMULATION SOFTWARE FOR TEACHING CAMERA CALIBRATION David Samper 1, Jorge Santolaria 1,
More informationANALYTICAL MODEL OF THE CUTTING PROCESS WITH SCISSORS-ROBOT FOR HAPTIC SIMULATION
Bulletin of the ransilvania University of Braşov Series I: Engineering Sciences Vol. 4 (53) No. 1-2011 ANALYICAL MODEL OF HE CUING PROCESS WIH SCISSORS-ROBO FOR HAPIC SIMULAION A. FRAU 1 M. FRAU 2 Abstract:
More informationMTRX4700 Experimental Robotics
MTRX 4700 : Experimental Robotics Lecture 2 Stefan B. Williams Slide 1 Course Outline Week Date Content Labs Due Dates 1 5 Mar Introduction, history & philosophy of robotics 2 12 Mar Robot kinematics &
More informationRigid Body Motion and Image Formation. Jana Kosecka, CS 482
Rigid Body Motion and Image Formation Jana Kosecka, CS 482 A free vector is defined by a pair of points : Coordinates of the vector : 1 3D Rotation of Points Euler angles Rotation Matrices in 3D 3 by 3
More informationREAL-TIME PHOTOGRAMMETRIC ALGORITHMS FOR ROBOT CALIBRATION J. Hefele
REAL-TIME PHOTOGRAMMETRIC ALGORITHMS FOR ROBOT CALIBRATION J. Hefele ifp, Institute for Photogrammetry, Geschwister-Scholl-Str. 24 70174 Stuttgart, Germany juergen.hefele@ifp.uni-stuttgart.de Commission
More informationθ x Week Date Lecture (M: 2:05p-3:50, 50-N202) 1 23-Jul Introduction + Representing Position & Orientation & State 2 30-Jul
θ x 2018 School of Information Technology and Electrical Engineering at the University of Queensland Lecture Schedule Week Date Lecture (M: 2:05p-3:50, 50-N202) 1 23-Jul Introduction + Representing Position
More informationRobotics 2 Visual servoing
Robotics 2 Visual servoing Prof. Alessandro De Luca Visual servoing! objective use information acquired by vision sensors (cameras) for feedback control of the pose/motion of a robot (or of parts of it)
More information3D Sensing. 3D Shape from X. Perspective Geometry. Camera Model. Camera Calibration. General Stereo Triangulation.
3D Sensing 3D Shape from X Perspective Geometry Camera Model Camera Calibration General Stereo Triangulation 3D Reconstruction 3D Shape from X shading silhouette texture stereo light striping motion mainly
More informationWritten exams of Robotics 1
Written exams of Robotics 1 http://www.diag.uniroma1.it/~deluca/rob1_en.php All materials are in English, unless indicated (oldies are in Year Date (mm.dd) Number of exercises Topics 2018 06.11 2 Planar
More informationLecture «Robot Dynamics»: Kinematic Control
Lecture «Robot Dynamics»: Kinematic Control 151-0851-00 V lecture: CAB G11 Tuesday 10:15 12:00, every week exercise: HG E1.2 Wednesday 8:15 10:00, according to schedule (about every 2nd week) Marco Hutter,
More informationEEE 187: Robotics Summary 2
1 EEE 187: Robotics Summary 2 09/05/2017 Robotic system components A robotic system has three major components: Actuators: the muscles of the robot Sensors: provide information about the environment and
More informationPerspective Projection Describes Image Formation Berthold K.P. Horn
Perspective Projection Describes Image Formation Berthold K.P. Horn Wheel Alignment: Camber, Caster, Toe-In, SAI, Camber: angle between axle and horizontal plane. Toe: angle between projection of axle
More informationVision Review: Image Formation. Course web page:
Vision Review: Image Formation Course web page: www.cis.udel.edu/~cer/arv September 10, 2002 Announcements Lecture on Thursday will be about Matlab; next Tuesday will be Image Processing The dates some
More informationThree-dimensional nondestructive evaluation of cylindrical objects (pipe) using an infrared camera coupled to a 3D scanner
Three-dimensional nondestructive evaluation of cylindrical objects (pipe) using an infrared camera coupled to a 3D scanner F. B. Djupkep Dizeu, S. Hesabi, D. Laurendeau, A. Bendada Computer Vision and
More information-SOLUTION- ME / ECE 739: Advanced Robotics Homework #2
ME / ECE 739: Advanced Robotics Homework #2 Due: March 5 th (Thursday) -SOLUTION- Please submit your answers to the questions and all supporting work including your Matlab scripts, and, where appropriate,
More informationSimulation-Based Design of Robotic Systems
Simulation-Based Design of Robotic Systems Shadi Mohammad Munshi* & Erik Van Voorthuysen School of Mechanical and Manufacturing Engineering, The University of New South Wales, Sydney, NSW 2052 shadimunshi@hotmail.com,
More informationDETC2000/MECH KINEMATIC SYNTHESIS OF BINARY ACTUATED MECHANISMS FOR RIGID BODY GUIDANCE
Proceedings of DETC ASME International Design Engineering Technical Conferences and Computers and Information in Engineering Conference Baltimore, Maryland, September -3, DETC/MECH-7 KINEMATIC SYNTHESIS
More informationReinforcement Learning for Appearance Based Visual Servoing in Robotic Manipulation
Reinforcement Learning for Appearance Based Visual Servoing in Robotic Manipulation UMAR KHAN, LIAQUAT ALI KHAN, S. ZAHID HUSSAIN Department of Mechatronics Engineering AIR University E-9, Islamabad PAKISTAN
More informationA simple example. Assume we want to find the change in the rotation angles to get the end effector to G. Effect of changing s
CENG 732 Computer Animation This week Inverse Kinematics (continued) Rigid Body Simulation Bodies in free fall Bodies in contact Spring 2006-2007 Week 5 Inverse Kinematics Physically Based Rigid Body Simulation
More informationFREE SINGULARITY PATH PLANNING OF HYBRID PARALLEL ROBOT
Proceedings of the 11 th International Conference on Manufacturing Research (ICMR2013), Cranfield University, UK, 19th 20th September 2013, pp 313-318 FREE SINGULARITY PATH PLANNING OF HYBRID PARALLEL
More informationCamera Models and Image Formation. Srikumar Ramalingam School of Computing University of Utah
Camera Models and Image Formation Srikumar Ramalingam School of Computing University of Utah srikumar@cs.utah.edu Reference Most slides are adapted from the following notes: Some lecture notes on geometric
More informationPSO based Adaptive Force Controller for 6 DOF Robot Manipulators
, October 25-27, 2017, San Francisco, USA PSO based Adaptive Force Controller for 6 DOF Robot Manipulators Sutthipong Thunyajarern, Uma Seeboonruang and Somyot Kaitwanidvilai Abstract Force control in
More informationKinematics of pantograph masts
Kinematics of pantograph masts B. P. Nagaraj, R. Pandiyan ISRO Satellite Centre, Bangalore, 560 017, India and Ashitava Ghosal Dept. of Mechanical Engineering, Indian Institute of Science, Bangalore 560
More informationHomogeneous Coordinates. Lecture18: Camera Models. Representation of Line and Point in 2D. Cross Product. Overall scaling is NOT important.
Homogeneous Coordinates Overall scaling is NOT important. CSED44:Introduction to Computer Vision (207F) Lecture8: Camera Models Bohyung Han CSE, POSTECH bhhan@postech.ac.kr (",, ) ()", ), )) ) 0 It is
More information6-dof Eye-vergence visual servoing by 1-step GA pose tracking
International Journal of Applied Electromagnetics and Mechanics 52 (216) 867 873 867 DOI 1.3233/JAE-16225 IOS Press 6-dof Eye-vergence visual servoing by 1-step GA pose tracking Yu Cui, Kenta Nishimura,
More informationModelling and index analysis of a Delta-type mechanism
CASE STUDY 1 Modelling and index analysis of a Delta-type mechanism K-S Hsu 1, M Karkoub, M-C Tsai and M-G Her 4 1 Department of Automation Engineering, Kao Yuan Institute of Technology, Lu-Chu Hsiang,
More informationAutonomous Floor Cleaning Prototype Robot Based on Image Processing
Autonomous Floor Cleaning Prototype Robot Based on Image Processing A.Charles, 1 PG Scholar, Kumaraguru College of Technology, Coimbatore, India Varunac1186@gmail.com Dr. Rani Thottungal, 2 Head of the
More informationCOLLISION-FREE TRAJECTORY PLANNING FOR MANIPULATORS USING GENERALIZED PATTERN SEARCH
ISSN 1726-4529 Int j simul model 5 (26) 4, 145-154 Original scientific paper COLLISION-FREE TRAJECTORY PLANNING FOR MANIPULATORS USING GENERALIZED PATTERN SEARCH Ata, A. A. & Myo, T. R. Mechatronics Engineering
More information