Advanced Technologies for Thinning of Tree Fruit -- Engineering Solutions Workshop, CMU

Size: px
Start display at page:

Download "Advanced Technologies for Thinning of Tree Fruit -- Engineering Solutions Workshop, CMU"

Transcription

1 Advanced Technologies for Thinning of Tree Fruit -- Engineering Solutions Workshop, CMU Paul Heinemann, Penn State Dept. of Ag & Biol. Engineering Tara Baugher, Penn State Extension

2 Multi-State Project WA IL PA CA MD WV SC

3 Partners involved: Penn State WSU UC-Davis Clemson U Maryland U Illinois USDA Extension Grower partners Other industry partners CMU (selective thinning)

4 Problem Statement Fruit thinning is a labor-intensive and expensive task; time and crew availability limitations often result in orchards not being thinned in an optimal way for maximum fruit quality

5 Why is fruit thinned? Crowding results in low quality, small fruit Thinning results in high quality, large fruit

6 Technology mechanized thinning Two levels of technology are being used for fruit thinning mechanization: Non-selective Selective

7 Non-selective thinners String thinners PT 250 Darwin 300

8 Drum shaker

9 Hand held string thinners From the Washington State investigators

10 Positioning issues

11 String thinner positioning making the work easier for the operator Two-tiered approach to controlled positioning Joystick control Sensor control

12 Joystick control E- Stop LED Indicator Lights Autonomy Controls Joystick for Tilt and Offset This is an interim step for providing easier manual positioning control

13 Controller adjusts the spindle accordingly Two degrees of motion: angle of spindle, lateral position of spindle

14 Modifications: Sonar sensors Thinner Moved to Rear SICK laser

15 hydraulics and controls added components: Lateral Offset Cylinder Tilt Cylinder Flow Divider Proportional Control Valves

16 Ultrasonic Sensing Arduino Microcontroller $65 4 Sonar Range Finders Maxbotix LV-MaxSonar-WR1 $100 Low Cost GPS USGlobalSat EM-406A GPS Module $60

17 Ultrasonically Sensed Position z Best Fit Line Sensor Distance Readings (dashed lines) x Orchard Row Sensor Mast y

18 Laser Sensing Trimble AG GPS 442 SICK LMS 120 Laser Rangefinder $ thousands

19 Automated positioning

20 Selective Thinning Select blossoms/small fruit to be removed for higher precision in thinning using machinery

21 Vision End effector Integrated unit Robotic arm Platform Components

22 Vision system Vision End effector Integrated unit Robotic arm Platform

23 Projected texture in : White Light 2010: Textured Light Credit: UC Davis 23

24 Xbox Kinect Credit: UC Davis 24

25 : Real-time acquisition Real-time Industrial Cameras Strobe Texture Illumination (reverse view camera ) Credit: UC Davis 25

26 Building the 3D Map of all Trees in a row from the Individual Sequences GPS (x,y,z) Lidar R-camera Θ Pattern strobe (or floodlight) VectorNAV (yaw,pitch, roll) L-camera Credit: UC Davis

27 Real-time 3D Tree and Blossom Mapping System GPS Lidar Right Camera Pattern Strobe Tilt Sensor Left Camera Credit: UC Davis 27

28 Normal Processing the LIDAR points Credit: UC Davis

29 3D StereoVision Blossom Mapping sec per image Credit: UC Davis 29

30 End effector Vision End effector Integrated unit Robotic arm Platform

31 Brush end effector fabricated Reuben Dise & David Lyons

32 End-Effector 2 nd Generation Brush End-Effector Improvements Electric powered Shorter Brushes Softer Brushes End-Effector 1st Generation Hand Gripper End-Effector

33 Brush end effector fabricated David Lyons

34 Counter-rotating brushes Open/close based on the position along branch

35 Robotics Vision End effector Integrated unit Robotic arm Platform

36 Could not gain external control of the Fanuc unit Fabricating components for lab unit

37 ¼ - scale robot designed and fabricated David Lyons

38 Results of Non-Selective Thinning Trials in 4 States New molded hollow cords tested in 2009

39 Before thinning Blossom Removal 35 to 50% After thinning

40 Follow-Up Hand Thinning $100 to $400/acre savings Hrs/ acre Treatments with different letters are significantly different at P=0.05

41 Flower Removal (%) California Molded Strings - 2 Rows - No Gaps - 2 mph y = 0.614x R 2 = y = 0.588x R 2 = y = 0.552x - 49 y = 0.788x - 82 R 2 = R 2 = 1 y = 0.588x R 2 = y = 0.528x R 2 = y = 0.436x R 2 = Spindle Rotation (rpm)

42 Percent Production South Carolina Fruit Size Distribution from Three Thinning Treatments in Nesstar Peaches Large Medium Control 220 rpm, 1.8 mph 200 rpm, 1.8mph Small

43 Washington

44 Pennsylvania % Flower Removal in Bloom Stage Trials

45 Pennsylvania % Flower Removal in Pruning Trials

46 Drum Shaker Trials - PA String thinner at bloom/drum shaker for green fruit thinning an effective combination New drum shaker at green fruit stage more consistent than previous citrus shaker prototypes Smaller rods, tilting drums, front or side-mount Tree damage still a problem

47 Thinning results from 2011 (controlled positioning) % blossoms thinned Upper canopy Lower canopy Scaffold Manually operated joystick 62.8 a 63.5 a 63.1 a Ultrasonic controlled positioning 49.7 a 35.4 b 43.7 b Laser controlled positioning 61.2 a 51.9 a 58.7 a Blossom density, flowers/cm 2 cross-sectional area Upper canopy Lower canopy Scaffold Manually operated joystick 3.9 a 1.3 a 3.6 a Ultrasonic controlled positioning 4.7 a 2.7 b 5.8 a Laser controlled positioning 4.7 a 1.9 a 4.8 a

48 Challenges and Limitations Non-selective thinners work well with stone fruit, but major challenges with pome fruit Selective thinning is an extremely complex task Locating branches, blossoms, 2-D and 3-D Mobility of robotic in field Cost of robotic approach Speed of activity

49 Economic Evaluations

50 Net Economic Impact Processing Peach Plantings $236 to $1490/acre Fresh Peach Plantings $185 to $934/acre Hand Thinned Blossom Thinned with String Thinner Labor savings and yield increases (due to larger fruit size) were of greater importance for canning peach growers Increased fruit size had a greater positive impact for fresh market producers

51 Technology Adoption Case Study Interviews 11 growers who had thinned a total of 154 acres Employees liked thinner - saved time/minimized ladder use Hand thinning completed earlier - more timely work in other crops 100% said hand thinning time reduced 80% said fruit were larger

52 Commercialization

53 Questions? Thank You! Funded by the USDA SCRI Program

The Pennsylvania State University. The Graduate School. Department of Agricultural and Biological Engineering

The Pennsylvania State University. The Graduate School. Department of Agricultural and Biological Engineering The Pennsylvania State University The Graduate School Department of Agricultural and Biological Engineering EXPERIMENTAL INVESTIGATION OF SELECTIVE AUTOMATED PEACH (PRUNUS PERSICA (L.) BATSCH) BLOSSOM

More information

IFAS Citrus Initiative Annual Research and Extension Progress Report Mechanical Harvesting and Abscission

IFAS Citrus Initiative Annual Research and Extension Progress Report Mechanical Harvesting and Abscission IFAS Citrus Initiative Annual Research and Extension Progress Report 2006-07 Mechanical Harvesting and Abscission Investigator: Dr. Tom Burks Priority Area: Robotic Harvesting Purpose Statement: The scope

More information

Ceilbot vision and mapping system

Ceilbot vision and mapping system Ceilbot vision and mapping system Provide depth and camera data from the robot's environment Keep a map of the environment based on the received data Keep track of the robot's location on the map Recognize

More information

Twin Master Combine. Electrical Systems Section 12. Electrical Systems ( ) Electrical Systems ( )

Twin Master Combine. Electrical Systems Section 12. Electrical Systems ( ) Electrical Systems ( ) Twin Master Combine Electrical Systems Section 2 Electrical Systems (2006 200)... 2-3 Electrical Systems (2008 204)... 4-5 Electrical Systems (205 Present)... 6- Return to this page by clicking the upper

More information

Vision-based Mobile Robot Localization and Mapping using Scale-Invariant Features

Vision-based Mobile Robot Localization and Mapping using Scale-Invariant Features Vision-based Mobile Robot Localization and Mapping using Scale-Invariant Features Stephen Se, David Lowe, Jim Little Department of Computer Science University of British Columbia Presented by Adam Bickett

More information

GETTING STARTED GUIDE

GETTING STARTED GUIDE GETTING STARTED GUIDE Trimble Variety Tracking System Introduction Getting the most out of the Trimble Variety Tracking system Preparing for installation Calibrating the system Recording varieties during

More information

CSE-571 Robotics. Sensors for Mobile Robots. Beam-based Sensor Model. Proximity Sensors. Probabilistic Sensor Models. Beam-based Scan-based Landmarks

CSE-571 Robotics. Sensors for Mobile Robots. Beam-based Sensor Model. Proximity Sensors. Probabilistic Sensor Models. Beam-based Scan-based Landmarks Sensors for Mobile Robots CSE-57 Robotics Probabilistic Sensor Models Beam-based Scan-based Landmarks Contact sensors: Bumpers Internal sensors Accelerometers (spring-mounted masses) Gyroscopes (spinning

More information

Lecture 19: Depth Cameras. Visual Computing Systems CMU , Fall 2013

Lecture 19: Depth Cameras. Visual Computing Systems CMU , Fall 2013 Lecture 19: Depth Cameras Visual Computing Systems Continuing theme: computational photography Cameras capture light, then extensive processing produces the desired image Today: - Capturing scene depth

More information

A Fruit Detection System and an End Effector for Robotic Harvesting of Fuji Apples

A Fruit Detection System and an End Effector for Robotic Harvesting of Fuji Apples 1 A Fruit Detection System and an End Effector for Robotic Harvesting of Fuji Apples D. M. Bulanon 1, T. Kataoka 2 1 Department of Agricultural and Biological Engineering, University of Florida, Gainesville,

More information

Watchmaker precision for robotic placement of automobile body parts

Watchmaker precision for robotic placement of automobile body parts FlexPlace Watchmaker precision for robotic placement of automobile body parts Staff Report ABB s commitment to adding value for customers includes a constant quest for innovation and improvement new ideas,

More information

Ch 22 Inspection Technologies

Ch 22 Inspection Technologies Ch 22 Inspection Technologies Sections: 1. Inspection Metrology 2. Contact vs. Noncontact Inspection Techniques 3. Conventional Measuring and Gaging Techniques 4. Coordinate Measuring Machines 5. Surface

More information

Sensor technology for mobile robots

Sensor technology for mobile robots Laser application, vision application, sonar application and sensor fusion (6wasserf@informatik.uni-hamburg.de) Outline Introduction Mobile robots perception Definitions Sensor classification Sensor Performance

More information

Are you looking for ultrafast and extremely precise stereovision technology for industrial applications? Learn about

Are you looking for ultrafast and extremely precise stereovision technology for industrial applications? Learn about Edition November 2017 Image sensors and vision systems, Smart Industries, imec.engineering Are you looking for ultrafast and extremely precise stereovision technology for industrial applications? Learn

More information

ME132 February 3, 2011

ME132 February 3, 2011 ME132 February 3, 2011 Outline: - active sensors - introduction to lab setup (Player/Stage) - lab assignment - brief overview of OpenCV ME132 February 3, 2011 Outline: - active sensors - introduction to

More information

with the Yield Monitoring System Quick Reference Card

with the Yield Monitoring System Quick Reference Card with the Yield Monitoring System Quick Reference Card Run screen When the Yield Monitoring plugin has been activated on the FmX integrated display, the Run screen appears. c j i d e f g h Item Description

More information

Project Title: Dense distributed environmental sensing via wireless sensor networks

Project Title: Dense distributed environmental sensing via wireless sensor networks CONTINUING PROJECT REPORT YEAR: 2 (2011) WTFRC Project Number: TR-09-909 Project Title: Dense distributed environmental sensing via wireless sensor networks PI: George Kantor Organization: Sensible Machines,

More information

Laboratory Assessment of Commercially Available Ultrasonic Rangefinders

Laboratory Assessment of Commercially Available Ultrasonic Rangefinders USAARL Report No. 2016-01 Laboratory Assessment of Commercially Available Ultrasonic Rangefinders By Michael Chen 1,2 Efrem Reeves 1,2 1 U.S. Army Aeromedical Research Laboratory 2 Laulima Government Solutions,

More information

Outline Sensors. EE Sensors. H.I. Bozma. Electric Electronic Engineering Bogazici University. December 13, 2017

Outline Sensors. EE Sensors. H.I. Bozma. Electric Electronic Engineering Bogazici University. December 13, 2017 Electric Electronic Engineering Bogazici University December 13, 2017 Absolute position measurement Outline Motion Odometry Inertial systems Environmental Tactile Proximity Sensing Ground-Based RF Beacons

More information

DEVELOPMENT OF REAL TIME 3-D MEASUREMENT SYSTEM USING INTENSITY RATIO METHOD

DEVELOPMENT OF REAL TIME 3-D MEASUREMENT SYSTEM USING INTENSITY RATIO METHOD DEVELOPMENT OF REAL TIME 3-D MEASUREMENT SYSTEM USING INTENSITY RATIO METHOD Takeo MIYASAKA and Kazuo ARAKI Graduate School of Computer and Cognitive Sciences, Chukyo University, Japan miyasaka@grad.sccs.chukto-u.ac.jp,

More information

ECGR4161/5196 Lecture 6 June 9, 2011

ECGR4161/5196 Lecture 6 June 9, 2011 ECGR4161/5196 Lecture 6 June 9, 2011 YouTube Videos: http://www.youtube.com/watch?v=7hag6zgj78o&feature=p layer_embedded Micro Robotics Worlds smallest robot - Version 1 - "tank" Worlds smallest robot

More information

Identification and Determination of the Number of Green Citrus Fruit under Different Ambient Light Conditions

Identification and Determination of the Number of Green Citrus Fruit under Different Ambient Light Conditions Identification and Determination of the Number of Green Citrus Fruit under Different Ambient Light Conditions Subhajit Sengupta a, Won Suk Lee b * a Computer and Information Science and Engineering, University

More information

Interaction with the Physical World

Interaction with the Physical World Interaction with the Physical World Methods and techniques for sensing and changing the environment Light Sensing and Changing the Environment Motion and acceleration Sound Proximity and touch RFID Sensors

More information

Remote Reality Demonstration

Remote Reality Demonstration Remote Reality Demonstration Terrance E. Boult EECS Dept., 19 Memorial Drive West Lehigh Univ., Bethlehem, PA 18015 tboult@eecs.lehigh.edu Fax: 610 758 6279 Contact Author: T.Boult Submission category:

More information

3D Laser Range Finder Topological sensor gathering spatial data from the surrounding environment

3D Laser Range Finder Topological sensor gathering spatial data from the surrounding environment Initial Project and Group Identification Document September 19, 2013 3D Laser Range Finder Topological sensor gathering spatial data from the surrounding environment Christian Conrose Jonathan Ulrich Andrew

More information

A RAPID PROTOTYPING DESIGN TOOL FOR PEAR HARVEST-AID PLATFORMS UTILIZING 3D FRUIT REACHABILITY AND KINEMATIC MODELING

A RAPID PROTOTYPING DESIGN TOOL FOR PEAR HARVEST-AID PLATFORMS UTILIZING 3D FRUIT REACHABILITY AND KINEMATIC MODELING A RAPID PROTOTYPING DESIGN TOOL FOR PEAR HARVEST-AID PLATFORMS UTILIZING 3D FRUIT REACHABILITY AND KINEMATIC MODELING Stavros Vougioukas 1, Rajkishan Arikapudi 1, David Slaughter 1, Rachel Elkins 2, Chuck

More information

ROBOT TEAMS CH 12. Experiments with Cooperative Aerial-Ground Robots

ROBOT TEAMS CH 12. Experiments with Cooperative Aerial-Ground Robots ROBOT TEAMS CH 12 Experiments with Cooperative Aerial-Ground Robots Gaurav S. Sukhatme, James F. Montgomery, and Richard T. Vaughan Speaker: Jeff Barnett Paper Focus Heterogeneous Teams for Surveillance

More information

Computer Vision. 3D acquisition

Computer Vision. 3D acquisition è Computer 3D acquisition Acknowledgement Courtesy of Prof. Luc Van Gool 3D acquisition taxonomy s image cannot currently be displayed. 3D acquisition methods Thi passive active uni-directional multi-directional

More information

Lesson 6 The Key Operation Procedures

Lesson 6 The Key Operation Procedures Lesson 6 The Key Operation Procedures Step-by-step procedures can keep you from having to memorize every function that you must perform on your CNC machining center. You will soon memorize procedures for

More information

Probabilistic Robotics

Probabilistic Robotics Probabilistic Robotics Probabilistic Motion and Sensor Models Some slides adopted from: Wolfram Burgard, Cyrill Stachniss, Maren Bennewitz, Kai Arras and Probabilistic Robotics Book SA-1 Sensors for Mobile

More information

EECS 4330/7330 Introduction to Mechatronics and Robotic Vision, Fall Lab 5. Controlling Puma Using Leap Motion Device

EECS 4330/7330 Introduction to Mechatronics and Robotic Vision, Fall Lab 5. Controlling Puma Using Leap Motion Device 1 Lab 5 Controlling Puma Using Leap Motion Device Objective In this experiment, students will use Leap Motion device to achieve the following goals: - Get familiar with the Leap Motion device - Experience

More information

Autonomous People Mover Phase II - Sensors P MSD 1 - FINAL DESIGN REVIEW

Autonomous People Mover Phase II - Sensors P MSD 1 - FINAL DESIGN REVIEW Autonomous People Mover Phase II - Sensors P15242 - MSD 1 - FINAL DESIGN REVIEW 1 The Team Member Role Program Nathan Biviano Project Manager & Integration IE Madeleine Daigneau Software Design & Hierarchy

More information

Oklahoma Economic Outlook 2015

Oklahoma Economic Outlook 2015 Oklahoma Economic Outlook 2015 by Dan Rickman Regents Professor of Economics and Oklahoma Gas and Electric Services Chair in Regional Economic Analysis http://economy.okstate.edu/ October 2013-2014 Nonfarm

More information

AUTONOMOUS MULTI-ROBOT MAPPING SYSTEM

AUTONOMOUS MULTI-ROBOT MAPPING SYSTEM -- Proposal AUTONOMOUS MULTI-ROBOT MAPPING SYSTEM ECE4007 Senior Design Project Section L01, The Cartel Group Brandon Chong, Team Leader David Esiobu Jonathan King Mark Nfodzo Christopher Pau Submitted

More information

Replacing expensive machine vision systems with low-cost 3D Time of Flight sensors in mobile robotics

Replacing expensive machine vision systems with low-cost 3D Time of Flight sensors in mobile robotics White paper PULUWHITE001 Replacing expensive machine vision systems with low-cost 3D Time of Flight sensors in mobile robotics Antti Alhonen, Pulu Robotics Oy, 2018 www.pulurobotics.fi Definitions Autonomous

More information

Sonar range sensor WiFi n

Sonar range sensor WiFi n Continuously rotating Pan and 100o Tilt Thermal Imaging Camera (option) On-board Peripherals:USB RS232 I2C SPI GPIO Laser Pointer 36x Optical Zoom / 12x Digital Zoom SONY Camera Front & Rear Drive Camera

More information

Outline of today s lecture. Proseminar Roboter und Aktivmedien Mobile Service Robot TASER. Outline of today s lecture.

Outline of today s lecture. Proseminar Roboter und Aktivmedien Mobile Service Robot TASER. Outline of today s lecture. Proseminar Roboter und Aktivmedien Mobile Service Robot TASER Lecturer Lecturer Houxiang Houxiang Zhang Zhang TAMS, TAMS, Department Department of of Informatics Informatics University University of of

More information

Robotics in Agriculture

Robotics in Agriculture Robotics in Agriculture The Australian Centre for Field Robotics is currently pursuing exciting research and development projects in agricultural robotics, which will have a large and long-term impact

More information

EASTERN LABS. Instructions Model RM /25/2007. Operation. Junction Box Assembly. Different Types of Switch Installations

EASTERN LABS. Instructions Model RM /25/2007. Operation. Junction Box Assembly. Different Types of Switch Installations EASTERN LABS Instructions Model RM-1205 04/25/2007 Operation Junction Box Assembly Different Types of Switch Installations Counter Mounting Suggestions Operation Total Counter Mix Counter Thru counter

More information

Robotic real-time 3D object reconstruction using multiple laser range finders

Robotic real-time 3D object reconstruction using multiple laser range finders Advances in Animal Biosciences: Precision Agriculture (ECPA) 2017, (2017), 8:2, pp 183 188 The Animal Consortium 2017 doi:10.1017/s2040470017001157 advances in animal biosciences Robotic real-time 3D object

More information

Equipment use workshop How to use the sweet-pepper harvester

Equipment use workshop How to use the sweet-pepper harvester Equipment use workshop How to use the sweet-pepper harvester Jochen Hemming (Wageningen UR) September-2014 Working environment robot Environmental conditions Temperature: 13 to 35 C Relative Humidity:

More information

THREE-DIMENSIONAL RECONSTRUCTION OF

THREE-DIMENSIONAL RECONSTRUCTION OF DAAAM INTERNATIONAL SCIENTIFIC BOOK 2016 pp. 059-068 Chapter 06 THREE-DIMENSIONAL RECONSTRUCTION OF THE TREE CANOPY FOR ASSESSMENT OF LEAFS BERK, P., STAJNKO, D., LAKOTA, M. & BELSAK, A. Abstract: A research

More information

DEVELOPMENT OF TELE-ROBOTIC INTERFACE SYSTEM FOR THE HOT-LINE MAINTENANCE. Chang-Hyun Kim, Min-Soeng Kim, Ju-Jang Lee,1

DEVELOPMENT OF TELE-ROBOTIC INTERFACE SYSTEM FOR THE HOT-LINE MAINTENANCE. Chang-Hyun Kim, Min-Soeng Kim, Ju-Jang Lee,1 DEVELOPMENT OF TELE-ROBOTIC INTERFACE SYSTEM FOR THE HOT-LINE MAINTENANCE Chang-Hyun Kim, Min-Soeng Kim, Ju-Jang Lee,1 Dept. of Electrical Engineering and Computer Science Korea Advanced Institute of Science

More information

Automation of wafer handling

Automation of wafer handling Project Report Automation of wafer handling ELECTRONIC DESIGN LAB DEPARTMENT OF ELECTRICAL ENGINEERING IIT BOMBAY Group Members: SHREYANS GANDHI 06D07005 ISHAN GAIKWAD 06D07013 PRADEEP GAIKWAD 06D07010

More information

ROBOT SENSORS. 1. Proprioceptors

ROBOT SENSORS. 1. Proprioceptors ROBOT SENSORS Since the action capability is physically interacting with the environment, two types of sensors have to be used in any robotic system: - proprioceptors for the measurement of the robot s

More information

Bumblebee2 Stereo Vision Camera

Bumblebee2 Stereo Vision Camera Bumblebee2 Stereo Vision Camera Description We use the Point Grey Bumblebee2 Stereo Vision Camera in this lab section. This stereo camera can capture 648 x 488 video at 48 FPS. 1) Microlenses 2) Status

More information

Runway Centerline Deviation Estimation from Point Clouds using LiDAR imagery

Runway Centerline Deviation Estimation from Point Clouds using LiDAR imagery Runway Centerline Deviation Estimation from Point Clouds using LiDAR imagery Seth Young 1, Charles Toth 2, Zoltan Koppanyi 2 1 Department of Civil, Environmental and Geodetic Engineering The Ohio State

More information

PLC Laboratories The Next Generation

PLC Laboratories The Next Generation Session 3548 PLC Laboratories The Next Generation James A. Rehg, Associate Professor, Pennsylvania State University Abstract Programmable Logic Controllers (PLCs) were a novelty in the automotive industry

More information

Electronic SD1, AS 8, ASR 14, ASR 20

Electronic SD1, AS 8, ASR 14, ASR 20 Electronic SD1, AS 8, ASR 14, ASR 20 2 Electronic SD1, AS 8, ASR 14, ASR 20 Contents Page List of contents..................................................... 3 Function and characteristics.........................

More information

IEEE SoutheastCon Hardware Challenge

IEEE SoutheastCon Hardware Challenge IEEE SoutheastCon Hardware Challenge Cameron McSweeney, Kendall Knapp Brian Roskuszka, Daniel Hofstetter May 2, 207 Advisors: Dr. Jing Wang, Dr. Yufeng Lu, Dr. In Soo Ahn 2 Task 3 - Bring Down the Shields

More information

Apple detection algorithm for robotic harvesting using a RGB-D camera

Apple detection algorithm for robotic harvesting using a RGB-D camera Ref: C0229 Apple detection algorithm for robotic harvesting using a RGB-D camera Abstract Tien Thanh Nguyen, Koenraad Vandevoorde, Erdal Kayacan, Josse De Baerdemaeker, Wouter Saeys MeBioS (Mechatronics,

More information

Stereo and structured light

Stereo and structured light Stereo and structured light http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2018, Lecture 20 Course announcements Homework 5 is still ongoing. - Make sure

More information

Mechanical simulation design of the shaft type hybrid mechanical arm based on Solidworks

Mechanical simulation design of the shaft type hybrid mechanical arm based on Solidworks International Forum on Energy, Environment and Sustainable Development (IFEESD 2016) Mechanical simulation design of the shaft type hybrid mechanical arm based on Solidworks Liu Yande1, a Hu Jun2,b Ouyang

More information

BOSSA NOVA TECHNOLOGIES,

BOSSA NOVA TECHNOLOGIES, SAMBA Hair System Objective measurement of parameters involved in the visual appearance of hair BOSSA NOVA TECHNOLOGIES, California Robert George - Sebastien Breugnot Company Overview Located in Los Angeles

More information

Smart Helmet. Group 22. Julian Bonnells. Jorge De Gouveia. Jeremy Reimers. Blake Scherschel

Smart Helmet. Group 22. Julian Bonnells. Jorge De Gouveia. Jeremy Reimers. Blake Scherschel Smart Helmet Group 22 Julian Bonnells CpE Jorge De Gouveia CpE Jeremy Reimers Blake Scherschel EE CpE Introduction Motivation In 2014, 92,00 motorcyclists were injured and 4,586 died in motorcycle related

More information

Experiment 9. Law of reflection and refraction of light

Experiment 9. Law of reflection and refraction of light Experiment 9. Law of reflection and refraction of light 1. Purpose Invest light passing through two mediums boundary surface in order to understand reflection and refraction of light 2. Principle As shown

More information

Last update: May 6, Robotics. CMSC 421: Chapter 25. CMSC 421: Chapter 25 1

Last update: May 6, Robotics. CMSC 421: Chapter 25. CMSC 421: Chapter 25 1 Last update: May 6, 2010 Robotics CMSC 421: Chapter 25 CMSC 421: Chapter 25 1 A machine to perform tasks What is a robot? Some level of autonomy and flexibility, in some type of environment Sensory-motor

More information

Table of Contents Data Management...1

Table of Contents Data Management...1 Table of Contents Data Management...1 3D Mapping...1 Different Types of Summary Data...4 Saving Raw Files out of SMS...7 Scaling Yield Data...8 Q: How do I format my data card for my monitor?...10 Shape

More information

On the basis of degree of freedom of the arm and the type of joints used, a robotic arm can have any of the following designs:

On the basis of degree of freedom of the arm and the type of joints used, a robotic arm can have any of the following designs: Available online at www.sciencedirect.com ScienceDirect Procedia Manufacturing 20 (2018) 400 405 www.elsevier.com/locate/procedia 2nd International Conference on Materials Manufacturing and Design Engineering

More information

Published Technical Disclosure. Camera-Mirror System on a Remotely Operated Vehicle or Machine Authors: Harald Staab, Carlos Martinez and Biao Zhang

Published Technical Disclosure. Camera-Mirror System on a Remotely Operated Vehicle or Machine Authors: Harald Staab, Carlos Martinez and Biao Zhang Background: Camera-Mirror System on a Remotely Operated Vehicle or Machine Authors: Harald Staab, Carlos Martinez and Biao Zhang This innovation relates to situational awareness for a remote operator of

More information

Tracking Under Low-light Conditions Using Background Subtraction

Tracking Under Low-light Conditions Using Background Subtraction Tracking Under Low-light Conditions Using Background Subtraction Matthew Bennink Clemson University Clemson, South Carolina Abstract A low-light tracking system was developed using background subtraction.

More information

Improving autonomous orchard vehicle trajectory tracking performance via slippage compensation

Improving autonomous orchard vehicle trajectory tracking performance via slippage compensation Improving autonomous orchard vehicle trajectory tracking performance via slippage compensation Dr. Gokhan BAYAR Mechanical Engineering Department of Bulent Ecevit University Zonguldak, Turkey This study

More information

Automatic Generation of Indoor VR-Models by a Mobile Robot with a Laser Range Finder and a Color Camera

Automatic Generation of Indoor VR-Models by a Mobile Robot with a Laser Range Finder and a Color Camera Automatic Generation of Indoor VR-Models by a Mobile Robot with a Laser Range Finder and a Color Camera Christian Weiss and Andreas Zell Universität Tübingen, Wilhelm-Schickard-Institut für Informatik,

More information

Camera Positioning System

Camera Positioning System Camera Positioning System Team 79 Members: Junjiao Tian, Jialu Li, and Weicheng Jiang Spring 2017 TA: John Capozzo Table of Contents 1 Introduction 1.1 Objective 1.2 Background 1.3 High-level requirement

More information

Autonomous Programming FTC Challenge Workshops VCU School of Engineering September 24, 2016 Presented by: Team 8297 Geared UP!

Autonomous Programming FTC Challenge Workshops VCU School of Engineering September 24, 2016 Presented by: Team 8297 Geared UP! Autonomous Programming 2016-2017 FTC Challenge Workshops VCU School of Engineering September 24, 2016 Presented by: Team 8297 Geared UP! Autonomous in VELOCITY VORTEX The Match starts with a 30 second

More information

Industrial Robots : Manipulators, Kinematics, Dynamics

Industrial Robots : Manipulators, Kinematics, Dynamics Industrial Robots : Manipulators, Kinematics, Dynamics z z y x z y x z y y x x In Industrial terms Robot Manipulators The study of robot manipulators involves dealing with the positions and orientations

More information

Advanced Driver Assistance Systems: A Cost-Effective Implementation of the Forward Collision Warning Module

Advanced Driver Assistance Systems: A Cost-Effective Implementation of the Forward Collision Warning Module Advanced Driver Assistance Systems: A Cost-Effective Implementation of the Forward Collision Warning Module www.lnttechservices.com Table of Contents Abstract 03 Introduction 03 Solution Overview 03 Output

More information

IP-S2 HD HD IP-S2. 3D Mobile Mapping System. 3D Mobile Mapping System

IP-S2 HD HD IP-S2. 3D Mobile Mapping System. 3D Mobile Mapping System HD HD 3D Mobile Mapping System 3D Mobile Mapping System Capture Geo-referenced, Time-Stamped Point Clouds and Imagery 3D Scanning of Roadside Features 360º Camera for Spherical Image Capture Dual Frequency

More information

Modules For Six Months Industrial Training On WIRELESS EMBEDDED SYSTEM DESIGN

Modules For Six Months Industrial Training On WIRELESS EMBEDDED SYSTEM DESIGN Modules For Six Months Industrial Training On WIRELESS EMBEDDED SYSTEM DESIGN 1 st Week Introduction to Embedded System a) Tool Hardware tool and Software tool b) Embedded designing, course study c) Board

More information

Depth Camera for Mobile Devices

Depth Camera for Mobile Devices Depth Camera for Mobile Devices Instructor - Simon Lucey 16-423 - Designing Computer Vision Apps Today Stereo Cameras Structured Light Cameras Time of Flight (ToF) Camera Inferring 3D Points Given we have

More information

Members. Team Members. Advisor. Mentor. Tim Sonnen Joe Carter Marshall Townsend Brian Gift Nathan Park Kierra Ryan Qinlin Xu. Dr.

Members. Team Members. Advisor. Mentor. Tim Sonnen Joe Carter Marshall Townsend Brian Gift Nathan Park Kierra Ryan Qinlin Xu. Dr. Discover Bot 1 Members Team Members Advisor Tim Sonnen Joe Carter Marshall Townsend Brian Gift Nathan Park Kierra Ryan Qinlin Xu Dr. Joel Perry Mentor Sarah Willis 2 Project Goal To develop a single-user

More information

Indoor Mobile Robot Navigation and Obstacle Avoidance Using a 3D Camera and Laser Scanner

Indoor Mobile Robot Navigation and Obstacle Avoidance Using a 3D Camera and Laser Scanner AARMS Vol. 15, No. 1 (2016) 51 59. Indoor Mobile Robot Navigation and Obstacle Avoidance Using a 3D Camera and Laser Scanner Peter KUCSERA 1 Thanks to the developing sensor technology in mobile robot navigation

More information

New Sony DepthSense TM ToF Technology

New Sony DepthSense TM ToF Technology ADVANCED MATERIAL HANDLING WITH New Sony DepthSense TM ToF Technology Jenson Chang Product Marketing November 7, 2018 1 3D SENSING APPLICATIONS Pick and Place Drones Collision Detection People Counting

More information

Southern Illinois University Edwardsville

Southern Illinois University Edwardsville Southern Illinois University Edwardsville 2014-2015 I certify that the design and engineering of the vehicle Roadrunner by the SIUE Team Roadrunner has been significant and equivalent to what might be

More information

Crop Progress. Corn Emerged - Selected States [These 18 States planted 92% of the 2016 corn acreage]

Crop Progress. Corn Emerged - Selected States [These 18 States planted 92% of the 2016 corn acreage] Crop Progress ISSN: 00 Released June, 0, by the National Agricultural Statistics Service (NASS), Agricultural Statistics Board, United s Department of Agriculture (USDA). Corn Emerged Selected s [These

More information

Next-Generation Monitoring and Control Hardware Development

Next-Generation Monitoring and Control Hardware Development Next-Generation Monitoring and Control Hardware Development George Kantor Carnegie Mellon University Robotics Institute, 5000 Forbes Ave Pittsburgh, PA 15217 kantor@cmu.edu David Kohanbash Carnegie Mellon

More information

Crop Progress. Corn Dough Selected States [These 18 States planted 92% of the 2017 corn acreage] Corn Dented Selected States ISSN:

Crop Progress. Corn Dough Selected States [These 18 States planted 92% of the 2017 corn acreage] Corn Dented Selected States ISSN: Crop Progress ISSN: 00 Released August, 0, by the National Agricultural Statistics Service (NASS), Agricultural Statistics Board, United s Department of Agriculture (USDA). Corn Dough Selected s [These

More information

Wall-Follower. Xiaodong Fang. EEL5666 Intelligent Machines Design Laboratory University of Florida School of Electrical and Computer Engineering

Wall-Follower. Xiaodong Fang. EEL5666 Intelligent Machines Design Laboratory University of Florida School of Electrical and Computer Engineering Wall-Follower Xiaodong Fang EEL5666 Intelligent Machines Design Laboratory University of Florida School of Electrical and Computer Engineering TAs: Tim Martin Josh Weaver Instructors: Dr. A. Antonio Arroyo

More information

Industrial Sections: 1.Robot Anatomy and Related Attributes 2.Robot Control Systems 3.End Effectors 4.Sensors in 5.Industrial Robot Applications 6.Robot Programming 7.Robot Accuracy and Repeatability Industrial

More information

Four Mainstream Reality Capture Tools* Optical GNSS (or more commonly GPS) Lidar. Photogrammetry 12/20/2015. Static Mobile Aerial

Four Mainstream Reality Capture Tools* Optical GNSS (or more commonly GPS) Lidar. Photogrammetry 12/20/2015. Static Mobile Aerial Four Mainstream Reality Capture Tools* Optical GNSS (or more commonly GPS) Lidar Static Mobile Aerial Photogrammetry UAV Collected Ground Collected 1 Optical Consists of three measurement devices H Angle,

More information

Sensor Modalities. Sensor modality: Different modalities:

Sensor Modalities. Sensor modality: Different modalities: Sensor Modalities Sensor modality: Sensors which measure same form of energy and process it in similar ways Modality refers to the raw input used by the sensors Different modalities: Sound Pressure Temperature

More information

New Sony DepthSense TM ToF Technology

New Sony DepthSense TM ToF Technology ADVANCED MATERIAL HANDLING WITH New Sony DepthSense TM ToF Technology Jenson Chang Product Marketing November 7, 2018 1 3D SENSING APPLICATIONS Pick and Place Drones Collision Detection People Counting

More information

Spring 2016 Final Exam

Spring 2016 Final Exam 16 311 Spring 2016 Final Exam Name Group Number Read all of the following information before starting the exam: You have 2hr and 0 minutes to complete this exam. When drawing paths, be sure to clearly

More information

An Innovative Image Processing Method Using Sum of Absolute Difference Algorithm For Real-time Military Applications

An Innovative Image Processing Method Using Sum of Absolute Difference Algorithm For Real-time Military Applications An Innovative Image Processing Method Using Sum of Absolute Difference Algorithm For Real-time Military Applications K.Kishore M.Tech Student, Dept of (ECE), Nova College of Engineering and Technology.

More information

A multilevel simulation framework for highly automated harvest processes enabled by environmental sensor systems

A multilevel simulation framework for highly automated harvest processes enabled by environmental sensor systems A multilevel simulation framework for highly automated harvest processes enabled by environmental sensor systems Jannik Redenius, M.Sc., Matthias Dingwerth, M.Sc., Prof. Dr. Arno Ruckelshausen, Faculty

More information

SIMULTANIOUS LOCALIZATION, MAPING AND SCENE RECONSTRUCTION

SIMULTANIOUS LOCALIZATION, MAPING AND SCENE RECONSTRUCTION DAAAM INTERNATIONAL SCIENTIFIC BOOK 2016 pp. 069-076 Chapter 07 SIMULTANIOUS LOCALIZATION, MAPING AND SCENE RECONSTRUCTION LEPEJ, P., LAKOTA, M., RAKUN, J. Abstract: This work describes an approach for

More information

for In-Vessel Inspection

for In-Vessel Inspection Advanced Visual Testing Technologies for In-Vessel Inspection Yoshinori i Satoh 1), Jun Suzuki 2), Toru Ootsubo 2) 1) Power and Industrial systems R&D Center, 2) Isogo Nuclear Engineering g Center, Power

More information

Advanced Reconstruction Techniques Applied to an On-Site CT System

Advanced Reconstruction Techniques Applied to an On-Site CT System 2nd International Symposium on NDT in Aerospace 2010 - We.1.A.4 Advanced Reconstruction Techniques Applied to an On-Site CT System Jonathan HESS, Markus EBERHORN, Markus HOFMANN, Maik LUXA Fraunhofer Development

More information

ME5286 Robotics Spring 2014 Quiz 1 Solution. Total Points: 30

ME5286 Robotics Spring 2014 Quiz 1 Solution. Total Points: 30 Page 1 of 7 ME5286 Robotics Spring 2014 Quiz 1 Solution Total Points: 30 (Note images from original quiz are not included to save paper/ space. Please see the original quiz for additional information and

More information

Advanced Vision Guided Robotics. David Bruce Engineering Manager FANUC America Corporation

Advanced Vision Guided Robotics. David Bruce Engineering Manager FANUC America Corporation Advanced Vision Guided Robotics David Bruce Engineering Manager FANUC America Corporation Traditional Vision vs. Vision based Robot Guidance Traditional Machine Vision Determine if a product passes or

More information

Georeferencing West Virginia DOT s Roadside Assets: An Asset Inventory Case Study. Geoff Dew April 13,

Georeferencing West Virginia DOT s Roadside Assets: An Asset Inventory Case Study. Geoff Dew April 13, : An Asset Inventory Case Study Geoff Dew April 13, 2010 General Project Scope 17,817 miles collected across all systems. System Type Delivered Miles 1 Interstates 1100.820 2 US Routes 2184.538 3 WV Routes

More information

Project Proposal Guide MATHWORKS TRACK Disclaimer:

Project Proposal Guide MATHWORKS TRACK Disclaimer: Project Proposal Guide MATHWORKS TRACK Disclaimer: The sample proposal below is to give an idea of how a proposal should be formatted. Our main objective is to illustrate the Design Methodology section

More information

Intelligent Outdoor Navigation of a Mobile Robot Platform Using a Low Cost High Precision RTK-GPS and Obstacle Avoidance System

Intelligent Outdoor Navigation of a Mobile Robot Platform Using a Low Cost High Precision RTK-GPS and Obstacle Avoidance System Intelligent Outdoor Navigation of a Mobile Robot Platform Using a Low Cost High Precision RTK-GPS and Obstacle Avoidance System Under supervision of: Prof. Dr. -Ing. Klaus-Dieter Kuhnert Dipl.-Inform.

More information

Introduction To Robotics (Kinematics, Dynamics, and Design)

Introduction To Robotics (Kinematics, Dynamics, and Design) Introduction To Robotics (Kinematics, Dynamics, and Design) SESSION # 5: Concepts & Defenitions Ali Meghdari, Professor School of Mechanical Engineering Sharif University of Technology Tehran, IRAN 11365-9567

More information

Goal of APPOLO APPOLO Objectives Establish and coordinate connections between end-users application laboratories equipment manufacturers Facilitate

Goal of APPOLO APPOLO Objectives Establish and coordinate connections between end-users application laboratories equipment manufacturers Facilitate 1 Lasers have been approved as a tool for diverse material processing. New application ideas, come from universities and research institutions, are implemented by spin-offs, but effective and low-cost

More information

Scan Times: PLC vs. PLuS

Scan Times: PLC vs. PLuS Scan Times: PLC vs. PLuS Programmable Logic Controllers (PLC s) and programmable limit switches such as the Electro Cam Corp. PLuS were developed to solve two different problems in the control of automated

More information

EE565:Mobile Robotics Lecture 3

EE565:Mobile Robotics Lecture 3 EE565:Mobile Robotics Lecture 3 Welcome Dr. Ahmad Kamal Nasir Today s Objectives Motion Models Velocity based model (Dead-Reckoning) Odometry based model (Wheel Encoders) Sensor Models Beam model of range

More information

Fire Bird V Insect - Nex Robotics

Fire Bird V Insect - Nex Robotics Fire Bird V Insect is a small six legged robot. It has three pair of legs driven by one servo each. Robot can navigate itself using Sharp IR range sensors. It can be controlled wirelessly using ZigBee

More information

TABLE OF CONTENTS. Page 2 35

TABLE OF CONTENTS. Page 2 35 TABLE OF CONTENTS INTRODUCTION... 3 WARNING SIGNS AND THEIR MEANINGS... 3 1. ABOUT THE PULSE ROBOT... 4 1.1. The hardware and software... 4 1.2. The operating states of the PULSE robot... 5 1.3. Safe operation

More information

Research Subject. Dynamics Computation and Behavior Capture of Human Figures (Nakamura Group)

Research Subject. Dynamics Computation and Behavior Capture of Human Figures (Nakamura Group) Research Subject Dynamics Computation and Behavior Capture of Human Figures (Nakamura Group) (1) Goal and summary Introduction Humanoid has less actuators than its movable degrees of freedom (DOF) which

More information

4D Crop Analysis for Plant Geometry Estimation in Precision Agriculture

4D Crop Analysis for Plant Geometry Estimation in Precision Agriculture 4D Crop Analysis for Plant Geometry Estimation in Precision Agriculture MIT Laboratory for Information & Decision Systems IEEE RAS TC on Agricultural Robotics and Automation Webinar #37 Acknowledgements

More information