<p>Orchard automation, like automatic thinning and harvesting, requires robots understand the tree structure coherently. In this work, a vision system is developed for agricultural robot to detect tree branches under natural occlusions like leaves and fruits. Experiments illustrates the proposed vision system can detect complete branch with no noise.</p>