This article discusses a method that performs gesture recognition, with the objective of extracting characteristics of the segmented hand, from dynamic images captured from a webcam and identifying signal patterns. With this method it is possible to manipulate simulated multirobots that perform specific movements. The method consists of the Continuously Adaptive Mean-SHIFT algorithm, followed by the Threshold segmentation algorithm and Deep Learning through Boltzmann restricted machines. As a result, an accuracy of 82.2%.