{"id":3593,"date":"2018-09-11T20:05:30","date_gmt":"2018-09-11T20:05:30","guid":{"rendered":"https:\/\/athis-consulting.com\/news\/?p=3593"},"modified":"2018-10-12T10:31:00","modified_gmt":"2018-10-12T17:31:00","slug":"insect-inspired-vision-system-helps-drones-pass-through-small-gaps","status":"publish","type":"post","link":"https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/","title":{"rendered":"Insect-Inspired Vision System Helps Drones Pass Through Small Gaps"},"content":{"rendered":"<p>Bees\u00a0<a id=\"article\"><\/a> make this work through a sort of minimalist brute-force approach to the problem: They fly up to a small hole or gap, hover, wander back and forth a little bit to collect visual information about where the edges of the gap, and then steer themselves through. It\u2019s not fast, and it\u2019s not particularly elegant, but it\u2019s reliable and doesn\u2019t take much to execute.<\/p>\n<p>Reliable and not-taking-much to execute is one way to summarize the focus of the next generation of practical robotics\u2014in other words, robotic platforms that offer affordable real-world autonomy. The University of Maryland\u2019s Perception and Robotics Group has been working on\u00a0a system that allows a drone to fly through very small and completely unknown gaps\u00a0using just a single camera and onboard processing. And it\u2019s based on a bee-inspired strategy that yields a success rate of 85 percent.<\/p>\n<p>We\u2019ve posted before about\u00a0autonomous drones\u00a0flying through small gaps, but the big difference here is that in this case, the drone has no information about the location or size of the gap in advance. It doesn\u2019t need to build up any kind of 3D map of its environment or model of the gap, which is good because that would be annoying to do with a monocular camera. Instead, UMD\u2019s strategy is to \u201crecover a minimal amount of information that is sufficient to complete the task under consideration.\u201d<\/p>\n<p>To detect where the gap is, the drone uses an optical-flow technique. It takes a picture, moves a little bit, and then takes another picture. It identifies similar features in each picture, and thanks to parallax, the farther away features behind the gap will appear to have moved less than the closer features around the gap. The edges of the gap are the places where you\u2019ve got the biggest difference between the amount that features appear to have moved. And now that you know where all those things are, you can just zip right through!<\/p>\n<aside class=\"inlay pullquote xlrg\">To detect where the gap is, the drone uses an optical-flow technique. It takes a picture, moves a little bit, and then takes another picture. It then identifies similar features in each picture, and thanks to parallax, the farther away features behind the gap will appear to have moved less than the closer features around the gap. The edges of the gap are the places where you\u2019ve got the biggest difference between the amount that features appear to have moved.<\/aside>\n<aside><\/aside>\n<p>Or, almost. The other piece of this is using visual servoing to pass through the gap. Visual servoing is just using visual feedback to control motion: The drone takes a picture of the gap, moves forward, takes another picture, and then adjusts its movement to make sure that its position relative to the gap is still what it wants. This is different from a pre-planned approach, where the drone figures out in advance the entire path that it wants to take and then follows it\u2014visual servoing is more on the fly. Or, you know, on the bee.<\/p>\n<p>The UMD researchers tested this out with a\u00a0Bebop\u00a02 drone packing an\u00a0NVIDIA Jetson TX2 GPU. A variety of different gaps of varying sizes and shapes were cut in a foreground wall, which was covered in newspapers to give them some extra texture, and this is where we\u2019re obligated to point out that this technique probably won\u2019t work out if you\u2019re trying to fly through a gap in one white wall with another white wall on the other side. Anyway, as long as you\u2019ve got newspapered walls, this system works quite well, the researchers say: \u201cWe achieved a remarkable success rate of 85 percent over 150 trials for different arbitrary shaped windows under a wide range of conditions which includes a window with a minimum tolerance of just 5 cm.\u201d<\/p>\n<p>The maximum speed that the drone was able to achieve while passing through the gap was 2.5 m\/s, primarily constrained by the rolling shutter camera (which could mess up the optical flow at higher speeds), but again, this method isn\u2019t really intended for high performance drones. Having said that, the researchers do mention in the conclusion of their paper that \u201cIMU data can be coupled with the monocular camera to get a scale of the window and plan for aggressive maneuvers.\u201d So, hopefully we\u2019ll be seeing some of that in the near future.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Bees\u00a0 make this work through a sort of minimalist brute-force approach to the problem: They fly up to a small hole or gap, hover, wander back and forth a little bit to collect visual information about where the edges of the gap, and then steer themselves through. It\u2019s not fast, and it\u2019s not particularly elegant, [&hellip;]<\/p>\n","protected":false},"author":5,"featured_media":3595,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"video","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"amp_status":"","_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"Insect-Inspired Vision System Helps Drones Pass Through Small Gaps","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false}}},"categories":[208,357,349],"tags":[307,255,311],"jetpack_publicize_connections":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.8 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Insect-Inspired Vision System Helps Drones Pass Through Small Gaps - AthisNews<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Insect-Inspired Vision System Helps Drones Pass Through Small Gaps - AthisNews\" \/>\n<meta property=\"og:description\" content=\"Bees\u00a0 make this work through a sort of minimalist brute-force approach to the problem: They fly up to a small hole or gap, hover, wander back and forth a little bit to collect visual information about where the edges of the gap, and then steer themselves through. It\u2019s not fast, and it\u2019s not particularly elegant, [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/\" \/>\n<meta property=\"og:site_name\" content=\"AthisNews\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/AthisNews-271175647014395\/\" \/>\n<meta property=\"article:published_time\" content=\"2018-09-11T20:05:30+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2018-10-12T17:31:00+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/athis-technologies.com\/news\/wp-content\/uploads\/2018\/09\/MzEyOTQyMQ.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"1256\" \/>\n\t<meta property=\"og:image:height\" content=\"886\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Mickael Madjour\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@https:\/\/twitter.com\/MMickael82\" \/>\n<meta name=\"twitter:site\" content=\"@Athis_News\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Mickael Madjour\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/\",\"url\":\"https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/\",\"name\":\"Insect-Inspired Vision System Helps Drones Pass Through Small Gaps - AthisNews\",\"isPartOf\":{\"@id\":\"https:\/\/athis-technologies.com\/news\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/athis-technologies.com\/news\/wp-content\/uploads\/2018\/09\/MzEyOTQyMQ.jpeg\",\"datePublished\":\"2018-09-11T20:05:30+00:00\",\"dateModified\":\"2018-10-12T17:31:00+00:00\",\"author\":{\"@id\":\"https:\/\/athis-technologies.com\/news\/#\/schema\/person\/4e336579b063b8819b1c5bee603430a8\"},\"breadcrumb\":{\"@id\":\"https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/#primaryimage\",\"url\":\"https:\/\/athis-technologies.com\/news\/wp-content\/uploads\/2018\/09\/MzEyOTQyMQ.jpeg\",\"contentUrl\":\"https:\/\/athis-technologies.com\/news\/wp-content\/uploads\/2018\/09\/MzEyOTQyMQ.jpeg\",\"width\":1256,\"height\":886},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/athis-technologies.com\/news\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Insect-Inspired Vision System Helps Drones Pass Through Small Gaps\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/athis-technologies.com\/news\/#website\",\"url\":\"https:\/\/athis-technologies.com\/news\/\",\"name\":\"AthisNews\",\"description\":\"More than Words\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/athis-technologies.com\/news\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/athis-technologies.com\/news\/#\/schema\/person\/4e336579b063b8819b1c5bee603430a8\",\"name\":\"Mickael Madjour\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/athis-technologies.com\/news\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/athis-technologies.com\/news\/wp-content\/uploads\/2018\/09\/2u1pp9J__400x400-100x100.jpg\",\"contentUrl\":\"https:\/\/athis-technologies.com\/news\/wp-content\/uploads\/2018\/09\/2u1pp9J__400x400-100x100.jpg\",\"caption\":\"Mickael Madjour\"},\"description\":\"As an Expert in IT &amp; AI, Mickael brings fresh news about Emerging, Wearable Techs, and IT Innovation. He has 12+ years as a Software Engineer in IT and Telecom companies He is now contributor at Athis News.\",\"sameAs\":[\"https:\/\/athis-technologies.com\/news\/?author=5\",\"https:\/\/www.linkedin.com\/in\/mickael-madjour-3728a3307\/\",\"https:\/\/x.com\/https:\/\/twitter.com\/MMickael82\"],\"url\":\"https:\/\/athis-technologies.com\/news\/author\/mmickael\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Insect-Inspired Vision System Helps Drones Pass Through Small Gaps - AthisNews","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/","og_locale":"en_US","og_type":"article","og_title":"Insect-Inspired Vision System Helps Drones Pass Through Small Gaps - AthisNews","og_description":"Bees\u00a0 make this work through a sort of minimalist brute-force approach to the problem: They fly up to a small hole or gap, hover, wander back and forth a little bit to collect visual information about where the edges of the gap, and then steer themselves through. It\u2019s not fast, and it\u2019s not particularly elegant, [&hellip;]","og_url":"https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/","og_site_name":"AthisNews","article_publisher":"https:\/\/www.facebook.com\/AthisNews-271175647014395\/","article_published_time":"2018-09-11T20:05:30+00:00","article_modified_time":"2018-10-12T17:31:00+00:00","og_image":[{"width":1256,"height":886,"url":"https:\/\/athis-technologies.com\/news\/wp-content\/uploads\/2018\/09\/MzEyOTQyMQ.jpeg","type":"image\/jpeg"}],"author":"Mickael Madjour","twitter_card":"summary_large_image","twitter_creator":"@https:\/\/twitter.com\/MMickael82","twitter_site":"@Athis_News","twitter_misc":{"Written by":"Mickael Madjour","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/","url":"https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/","name":"Insect-Inspired Vision System Helps Drones Pass Through Small Gaps - AthisNews","isPartOf":{"@id":"https:\/\/athis-technologies.com\/news\/#website"},"primaryImageOfPage":{"@id":"https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/#primaryimage"},"image":{"@id":"https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/#primaryimage"},"thumbnailUrl":"https:\/\/athis-technologies.com\/news\/wp-content\/uploads\/2018\/09\/MzEyOTQyMQ.jpeg","datePublished":"2018-09-11T20:05:30+00:00","dateModified":"2018-10-12T17:31:00+00:00","author":{"@id":"https:\/\/athis-technologies.com\/news\/#\/schema\/person\/4e336579b063b8819b1c5bee603430a8"},"breadcrumb":{"@id":"https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/#primaryimage","url":"https:\/\/athis-technologies.com\/news\/wp-content\/uploads\/2018\/09\/MzEyOTQyMQ.jpeg","contentUrl":"https:\/\/athis-technologies.com\/news\/wp-content\/uploads\/2018\/09\/MzEyOTQyMQ.jpeg","width":1256,"height":886},{"@type":"BreadcrumbList","@id":"https:\/\/athis-technologies.com\/news\/video\/2018\/insect-inspired-vision-system-helps-drones-pass-through-small-gaps\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/athis-technologies.com\/news\/"},{"@type":"ListItem","position":2,"name":"Insect-Inspired Vision System Helps Drones Pass Through Small Gaps"}]},{"@type":"WebSite","@id":"https:\/\/athis-technologies.com\/news\/#website","url":"https:\/\/athis-technologies.com\/news\/","name":"AthisNews","description":"More than Words","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/athis-technologies.com\/news\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/athis-technologies.com\/news\/#\/schema\/person\/4e336579b063b8819b1c5bee603430a8","name":"Mickael Madjour","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/athis-technologies.com\/news\/#\/schema\/person\/image\/","url":"https:\/\/athis-technologies.com\/news\/wp-content\/uploads\/2018\/09\/2u1pp9J__400x400-100x100.jpg","contentUrl":"https:\/\/athis-technologies.com\/news\/wp-content\/uploads\/2018\/09\/2u1pp9J__400x400-100x100.jpg","caption":"Mickael Madjour"},"description":"As an Expert in IT &amp; AI, Mickael brings fresh news about Emerging, Wearable Techs, and IT Innovation. He has 12+ years as a Software Engineer in IT and Telecom companies He is now contributor at Athis News.","sameAs":["https:\/\/athis-technologies.com\/news\/?author=5","https:\/\/www.linkedin.com\/in\/mickael-madjour-3728a3307\/","https:\/\/x.com\/https:\/\/twitter.com\/MMickael82"],"url":"https:\/\/athis-technologies.com\/news\/author\/mmickael\/"}]}},"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/athis-technologies.com\/news\/wp-content\/uploads\/2018\/09\/MzEyOTQyMQ.jpeg","jetpack_shortlink":"https:\/\/wp.me\/p9Volu-VX","_links":{"self":[{"href":"https:\/\/athis-technologies.com\/news\/wp-json\/wp\/v2\/posts\/3593"}],"collection":[{"href":"https:\/\/athis-technologies.com\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/athis-technologies.com\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/athis-technologies.com\/news\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/athis-technologies.com\/news\/wp-json\/wp\/v2\/comments?post=3593"}],"version-history":[{"count":0,"href":"https:\/\/athis-technologies.com\/news\/wp-json\/wp\/v2\/posts\/3593\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/athis-technologies.com\/news\/wp-json\/wp\/v2\/media\/3595"}],"wp:attachment":[{"href":"https:\/\/athis-technologies.com\/news\/wp-json\/wp\/v2\/media?parent=3593"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/athis-technologies.com\/news\/wp-json\/wp\/v2\/categories?post=3593"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/athis-technologies.com\/news\/wp-json\/wp\/v2\/tags?post=3593"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}