• Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to secondary sidebar
  • Skip to footer
  • DroneRacingLife
  • DroneFlyers
  • Newsletter
DroneLife

DRONELIFE

Stay up to date on all the latest Drone News

  • News
  • Products
  • Industries
    • Agriculture
    • Construction
    • Delivery
    • Dual Use
    • Inspection
    • Public Safety
    • Surveying
  • Enthusiasts
  • Regulations
  • Business
  • Video
  • Podcasts

Sense and Avoid for Drones is No Easy Feat

September 20, 2016 by Alan Phillips 9 Comments

But development is vibrant, and you’ll see it work first in prosumer drones

QuickTake

THE FACTS: “Sense and avoid” for drones is a popular topic in the press right now, but the phrase can mean different things in different contexts and for different people. To clarify, there is a difference between solving the problem of “sense” and solving the problem of “avoid.” Also, there is a difference between “airborne collision avoidance” (which is what most concerns the FAA) and “obstacle avoidance” (which is the problem that most manufacturers are trying to solve right now). With that in mind, this post looks at what a few manufacturers and software providers are doing to solve obstacle avoidance.

WHAT’S COOL AND WHAT’S NOT: DJI – DJI was one of the first to release a drone that could sense and avoid obstacles. In June 2015, they announced Guidance, a combination of ultrasonic sensors and stereo cameras that allow the drone to detect objects up to 65 feet (20 meters) away and stay away from objects at a preconfigured distance. The kit was immediately available for the Matrice 100 drone development platform. They subsequently incorporated that technology into their flagship Phantom 4 prosumer drone but not their new professional drone, the Matrice 600.

The Phantom 4 has front obstacle sensors combined with advanced computer vision and processing that allow it to react to and avoid obstacles in its path. The secret sauce for the Phantom 4’s ability to sense and avoid obstacles in real time and hover in a fixed position without a GPS signal is a set of specialized software algorithms for spatial computing and 3D depth sensing. These algorithms are coupled with an onboard Movidius vision processing unit (VPU) that gives the Phantom 4 drone the ability to sense and avoid obstacles in real time. In the “TapFly Mode” of the flight control program, the Phantom 4 obstacle sensing systems are supposed to enable you to fly a path with the drone automatically moving around objects as it flies. But you can find several real-world tests like this one that show it’s not a perfect system.

Intel – Intel is all over sense and avoid, and they accomplish it with active sensors. In 2015 at the Consumer Electronics Show (CES), they gave this sneak peek at what they were working on. In January 2016, they acquired German drone manufacturer Ascending Technologies (AscTec) and dazzled CES with an on-stage demo of their Intel® RealSense™ technology integrated into an AscTec drone that showcased how it can avoid obstacles and continue to follow the subject. They recently announced their Aero Ready-to-Fly Drone, a fully functional quadcopter powered by the Intel® Aero Compute Board, equipped with Intel® RealSense™ depth and vision capabilities and running an open-source Linux operating system. It is geared for developers, researchers, and UAV enthusiasts.

Image courtesy of Intel
Image courtesy of Intel

It’s clear Intel understands the importance of sense and avoid technology for ready-to-fly prosumer and commercial drones, too. In June 2016, Intel announced the addition of a factory-installed Intel RealSense R200 camera and an Intel Atom processor module for Yuneec’s Typhoon H. The module will map the Typhoon H’s surroundings in 3D, which it then uses to autonomously navigate its environment—including rerouting itself around obstacles. Yuneec’s Typhoon H camera drone already had the ability to stop itself before colliding into large objects. But now it should avoid obstacles and keep moving right around them. We’ll see if that comes true in the real world. Let’s hope it does. Otherwise Intel’s $60 million investment in Yuneec may show signs of not delivering the expected return.
Either way, Intel has hedged its bets. In July 2016, a team from Intel and Airbus demonstrated an aircraft visual inspection with a modified AscTec Falcon 8 with RealSense cameras. The demo took place during this week’s Farnborough International Airshow in England on an Airbus passenger airliner. Additionally, in September 2016, Intel acquired DJI’s VPU vendor Movidius, which means they may have the market cornered for sense-and-avoid technology.

Parrot – Parrot’s S.L.A.M.dunk integrates advanced software applications based on the robotic mapping construct called “simultaneous localization and mapping,” or SLAM. The name of Parrot’s solution is a play on the words “slam dunk,” but really it’s anything but that. SLAM is a computational problem of constructing or updating a map of an unknown environment while simultaneously keeping track of an agent’s location within it. Parrot’s use of SLAM enables a drone to understand and map its surroundings in 3D and to localize itself in environments with multiple barriers and where GPS signals are not available. In other words, it performs obstacle avoidance. Their solution depends on active sensors. You can read more here.

Neurala – Neurala is a software solution that analyzes the images from off-the-shelf cameras to enhance drone navigation. Unlike Parrot’s solution, Nueurla technology is passive. It uses GPU-based hardware running artificial intelligence neural network software. While commercial-grade GPS can fly a drone close to its objectives, Neurala software can help it identify safe areas to travel and land. At InterDrone, Neurala announced the launch of Bots Software Development Kit. The kit will allow manufacturers to install artificial-intelligence “neural” software directly into their applications without the need for additional hardware. That said, full collision avoidance is still under development.

LeddarTech – Leddar just announced its modular Vu8. The specs make it ideal for autonomous drone use. The Vu8 is a compact solid-state LiDAR sensor that detects targets at a range of up to 705 feet (or 215 meters) and weighs 75 grams. The Vu8 is an active sensor that “could be” used for collision avoidance, navigation, and as an altimeter for drones. According to LeddarTech, the Vu8 LiDAR is “immune to ambient light” and was designed to provide “highly accurate multi-target detection over eight independent segments.” There are some cool details in this video but no real-life use on a drone demo just yet.

BOTTOM LINE: At this time, the drone industry appears to be rich with R&D and solutions that attempt to tackle the obstacle avoidance problem. But a simple search on YouTube for successful real-world examples reveals we still have a way to go before anyone claims victory. I like what LeddarTech says:

Available drones sensing solutions for position and range measurements as well as for collision avoidance are still far from perfect: GPSs and barometers aren’t full-proof—even outdoors—and can’t be relied upon when navigating indoors. Ultrasonic altimeters have very limited range. Optical flow sensors require good lighting and textured surfaces, and camera vision are still a work in progress and tend to be processing-intensive.

As with any technology, there are always trade-offs. It’s still not clear to me who has the category-killing solution. I think that’s going to take more R&D investment. One thing is for sure—we’ll see more new sense-and-avoid product and tech announcements this year. Like with DJI, I believe it will continue to be released first in prosumer drones because that’s the only place where sales volumes and margins are strong enough to recoup the investment.

20140718_ColinSnow_0024_1x1_WebColin Snow is CEO and Founder of Skylogic Research, LLC (aka Drone Analyst®), a research, content, and advisory services firm for the commercial drone industry. Colin is a 25-year technology industry veteran with a background in market research, enterprise software, electronics, digital imaging, and mobility.

Alan Phillips
Alan Phillips

Alan is serial entrepreneur, active angel investor, and a drone enthusiast. He co-founded DRONELIFE.com to address the emerging commercial market for drones and drone technology. Prior to DRONELIFE.com, Alan co-founded Where.com, ThinkingScreen Media, and Nurse.com. Recently, Alan has co-founded Crowditz.com,  a leader in Equity Crowdfunding Data, Analytics, and Insights.  Alan can be reached at alan(at)dronelife.com

Filed Under: Colin Snow, Commentary, News, Technology Tagged With: DJI, drones, Intel, Parrot, Sense and Avoid, Yuneec

Reader Interactions

Comments

  1. zyvox online store money order says

    February 21, 2017 at 5:23 am

    It’s going to be ending of mine day, however before end I am reading this enormous piece of writing to increase my knowledge.

    Reply
  2. Raul says

    February 20, 2017 at 2:29 am

    I go to see everyday a few web sites and blogs
    to read content, but this website offers feature based writing.

    Reply
  3. Riccardo says

    December 15, 2016 at 4:34 pm

    Hi Colin,

    I would further discuss with you about the drones inability to sense and avoid (at least simple objects and following paths, not moving targets, for now) and especially the profit margins on commercial drones in the 30k-40k $ price.

    Every market analysis states that the commercial drones market is a 127B $ opportunity – overall – and many professional drones companies have already positive balances.

    Maybe you mean that the prosumer sector is the only one which can sustain an R&D for sense and avoid technologies to put inside a prosumer drone, which will be sold in millions of units?

    Reply
  4. Flyosk says

    November 14, 2016 at 6:49 pm

    We have a Yuneec Typhoon H Pro with RealSense and I was wondering what kind of real-world use does the mapping have? For example, would it be able to plot a route through obstacles that it flew through before when I flip it to Home mode?

    Reply

Trackbacks

  1. Why I Think the Prosumer Drone Will Never Die – Drone Newz says:
    June 12, 2017 at 9:42 pm

    […] and margins are strong enough for manufacturers to recoup R&D investment. As I wrote about in Sense and Avoid for Drones is No Easy Feat, you can see this trend now with obstacle avoidance […]

    Reply
  2. Why I Think the Prosumer Drone Will Never Die | AllDrones.com says:
    October 26, 2016 at 8:10 pm

    […] and margins are strong enough for manufacturers to recoup R&D investment. As I wrote about in Sense and Avoid for Drones is No Easy Feat, you can see this trend now with obstacle avoidance […]

    Reply
  3. The Prosumer Drone Will Never Die says:
    October 26, 2016 at 1:33 pm

    […] and margins are strong enough for manufacturers to recoup R&D investment. As I wrote about in Sense and Avoid for Drones is No Easy Feat, you can see this trend now with obstacle avoidance […]

    Reply
  4. The Prosumer Drone Will Never Die - DFW FlyBy PhotograpghyDFW FlyBy Photograpghy | Drone Services & Aerial Cinematography – FAA Approved says:
    October 24, 2016 at 5:19 am

    […] and margins are strong enough for manufacturers to recoup R&D investment. As I wrote about in Sense and Avoid for Drones is No Easy Feat, you can see this trend now with obstacle avoidance […]

    Reply
  5. YI Technology’s Erida — a Challenger to GoPro Karma? - DFW FlyBy PhotograpghyDFW FlyBy Photograpghy | Drone Services & Aerial Cinematography – FAA Approved says:
    September 26, 2016 at 9:37 am

    […] else in common. Neither integrate sense and avoid technology. (But as our guest contributor Colin Snow noted recently, that is no easy […]

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Primary Sidebar

LATEST

PG&E Automates BVLOS Drone Compliance with AirData: A Case Study

Pacific Gas and Electric (PG&E) is taking a major step forward in drone operations by automating compliance for Beyond Visual…

Continue Reading PG&E Automates BVLOS Drone Compliance with AirData: A Case Study

Pierce Aerospace and MITRE Partner to Advance Remote ID Research

Collaboration will enhance UAS remote identification, airspace safety, and homeland security capabilities Pierce Aerospace and MITRE Launch New Remote ID…

Continue Reading Pierce Aerospace and MITRE Partner to Advance Remote ID Research

Progress in BVLOS Rulemaking: A Turning Point for U.S. Commercial Drone Operations

After years of anticipation and industry advocacy, the U.S. is finally seeing movement on a federal rule that could transform…

Continue Reading Progress in BVLOS Rulemaking: A Turning Point for U.S. Commercial Drone Operations

AI-Driven UTM Deployed in North Texas to Monitor Drone Traffic

Canadian company launches Texas drone traffic management system By DRONELIFE Features Editor Jim Magill As drone traffic increases in the…

Continue Reading AI-Driven UTM Deployed in North Texas to Monitor Drone Traffic

ANRA Technologies Becomes First EASA-Certified U-space Service Provider

Milestone Achieved at Airspace World Marks Major Step Forward for Europe’s Drone Airspace Integration ANRA Secures First-Ever EASA Certification for…

Continue Reading ANRA Technologies Becomes First EASA-Certified U-space Service Provider

WarrenUAS Receives FAA Approval to Train Students on Large Drones

New exemption allows Warren County Community College to expand its advanced UAS training capabilities WarrenUAS, the unmanned systems training program…

Continue Reading WarrenUAS Receives FAA Approval to Train Students on Large Drones

Teledyne FLIR OEM Thermal by FLIR Collaborator AerialOGI Launches First Dual-use OGI Camera Module

New AerialOGI-N Enables Real-Time Detection of Gas Emissions by Hand or Drone Teledyne FLIR OEM and AerialOGI Unveil AerialOGI-N Teledyne…

Continue Reading Teledyne FLIR OEM Thermal by FLIR Collaborator AerialOGI Launches First Dual-use OGI Camera Module

Commercial Drone Alliance’s Lisa Ellman Calls for Restoring American Leadership in Drones at Industry Summit

Summit Opens Amid Policy Shifts and Market Changes At the Commercial Drone Innovation and Security Summit in Washington, D.C., Lisa…

Continue Reading Commercial Drone Alliance’s Lisa Ellman Calls for Restoring American Leadership in Drones at Industry Summit

Evolve Dynamics Unveils Foxe and Wolfe: New Miniature Drones for Defense Operations

UK Manufacturer Introduces New Military Drones: Rugged ISR Platforms Inspired by Battlefield Lessons and Built for Harsh Environments Evolve Dynamics…

Continue Reading Evolve Dynamics Unveils Foxe and Wolfe: New Miniature Drones for Defense Operations

DJI Mavic 4 Pro: Revolutionary Features, Rave Reviews, and U.S. Availability Challenges

DJI has officially unveiled the highly anticipated Mavic 4 Pro, a drone packed with groundbreaking features that are turning heads…

Continue Reading DJI Mavic 4 Pro: Revolutionary Features, Rave Reviews, and U.S. Availability Challenges

Secondary Sidebar

Footer

SPONSORED

Inspired Flight Gremsy IF800 VIO F1 drones geo week

What Will It Take to Strengthen U.S. Drone Manufacturing? A Conversation with Inspired Flight’s CEO

Global Mapper Mobile data collection

Collection Ground Control Points with Global Mapper Mobile

Military Drone Mapping Solutions

How SimActive’s Correlator3D™ is Revolutionizing Military Mapping: An Exclusive Interview with CEO Philippe Simard

Photogrammetry Accuracy Standards

SimActive Photogrammetry Software: Enabling Users to Meet Accuracy Standards for Over 20 Years

NACT Engineering Parrot ANAFI tether indoor shot

Smart Tether for Parrot ANAFI USA from NACT Engineering

Blue Marble, features global mapper, features Blue Marble

Check Out These New Features in Global Mapper v25 from Blue Marble

About Us | Contact Us | Advertise With Us | Write for Us | Privacy Policy | Terms of Service

The Trusted Source for the Business of Drones.

This website uses cookies and third party services. By clicking OK, you are agreeing to our privacy policy. ACCEPT

Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT