• Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to secondary sidebar
  • Skip to footer
  • DroneRacingLife
  • DroneFlyers
  • Newsletter
DroneLife

DRONELIFE

Stay up to date on all the latest Drone News

  • News
  • Products
  • Industries
    • Agriculture
    • Construction
    • Delivery
    • Dual Use
    • Inspection
    • Public Safety
    • Surveying
  • Enthusiasts
  • Regulations
  • Business
  • Video
  • Podcasts

Piloting a Drone With Eye-Tracking Glasses

September 26, 2018 by Malek Murison 3 Comments

With the steady improvement of autonomous flight modes and safety features from DJI and futuristic computer vision from the likes of Skydio, you might think that the way we pilot drones is only heading one way: to true autonomy. Also known as not really needing to pilot them at all.

As exciting as that might be for businesses seeking to automate operations, it doesn’t sound that fun. Fortunately, the prospect of wall to wall autonomy isn’t stopping researchers from developing new and intriguing ways for pilots to get behind to controls.

eye-tracking tech used to pilot drone

Read more: New Developer Platform Could Make Skydio R1 The Go-To Commercial Drone

Flying a drone with eye-tracking glasses

A team of researchers from across the United States is working on technology that could allow drone pilots to control their aircraft with their eyes and a pair of gaze-tracking glasses.

The concept is outlined in the paper ‘Human Gaze-Driven Spatial Tasking of an Autonomous MAV’, written by Liangzhe Yuan, Christopher Reardon, Garrett Warnell, and Giuseppe Loianno, from the University of Pennsylvania, U.S. Army Research Laboratory, and New York University.

The navigation system used by the researchers’ drone is self-contained and, importantly, takes instructions based on the user’s orientation. Standard drone controls will move the aircraft in response to its own orientation – if you tell a drone to move right with the controls, it will move to its right.

So this new system is something of a feat: it’s able to understand both the location and orientation of the drone and its pilot. And it does so without needing an external motion-capture system or GPS.

This is all achieved with some readily available hardware: Tobii Pro’s Glasses 2 are used to track the eye movements of the pilot. There are tons of applications for eye-tracking tech; these same glasses are commonly used in advertising and market research, assessing the subconscious attention of potential customers.

The glasses are plugged into an NVIDIA Jetson TX2 CPU and GPU. A deep neural network takes the incoming images from the glasses, crunches the numbers and is able to calculate how far away the drone is based on its perceived size.

From there it’s just a case of gazing at your chosen location. The glasses will translate that data into a vector for the drone.

The research team has ambitions for their system to one day provide inexperienced pilots with an easy way to pick up the controls (glasses) and fly. We’ll be sure to keep an eye out for more eye-tracking developments in the drone space.

Malek Murison
Malek Murison

Malek Murison is a freelance writer and editor with a passion for tech trends and innovation. He handles product reviews, major releases and keeps an eye on the enthusiast market for DroneLife.
Email Malek
Twitter:@malekmurison

Subscribe to DroneLife here.

Filed Under: Drone News Feeds, Enthusiasts, News, Technology Tagged With: Drone Pilots, eye control, eye-tracking, New York University, U.S. Army Research Laboratory, University of Pennsylvania

Reader Interactions

Trackbacks

  1. Even small drones, like a DJI Phantom, pose a risk to manned aircraft [video] | Drone "Ki" says:
    October 21, 2018 at 12:55 am

    […] With the steady improvement of autonomous flight modes and safety features from DJI and futuristic computer vision from the likes of Skydio, you might think that the way we pilot drones is only heading one way: to true autonomy. Also known as not really needing to pilot them at all. As exciting as that might […] The post Piloting a Drone With Eye-Tracking Glasses appeared first on DRONELIFE. See Original Article […]

    Reply
  2. AT&T and Dedrone Team Up on IoT Solution to Protect Against Malicious Drones | MUSIC 4 DRONES says:
    September 26, 2018 at 5:32 pm

    […] post Piloting a Drone With Eye-Tracking Glasses appeared first on […]

    Reply
  3. Piloting a Drone With Eye-Tracking Glasses - Drones Crunch says:
    September 26, 2018 at 2:54 pm

    […] DRONELIFE […]

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Primary Sidebar

LATEST

Draganfly Plans Local Drone Manufacturing Venture in the Philippines

Agreement with Philippine industrial group aims to combine Canadian drone technology with domestic production, maintenance, and support for industrial and…

Continue Reading Draganfly Plans Local Drone Manufacturing Venture in the Philippines

FAA Air Traffic Control Modernization: What It Means for Drones and Advanced Air Mobility

FAA leadership discussed plans to modernize air traffic control and support drone integration, days before a nationwide outage highlighted the…

Continue Reading FAA Air Traffic Control Modernization: What It Means for Drones and Advanced Air Mobility

Army Plans Drone Manufacturing Competition to Test U.S. Production Capacity

New Manufacturing Rodeo seeks affordable military drones and a production model that combines commercial innovation with Army manufacturing facilities. The…

Continue Reading Army Plans Drone Manufacturing Competition to Test U.S. Production Capacity

Camp Lejeune Turns Military Drones Into Tools for Firefighters and First Responders

Marine Corps base repurposes military drones to detect fires, assess hazards, and improve emergency response across its nearly 250-square-mile installation.…

Continue Reading Camp Lejeune Turns Military Drones Into Tools for Firefighters and First Responders

Chipotle and Zipline Deliver Burritos by Drone to PGA Tour Golfers

Drone delivery brings fresh meals to the 18th hole during a practice round in Austin, Texas Drone delivery reached a…

Continue Reading Chipotle and Zipline Deliver Burritos by Drone to PGA Tour Golfers

White House Puts Drone Security at the Top of Its Agenda

National Security Council official Sebastian Gorka calls for faster action, expanded training, and a greater role for local law enforcement.…

Continue Reading White House Puts Drone Security at the Top of Its Agenda

Ondas Reports 16-Fold Revenue Growth as Defense Drone Business Expands

Company reports $214 million in new orders, expands counter-drone operations, and targets $1.1 billion in revenue for 2027 Ondas Inc.…

Continue Reading Ondas Reports 16-Fold Revenue Growth as Defense Drone Business Expands

Hawaiian Electric Uses Cyberhawk Drones to Identify Power Line Problems Before They Spark Wildfires

Drone inspections across Hawaii Island, Maui County, and Oahu aim to detect damaged electrical equipment and reduce wildfire risks. by…

Continue Reading Hawaiian Electric Uses Cyberhawk Drones to Identify Power Line Problems Before They Spark Wildfires

FBI Plans to Triple Counter-Drone Training Capacity for State and Local Agencies

At a media roundtable during the Drone Security and SLTT Grant Forum, FBI officials discussed new counter-UAS authority, training requirements,…

Continue Reading FBI Plans to Triple Counter-Drone Training Capacity for State and Local Agencies

Agri Spray Plans Shift to U.S. Drone Manufacturing as Federal Restrictions Reshape the Market

Missouri-based agricultural drone company outlines five-year plan to replace foreign components and build a domestic supply chain. by DRONELIFE Features…

Continue Reading Agri Spray Plans Shift to U.S. Drone Manufacturing as Federal Restrictions Reshape the Market

Secondary Sidebar

Footer

SPONSORED

drone cleaning

Do Cleaning Drones Actually Work? 15 Apellix Before-and-After Jobs Show the Results

What Is the Best Commercial Cleaning Drone in 2026? Specs, Prices, and a Head-to-Head Comparison

Inspired Flight Gremsy IF800 VIO F1 drones geo week

What Will It Take to Strengthen U.S. Drone Manufacturing? A Conversation with Inspired Flight’s CEO

Global Mapper Mobile data collection

Collection Ground Control Points with Global Mapper Mobile

Military Drone Mapping Solutions

How SimActive’s Correlator3D™ is Revolutionizing Military Mapping: An Exclusive Interview with CEO Philippe Simard

Photogrammetry Accuracy Standards

SimActive Photogrammetry Software: Enabling Users to Meet Accuracy Standards for Over 20 Years

About Us | Contact Us | Advertise With Us | Write for Us | Privacy Policy | Terms of Service

The Trusted Source for the Business of Drones.

This website uses cookies and third party services. By clicking OK, you are agreeing to our privacy policy. ACCEPT

Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT