• Home
  • About
    • James Thesken photo

      James Thesken

      James' World

    • Learn More
    • Email
    • LinkedIn
    • Github
    • Youtube
  • Posts
    • All Posts
    • All Tags
  • Projects

How to: Running YOLO with DJI Video Feed

20 Jul 2018

Reading time ~1 minute

YOLO (You Only Look Once) is a powerful object detector that has come out in recent years. It would be really helpful to run on a drone for a lot of reasons that people are interested in: search and rescue, warehouse ops, robot helpers, etc. Also I wanted a chance to treat my thinkpad like a real field laptop. This is a simple way to do that using any DJI drone with a controller that outputs HDMI.

High tech surf/ramble mini-van.

Hardware Needed:

  • DJI Drone w/controller that outputs HDMI
  • Mini HDMI to HDMI adapter
  • HDMI USB capture device
  • PC

I was relieved to find a USB capture device with Linux support, not many do.

YOLO

With all the hardware the easy part is cloning a github repo and running the script. OpenCV is able to recognize the USB capture device as a webcam, so really any CV app that you could come up with could use this.

Get the script here. (Disclaimer: I did not write this script)
Go to settings in the DJI Go app and set the output to be shared with the HDMI port.

Real-time capable.

DONE.



dronesmachine-learning Share Tweet +1