Dove-eye (3D object tracking) improvement
an invention by mkoutny
Updated over 5 years ago. 1 hackers ♥️.

See README for description of the Dove-eye project (poor man's Hawk-Eye).

The main goal is to make 2D object tracking from a single camera more stable, so that it's reliable for 3D localization.

Minor goal 1 is to extend calibration with definition of custom frame of reference.

Another minor (minor by importance, not difficulty) goal is to modify pipeline and GUI in such a way that it'll allow offline tracking (from video files) and frame-by-frame processing -- this might be prerequisite for making the 2D tracking work properly.

Update after Hackweek 13

  • naïve approach to tracking proved to work in simple setups only -> identified need for more sophisticated tracking
  • implemented video files tracking
  • implemented frame-by-frame processing
  • refactored Tracker code

Plan for Hackweek 14

Georg Nebehay published two very promising tracking algorithms OpenTLD and CMT. The plan is to compile these two in openSUSE (and learn some of packaging stuff) and see the announced result for myself. The next step is to integrate at least on of these tracking algorithms into Dove-eye. If time permits, it'd be nice to also to implement the minor goal 1 from previous HW.

Update after Hackweek 14

  • (not as much time spent as projected)
  • OpenTLD packaged for openSUSE distributions
  • integrated OpenTLD based tracker into Dove-eye
  • Dove-eye is now able to track a pendulum (on a desk, ~0.4 m long) quite reliably, the precision is not so great though (the bounding box changes size, is slightly moved -> noise)
  • this seems to be sufficient to move attention to data processing (and then perhaps back to tracking, tick-tock)

Looking for hackers with the skills:

opencv qt

This project is part of:

Hack Week 13 Hack Week 14

Activity

  • over 9 years ago: michal-m liked this project.
  • over 9 years ago: mkoutny added keyword "opencv" to this project.
  • over 9 years ago: mkoutny added keyword "qt" to this project.
  • almost 10 years ago: mkoutny started this project.
  • almost 10 years ago: mkoutny originated this project.


    • Comments

    • mkoutny
      over 9 years ago by mkoutny | Reply

      L&L presentation after HW14

    Similar Projects

    Create an Android app for Syncthing as part of the Syncthing Tray project by mkittler

    Description

    There's already an app but code/features already in Syncthing Tray could be reused to create a nicer app with additional features like managing ignore patterns more easily. The additional UI code for the app could then in turn be re-used by other parts of Syncthing Tray, e.g. to implement further steps in the wizard as requested by some users. This way one "UI wrapper codebase" could serve GNU/Linux, Windows and Android (and in theory MacOS) at the same time which is kind of neat.

    Goals

    • DONE: Learn more about development for Android and development of UIs with Qt Quick
    • DONE: Create an experimental app reusing as much existing Syncthing Tray code as possible
    • DONE: Build Syncthing as a library also for Android and use it in the app (already done but needs further testing and integration with the rest of the app configuration)
    • DONE: Update the Syncthing Tray website, documentation
    • DONE: Extend the app so it has at least a start page and an import
    • Update forum thread
    • DONE: Upload an experimental build on GitHub
    • Extend the Syncthing API to download single files on demand (instead of having to sync the whole directory or use ignore patterns)
    • Bring back parts of the newly developed mobile UI back to Syncthing Tray on the desktop to fully benefit from the cross-platform development
      • Add UI to add/edit folders and devices in desktop tray app
      • Add UI to show out-of-sync items in desktop tray app
      • Create an alternative "AppWindow" tailored for desktop platforms reusing UI components developed for the mobile app

    Resources

    • Android SDK/NDK and emulator
    • Qt Quick