Just Renegade TikTok Skeleton Tracking App, a UGAHacks 5 submission. We developed a pseudo native app using Python and front-end web technologies. Users interact with a Selenium-controlled Chrome browser, which changes the text in an invisible paragraph tag to communicate with a Python script. This script controls the state of the game and even edits the DOM to display the video. We used the OpenPose library to detect poses, and using some clever math involving calculating angles between points of interest, we compared the user's video to the original video to score their accuracy. A result video with a skeleton tracking overlay is generated in addition to tons of json output data, upon which we conducted data analysis with Python scripts. All of this is then loaded with a Bootstrap/JQuery frontend and displayed as a webpage for the end user.
No fully live demo right now due to hackathon restrictions on development time but real-time data analysis and comparison can be implemented in the future.
Visit justrenegade.tech for a temporary video demonstration of the project.
-
OpenPose - Real-time multi-person keypoint detection library for body, face, hands, and foot estimation created and maintained by members of Carnegie Mellon University
-
Selenium - a portable framework for testing web applications; provides a playback tool for authoring functional tests without the need to learn a test scripting language
-
NumPy - a library for the Python programming language, adding support for large, multi-dimensional arrays and matrices, along with a large collection of high-level mathematical functions
-
Bootstrap - an open source toolkit for developing with HTML, CSS, and JS
-
JQuery - a JavaScript library designed to simplify HTML DOM tree traversal and manipulation, as well as event handling, CSS animation, and Ajax
-
TikTok - a video-sharing social networking service used to create short lip-sync, comedy, and talent videos
We did not have time to write documentation.
- Richard Red - OpenPose/OpenCV infrastructure, TikTok dance - richardred
- Sarah Yoo - Bootstrap frontend implementation - gayeonsarahyoo
- Kavin Phan - Basically everything - phan-kavin
- Kelly Tran - JQuery frontend design - kellytran3k
This project is licensed under the MIT License - see the License file for details