The aim of this project is the proposal of a real time vision system for its application within visual interaction environments through hand gesture recognition using an FPGA and a camera.
-
The project is based on the ALTERA DE2-115 FPGA kit and the TRDB-D5M camera.
-
The current repository includes the hardware files only, software files can be found at al-haitham software repo.
-
Check pdf/project-doc.pdf for more technical details and block diagrams.
-
The tracker detects :
- pink colors and outputs their (x,y) locations , as a demo we used these locations to control the mouse pointer in Ubuntu .
- pink + green as a left click.
- green only as a right click.
-
The results definitely need improvement (about ~0.5 fps) but it was basically a learning project and we wasted a lot of time messing with ALTERA glitchy tools, this project may act as a good base for others who want to quickly build up a working system and then start improving it.
Just clone the repo:
git clone https://github.com/aabdelfattah/alhaitham-hardware.git
-
Import the selected project from the repository to the local drive.
-
Open the project in Quartus II.
-
Open the SOPC builder project and build it.
-
Build the Quartus II project and program the hardware into the FPGA.
-
Import the software part(separate repository) of the project into a NIOS II IDE workplace.
That's it. Its ready to go.
Download the SOF to the DE2-115 , and run the software from NIOS II IDE .
- Fork project
- Add features
- Run tests
- Send pull request
See LICENSE file for details (note : the license applies for our contributions only , other modules by TERASIC and ALTERA have their separate licensing)