Skip to content

My experiments in lip reading using deep learning with the LRW dataset

Notifications You must be signed in to change notification settings

PingYufeng/lipreading-in-the-wild-experiments

 
 

Repository files navigation

lipreading-in-the-wild-experiments

This repository contains my experiments with lip reading using deep learning in Keras. I train and test on the LRW dataset.

process-lrw/

Codes to convert the videos in LRW Dataset to: - frames pertaining to words - mouth area of those frames - audio

Instructions are provided in README file in directory.

shape-predictor/

Directory to place the "shape_predictor_68_face_landmarks.dat" file, required by process-lrw and head-pose

image-retrieval/

Codes and files --- considering the lipreader as an image retrieval system

head-pose/

Codes and files --- to compute head pose in all frames in LRW dataset (extracted using process-lrw)

Head pose is determined using voletiv/deepgaze (my fork of deepgaze).

Instructions are provided in README file in directory.

About

My experiments in lip reading using deep learning with the LRW dataset

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%