Skip to content

WWChen2310/eye_track_based_video_analyze_system

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 

Repository files navigation

此程式為一個基於眼動儀上的影片視覺行為分析系統,具有三個模組:「眼動紀錄模組」紀錄受測者的眼動行為並輸出、「動態AOI設置系統」分析影片並設置AOI檔案、「影片分析系統」結合前兩個模組的輸出檔案並用不同結果呈現。

DEMO影片:https://www.youtube.com/edit?video_id=w6y7CtC2mQ4&video_referrer=watch


環境設置:

將下載的opencv解壓縮至C槽,並設定環境變數path->新增路徑 C:\opencv\build\x86\MinGW32\bin


程式使用:

※在使用任何模組之前都先使用 File->Open Video 載入影片


一.眼動紀錄模組:
用來紀錄受測者的眼動資料,須配合眼動儀使用。

1.點選 Eye Movement Recorder Module

2.使用ctrl+L載入影片

3.使用ctrl+R調整視窗大小

4.使用ctrl+P播放/暫停影片

5.影片播放完成後,使用ctrl+O儲存眼動資料

6.使用ctrl+E關閉模組


二.動態AOI設置模組-自動AOI設置模式:

1. 點選 AOI setting Module -> AUTO Setting

2. 影片一開始會暫停在第一張frame,並自動框選"人物物件",同時使用者也可框選"非人物件"以供之後追蹤。

3. 按下"空白建"解除暫停並開始追蹤AOI,每格N張frame(目前是10張)做一次AOI追蹤並用"淡紫色"顯示結果(AOI位置),之後的frame並依照此模式追蹤,夾在兩兩追蹤間的frame由內插法算出位置,並用"藍色"顯示結果。

4. 影片播放至"場景變換"時,即會"暫停"在新段落的第一張frame並自動框選"人物物件",使用者也可框選"非人物件"(同2.),同時自動幫上一段落影片的AOI做結束(即自動儲存AOI最後的位置,不用在手動取消)。

5. 若AOI因追蹤偏差而須調整,則調整此AOI顯示"淡紫色"框時的frame,此frame後的追蹤皆會以調整的位置重新追蹤。

6. 此AUTO Mode也支援手動設置AOI,在框選出的AOI中點選"滑鼠中鍵",此AOI會顯示為"紅色",即為手動設置模式(此AOI不做追蹤)。

7. 鍵盤功能:

frame -1 +1 :v n
frame -10 +10 :f h
frame -100 +100 :r y
frame -N +N :a d

8. 可在選擇手動或自動的介面左上角落點選 interval 設定追蹤間隔 N (default N=10)


三.影片分析模組-多點與熱圖模式:

1. 點選 影片分析模組 -> 多點(熱圖)

2. 載入 AOI設置txt,眼動紀錄txt(複數),並開始撥放分析影片。

3. 影片播放完成後,輸出相關分析資料。

如有任合疑問 請聯絡 kxc0079@gmail.com

=============================================================================

This program is a video analysis system based on Eye-Tracking.

DEMO video here:https://www.youtube.com/edit?video_id=w6y7CtC2mQ4&video_referrer=watch

Environment setting:
Download opencv and extract it to disk C. Then add an path C:\opencv\build\x86\MinGW32\bin to environment parameter PATH.

How to use:

※Make sure to use File->load video to load a test video before using any module.

※Eye Movement Recorder Module(work with the eyetracking devices)
This module is used to record the subject's eye movement and output a txt file for the other module.

Click the button "Eye Movement Recorder" to use.

Functions:
ctrl+L: load the video
ctrl+R: resize the window
ctrl+P: play/pause the video
ctrl+O: save the eye movement data
ctrl+E: exit

※Dynamic AOI Module
This module provides the functionality of AOIs setting.
In "Dynamic AOI Module", it provides two AOI setting modes: "Manual setting mode" and "Automatic setting mode".
"Manual setting mode" provides user with using simple mouse operations to define the dynamic AOIs in the video.
"Automatic setting mode" applies face detection, object tracking and scene change detection to decrease the mouse operations, conveniently defining the dynamic AOIs in the video.
We could use these functions to define which moving objects as dynamic AOI in a video.

Click the button "Dynamic AOI module" to use.
The video will pause automatically while the sence changes.
When you need to define a new AOI, pause the video and use mouse to drag a rectangle.
You can change the frame interval to N(default N=10) from the interval button.

Functions:
space: play/pause the video
mouse drag: to create a new manual AOI
mouse mid click: change the AOI property between auto and manual
double click: cancle a AOI
v n: frame -1 +1
f h: frame -10 +10
r y: frame -100 +100
a d: frame -N +N

※Video Analyzer
"Video Analyzer" provides three visualization displaying modes - "Singular Spot mode", "Plural Spot mode", "Heat Map mode".
"Singular Spot mode" and "Plural Spot mode" provide video displaying which integrates the subject’s eye movementdata and the dynamic AOIs.
"Heat Map mode" provides video displaying which integrates the heat map of subject’s eye movement data.
In this replay, we can observe whether the subject see the key points (dynamic AOI) in the video.
In addition, all these modes could output simple statistical charts and detail fixation results.

Click the button "Video Analyzer" to use.
Chose the dynamic AOI file, eyemovement data you want to analyze in sequence. 

Anyproblem please contact kxc0079@gmail.com

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published