Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

details about training and evaluate on the ActorsHQ dataset. #48

Open
liwenssss opened this issue Sep 5, 2024 · 4 comments
Open

details about training and evaluate on the ActorsHQ dataset. #48

liwenssss opened this issue Sep 5, 2024 · 4 comments

Comments

@liwenssss
Copy link

Hi, I tried your code on the ActorsHQ dataset (actors1/seq1). I used 46 cameras for training and 1 view for evaluation. My config settings are as follows:

train:
  dataset: MvRgbDatasetActorsHQ
  data:
    subject_name: actor01
    data_dir: /nfs/datasets/humanrf-dataset/tmp/actorshq/Actor01/Sequence1/
    frame_range: &id001
    - 48
    - 2177
    - 1
    used_cam_ids: [4, 5, 6, 7, 20, 21, 22, 23, 36, 37, 38, 39, 52, 53, 54, 55, 76, 77, 78, 79, 92, 93, 94, 95, 108, 109, 110, 111, 125, 126, 130, 131, 134, 135, 138, 139, 142, 143, 146, 147, 150, 151, 154, 155, 158, 159]
    load_smpl_pos_map: true

......

test:
  dataset: MvRgbDatasetActorsHQ
  data:
    data_dir: /nfs/datasets/humanrf-dataset/tmp/actorshq/Actor01/Sequence1/
    frame_range: *id001
    subject_name: actor01
  view_setting: camera 
  render_view_idx: 127
  global_orient: true
  img_scale: 1.0
  save_mesh: false
  render_skeleton: false
  save_tex_map: false
  save_ply: false
  n_pca: 20
  sigma_pca: 2.0
  prev_ckpt: ./results/actor01/avatar/batch_800000
model:
  with_viewdirs: true
  random_style: false

I tested all the 2129 frames under Cam128 (render_view_idx 127) and got the following results:

Count: 2129, PSNR: 28.642307322254315, SSIM: 0.922512511663277, LPIPS: 0.08213683989418678
The results seem a little lower than those in the paper. Is this normal?

@lizhe00
Copy link
Owner

lizhe00 commented Sep 7, 2024

We test on Cam127 and the 48-547 frames. Here is our results.

@liwenssss
Copy link
Author

Can you provide the training view index ? It seems that Cam127(view index 126) in the training camera list.

@lizhe00
Copy link
Owner

lizhe00 commented Sep 7, 2024

We evaluate training view reconstruction.

@liwenssss
Copy link
Author

We evaluate training view reconstruction.

Thanks. Can you provide your trained checkpoint files along with the training configuration files? I want to compare my experimental results with yours.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants