Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kit_with_splits_2023.npz #1

Open
Stefano-retinize opened this issue Nov 1, 2024 · 7 comments
Open

kit_with_splits_2023.npz #1

Stefano-retinize opened this issue Nov 1, 2024 · 7 comments

Comments

@Stefano-retinize
Copy link

Hello.

I was interested in using this code for a dataset purpose but, can't find this file: C:\Users\karim\PycharmProjects\HumanML3D\kit_with_splits_2023.npz'

Thanks for your help @rd20karim

@rd20karim
Copy link
Owner

Hi @Stefano-retinize,
You can find it by following the processing requirements mentioned in the README, which will direct you to this project link section
then you can change the path to match your project path directory.

@Stefano-retinize
Copy link
Author

Sorry maybe I am doing something wrong, but the .npz file you can download from (https://drive.google.com/drive/folders/1zkJ4LnGV64Ne5ZlRy2aWH1sXcH_aVFF8) doesn't seem to be the same. As an example in your code: [Line 21] (

self.splits_ids = data["splits_ids"]
)

but there is no key ["splits_ids"] inside that .npy file either the key ['old_desc'].

Please Appreciate your help
Thanks

@rd20karim
Copy link
Owner

@Stefano-retinize

The link provided allows you to download the original KIT-ML version. In this work, I use an augmented version stored as kit_with_splits_2023.npz. To generate this file along with the corresponding corrected text annotations, please follow the steps here.

You can also refer to my detailed answer here.

For this project, you will only need the augmented version.

Feel free to ask if you have questions!

@Stefano-retinize
Copy link
Author

Stefano-retinize commented Nov 3, 2024

Hey @rd20karim thanks for your prompts answers. I think I am missing something, in the Link , there is no kit_with_splits_2023.npz file.

Thanks again!

@rd20karim
Copy link
Owner

rd20karim commented Nov 3, 2024

@Stefano-retinize

If you want to generate text based on your custom dataset (e.g., Mocap data), it needs to be converted to match the scale and format of either KIT-ML (21 joints) or HumanML3D (22 joints). The key 'all_motions' provides access to all motion samples, where each sample is a sequence of 3D coordinates (xyz) representing human skeleton joints. If you don’t have target text available, you can modify the code to generate predictions without performing quantitative evaluation.

The dataset loader scripts in the datasets folder should be updated accordingly.

You'll need to download the previous datasets to construct the vocabulary object. I recommend reviewing the entire discussion here.

The link is for downloading the raw KIT-ML data, which will need to be processed.

@Stefano-retinize
Copy link
Author

Oh If I am doing things right now, I think my confusion was because there is no build_dataset.py in this repo. And I couldn't see where it was telling me to run that in the readme actually. I go the .npz now.
I also had this error: ValueError: setting an array element with a sequence. The requested array has an inhomogeneous shape after 1 dimensions. The detected shape was (6016,) + inhomogeneous part
which I solved doing: kit_poses = np.array(kit_poses, dtype=object)

@rd20karim
Copy link
Owner

Yes, some of these errors and their solutions are mentioned in this discussion link
The steps mentioned in the other project should use their own files.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants