Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extend GMM-MI to work with multivariate random variables, too #18

Open
wants to merge 14 commits into
base: main
Choose a base branch
from

Conversation

dpiras
Copy link
Owner

@dpiras dpiras commented Jul 24, 2023

As explained in #17

@dpiras
Copy link
Owner Author

dpiras commented Jul 24, 2023

We will wait to merge until we test this new feature against the results in Sui et al. (2023), as explained in #17. We will then update the Pypi version to 0.9.0, too. It might be useful to add a warning sating that these high-dimensional capabilities are not still fully tested.

@dpiras
Copy link
Owner Author

dpiras commented Oct 12, 2023

For now, we observe that when applying our estimator on data from Sui et al. (2023), we get consistent results, but crucially with the PS&BS estimates below the PS estimates for the pure signal and the thermal noise + foreground cases. We suspect this is due to either outliers in the PS features, or to the suboptimal choise of hyperparameters when fitting GMMs in such high dimensions (>50); however, so far we found no quick way to fix this. It might require more work, so for now we will search for other datasets to test the high-dimensional MI, and if possible we will test more hyperparameter configurations.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant