You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The code below creates new 10 similarity features based on the location of the districts.
But it also uses the information of "median_house_value" as sample weight.
But isn't it kind of information leakage to the model?
The model is going to be trained on predicting the median house value and should NOT have any direct information about it.
The text was updated successfully, but these errors were encountered:
Using "median_house_value" as sample weight is nonsense because for prediction in the future it shouldn't be available.
On the other hand, the "median_income" feature instead would be adequate for sample weight.
In fact, the sample_weight option is used only for the demonstration of how to use ClusterSimilarity class and is ignored after that. There is therefore no information leakage during the training.
However, it is still misleading to use "median_house_value" as the value for sample_weight. Using instead "median_income" results in almost the same clustering.
This question is referring to the jupyter notebook of Chapter 2.
===
The code below creates new 10 similarity features based on the location of the districts.
But it also uses the information of
"median_house_value"
as sample weight.But isn't it kind of information leakage to the model?
The model is going to be trained on predicting the median house value and should NOT have any direct information about it.
The text was updated successfully, but these errors were encountered: