Should I give treatment to all people whose predict uplift is positive or just the portion which qini curve is ascending? #655
Ramlinbird
started this conversation in
General
Replies: 1 comment
-
With a qini curve, you're checking the quality of your uplift model's rankings against actual uplift values. If your check with actual values shows that the last X% of your population has negative lift, then you probably don't want to target them even if your model predicts positive lift for those observations. Models aren't perfect, so this is a check. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello, I use the causalml's plot_qini function to draw the qini curve of my dataframe, the result is below, (The dataframe contains control/treatment random-ab-test data)
![image](https://private-user-images.githubusercontent.com/11084132/259979845-68ee9984-ee79-422e-a8e6-beef0b79e865.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjM1NTc1MDIsIm5iZiI6MTcyMzU1NzIwMiwicGF0aCI6Ii8xMTA4NDEzMi8yNTk5Nzk4NDUtNjhlZTk5ODQtZWU3OS00MjJlLWE4ZTYtYmVlZjBiNzllODY1LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODEzVDEzNTMyMlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTQyMTI2MmE2OWIwOWM2MGU4NmE2ODZhY2NhMzQwOTQ4YWZmZjc4ZTViZWMwZGNkNDEyNzhiZjhhOTM2OTc4ODMmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.Z1tCAgJpVQGKK9aydxr7AlQnjAVqCaGT3Ri1KAZOpjM)
According to the curve, it seems that only the first 50% users with treatment is useful, and there is negative effect at the last.
But in the original predict uplift with treatment by the model, nearly 90% is larger than 0.
Should I chose the 90% or 30% to give the treatment? Thanks a lot.
Beta Was this translation helpful? Give feedback.
All reactions