← All projects

PROJECT 022 / 102 · Marketing

Subscription probability calibration.

Do predicted probability bands match observed subscriptions on later records?

Focused analytical studyBank marketingExecuted notebook

THE RESULT

What the data shows

The largest computed metric is 0.3327 for (0.122, 0.184]; the smallest is 0.04992 for (0.0951, 0.102]. Metric: absolute_gap (Absolute calibration gap).

These are diagnostics on a previously defined test set, not a new independent experiment.

Subscription probability calibration — chart from the computed study output
Computed study output. Full values and units are available in the results download.
Computed results · 10 of 10 rows. Values rounded for display; source units and raw column names are retained in the download.
binnpredicted probabilityobserved rateabsolute gap
(0.00081, 0.0312]9050.023660.18670.1631
(0.0312, 0.0388]9040.03450.16480.1303
(0.0388, 0.0561]9040.047170.27540.2283
(0.0561, 0.0736]9120.06350.31910.2556
(0.0736, 0.0951]9480.087170.18990.1027
(0.0951, 0.102]8590.099090.1490.04992
(0.102, 0.122]8980.10960.25390.1443
(0.122, 0.184]9040.14410.47680.3327
(0.184, 0.41]9040.28960.60730.3177
(0.41, 0.926]9050.63360.53260.101
Download the complete result table ↓

THE METHOD

From source to answer

Reliability table for a fixed logistic model, with equal-frequency probability bins.

The Python source exposes this study’s transformations. The complete project download includes shared preparation and evaluation routines.

EVALUATION

How the result was checked

First 80% of ordered observations train; final 20% test.

36,168Training observations
9,043Test observations

Fixed models; default decision threshold; no holdout tuning.

Target and input features

Target: subscribed

Inputs: contact, month, day, campaign, pdays, previous, poutcome

Download evaluation record ↓

THE NEXT DECISION

What follows from the finding

Check calibration on new campaigns before interpreting probabilities as expected response rates.

Where the conclusion stops

Observational marketing records do not identify campaign uplift. Month and row order are not precise timestamps; repeated-client identifiers are unavailable. Models are research diagnostics, not financial eligibility or automated contact decisions.

Related studies may reuse observations or holdouts. These are historical analyses; associations and backtests do not demonstrate commercial impact. Further model tuning needs new, untouched evaluation data.