← All projects

PROJECT 021 / 102 · Marketing

Call duration leakage audit.

How much does unavailable call-duration information change retrospective model scores?

Focused analytical studyBank marketingExecuted notebook

THE RESULT

What the data shows

The largest computed metric is 0.5529 for Includes completed duration / Logistic regression; the smallest is 0.3158 for Pre-call / Prior baseline. Metric: average_precision (Average precision).

The duration variant is intentionally invalid for pre-call use. Any score increase illustrates an information-timing problem.

Call duration leakage audit — chart from the computed study output
Computed study output. Full values and units are available in the results download.
Computed results · 6 of 6 rows. Values rounded for display; source units and raw column names are retained in the download.
modelaccuracybalanced accuracymacro f1roc aucaverage precisionbrierinformationvariant
Prior baseline0.68420.50.40620.50.31580.2779Pre-callPre-call / Prior baseline
Logistic regression0.68060.52720.49060.66320.48180.2353Pre-callPre-call / Logistic regression
Random forest0.6830.50360.42140.6740.46410.2365Pre-callPre-call / Random forest
Prior baseline0.68420.50.40620.50.31580.2779Includes completed durationIncludes completed duration / Prior baseline
Logistic regression0.70280.56960.55870.75010.55290.2235Includes completed durationIncludes completed duration / Logistic regression
Random forest0.69410.52670.47210.76490.55250.2253Includes completed durationIncludes completed duration / Random forest
Download the complete result table ↓

THE METHOD

From source to answer

Paired comparison with identical chronological test rows and duration included only in the diagnostic variant.

The Python source exposes this study’s transformations. The complete project download includes shared preparation and evaluation routines.

EVALUATION

How the result was checked

First 80% of ordered observations train; final 20% test.

36,168Training observations
9,043Test observations

Fixed models; default decision threshold; no holdout tuning.

Target and input features

Target: subscribed

Inputs: contact, month, day, campaign, pdays, previous, poutcome

Download evaluation record ↓

THE NEXT DECISION

What follows from the finding

Reject duration from any pre-call model even if the retrospective score rises.

Where the conclusion stops

Observational marketing records do not identify campaign uplift. Month and row order are not precise timestamps; repeated-client identifiers are unavailable. Models are research diagnostics, not financial eligibility or automated contact decisions.

Related studies may reuse observations or holdouts. These are historical analyses; associations and backtests do not demonstrate commercial impact. Further model tuning needs new, untouched evaluation data.