Using item-level analyses to better understand the consequences of partialing procedures: An example using the Dark Triad.

Partialing procedures are frequently used in psychological research. The present study sought to further explore the consequences of partialing, focusing on the replicability of partialing-based results.We used popular measures of the Dark Triad (DT; Machiavellianism, narcissism, and psychopathy) to explore the replicability of partialing procedures. We examined whether the residual content of popular DT scales is similar to the residual content of DT scales derived from separate samples based on relations with individual items from the IPIP-NEO-120, allowing for a finer-grained analysis of residual variable content.Profiles were compared using three sample sizes (Small N = 156-157, Moderate N = 313-314, Large N = 627-628) randomly drawn from a large MTurk sample (N = 1,255). There was low convergence between original and residual DT scales within samples. Additionally, results showed that the content of residual Dirty Dozen scales was not similar across samples. Comparable results were found for short Dark Triad-Machiavellianism, but only in the moderate and small samples.The results indicate that there are important issues that arise when using partialing procedures, including replicability issues surrounding residual variables. Reasons for the observed results are discussed and further research examining the replicability of residual-based results is recommended.