Skip to main content

Understanding Multiple Regression Analysis Study Guide

A comprehensive guide to multiple regression analysis, covering its core concepts, how to assess model fit and significance, and essential diagnostic checks to ensure the validity of your statistical models. This guide is suitable for students and researchers in psychology, social sciences, and related fields.

Save this study guide to your study set

Sign up free

Your learning path

Individual Differences, Psychological Theory, and Constructs

Critical Thinking About Individual Differences

This lecture examines the distinction between intraindividual mechanisms and interindividual variation within experimental and differential psychology.

  • intraindividual mechanisms
  • interindividual variation
  • psychometrics
  • positive manifold
  • factor analysis
  • general factor g
  • reflective latent-variable interpretation
  • mutualism
  • Big Five personality dimensions
  • heritability h²
  • phenotypic variance
  • gene–environment interaction
  • reliability
  • validity
  • Simpson’s paradox
  • aggregation mistakes

Critical Thinking About Psychological Theory

A discussion on why theory is necessary, the importance of testable predictions, and the distinction between theory, research hypotheses, and statistical hypotheses.

  • Theory-ladenness
  • Equivocation
  • Theory crisis
  • Replication crisis
  • Affirming the consequent
  • Ad hoc hypotheses
  • Falsifiability
  • Corroboration
  • Parsimony
  • Postdiction
  • Descriptive adequacy
  • Precision and interpretability
  • Coherence and consistency
  • Constructs
  • Operationalization
  • Reliability and validity

Psychological Measurement and Construct Validation

This material examines the complexities of measurement models, including construct operationalization, jingle and jangle fallacies, and the limitations of self-report and Implicit Association Test scores.

  • construct
  • indicator
  • operationalization
  • measurement model
  • reliability
  • validity
  • conflation
  • jingle fallacy
  • jangle fallacy
  • social desirability
  • Implicit Association Test (IAT)
  • meter reading
  • researcher degrees of freedom

Causal Inference and Research Methodology

Causal Inference and Neuroscience Validity

This content explores causal reasoning, directed acyclic graphs, and the distinction between correlation and causation in neuroscience and observational studies.

  • Implicit measures
  • Reverse inference
  • Construct validation
  • Correlation vs causation
  • Counterfactual framework
  • Fundamental problem of causal inference
  • Directed acyclic graphs (DAGs)
  • Confounder
  • Mediator
  • Collider
  • Backdoor path
  • Collider bias
  • Selection bias
  • Randomization
  • Statistical control
  • Mill’s criteria
  • Reverse causation
  • Preemption
  • Overdetermination

Causal Reasoning and Research Methodology

This content examines probabilistic causation, statistical adjustment, and the distinction between qualitative and quantitative research approaches.

  • probabilistic causation
  • statistical adjustment
  • stratification
  • multiple regression
  • confounder
  • mediator
  • collider
  • methodolatry
  • hypothetico-deductive approach
  • inductive approach
  • abductive approach
  • nomothetic research
  • idiographic research
  • purposive sampling
  • theoretical sampling
  • random sampling
  • reflexivity
  • mediation
  • moderation
  • counterfactual reasoning

Multiple Regression, Mediation, Moderation, and Chi-Square

Multiple Regression Analysis and Model Diagnostics

Regression predicts a numerical outcome using one or more predictors while assessing model fit, assumptions, and hierarchical changes.

  • Multiple regression
  • Predictors
  • Intercept
  • Partial slope
  • Residuals
  • Ordinary least squares
  • Adjusted R-squared
  • Omnibus F-test
  • Hierarchical regression
  • R-squared change
  • Unstandardized b
  • Standardized beta
  • Linearity
  • Homoscedasticity
  • Heteroscedasticity
  • Normality
  • Independence
  • Multicollinearity
  • Variance inflation factor

Mediation Analysis and Linear Regression

Mediation investigates whether an X–Y association may operate through an intermediate variable M using regression paths and bootstrap confidence intervals.

  • Linear Regression
  • Mediation
  • Indirect effect
  • Direct effect
  • Total effect
  • Path coefficients
  • Bootstrap confidence intervals
  • Inconsistent mediation
  • Suppression
  • Causal assumptions
  • Confounding
  • Reverse causality
  • Full mediation
  • Partial mediation

Mediation and Moderation in Regression

Mediation proposes how a relation occurs while moderation asks when or for whom the relationship changes through an interaction term.

  • Mediation
  • Moderation
  • Interaction term
  • Direct, indirect and total effects
  • Simple slopes
  • Mean-centering
  • Multicollinearity
  • Binary moderator
  • Continuous moderators
  • Bootstrap CI
  • Main effects

Statistical Testing and Bayesian Inference

This topic covers chi-square tests of independence, moderation and mediation analysis, and Bayesian statistics including Bayes factors and model comparison.

  • Contingency tables
  • Expected and observed counts
  • Phi coefficient
  • Odds and odds ratios
  • Moderation and interaction effects
  • Mediation and indirect effects
  • Priors and likelihood
  • Posterior distribution
  • Bayesian credible intervals
  • Bayes factors
  • Model comparison
  • Standardized residuals
  • Effect size

Make it your own.

Keep these readings and topics in a new study set, or add them to one you already use.