Lecture 2: Reading and Evaluating Scientific Research (Introduction to Psychology)

Principles of Scientific Research

Objective vs. Subjective Measurement

Scientific research in psychology relies on the use of objective, valid, and reliable measurements to ensure the quality and credibility of findings.

• Objective Measurements: Data that are consistent across instruments and observers, minimizing personal bias.

• Subjective Measurements: Data influenced by personal feelings, interpretations, or prejudice.

• Operationalization of Variables: Defining variables in practical, measurable terms to allow for objective assessment.

Validity and Reliability

• Validity: The degree to which an instrument or procedure accurately measures what it is intended to measure.

• Reliability: The consistency of measurements across observations or over time.

Example: A bathroom scale that gives the same weight every time (reliable) but is off by 5 kg (not valid).

Accuracy	Reliability	Description
Poor	Poor	Measurements are scattered and not centered on the true value.
Poor	Good	Measurements are consistent but not centered on the true value.
Good	Poor	Measurements are centered but scattered.
Good	Good	Measurements are both consistent and centered on the true value.

Generalizability

Generalizability refers to the extent to which research findings can be applied to populations beyond the studied sample.

• Sample: A subset of individuals drawn from a larger population.

• Sampling: The process of selecting participants from the population.

• Sample Size: Larger samples generally increase generalizability, but representativeness is also crucial.

• Example: Using only psychology students as participants may limit the generalizability of findings to the broader population.

Reducing Bias in Research

Bias can distort research findings. Several techniques are used to minimize bias:

• Experimenter Bias: When a researcher's expectations influence the outcome.

• Participant Bias: When participants alter their behavior due to awareness of being studied (e.g., social desirability bias).

• Placebo Effect: Improvement in health or behavior not due to the treatment itself, but due to participants' expectations.

• Blinding: Single-blind and double-blind study designs help reduce both experimenter and participant bias.

• Anonymity and Confidentiality: Protecting participant identity to encourage honest responses.

Publication and Replication

Scientific findings are disseminated through publication in peer-reviewed journals. Replication and transparency are essential for scientific progress.

• Peer Review: The process by which other experts evaluate the quality and validity of research before publication.

• Replication Crisis: Many published findings fail to replicate, raising concerns about reliability in psychology.

• Publication Bias: The tendency for journals to publish positive results more frequently than negative or null results.

• Retraction: Withdrawal of published studies due to errors or misconduct.

Example: Retraction Watch tracks retracted scientific papers and highlights issues in scientific publishing.

Research Design

Overview of Research Design

Research design refers to the set of methods and procedures used to test hypotheses and answer research questions in psychology.

• Variables: Elements that can vary or change within a study (e.g., age, gender, treatment type).

• Subjects/Participants: Individuals who take part in the research study.

Descriptive Research

Descriptive research aims to describe characteristics or behaviors without manipulating variables.

• Qualitative Research: Involves non-numerical data, such as interviews, observations, or case studies.

• Quantitative Research: Involves numerical data and statistical analysis.

Example: Observing children in a playground to record types of play (qualitative), or counting the number of aggressive acts (quantitative).

Naturalistic Observation

Naturalistic observation involves unobtrusively observing subjects in their natural environment.

• Strengths: Provides data on real-world behavior without experimental manipulation.

• Limitations: Lack of control over variables; potential observer bias.

Example: Observing social interactions in a public park.

Correlational Research

Correlational research examines the relationship between two or more variables without manipulating them.

• Correlation Coefficient ($r$): A statistical measure ranging from $-1$ to $+1$ that indicates the strength and direction of a relationship.

• Positive Correlation: Both variables increase or decrease together.

• Negative Correlation: One variable increases as the other decreases.

• Limitation: Correlation does not imply causation.

Example: Height and weight are positively correlated, but correlation does not mean one causes the other.

Experimental Research

Experimental research tests causal hypotheses by manipulating an independent variable and measuring its effect on a dependent variable, while controlling for other factors.

• Independent Variable (IV): The variable that is manipulated by the researcher.

• Dependent Variable (DV): The variable that is measured to assess the effect of the IV.

• Control: Keeping other variables constant to isolate the effect of the IV.

Example: Testing whether a new teaching method (IV) improves test scores (DV) compared to a traditional method.

Summary Table: Types of Research Designs

Design Type	Main Purpose	Key Features
Descriptive	Describe characteristics or behaviors	No manipulation; qualitative or quantitative data
Correlational	Examine relationships between variables	No manipulation; uses correlation coefficient $r$
Experimental	Test causal hypotheses	Manipulation of IV; control of extraneous variables

Additional info: These notes expand on the brief points in the slides to provide definitions, examples, and context for key research concepts in psychology. The summary tables and explanations are inferred from standard introductory psychology curricula.