Graphics Group Presentation
University of Nebraska-Lincoln, Department of Statistics
2023-11-30
Cleveland and McGill (1984) conducted studies on elementary perceptual tasks (EPTs).
The experiments that Cleveland and McGill conducted focused on position, length, and angle.
Participants had to estimate the ratio between two measurements (10 ratios per graph).
Accuracy: Position > Length > Angle
The theory for volume comparisons was ranked low by Cleveland and McGill. Several studies show that people make less accurate judgments using 3D graphs than 2D graphs (Barfield and Robless 1989; Zacks et al. 1998).
These studies focus on the projection of 3D graphs on 2D surfaces!
What would happen if we use true 3D dimensional graphs?
Partially replicate Cleveland and McGill using similar graphs and ratio comparisons.
Sample size of around 40 participants, consisting of members of the UNL department of statistics and their adult roommates.
The overall goal is to assess how students learn about the statistical process by participating in an experiment through a series of reflections.
Our sample consists of 23 STAT 218 online students from the July-August summer session of 2023 (most students completed every reflection).
What do you think the purpose of the experiment was?
What hypotheses might the experimenter have been testing?
What sources of error are involved in this experiment?
What variables were examined? For each variable, identify whether it was quantitative or categorical.
What elements of experimental design, such as randomization or the use of a control group, do you think were present in the experiment? Why?
What do you think the purpose of the experiment was?
What hypotheses might the experimenter have been testing?
What sources of error are involved in this experiment?
What variables were examined? For each variable, identify whether it was quantitative or categorical.
What elements of experimental design, such as randomization or the use of a control group, do you think were present in the experiment? Why?
What do you think the purpose of the experiment was?
“To see how well we identified the larger bar and how well we could guess the proportion.”
“They could be trying to determine how different genders, ages, etc. perceive the sizes of the bars in the graph. Demographics could make a pretty significant difference.”
“I think the purpose of the experiment was to compare how the general public reads and interprets graphs in different formats compared to scientists, and how they analyze experiments.”
What elements of experimental design, such as randomization or the use of a control group, do you think were present in the experiment?
“Sex and race of the participants is random as it is unknown by the researcher. Because the researcher does not know who of the stats students will take the extra credit.”
“I feel like all the same graphs were used for everybody. Since there weren’t very many, this could have possibly created unnecessary outliers.”
What components of the experiment are clearer now than they were as a participant? What questions do you still have for the experimenter? Write 3-5 sentences reflecting on the abstract.
How did the information you gained from the components of this project (participation, post-study reflection, extended abstract, presentation) differ?
What components were emphasized in the presentation that weren’t emphasized in the abstract? Why do you think that is?
What critiques do you have of this study and its design? What would have made the study better?
If you had to hear about this study using only the extended abstract or only the presentation, which one would you prefer? Which one would be better for determining whether the experiment was well designed?
How did the information you gained from the components of this project differ?
“While actively participating in the study, I had some doubts about the purpose of the experiment and thought that it was kind of a waste of time. After reading the abstract and watching the presentation, I have a new found respect for the purpose and reasoning behind the design of the experiment.”
“The information gained progressively became more interactive and communicative of the study and what the purpose of it was.”
Same experiment in progress for Fall 2023 semester
Create coding scheme to turn open ended responses into meaningful variables
Implement experiment in Spring 2024 semester (train new TA’s how to give experiment)
Summer/Fall 2024: design experiment around heatmaps
Simplify factors (currently 42 factor combinations)
Use one package for consistent graphing methods