Methods Core - Seminars
Please note: All seminars take place at CAPS in the McKusick Conference room, unless otherwise noted. Directions to CAPS.
See materials from past seminars.
Quantitative Methods
- Friday, May 16, 2008 - 9:30 -11 am
Presenter: CAPS Methods Core / Seminar participants / TBA
Topic: Discussion Forum: Best Practices for Data Management: Variable creation, Data Documentation and Storage - Friday, June 20, 2008 - 9:30 -11 am
Presenter: Dr. William Shadish, Professor, Founding Faculty, and Chair, Psychological Sciences Section, University of California, Merced
Topic: Can Nonrandomized Experiments Yield Accurate Answers? A Randomized Experiment Comparing Random to Nonrandom Assignment?
Most of our seminar participants are statisticians or data analysts, and deal closely with data. We typically generate output and need to communicate the results of the runs to the PI, or explain the data to other analysts. Some of us at CAPS have discussed ideas for best practices in the creation of variable names, labels, and formats/value labels. We have also discussed possible best practices for documenting data sets and storing data and analysis outputs for easy retrieval and we have also discussed how to best communicate results to investigators and colleagues. We would now like to expand the discussion and possibly come up with some guidelines / recommendations for data management topics that come up frequently. We hope for a lively discussion. Clearly, these recommendations are non-binding, as in many situations some of the practices are a matter of personal taste and choice.
This topic will require some "homework" on the part of participants in that we would like you to think about the practices you and your colleagues use in your work and come prepared to share what you think are effective practices in your own data analysis work. If you have a particular subject dear to your hart that you'd like to take the lead on, please let Estie Hudes know in advance. You could also prepare a small number of slides to demonstrate your point(s).
This talk presents final analyses from a study with M.H. Clark (Southern
Illinois University, Carbondale) and Peter M. Steiner (Institute for
Advanced Studies, Vienna, Austria) in which participants were randomly
assigned to a randomized or a nonrandomized experiment. In the randomized
experiment, participants were randomly assigned to mathematics or
vocabulary training; in the nonrandomized experiment, they chose their
training. The study held all other features of the experiment constant;
it carefully measured pretest variables that might predict the condition
that participants chose; and all participants were measured on vocabulary
and mathematics outcome. The analyses used covariates to create propensity
scores, used Rubin’s (2001) diagnostics for balance over covariates
after propensity score adjustment, used covariate-adjusted randomized
results as the benchmark, and compared propensity score adjustments
to ordinary linear regression adjustments. Ordinary linear regression
reduced bias in the nonrandomized experiment by 84 – 94% using
covariate-adjusted randomized results as the benchmark. Propensity
score stratification, weighting and covariance adjustment reduced
bias by about 58 – 96%, depending on the outcome measure and
adjustment method. Propensity score adjustment performed poorly when
the scores were constructed from predictors of convenience (sex, age,
marital status and ethnicity) rather than from a broader set of predictors
that might include these. We present some results clarifying the circumstances
under which propensity scores might work better or worse, and conclude
with implications for practice.
Qualitative Methods
- Tuesday, May 6 - 10-11:30am
Presenter: Gretchen Purser, PhD candidate in the Department of Sociology at University of California, Berkeley
Topic: Diving into the Labor Pool: Methodological Reflections of an “Undercover” Day Laborer
Gretchen's research focuses on work, urban poverty and the labor market experiences of the formerly-incarcerated. Based upon comparative ethnographic fieldwork in Oakland and Baltimore, her dissertation examines the growth, structure and workings of the formal day labor (or “labor pool”) industry. With particular attention to race and gender, her talk will focus upon the methodological challenges of, as well as the analytic insights that can be gleaned from, deep immersion in this flexible “reserve army of labor.”
Past seminars
- April 2008 - Basics of Interim Analysis presented by Dr. Dave Glidden,
- March 2008 - Prediction of random effects and effects of misspecification of their distributions presented by Dr. Charles McCulloch
- February 2008 - Using Regression to Analyze Randomized Trials: Valid Hypothesis Tests Despite Incorrectly Specified Models presented by Dr. Michael Rosenblum.
- January 2008 - Repeated measures models with multiple, correlated random effects by Dr. Steve Gregorich
- November 2007 - The Bathwater Has No Baby, and The Clothes Have No Emperor: Coming to Terms with Self-Responsibility in Science and in Real Life presented by Dr. Mike Acree
- October 2007 - Presentations by Dr. Matthew Salganik:
- An introduction to respondent-driven sampling: presentation and article
- Respondent-Driven Sampling as Markov Chain Monte Carlo: presentation and article
- September 2007 - Designing Effective Questionnaires: An Exploration of the Psychology of Question-Answering presented by Dr. Jon Krosnick
- June 2007 - Statistical Mediation Analysis presented by Dr. David MacKinnon
- May 2007 - Multiple Events in Applications: Ventilator-Free Days in Critical Care presented by Dr. David Glidden
- April 2007 - Enhancement of data management and epidemiological skills: analysis of the effects of hormonal contraception on the natural history of HIV-1 infected women in Nairobi and Zimbabwe presented by Christina Mwachari, MD
- March 2007 - Handling Missing Data presented by Tor Neilands and Estie Hudes
- February 2007 - Structural Equation Modeling Software Capabilities of General Interest
- January 2007 - The Tribulations of a Trial: Design Dilemmas in Testing the Efficacy of a Community-Level HIV Prevention Intervention for Young Black MSM presented by Susan M. Kegeles, Greg Rebchook, John Peterson, Dave Huebner