Workshops during the General
Online Research 05
1.) title of the workshop:
On-line Experiments
PD Dr. Ulf-Dietrich Reips
(University Zurich)
2.) duration of the workshop:
90 minutes, Monday, 21st of March, see conference program
3.) workshop fees:
40,- EUR (62,- CHF)/ 25,- EUR (39,- CHF)
4.) target groups:
Researchers and employees of companies who would like to conduct Internet-based experiments. The workshop is useful for both newcomers and experienced experimenters. It will contain information about the newest developments.
5.) Is the workshop prepared for an exclusively German language or an international audience?
International workshop, held in English. Individual coaching during practice parts will also be available in German.
6.) workshop language:
English
7.) Description of the content of the workshop:
This workshop will provide you with an up-to-date overview of basics, techniques, methods, tricks, and tools for Internet-based experimentation. Using a practical example, you will learn how to conduct Web experiments that provide results within hours. For this purpose, the workshop includes a hands-on demonstration of interactive systems for designing Web experiments online, e.g. WEXTOR. You will learn about ways of dealing with issues in experimental design, security, recruitment, sampling, self-selection, multiple submissions, question design, dropout, error estimation, distributed experimentation, data handling, data quality, and log file analysis. Among other “tricks”, you will know the high hurdle technique, the warm-up technique, sub-sampling procedures, multiple site entry, and ways to check for motivational confounding. You will learn how to make use of Web services like the free "::web experiment list::", and of analysis tools for subsequent data analysis, such as Scientific LogAnalyzer. Additional information materials will be provided, Workshop participants will receive free temporary licenses for WEXTOR and Scientific LogAnalyzer.
8.) goals of the workshop:
Learn or review basic knowledge about Internet-based experimenting; learn a number of useful techniques and tricks; learn to avoid pitfalls that may make your experiment useless; create an experiment during the workshop; get to know several tools and how to use them.
9.) necessary previous knowledge:
How to use a Web browser.
10.) literature that has to be read for participation:
Reips, U.-D. (2002). Standards for Internet-based experimenting. Experimental Psychology, 49 (4), 243-256. [PDF, 124kb: http://www.psychologie.unizh.ch/sowi/reips/papers/exppsy/ExPsyReipsReprint.pdf]
11.) additional literature
Recommendations:
Reips, U.-D., & Bosnjak, M. (Eds.)(2001). Dimensions of Internet Science. Lengerich: Pabst. (http://www.psychologie.unizh.ch/sowi/reips/dis/).
Reips, U.-D., & Stieger, S. (2004). Scientific LogAnalyzer: A Web-based tool for analyses of server log files in psychological research. Behavior Research Methods, Instruments, & Computers, 36(2), 304-311. (http://www.psychologie.unizh.ch/sowi/team/reips/papers/Reips_Stieger2004prp.pdf)
Tools to try out:
web experiment list: http://genpsylab-logcrunsh.unizh.ch/
WEXTOR: http://psych-wextor.unizh.ch/wextor/en/index.php
Scientific LogAnalyzer: http://genpsylab-logcrunsh.unizh.ch/
12.) information about the workshop organizer:
PD Dr. Ulf-Dietrich Reips is assistant professor in Social and Business Psychology at the University of Zürich, Switzerland. He is one of the founders and long-time board member of DGOF and currently main local organizer of GOR’05. Most recently, he was elected the first non-US American president-elect of the Society for Computers in Psychology. As a methodologist he has conducted research to the advancement of methodologies and techniques for Internet Science, especially on Internet-based experimenting. He has given workshops on this topic in several European countries as well as in the US (e.g. for the National Science Foundation). Many of his publications (both in English and in German, see http://www.psychologie.unizh.ch/sowi/team/reips/publikationsliste.html) are widely cited in the field.