Publication:
Shifts of the psychometric function: distinguishing bias from perceptual effects.

Loading...
Thumbnail Image
Full text at PDC
Publication Date
2013
Advisors (or tutors)
Editors
Journal Title
Journal ISSN
Volume Title
Publisher
Taylor and Francis
Citations
Google Scholar
Research Projects
Organizational Units
Journal Issue
Abstract
Morgan, Dillenburger, Raphael, and Solomon have shown that observers can use different response strategies when unsure of their answer, and, thus, they can voluntarily shift the location of the psychometric function estimated with the method of single stimuli (MSS; sometimes also referred to as the single-interval, two-alternative method). They wondered whether MSS could distinguish response bias from a true perceptual effect that would also shift the location of the psychometric function. We demonstrate theoretically that the inability to distinguish response bias from perceptual effects is an inherent shortcoming of MSS, although a three-response format including also an "undecided" response option may solve the problem under restrictive assumptions whose validity cannot be tested with MSS data. We also show that a proper two-alternative forced-choice (2AFC) task with the three-response format is free of all these problems so that bias and perceptual effects can easily be separated out. The use of a three-response 2AFC format is essential to eliminate a confound (response bias) in studies of perceptual effects and, hence, to eliminate a threat to the internal validity of research in this area.
Description
Keywords
Citation
Alcalá-Quintana, R., & García-Pérez, M. A. (2011). A model for the time-order error in contrast discrimination. Quarterly Journal of Experimental Psychology, 64, 1221–1248. doi:10.1080/17470218.2010.540018 Alcalá-Quintana, R., & García-Pérez, M. A. (2012). Fitting psychometric functions to simultaneity and temporal-order judgment data: MATLAB and R routines. Manuscript submitted for publication. Armstrong, L., & Marks, L. E. (1997). Differential effects of stimulus context on perceived length: Implications for the horizontal–vertical illusion. Perception & Psychophysics, 59, 1200–1213. doi:10.3758/BF03214208 Bailey, P. J., Hodgson, P., & Hill, N. I. (1998). On the strategic weighting of spectral information in consonant identification. Quarterly Journal of Experimental Psychology, Section A: Human Experimental Psychology, 51, 393–407. doi:10.1080/713755765 Cheal, M. L., Lyon, D. R., & Hubbard, D. C. (1991). Does attention have different effects on line orientation and line arrangement discrimination? Quarterly Journal of Experimental Psychology, Section A: Human Experimental Psychology, 43, 825–857. doi:10.1080/14640749108400959 Davis, C., & Kim, J. (2011). What’s in a mask? Information masking with forward and backward visual masks. Quarterly Journal of Experimental Psychology, 64, 1990–2002. doi:10.1080/ 17470218.2011.573150 Erlebacher, A., & Sekuler, R. (1971). Response frequency equalization: A bias model for psychophysics. Perception & Psychophysics, 9, 315–320. doi:10.3758/BF03212657 Estes, W. K. (1956). The problem of inference from curves based on group data. Psychological Bulletin, 53, 134–140. doi:10.1037/h0045156 Fechner, G. T. (1966). Elements of psychophysics. New York, NY: Holt. (Original work published 1860) García-Pérez, M. A. (2002). Properties of some variants ofadaptive staircases with fixed step sizes. Spatial Vision, 15, 303–321. doi:10.1163/156856802 60174056 García-Pérez, M. A. (2010). Denoising forced-choice detection data. British Journal of Mathematical and Statistical Psychology, 63, 75–100. doi:10.1348/ 000711009X424057 García-Pérez, M. A., & Alcalá-Quintana, R. (2007). The transducer model for contrast detection and discrimination: Formal relations, implications, and an empirical test. Spatial Vision, 20, 5–43. doi:10.1163/156856807779369724 García-Pérez,M. A., & Alcalá-Quintana, R. (2009). Fixed vs. variable noise in 2AFC contrast discrimination: Lessons from psychometric functions. Spatial Vision, 22, 273–300. doi:10.1163/156856809788746309 García-Pérez, M. A., & Alcalá-Quintana, R. (2010a). The difference model with guessing explains interval bias in two-alternative forced-choice detection procedures. Journal of Sensory Studies, 25, 876–898. doi:10.1111/j.1745-459X.2010.00310.x García-Pérez, M. A., & Alcalá-Quintana, R. (2010b). Reminder and 2AFC tasks provide similar estimates of the difference limen: A reanalysis of data from Lapid, Ulrich, and Rammsayer (2008) and a discussion of Ulrich and Vorberg (2009). Attention, Perception & Psychophysics, 72, 1151-1178. doi:10.3758/APP.72.4.1155 García-Pérez, M. A., & Alcalá-Quintana, R. (2011a). Improving the estimation of psychometric functions in 2AFC discrimination tasks. Frontiers in Psychology–Quantitative Psychology and Measurement, 2, 96. doi:10.3389/fpsyg.2011.00096 García-Pérez, M. A., & Alcalá-Quintana, R. (2011b). Interval bias in 2AFC detection tasks: Sorting out the artifacts. Attention, Perception & Psychophysics, 73, 2332–2352. doi:10.3758/s13414-011-0167-x García-Pérez, M. A., & Alcalá-Quintana, R. (2012a). Correction to “Reminder and 2AFC tasks provide similar estimates of the difference limen: A reanalysis of data from Lapid, Ulrich, and Rammsayer (2008) and a discussion of Ulrich and Vorberg (2009)”. Attention, Perception & Psychophysics, 74, 489–492. doi:10.3758/s13414-012-0274-3 García-Pérez, M. A., & Alcalá-Quintana, R. (2012b). Response errors explain the failure of independentchannels models of perception of temporal order. Frontiers in Psychology–Perception Science, 3, 94. doi:10.3389/fpsyg.2012.00094 García-Pérez, M. A., & Alcalá-Quintana, R. (in press). On the discrepant results in synchrony and temporal-order judgment tasks: A quantitative model. Psychonomic Bulletin & Review. doi:10.3758/s13423-012-0278-y García-Pérez, M. A., Alcalá-Quintana, R., Woods, R. L., & Peli, E. (2011). Psychometric functions for detection and discrimination with and without flankers. Attention, Perception & Psychophysics, 73, 829–853. doi:10.3758/s13414-010-0080-8 García-Pérez, M. A., & Peli, E. (1999). Imputation of direction of motion in one dimension. Journal of the Optical Society of America A, 16, 1531–1540. doi:10.1364/JOSAA.16.001531 García-Pérez, M. A., & Peli, E. (2011). Visual contrast processing is largely unaltered during saccades. Frontiers in Psychology–Perception Science, 2, 247. doi:10.3389/fpsyg.2011.00247 Gast, A., & Rothermund, K. (2010). When old and frail is not the same: Dissociating category and stimulus effects in four implicit attitude measurement methods. Quarterly Journal of Experimental Psychology, 63, 479–498. doi:10.1080/17470210903049963 Gegenfurtner, K. R., Mayser, H. M., & Sharpe, L. T. (2000). Motion perception at scotopic light levels. Journal of the Optical Society of America A, 17, 1505–1515. doi:10.1364/JOSAA.17.001505 Green, D. M., & Swets, J. A. (1966). Signal detection theory and psychophysics. New York, NY: Wiley. Guilford, J. P. (1954). Psychometric methods. New York, NY: McGraw-Hill. Harris, J. M., Chopin, A., Zeiner, K., & Hibbard, P. B.(2012). Perception of relative depth interval: Systematic biases in perceived depth. Quarterly Journal of Experimental Psychology, 65, 73–91. doi:10.1080/17470218.2011.589520 Hellström, Å. (2003). Comparison is not just subtraction: Effects of time- and space-order on subjective stimulus difference. Perception & Psychophysics, 65, 1161–1177. doi:10.3758/BF03194842 Irwin, F. W. (1935). Psychophysical measurement methods. Psychological Bulletin, 32, 140–171. doi:10.1037/h0054960Jäkel, F., & Wichmann, F. A. (2006). Spatial fouralternative forced-choice method is the preferred psychophysical method for naïve observers. Journal of Vision, 6, 1307–1322. doi:10.1167/6.11.13 Johnston, J. C., & McCann, R. S. (2006). On the locus of dual-task interference: Is there a bottleneck at the stimulus classification stage? Quarterly Journal of Experimental Psychology, 59, 694–719. doi:10.1080/02724980543000015 Jones, F. N. (1974). History of psychophysics and judgment. In E. C. Carterette & M. P. Friedman (Eds.), Handbook of perception: Vol. II. Psychophysical judgment and measurement (pp. 1–22). New York, NY:Academic Press. Kaernbach, C. (2001). Adaptive threshold estimation with unforced-choice tasks. Perception & Psychophysics, 63, 1377–1388. doi:10.3758/BF0319 454 Katkov, M., Tsodyks, M., & Sagi, D. (2006a). Analysis of a two-alternative forced-choice signal detection theory model. Journal of Mathematical Psychology, 50, 411–420. doi:10.1016/j.jmp.2005.11.002 Katkov, M., Tsodyks, M., & Sagi, D. (2006b). Singularities in the inverse modeling of 2AFC contrast discrimination data. Vision Research, 46, 259–266. doi:10.1016/j.visres.2005.09.022 Katkov, M., Tsodyks, M., & Sagi, D. (2007).Inverse modeling of human contrast response. Vision Research, 47, 2855–2867. doi:10.1016/j.visres.2007.06.024 Laming, D., & Laming, J. (1992). F. Hegelmaier: On memory for the length of a line. Psychological Research, 54, 233–239. doi:10.1007/BF0135826 Link, S. W. (1992). The wave theory of difference and similarity. Hillsdale, NJ: Lawrence Erlbaum Associates. Loftus, A. M., Nicholls, M. E. R., Mattingley, J. B., Chapman, H. L., & Bradshaw, J. L. (2009). Pseudoneglect for the bisection of mental number lines. Quarterly Journal of Experimental Psychology, 62, 925–945. doi:10.1080/17470210802305318 Macmillan, N. A., & Creelman, C. D. (2005). Detection theory. A user’s guide (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates. Morgan, M., Dillenburger, B., Raphael, S., & Solomon, J. A. (2012). Observers can voluntarily shift their psychometric functions without losing sensitivity. Attention, Perception & Psychophysics, 74, 185–193. doi:10.3758/s13414-011-02222-7 Morgan, M. J., Ward, R. M., & Castet, E. (1998). Visual search for a tilted target: Tests of spatial uncertainty models. Quarterly Journal of Experimental Psychology, Section A: Human Experimental Psychology, 51, 347–370. doi:10.1080/713755766 Prinzmetal, W., Zvinyatskovskiy, A., Gutierrez, P., & Dilem, L. (2009). Voluntary and involuntary attention have different consequences: The effect of perceptual difficulty. Quarterly Journal of Experimental Psychology, 62, 352–369. doi:10.1080/17470210801954892 Schneider, K. A., & Bavelier, D. (2003). Components of visual prior entry. Cognitive Psychology, 47, 333–366. doi:10.1016/S0010-0285(03)00035-5 Sekuler, R., & Erlebacher, A. (1971). The invalidity of “invalid results from the method of constant stimuli”: A common artifact in the methods of psychophysics. Perception & Psychophysics, 9, 309–311. doi:10.3758/BF03212655 Spence, C., & Parise, C. (2010). Prior-entry: A review. Consciousness and Cognition, 19, 364–379. doi:10.1016/j.concog.2009.12.001 Sternberg, S.,& Knoll,R. L. (1973).The perception of temporal order: Fundamental issues and a general model. In S. Kornblum (Ed.), Attention and Performance IV (pp. 629–685). New York, NY: Academic Press. Swets, J. A. (1961). Is there a sensory threshold? Science, 134, 168–177. doi:10.1126/science.134.3473.168 Treisman, M. (1973). Relation between signal detectability theory and the traditional procedures for measuring thresholds: An addendum. Psychological Bulletin, 79, 45–47. doi:10.1037/h0033771 Treisman, M., & Watts, T. R. (1966). Relation between signal detectability theory and the traditional procedures for measuring sensory thresholds: Estimating d′ from results given by the method of constant stimuli. Psychological Bulletin, 66, 438–454. doi:10.1037/ h0020413 Ulrich, R. (1987). Threshold models of temporal-order judgments evaluated by a ternary response task. Perception & Psychophysics, 42, 224–239. doi:10.3758/BF03203074 Ulrich, R., & Vorberg, D. (2009). Estimating the difference limen in 2AFC tasks: Pitfalls and improved estimators. Attention, Perception & Psychophysics, 71, 1219–1227. doi:10.3758/APP.71.6.1219 Urban, F. M. (1907). On the method of just perceptible differences. Psychological Review, 14, 244–253. doi:10.1037/h0073288 Urban, F. M. (1910). The method of constant stimuli and its generalizations. Psychological Review, 17, 229–259. doi:10.1037/h0074515 van Eijk, R. L. J., Kohlrausch, A., Juola, J. F., & van de Par, S. (2008). Audiovisual synchrony and temporal order judgments: Effects of experimental method and stimulus type. Perception & Psychophysics, 70, 955–968. doi:10.3758/PP.70.6.955 van Vleet, T. M., & Robertson, L. C. (2006). Crossmodal interactions in time and space: Auditory influence on visual attention in hemispatial neglect. Journal of Cognitive Neuroscience, 18, 1368–1379. doi:10.1162/jocn.2006.18.8.1368 Watson, C. S., Kellogg, S. C., Kawanishi, D. T., & Lucas, P. A. (1973). The uncertain response in detection-oriented psychophysics. Journal of Experimental Psychology, 99, 180–185. doi:10.1037/h0034736 Wearden, J. H., Todd, N. P. M., & Jones, L. A. (2006). When do auditory/visual differences in duration judgements occur? Quarterly Journal of Experimental Psychology, 59, 1709–1724. doi:10.1080/17470210500314729 Woodworth, R. S., & Schlosberg, H. (1954). Experimental psychology. New York, NY: Holt. Yarrow, K., Jahn, N., Durant, S., & Arnold, D. H. (2011). Shifts of criteria or neural timing? The assumptions underlying timing perception studies. Consciousness and Cognition, 20, 1518–1531. doi:10.1016/j.concog.2011.07.003
Collections