| 研究生: |
黎引真 Yin-chen Li |
|---|---|
| 論文名稱: |
以行為及腦造影證據探討英文字音及字形相似效果對中英雙語使用者之短期記憶的影響 Behavioral and fMRI investigations on the effects of phonological and visual similarity of English words on short-term memory in unbalanced Chinese-English bilinguals |
| 指導教授: |
吳嫻
Denise Hsien Wu |
| 口試委員: | |
| 學位類別: |
碩士 Master |
| 系所名稱: |
生醫理工學院 - 認知與神經科學研究所 Graduate Institute of Cognitive and Neuroscience |
| 論文出版年: | 2013 |
| 畢業學年度: | 101 |
| 語文別: | 英文 |
| 論文頁數: | 117 |
| 中文關鍵詞: | 言語短期記憶 、探針序列回憶派典 、字形相似度 、雙語 、fMRI |
| 外文關鍵詞: | verbal short-term memory, the probed serial recall paradigm, orthographic similarity, bilingualism, fMRI |
| 相關次數: | 點閱:16 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
過去研究拼音語言讀者的文獻顯示,言語的訊息主要以語音表徵維持在短期記憶內,而非視覺表徵。相對的,中文讀者的短期記憶則同時展現來自語音和字形表徵的貢獻。為了探討雙語使用者的短期記憶是受其母語特性或受刺激材料影響,此研究分別檢視英文母語者和中英雙語使用者的英文字音、字形相似效果。另外,此研究也透過功能磁振造影,比較英文短期記憶中語音和視覺表徵相關的神經機制,在此兩種語言使用者之間的異同。
此研究包含兩個實驗。實驗一由兩個使用探針序列回憶作業 (probed serial recall task) 的行為實驗組成。行為實驗結果顯示,英文母語者的英文短期記憶只受到字音相似度干擾、而不被字形相似度影響;另一方面,中英雙語使用者的英文短期記憶則同時受到字音和字形相似度影響。另外,雙語使用者的英文能力似乎也會調節字形相似效果的強度。實驗二是功能核磁共振腦造影 (fMRI) 實驗,使用類似前一實驗的探針序列再認派典 (probed serial recognition paradigm)。腦造影結果大致於言語短期記憶作業時呈現左側化的額顳頂葉活化網絡,且在字音相似效果下呈現左側化的額頂葉活化網絡。另一方面,視覺相似效果的活化則在英文讀者和中英雙語使用者分別呈現右側及雙側額頂葉網絡。大致上,與字音和字形相似效果相關的腦部活化在英文母語者較側化,而在中英雙語使用者顯得較平均雙側化。
本研究結果指出,雙語使用者的言語短期記憶表徵,同時受到其母語的特性及第二語言的能力影響,並且行為觀察到的字形相似效果可能與雙側化的額頂葉活化有關。
Previous findings from readers of alphabetic languages demonstrate that verbal information in short-term memory (STM) is mainly retained by phonological but not visual representation. In contrast, our previous findings from Chinese readers demonstrate the contribution from both phonological and orthographic representation. To investigate whether bilinguals’ STM is delineated by characteristics of the native language or by the to-be-remembered materials, the effects of phonological and visual similarity of English words in native English speakers and in Chinese-English bilinguals were examined. The neural substrates underlying the phonological and visual representations of English words during STM tasks are also compared between native English speakers and Chinese-English bilinguals.
Two experiments were conducted in this study. Experiment 1 consisted of two behavioral experiments using a probed serial recall task. The results of the behavioral experiments showed that English speakers’ STM was only hindered by phonological but not visual similarity of English materials, while the STM of Chinese-English bilinguals was affected by both phonological and visual similarity. Furthermore, bilinguals’ proficiency in English seemed to modulate the effect of visual similarity. Experiment 2 was an fMRI experiment employing a similar task with the probed serial recognition paradigm. The neuroimaging results generally showed a left lateralized fronto-temporo-parietal network of verbal STM and a left lateralized fronto-parietal network of the phonological similarity effect (PSE). On the other hand, the results showed a right lateralized and bilateralized fronto-parietal network of the visual similarity effect (VSE) in native English readers and Chinese-English bilinguals, respectively. In general, the activations associated with the PSE and the VSE were more lateralized in the native English participants while being more bilateralized in the Chinese-English participants.
The present findings suggest that the representation underlying bilingual verbal STM is jointly determined by features of the first language and proficiency of the second language, and that the behaviorally observable VSE might be associated with the bilateralized fronto-parietal activations.
Abutalebi, J., Cappa, S. F., & Perani, D. (2005). What Can Functional Neuroimaging Tell Us About the Bilingual Brain? In J. F. Kroll & A. M. B. DeGroot (Eds.), Handbook of Bilingualism: Psycholinguistic Approaches (pp. 497–512). Oxford University Press, Inc.
Baddeley, A. D. (1966a). Short-term memory for word sequences as a function of acoustic, semantic and formal similarity. The Quarterly journal of experimental psychology, 18(4), 362–5. doi:10.1080/14640746608400055
Baddeley, A. D. (1966b). The influence of acoustic and semantic similarity on long-term memory for word sequences. The Quarterly journal of experimental psychology, 18(4), 302–9. doi:10.1080/14640746608400047
Baddeley, A. D. (1996). Exploring the Central Executive. The Quarterly Journal of Experimental Psychology Section A, 49(1), 5–28. doi:10.1080/713755608
Baddeley, A. D. (1998). Recent developments in working memory. Current opinion in neurobiology, 8(2), 234–8.
Baddeley, A. D. (2000a). The episodic buffer: a new component of working memory? Trends in cognitive sciences, 4(11), 417–423.
Baddeley, A. D. (2000b). Short-Term and Working Memory. In E. Tulving & F. I. M. Craik (Eds.), The Oxford Handbook of Memory (pp. 77–92). Oxford University Press.
Baddeley, A. D. (2012). Working memory: theories, models, and controversies. Annual review of psychology, 63, 1–29. doi:10.1146/annurev-psych-120710-100422
Baddeley, A. D., & Hitch, G. J. (1974). Working Memory. In G. A. Bower (Ed.), The Psychology of Learning and Motivation: Advances in Research and Theory (pp. 47–89). New York: Academic.
Baddeley, A. D., Thomson, N., & Buchanan, M. (1975). Word length and the structure of short-term memory. Journal of Verbal Learning and Verbal Behavior, 14(6), 575–589. doi:10.1016/S0022-5371(75)80045-4
Brett, M., Anton, J.-L., Valabregue, R., & Poline, J.-B. (2002). Regions of Interest analysis using the MarsBaR Toolbox for SPM99. NeuroImage, 16(2).
Brysbaert, M., & New, B. (2009). SubtlexUS: American Word Frequencies. Retrieved August 23, 2011, from http://subtlexus.lexique.org/
Chang, T.-T., & Lee, J. R. (2009). Familiarity and Age of Acquisition Ratings for English Words by Taiwanese College Students. Bulletin of Educational Psychology, 41(2), 441–452.
Chein, J. M., & Fiez, J. A. (2001). Dissociation of verbal working memory system components using a delayed serial recall task. Cerebral cortex, 11(11), 1003–14.
Conrad, R. (1964). Acoustic confusions in immediate memory. British Journal of Psychology, 55(1), 75–84. doi:10.1111/j.2044-8295.1964.tb00899.x
Conrad, R., & Hull, A. J. (1964). Information, acoustic confusion and memory span. British Journal of Psychology, 55(4), 429–432. doi:10.1111/j.2044-8295.1964.tb00928.x
Della Sala, S., Gray, C., Baddeley, A., Allamano, N., & Wilson, L. (1999). Pattern span: a tool for unwelding visuo–spatial memory. Neuropsychologia, 37(10), 1189–1199. doi:10.1016/S0028-3932(98)00159-6
Fiez, J. A., Raife, E. A., Balota, D. A., Schwarz, J. P., Raichle, M. E., & Petersen, S. E. (1996). A positron emission tomography study of the short-term maintenance of verbal information. The Journal of neuroscience : the official journal of the Society for Neuroscience, 16(2), 808–22.
Gazzaniga, M. S., Ivry, R. B., & Mangun, G. R. (2009a). Language. In Cognitive Neuroscience: The Biology of the Mind (3rd ed., pp. 388–444). W. W. Norton, Incorporated.
Gazzaniga, M. S., Ivry, R. B., & Mangun, G. R. (2009b). Hemispheric Specialization. In Cognitive Neuroscience: The Biology of the Mind (3rd ed., pp. 445–490). W. W. Norton, Incorporated.
Gollan, T. H., Weissberger, G. H., Runnqvist, E., Montoya, R. I., & Cera, C. M. (2011). Self-ratings of spoken language dominance: A Multilingual Naming Test (MINT) and preliminary norms for young and aging Spanish–English bilinguals. Bilingualism: Language and Cognition, 15(03), 594–615. doi:10.1017/S1366728911000332
Grabner, G., Janke, A. L., Budge, M. M., Smith, D., Pruessner, J., & Collins, D. L. (2006). Symmetric atlasing and model based segmentation: an application to the hippocampus in older adults. Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention, 9(Pt 2), 58–66.
Hamada, M., & Koda, K. (2008). Influence of First Language Orthographic Experience on Second Language Decoding and Word Learning. Language Learning, 58(1), 1–31. doi:10.1111/j.1467-9922.2007.00433.x
Hamada, M., & Koda, K. (2011). The role of the phonological loop in English word learning: a comparison of Chinese ESL learners and native speakers. Journal of psycholinguistic research, 40(2), 75–92. doi:10.1007/s10936-010-9156-9
Henson, R. N., Burgess, N., & Frith, C. D. (2000). Recoding, storage, rehearsal and grouping in verbal short-term memory: an fMRI study. Neuropsychologia, 38(4), 426–40.
Hitch, G. J., Woodin, M. E., & Baker, S. (1989). Visual and phonological components of working memory in children. Memory & cognition, 17(2), 175–185.
Hoosain, R. J. (1992). Differential Cerebral Lateralization of Chinese-English Bilingual Functions? Advances in Psychology: Cognitive Processing in Bilinguals, 83, 561–571. doi:10.1016/S0166-4115(08)61517-4
Hoosain, R. J., & Shiu, L. P. (1989). Cerebral lateralization of Chinese-English bilingual functions. Neuropsychologia, 27(5), 705–12.
Hue, C. W., & Erickson, J. R. (1988). Short-term memory for Chinese characters and radicals. Memory & cognition, 16(3), 196–205.
Hull, R. J., & Vaid, J. (2007). Bilingual language lateralization: a meta-analytic tale of two hemispheres. Neuropsychologia, 45(9), 1987–2008. doi:10.1016/j.neuropsychologia.2007.03.002
Jones, D. M., & Macken, W. J. (1993). Irrelevant tones produce an irrelevant speech effect: Implications for phonological coding in working memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 19, 369–369.
Koda, K. (1989). Effects of L1 Orthographic Representation on L2 Phonological Coding Strategies. Journal of psycholinguistic research, 18(2), 201–222. doi:10.1007/BF01067782
Lai, C.-Y. (2008). Phonological and orthographic similarity affects verbal short-term memory for Chinese characters (Master’s thesis). National Central University, Taiwan.
Levenshtein, V. I. (1966). Binary codes capable of correcting deletions, insertions. Soviet Physics Doklady, 10, 707–710.
Lin, E. Y.-C. (2010). The investigation of orthographic representations of verbal short-term memory for Chinese characters (Master’s thesis). National Central University, Taiwan.
Logie, R. H., Della Sala, S., Wynn, V., & Baddeley, A. D. (2000). Visual similarity effects in immediate verbal serial recall. The Quarterly journal of experimental psychology. A, Human experimental psychology, 53(3), 626–46. doi:10.1080/713755916
Majerus, S., Bastin, C., Poncelet, M., Van der Linden, M., Salmon, E., Collette, F., & Maquet, P. (2007). Short-term memory and the left intraparietal sulcus: focus of attention? Further evidence from a face short-term memory paradigm. NeuroImage, 35(1), 353–67. doi:10.1016/j.neuroimage.2006.12.008
Majerus, S., D’Argembeau, A., Martinez Perez, T., Belayachi, S., Van der Linden, M., Collette, F., … Maquet, P. (2010). The commonality of neural networks for verbal and visual short-term memory. Journal of cognitive neuroscience, 22(11), 2570–93. doi:10.1162/jocn.2009.21378
Majerus, S., Poncelet, M., Van der Linden, M., Albouy, G., Salmon, E., Sterpenich, V., … Maquet, P. (2006). The left intraparietal sulcus and verbal short-term memory: focus of attention or serial order? NeuroImage, 32(2), 880–91. doi:10.1016/j.neuroimage.2006.03.048
Martin, R. C., Wu, D., Freedman, M., Jackson, E. F., & Lesch, M. (2003). An event-related fMRI investigation of phonological versus semantic short-term memory. Journal of Neurolinguistics, 16(4-5), 341–360. doi:10.1016/S0911-6044(03)00025-3
McDermott, K. B., Petersen, S. E., Watson, J. M., & Ojemann, J. G. (2003). A procedure for identifying regions preferentially activated by attention to semantic and phonological relations using functional magnetic resonance imaging. Neuropsychologia, 41(3), 293–303.
Mueller, S. T., Seymour, T. L., Kieras, D. E., & Meyer, D. E. (2003). Theoretical implications of articulatory duration, phonological similarity, and phonological complexity in verbal working memory. Journal of experimental psychology. Learning, memory, and cognition, 29(6), 1353–80. doi:10.1037/0278-7393.29.6.1353
Murray, D. J. (1968). Articulation and acoustic confusability in short-term memory. Journal of Experimental Psychology, 78(4, Pt.1), 679–684. doi:10.1037/h0026641
Norton, E. S., & Wolf, M. (2012). Rapid automatized naming (RAN) and reading fluency: implications for understanding and treatment of reading disabilities. Annual review of psychology, 63, 427–52. doi:10.1146/annurev-psych-120710-100431
Paradis, M. (1990). Language lateralization in bilinguals: enough already! Brain and language, 39(4), 576–86.
Paulesu, E., Frith, C. D., & Frackowiak, R. S. (1993). The neural correlates of the verbal component of working memory. Nature, 362(6418), 342–5. doi:10.1038/362342a0
Peereman, R., & Content, A. (n.d.). Orthography-phonology mapping in English and French. Retrieved January 31, 2013, from http://homepages.ulb.ac.be/~acontent/OPMapping.html
Peters, F., Collette, F., Degueldre, C., Sterpenich, V., Majerus, S., & Salmon, E. (2009). The neural correlates of verbal short-term memory in Alzheimer’s disease: an fMRI study. Brain, 132(Pt 7), 1833–46. doi:10.1093/brain/awp075
Ravizza, S. M., Behrmann, M., & Fiez, J. a. (2005). Right parietal contributions to verbal working memory: spatial or executive? Neuropsychologia, 43(14), 2057–67. doi:10.1016/j.neuropsychologia.2005.03.014
Ravizza, S. M., Delgado, M. R., Chein, J. M., Becker, J. T., & Fiez, J. A. (2004). Functional dissociations within the inferior parietal cortex in verbal working memory. NeuroImage, 22(2), 562–73. doi:10.1016/j.neuroimage.2004.01.039
Repovš, G., & Baddeley, A. D. (2006). The multi-component model of working memory: explorations in experimental cognitive psychology. Neuroscience, 139(1), 5–21. doi:10.1016/j.neuroscience.2005.12.061
Saito, S., Logie, R. H., Morita, A., & Law, A. (2008). Visual and phonological similarity effects in verbal immediate serial recall: A test with kanji materials. Journal of Memory and Language, 59(1), 1–17. doi:10.1016/j.jml.2008.01.004
Salmon, E., Van der Linden, M., Collette, F., Delfiore, G., Maquet, P., Degueldre, C., … Franck, G. (1996). Regional brain activity during working memory tasks. Brain, 119(5), 1617–1625. doi:10.1093/brain/119.5.1617
Sumiyoshi, C., Matsuo, K., Kato, C., Ozawa, F., Takehara, Y., Isoda, H., … Nakai, T. (2003). Orthography effect on brain activities in the working memory process for phonologically ambiguous syllables: a functional magnetic resonance imaging study using Japanese speakers. Neuroscience letters, 336(1), 50–4.
Todd, J. J., & Marois, R. (2004). Capacity limit of visual short-term memory in human posterior parietal cortex. Nature, 428(6984), 751–4. doi:10.1038/nature02466
Tzourio-Mazoyer, N., Landeau, B., Papathanassiou, D., Crivello, F., Etard, O., Delcroix, N., … Joliot, M. (2002). Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. NeuroImage, 15(1), 273–89. doi:10.1006/nimg.2001.0978
Wang, M., Koda, K., & Perfetti, C. A. (2003). Alphabetic and nonalphabetic L1 effects in English word identification: a comparison of Korean and Chinese English L2 learners. Cognition, 87(2), 129–149. doi:10.1016/s0010-0277(02)00232-9
Wang, P. P., & Bellugi, U. (1994). Evidence from two genetic syndromes for a dissociation between verbal and visual-spatial short-term memory. Journal of clinical and experimental neuropsychology, 16(2), 317–22. doi:10.1080/01688639408402641
Wilke, M., & Lidzba, K. (2007). LI-tool: a new toolbox to assess lateralization in functional MR-data. Journal of neuroscience methods, 163(1), 128–36. doi:10.1016/j.jneumeth.2007.01.026
Wilke, M., & Schmithorst, V. J. (2006). A combined bootstrap/histogram analysis approach for computing a lateralization index from neuroimaging data. NeuroImage, 33(2), 522–30. doi:10.1016/j.neuroimage.2006.07.010
Wolf, M., & Denckla, M. (2005). RAN/RAS: Rapid Automatized Naming and Rapid Alternating Stimulus Tests. Austin, TX: Pro-Ed.
Yarkoni, T., Balota, D., & Yap, M. (2008). Moving beyond Coltheart’s N: a new measure of orthographic similarity. Psychonomic bulletin & review, 15(5), 971–9. doi:10.3758/PBR.15.5.971
Yik, W. F. (1978). The effect of visual and acoustic similarity on short-term memory for Chinese words. The Quarterly journal of experimental psychology, 30(3), 487–94. doi:10.1080/00335557843000070