| 研究生: |
林依禛 Yi-Chen Lin |
|---|---|
| 論文名稱: |
中文短期記憶之字形表徵研究 The investigation of orthographic representations ofverbal short-term memory for Chinese characters |
| 指導教授: |
吳嫻
Denise H. Wu |
| 口試委員: | |
| 學位類別: |
碩士 Master |
| 系所名稱: |
生醫理工學院 - 認知與神經科學研究所 Graduate Institute of Cognitive and Neuroscience |
| 畢業學年度: | 98 |
| 語文別: | 英文 |
| 論文頁數: | 127 |
| 中文關鍵詞: | 序列回憶作業 、視覺空間表徵 、短期記憶 、字形相似度 、雙作業典範 、腦造影 |
| 外文關鍵詞: | dual-task paradigm, logographic languages, working memory, orthographic similarity, visual-spatial representaion, probed serial recall paradigm, neuroimaging |
| 相關次數: | 點閱:20 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
According to the prominent working memory model, verbal and non-verbal materials are stored in the forms of phonological and visual-spatial representations, respectively. However, previous studies of non-alphabetic languages (e. g., Chinese and Japanese) also found the visual similarity effect in verbal short-term memory (STM) tasks. It was unclear whether the effect resulted from the contribution from long-term memory or from the supplementary function of the visual-spatial sketchpad. The aim of the present study is to examine the nature of orthographic representation underlying Chinese characters, and to investigate how the orthographic representation is involved in verbal STM.
In the first part of the study, three dual-task experiments were conducted to examine the dissociation between orthographic and visual-spatial representations of verbal STM for Chinese characters. The retention of orthographically similar and dissimilar Chinese characters was intervened by a task of choice-reaction (the control condition), matrix matching (visual-spatial interference), or character matching (orthographic interference). Although all intervening tasks decreased memory performance, the magnitude of the orthographic similarity effect in phonologically dissimilar characters was selectively reduced by interfering character matching but not by matrix matching. These results support that the orthographic representation for Chinese characters might be different from the nonverbal spatial information underlying the retention of Brook’s matrices.
The second part of this study examined whether participants actually rely more on phonological representation in remembering the orthographically similar than dissimilar characters. Because the difference between the memory accuracy for orthographically similar and dissimilar conditions was not reduced by intervened homophone-judgment or concurrent articulatory suppression, it is suggested that the convergent effect of orthographic similarity does not result from more involvement of phonological representation in the orthographically similar condition.
In the third part of the study, the functional magnetic resonance imaging (fMRI) technique was applied to determine whether the neural mechanisms supporting the retention of orthographic representations reside in the brain network of visual-spatial or verbal STM. In an experiment with blocked design, participants silently maintained three Brook’s matrices and four Chinese characters in the spatial and verbal STM tasks, respectively, with orthographic similarity manipulated in the verbal task. The results revealed typical neural networks associated with stimulus retention in the spatial and verbal STM tasks. More important, when contrasting the retention of orthographically similar to dissimilar characters, there were more activations in the left middle frontal gyrus and the right superior parietal lobule. The former activation partially overlapped with the brain regions that are more activated in verbal than visual-spatial STM, while the latter activation partially overlapped with the brain regions that are more activated in visual-spatial than verbal STM. Such results were consistent with the behavioral findings to suggest that Chinese orthography involves linguistic-specific knowledge in addition to spatial representation.
In summary, the findings reported in the present study provide strong evidence for co-existing contributions from phonological and orthographic representations to verbal STM for Chinese characters. These results also indicate that the maintenance of Chinese orthographic representations involves abstract linguistic-specific knowledge in addition to visual-spatial analyses of word forms. Theoretical models of verbal STM should take characteristics of individual languages into account to accommodate the findings from linguistic materials with different degrees of homophony.
在過去與短期記憶相關的研究中,廣泛認為語言與非語言(例如視覺或空間材料)的短期記憶處理歷程是可以獨立的。語音表徵被認為是主要用來短暫記住語言材料的線索,只有當這個主要線索沒有辦法幫助受試者記憶時,才會觀察到字形這個與視覺相關的表徵對語言短期記憶的影響。由於中文具有高比例的同音字,因此本實驗室過去研究發現,即使在語音線索很容易使用也有幫助的狀況下,字形相似仍會降低短期記憶的表現。相關實驗進一步說明,字形相似性不能僅靠視覺相似性來解釋,其中中文使用者對文字結構的知識,例如:音旁、意旁的組合與語音的對應是字形處理關鍵。
本研究包括三個部分,分別採用行為實驗以及功能性磁振造影(fMRI)技術試圖澄清中文字形在短期記憶中的處理歷程,是否獨立於視覺與空間的處理歷程。實驗一採用雙作業派典(dual-task paradigm),在操弄刺激材料之語音與字形相似性之情況下,同時操弄干擾作業的特性,間接探討字形表徵之處理與視覺空間處理之關係。實驗結果呼應過去的資料,發現即使在語音線索可幫助受試者記憶的狀況下,受試者的表現仍然受到字形相似性的影響。此外,本實驗結果發現,字形相似性效果會受到附加的筆畫判別作業影響而略為減小,但不受額外之空間判別所干擾。
實驗一的結果似乎支持我們所提出的假設,即中文字形處理包括語言知識的層面,不能單由視覺空間處理所解釋。然而,對這些資料的另一種解釋方式為,由於字形相似情況下,字形表徵不易使用,因此受試者實際上反而更加仰賴語音線索來幫助記憶。若此假設成立,則我們應該預期語音干擾作業會破壞所謂的字形相似性效果。實驗二採用同音字配對作業及咬音抑制這兩種不同處理歷程中的語音干擾作業,結果發現語音干擾作業中咬音抑制作業僅會大幅削弱語音相似性效果,而這兩種干擾作業皆不影響字形相似性效果。此實驗結果並不支持在字形相似狀況下,受試者更加仰賴語音表徵之假設。
由於行為實驗可做的操弄有限,因此實驗三採用功能性核磁共振造影技術,觀察受試者執行作業之腦部活化情形,以獲得較直接的生理證據。受試者在掃描過程中,分別執行空間短期記憶,以及文字短期記憶作業。其中文字短期記憶作業中隨機出現字形相似與字形不相似兩種題型。實驗三中所觀察到的腦部活化現象,大致呼應文獻中空間與文字短期記憶作業的處理網路。此外,對照字形相似與字形不相似兩種情形,在維持記憶的階段,字形相似組在左側前中央溝(left precentral gyrus, BA 6)、雙側額葉中迴(bilateral middle frontal gyrus, BA 9)、右側頂葉上迴(right superior parietal lobule, BA 7)及左側頂葉下迴(left inferior parietal lobule, BA 39 & 40)會有較高的活化。實驗結果似乎也支持,字形處理機制除了視覺空間處理之外,亦包含了語言知識的處理。
總結本研究,我們觀察到語音表徵與字形表徵同時參與中文短期記憶機制。而中文字形處理機制同時包含了視覺空間及語言知識之處理。語言短期記憶模型,應該同時考量不同語言系統之特性,使用多同音字之語言者的短期記憶處理機制,可能包括語音以外之表徵參與其運作。
Alvarez, G. A., & Cavanagh, P. (2004). The capacity of visual short-term memory is set both by visual information load and by number of objects. Psychol Sci, 15(2), 106-111.
Atkinson, R. C., & Shiffrin, R. M. (1968). Human memory: A proposed system and its control processes. In I. K. W. Spence (Ed.), The psychology of learning and motivation: Advances in research and theory (pp. 89-195). New York: Academic Press.
Awh, E., Jonides, J., Smith, E. E., Schumacher, E. H., Koeppe, R. A., & Katz, S. (1996). Dissociation of storage and rehearsal in verbal working memory: Evidence from positron emission tomography. Psychological Science, 7(1), 25-31.
Baddeley, A. (2000). The episodic buffer: a new component of working memory? Trends in Cognitive Sciences, 4(11), 417-423.
Baddeley, A., & Hitch, G. J. (1974). Working memory. Psychology of Learning and Motivation, 8, 47-89.
Baddeley, A. D. (1966). Short-term memory for word sequences as a function of acoustic, semantic and formal similarity. Q J Exp Psychol, 18(4), 362-365.
Baddeley, A. D. (2001). Is working memory still working? American Psychologist, 56(11), 851-864.
Baddeley, A. D., & Lieberman, K. (1980). Spatial working memory. In R. Nickerson (Ed.), Attention and performance (Vol. VIII, pp. 521-539). Hillsdale, NJ: Lawrence Erlbaum Associates Inc.
Baddeley, A. D., Thomson, N., & Buchanan, M. (1975). Word Length and Structure of Short-Term-Memory. Journal of Verbal Learning and Verbal Behavior, 14(6), 575-589.
Basso, A., Spinnler, H., Vallar, G., & Zanobio, M. E. (1982). Left hemisphere damage and selective impairment of auditory verbal short-term memory. A case study. Neuropsychologia, 20(3), 263-274.
Brooks, L. R. (1968). Spatial and verbal components in the act of recall. Canadian Journal of Psychology, 22, 349-368.
Chein, J. M., & Fiez, J. A. (2001). Dissociation of verbal working memory system components using a delayed serial recall task. Cerebral Cortex, 11(11), 1003-1014.
Chein, J. M., Ravizza, S. M., & Fiez, J. A. (2003). Using neuroimaging to evaluate models of working memory and their implications for language processing. Journal of Neurolinguistics, 16(4-5), 315-339.
Chen. (2007). The semantic and orthographic contribution to VSTM: Evidence from behavioral and neuroimaging experiments. National Central University.
Courtney, S. M., Petit, L., Maisog, J. M., Ungerleider, L. G., & Haxby, J. V. (1998). An area specialized for spatial working memory in human frontal cortex. Science, 279(5355), 1347-1351.
D''Esposito, M., Aguirre, G. K., Zarahn, E., Ballard, D., Shin, R. K., & Lease, J. (1998). Functional MRI studies of spatial and nonspatial working memory. Cognitive Brain Research, 7(1), 1-13.
Della Sala, S., Gray, C., Baddeley, A. D., Allamano, N., & Wilson, L. (1999). Pattern span: a tool for unwelding visuo-spatial memory. Neuropsychologia, 37(10), 1189-1199.
Fang, S. P., Horng, R. Y., & Tzeng, O. J. L. (1986). Consistency effects in the Chinese character and pseudo-character naming tasks. In H. S. R. Kao & R. Hoosain (Eds.), Linguistics, Pschology, and the Chinese Language (pp. 11-21). University of Hong Kong, Center of Asian Studies, Hong Kong, China.
Fiez, J. A., Raife, E. A., Balota, D. A., Schwarz, J. P., Raichle, M. E., & Petersen, S. E. (1996). A positron emission tomography study of the short-term maintenance of verbal information. Journal of Neuroscience, 16(2), 808-822.
Gruber, O., & von Cramon, D. Y. (2003). The functional neuroanatomy of human working memory revisited - Evidence from 3-T fMRl studies using classical domain-specific interference tasks. Neuroimage, 19(3), 797-809.
Hanley, J. R., Pearson, N. A., & Young, A. W. (1990). Impaired memory for new visual forms. Brain, 113 ( Pt 4), 1131-1148.
Hue, C.-W., & Erickson, J. R. (1988). Short-term memory for Chinese characters and radicals. Memory & Cogmtion, 16(3), 196.
Jared, D. (1997). Spelling-sound consistency affects the naming of high-frequency words. Journal of Memory and Language, 36(4), 505-529.
Jared, D., & Seidenberg, M. S. (1990). Naming multisyllabic words. J Exp Psychol Hum Percept Perform, 16(1), 92-105.
Jonides, J., ReuterLorenz, P. A., Smith, E. E., Awh, E., Barnes, L. L., Drain, M., et al. (1996). Verbal and spatial working memory in humans. Psychology of Learning and Motivation, Vol 35, 35, 43-88.
Koch, I. (2009). The role of crosstalk in dual-task performance: evidence from manipulating response-code overlap. Psychol Res, 73(3), 417-424.
Kuo, W. J., Yeh, T. C., Duann, J. R., Wu, Y. T., Ho, L. T., Hung, D., et al. (2001). A left-lateralized network for reading Chinese words: a 3 T fMRI study. Neuroreport, 12(18), 3997-4001.
Kuo, W. J., Yeh, T. C., Lee, J. R., Chen, L. F., Lee, P. L., Chen, S. S., et al. (2004). Orthographic and phonological processing of Chinese characters: an fMRI study. Neuroimage, 21(4), 1721-1731.
Lai, C.-Y. (2008). Phonological and orthographic similarity affects verbal short-term memory for Chinese characters. National Central University.
Lee, C. Y., Tsai, J. L., Kuo, W. J., Yeh, T. C., Wu, Y. T., Ho, L. T., et al. (2004). Neuronal correlates of consistency and frequency effects on Chinese character naming: an event-related MRI study. Neuroimage, 23(4), 1235-1245.
Lee, C. Y., Tsai, J. L., Su, E. C. I., Tzeng, O. J. L., & Hung, D. L. (2005). Consistency, Regularity, and Frequency Effects in Naming Chinese Characters. Language and Linguistics, 6(1), 75-107.
Logie, R. H. (1995). Visuo-spatial working memory. Hove, UK: Lawrence erlbaum associations.
Logie, R. H., Della Sala, S., Wynn, V., & Baddeley, A. D. (2000). Visual similarity effects in immediate verbal serial recall. Quarterly Journal of Experimental Psychology Section a-Human Experimental Psychology, 53(3), 626-646.
Logie, R. H., Zucco, G. M., & Baddeley, A. D. (1990). Interference with visual short-term memory. Acta Psychol (Amst), 75(1), 55-74.
Mccarthy, G., Blamire, A. M., Puce, A., Nobre, A. C., Bloch, G., Hyder, F., et al. (1994). Functional Magnetic-Resonance-Imaging of Human Prefrontal Cortex Activation during a Spatial Working-Memory Task. Proceedings of the National Academy of Sciences of the United States of America, 91(18), 8690-8694.
Monnier, C., & Syssau, A. (2008). Semantic contribution to verbal short-term memory: Are pleasant words easier to remember than neutral words in serial recall and serial recognition? Memory & Cognition, 36(1), 35-42.
Mou, L. C., & Anderson, N. S. (1981). Graphemic and phonemic codings of Chinese characters in short-term retention. Bulletin of the Psychonomic Society, 17(6), 255-258.
Murray, D. J. (1968). Articulation and acoustic confusability in short-term memory. Journal of Experimental Psychology, 78(4), 676-684.
Owen, A. M., Evans, A. C., & Petrides, M. (1996). Evidence for a two-stage model of spatial working memory processing within the lateral frontal cortex: a positron emission tomography study. Cereb Cortex, 6(1), 31-38.
Petrides, M. (1994). Frontal lobes and behaviour. Curr Opin Neurobiol, 4(2), 207-211.
Ravizza, S. M., Delgado, M. R., Chein, J. M., Becker, J. T., & Fiez, J. A. (2004). Functional dissociations within the inferior parietal cortex in verbal working memory. Neuroimage, 22(2), 562-573.
Saito, S., Logie, R. H., Morita, A., & Law, A. (2008). Visual and phonological similarity effects in verbal immediate serial recall: A test with kanji materials. Journal of Memory and Language, 59(1), 1-17.
Shepard, R. N., & Metzler, J. (1971). Mental rotation of three-dimensional objects. Science, 171(972), 701-703.
Siok, W. T., Jin, Z., Fletcher, P., & Tan, L. H. (2003). Distinct brain regions associated with syllable and phoneme. Hum Brain Mapp, 18(3), 201-207.
Smith, E. E., & Jonides, J. (1998). Neuroimaging analyses of human working memory. Proceedings of the National Academy of Sciences of the United States of America, 95(20), 12061-12068.
Sumiyoshi, C., Matsuo, K., Kato, C., Ozawa, F., Takehara, Y., Isoda, H., et al. (2003). Orthography effect on brain activities in the working memory process for phonologically ambiguous syllables: a functional magnetic resonance imaging study using Japanese speakers. Neuroscience Letters, 336(1), 50-54.
Tan, L. H., Laird, A. R., Li, K., & Fox, P. T. (2005). Neuroanatomical correlates of phonological processing of Chinese characters and alphabetic words: a meta-analysis. Hum Brain Mapp, 25(1), 83-91.
Tan, L. H., Liu, H. L., Perfetti, C. A., Spinks, J. A., Fox, P. T., & Gao, J. H. (2001). The neural system underlying Chinese logograph reading. Neuroimage, 13(5), 836-846.
Tan, L. H., Spinks, J. A., Feng, C. M., Siok, W. T., Perfetti, C. A., Xiong, J., et al. (2003). Neural systems of second language reading are shaped by native language. Hum Brain Mapp, 18(3), 158-166.
Yeh, S. L., & Li, J. L. (2002). Role of structure and component in judgments of visual similarity of Chinese characters. J Exp Psychol Hum Percept Perform, 28(4), 933-947.
Yeh, S. L., Li, J. L., & Chen, I. P. (1997). The perceptual dimensions underlying the classification of the shapes of Chinese characters. Chinese Journal of Psychology, 39(1), 47-74.
Yeh, S. L., Li, J. L., & Chen, K. M. (1999). Classification of the shapes of Chinese characters: Verification by different predesignated categories and varied sample sizes. Chinese Journal of Psychology, 41(1), 65-85.
Yik, W. F. (1978). The effect of visual and acoustic similarity on short-term memory for Chinese words. Quarterly Journal of Experimental Psychology, 30, 487-494.
Zurowski, B., Gostomzyk, J., Gron, G., Weller, R., Schirrmeister, H., Neumeier, B., et al. (2002). Dissociating a common working memory network from different neural substrates of phonological and spatial stimulus processing. Neuroimage, 15(1), 45-57.