跳到主要內容

簡易檢索 / 詳目顯示

研究生: 陳璽尹
Hsi-yi Chen
論文名稱: 字形和語意對短期記憶的影響:
The semantic and orthographic contribution to VSTM: Evidence from behavioral and neuroimaging experiments
指導教授: 吳嫻
Denise Hsien Wu
口試委員:
學位類別: 碩士
Master
系所名稱: 生醫理工學院 - 認知與神經科學研究所
Graduate Institute of Cognitive and Neuroscience
畢業學年度: 95
語文別: 英文
論文頁數: 97
中文關鍵詞: 語意字形腦造影短期記憶
外文關鍵詞: verbal short-term memory, orthography, semantic
相關次數: 點閱:21下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 在過去的研究中,當人們要短暫地記住語言材料,語音被認為是唯一用來短暫記住訊息的編碼 (Baddeley, 1974)。然而在對病人的研究裡發現,語意在短期記憶中也扮演了一定的角色(Martin et al., 1994)。本研究利用中文具有許多同音字的特性,希望能夠讓受試者在短暫記憶語言刺激材料時,無法依賴音的訊息區辨同音字,並且同時要求受試者記住同音字的意義,以作為最後判別目標字(probe)有否出現在記憶列的依據。在實驗1b中,左腦有兩個區域對於受試者在記住同音字時,相對於記住不同音的字(可用音的訊息區辨)有較高的活化,分別是左側的額葉中迴(left middle frontal gyrus, BA 9)和頂葉上迴(left superior parietal lobe, BA 7)。由於判別目標字是否和任一記憶列中的同音字為相同字的作業(identity judgment task),無法確保受試者只使用了語意訊息,受試者可能也利用了字形作為短暫記住同音字的依據。於是實驗2b我們操弄了相似字形和不同字形的同音字,發現受試者的確受到相似字形的影響,使得反應時間較長於記住不同字形的同音字。實驗三,我們試圖要分離三種訊息對於短期記憶的影響(字音、字形、字意),結果發現當受試者被要求記住中文單字的字意時,三種訊息都會被激發。另一方面,當我們同時操弄字形及字音,並且請受試者對於相同的刺激材料做相同字(identity judgment task)以及相同音(homophone judgment task)的判斷,受試者對於相同字的判斷會受到語音的影響,而對於相同音的判斷則會被字形所影響。意即,當受試者可以用語音訊息作為編碼時,語音仍舊在短期記憶中扮演了重要的角色。然而,當受試者只需要利用語音訊息完成作業,字形的效果也會被彰顯。此結果顯示了在中文裡,儘管語音對於記住中文字是重要的,字形也影響了受試者提取或短暫記住字音的表現。


    Phonology has been assumed to play a dominant role in verbal shot-term memory (VSTM), nevertheless, semantic contribution is not thought to play a role in VSTM. Martin et al. (1994) reported two patients revealing functional dissociation between phonological and semantic short-term memory. In this thesis, three experiments were conducted. Experiment 1a sought to establish a valid paradigm for the following fMRI study (Experiment 1b). The STM task (identity vs. homophone judgment) and the memory load (1 character vs. 4 characters) were manipulated. The results demonstrated that the difficulty of the two memory tasks was not significantly different, and the manipulation of memory load was effective. In Experiment 1b, the results were compatible with previous findings in showing an involvement of the left middle frontal lobe (BA 9) and the left superior parietal lobe (BA 7) in reading Chinese characters and retaining homophonic Chinese characters in VSTM. In Experiment 2a, an identity judgment task and a homophone judgment task were employed. Visual similarity and the pronunciation among the stimuli were also manipulated. The results showed a visual similarity effect in the homophone judgment task, which suggested that the phonology of Chinese characters was heavily influenced by the visual form (i.e., the radical and its position). A phonological similarity effect was also found in the identity judgment task that supported that phonology in VSTM played a dominant role in Chinese. In Experiment 2b, only homophones were included in the identity judgment task, and the visual similarity effect was observed. In Experiment 3, an identity judgment task and a lexical-decision task (LDT) were conducted. The results showed a main effect of the probe types and that of the relatedness in accuracy. However, no significant difference was found in the analysis of the mean reaction time. It showed that three kinds of the probe (i.e., semantic, orthographic, and phonological) were equally primed by the to-be-remembered character. The results from the current study highlight semantic and orthographic contribution to VSTM. The neural network that supported the VSTM of Chinese homophones might include the brain regions that were associated with orthographic processing in addition to semantics.

    1. INTRODUCTION 1 1.1 THE OTHER COMPONENTS IN THE WM MODEL 3 1.1.1 The phonological similarity effect 3 1.1.2 The word length effect 4 1.1.3 The articulatory suppression 4 1.1.4 Neuroimaging evidence of phonological VSTM 5 1.2 THE SEMANTIC VSTM 7 1.2.1 Neuropsychological evidence of semantic VSTM 9 1.2.2 Neuroimaging evidence of semantic VSTM 11 1.3 THE INFLUENCE OF VISUAL FORMS TO VSTM 13 1.4 THE FEATURE OF CHINESE CHARACTERS 14 1.5 THE CURRENT STUDY 15 2. EXPERIMENT 1A 17 2.1. METHOD 17 2.1.1 Participants 17 2.1.2 Materials and Design 18 2.1.3 Procedure 19 2.2 RESULTS AND DISCUSSION 21 3. EXPERIMENT 1B 23 3.1 METHOD 23 3.1.1 Participants 23 3.1.2 Materials and design 23 3.1.3 Procedure 24 3.1.4 Data acquisition 24 3.1.5 Data processing 25 3.2 RESULT 26 3.2.1 Behavioral results 26 3.2.2 Imaging results 27 3.2.2.1 The main effect of the four memory conditions versus the blank period 27 3.2.2.2 The load effect of identity and homophone judgment 28 3.2.2.3 The main effect of the memory tasks 29 3.2.2.4 The interaction between two factors: The memory task and loads 30 3.3 DISCUSSION 32 3.3.1 The network of VSTM 32 3.3.2 The phonological loop of VSTM 33 3.3.3 The load effects of the identity vs. homophone judgment task 34 3.3.3.1 The left inferior frontal lobe (BA 44/45) and the middle frontal lobe (BA 9) 34 3.3.3.2 The left superior parietal lobe (BA 7) 36 3.3.4 The load effects of the homophone vs. identity judgment task 38 4. EXPERIMENT 2A 39 4.1 METHOD 41 4.1.1 Participants 41 4.1.2 Materials and Design 41 4.1.3 Procedure 45 4.2 RESULTS 46 4.3 DISCUSSION 52 4.3.1 The identity judgment task 52 4.3.2 The homophone judgment task 53 5. EXPERIMENT 2B 56 5.1 METHOD 56 5.1.1 Participants 56 5.1.2 Materials and design 56 5.1.3 Procedure 57 5.2 RESULTS 58 5.3 DISCUSSION 59 6. EXPERIMENT 3 61 6.! METHOD 62 6.1.1 Participants 62 6.1.2 Materials and Design 63 6.1.3 Procedure 64 6.2 RESULTS 65 6.3 DISCUSSION 68 7. GENERAL DISCUSSION 70 7.1 A SUMMARY OF THE RESULTS IN THE CURRENT STUDY 70 7.2 NEUROCORRELATES UNDERLYING VSTM 72 7.3 COMPONENTS OF VSTM OTHER THAN PHONOLOGY 74 7.4 THE PHONOLOGICAL SIMILARITY AND THE VISUAL SIMILARITY EFFECT IN EXPERIMENT 2A 78 7.5 CONCLUSION 79 REFERENCE 81

    Awh, E., Jonides, J., Smith, E.E., Schumacher, E.H., Koeppe, R.A., & Katz, S. (1996) Dissociation of storage and rehearsal in verbal working memory: Evidence from positron emission tomography. Psychological Science, 7(1), 25-31.
    Baddeley, A. D. (1966) Short-term memory for word sequences as a function of acoustic, semantic, and formal similarity. Quarterly Journal of Experimental Psychology, 18, 362-365.
    Baddeley, A. D., & Hitch, G. J. (1974) Working memory. In G. A. Bower (Ed.), Recent advances in learning and motivation, 8, 47-90.
    Baddeley, A. D., Thomson, N., & Buchanan, M. (1975) Word length and the structure of short-term memory. Journal of Verbal Learning and Verbal Behavior, 14, 575-589.
    Baddeley, A. D. (1992) Working memory. Science, 255, 556-559.
    Baddeley, A. D. (1995) Working memory. In M. S. Gazzaniga (Ed.), The cognitive neurosciences, 755-764.
    Baddeley, A. D. (2000) The episodic buffer: a new component of working memory?, Trends in Cognitive Sciences, 4(11), 417-423.
    Baddeley, A. D. (1998) Working memory. C. R. Acad. Sci. Paris, Sciences de la vie / Life Sciences, 321, 167-173.
    Booth, R., Dong, L., Burman, D., Chou, T.L., Jin, Z., Peng D.L., Zhang, L., Ding, G., Deng, Y., & Liu, L. (2006) Specialization of phonological and semantic processing in Chinese word reading. Brain research, 1071, 197-207.
    Chein, J. M., Fissell, K., Jacobs, S., & Fiez, J. A. (2002) Functional heterogeneity within Broca’s area during verbal working memory. Physiology and Behavior, 77(4-5), 635-639.
    Chincotta, D. & Underwood, G.. (1997) Bilingual memory span advantage for Arabic numerals over digit words. British Journal of Psychology, 88, 295-310.
    Chincotta, D., Underwood, G., Ghani, K. A., Papadopoulou, E., & Wresinski, M. (1999) Memory span for Arabic numerals and digit words: Evidence for a limited-capacity, visuo-spatial storage system. Quarterly Journal of Experimental Psychology, 52A(2), 325-351.
    Caza, N., & Belleville, S. (1999) Semantic contribution to immediate serial recall using an unlimited set of items: Evidence for a multi-level capacity view of short-term memory. International Journal of Psychology, 34, 334-338.
    Collette, F., Majerus, S., Linden, M., Pade, P., Degueldre, C., Delfiore, G., Luxen, A., & Salmon, E. (2001) Contribution of lexical-semantic processes to verbal short-term memory tasks: A PET activation study. Memory, 9, 249-259.
    Collete, F., & Van der Linden, M. (2002) Brain imaging of the central executive component of working memory. Neuroscience Biobehavioral Review, 26(2), 105-125.
    Coltheart, V., Mondy, S., Dux, P., & Stephenson, L. (2004) Effects of orthographic and phonological word length on memory for lists shown RSVP and STM rates. Journal of Experimental Psychology, 30(4), 815-826.
    Devlin, T., Matthews, P., & Rushworth, M. (2003) Semantic processing in the left inferior prefrontal cortex: A combined functional magnetic resonance imaging and transcranial magnetic stimulation study. Journal of Cognitive Neuroscience, 15(1), 71-84.
    Fiez, J. A., Raife, E. A., Balota, D. A., Schwarz, J. P., & Raichle, M. E. (1996) A positron emission tomography study of the short-term maintenance of verbal information. The Journal of Neuroscience, 16(2), 808-822.
    Garbrieli, D., Poldrack, A., & Desmond, E. (1998) The role of left prefrontal cortex in language and memory. Neuroimaging of Human Brain Function, 95, 906-913.
    Gathercole, S. E., & Baddeley, A. D. (1993) Working Mmemory and Llanguage. Psychology Press.
    Gruber, O. (2001) Effect of domain-specific interference on brain activation associated with verbal working memory task performance. Cerebral Cortex, 11, 1047-1055.
    Henson, R.N.A., Burgess, N., & Firth, C.D. (2000) Recoding, storage, rehearsal and grouping in verbal short-term memory: an fMRI study. Neuropsychologia, 38, 426-440.
    Hanten, G., & Martin, C. (2000) Contribution of phonological and semantic short-term memory to sentence processing: Evidence from two cases of closed head injury in children, Journal of Memory and Language, 43, 335-361.
    Hung, D. L., Tzeng, O. J. L., Tzeng, A. K. Y., (1992) Automatic activation of linguistic information in Chinese character recognition. Orthography, Phonology, Morphology, and Meaning, 199-130
    Hulme, C., Maughan, S., & Brown, G. (1991) Memory for familiar and unfamiliar words: Evidence for a long-term memory contribution to short-term memory span. Journal of Language and Memory, 30, 685-701.
    Jonides, J., Schumacher, E., Smith, E., Koeppe, R., Awh, E., Reuter-Lorenz, P., Marshuetz, C., & Willis, C. (1998) The role of parietal cortex in verbal working memory. The Journal of Neuroscience, 18(13), 5026-5034.
    Kuo, W.J., Yeh, T.C., Duann, J.R., Wu, Y.T., Ho, L.T., Hung, D., Tzeng, O.J.L., & Hsieh, J.C. (2001) A left-lateralized network for reading Chinese words: a 3T fMRI study. NeuroReport, 12, 1821.
    Logie, H., Sala, D., & Wynn, V. (2000) Visual similarity effects in immediate verbal serial recall. Quarterly of Experimental Psychology, 53A, 626-646.
    Larsen, J.D., Baddeley, A., & Andrade, J. (2000) Phonological similarity and the irrelevant speech effect: Implications for models of short-term verbal memory. Memory, 8(3), 145-157.
    Martin, C., Shelton, R., & Yaffee, L. (1994) Language processing and working memory: Neuropsychological evidence for separated phonological and seamantic capacities. Journal of Memory and Language, 33, 83-111.
    Martin, C., & Freedman L. (2001) Short-term retention of lexical-semantic representations: implication for speech production. Memory, 9, 261-280.
    Martin, C., Denise, W., Freedman, M., Jackson, E., & Lesch,.M. (2003) An event-related fMRI investigation of phonological versus semantic short-term memory. Journal of Neurolinguistics, 16, 341-360.
    Mo, L., Liu, H.L., Jin, Hua., & Yang, Y.L. (2005) Brain activation during semantic judgment of Chinese sentences: A Functional MRI study. Human Brain Mapping, 24, 305-312.
    Murray, D. J. (1968) Articulation and acoustic confusability in short-term memory. Journal of Experimental Psychology, 78, 679-684.
    Poirier, M., & Saint-Aubin J. (1995) Memory for related and unrelated words: further evidence on the influence of semantic factors in immediate serial recall. Quarterly Journal of Experimental Psychology, 48A(2), 384-404.
    Romani, C., & Martin, R. (1999) A deficit in the short-term retention of lexical-semantic information: Forgetting words but remembering a story. Journal of Experimental Psychology: General, 128(1), 56-77.
    Romani, C., McAlpine, S., Olson, A., Tspuknida E., & Martin, R. (2005) Length, lexicality, and articulatory suppression in immediate recall: Evidence against the articulatory loop. Journal of Memory and Language 52, 398-415.
    Roskies, A. L., Fiez, J. A., Balota, D. A., Raichle, M. E., & Petersen, S. E. (2001) Task-dependent modulation of regions in the left inferior frontal cortex during semantic processing. Journal of Cognitive Neuroscience, 13(6), 829-843.
    Rivizza, M., Delgado, R., Chein, J., Becker, J., & Fieze, J. (2004) Functional dissociations with the inferior parietal cortex in verbal working memory. Neuroimaging, 22, 562-573
    Siok, W.T., Perfetti, C.A., Jin, Z., & Tan, L.H. (2004) Biological abnormality of impaired reading is constrain by culture, Nature, 431, 71-76.
    Sumiyoshi, C.,Matsuo, K.,Kato, C., Ozawa, F., Takehara, Y.,Isoda, H., Isogai, S., Sakahara, H., & Nakai, T. (2003) Orthography effect on brain activities in the working memory process for phonologically ambiguous syllables: a functional magnetic resonance imaging study using Japanese speakers. Neuroscience Letters, 336, 50-55.
    Salamé, P., & Baddeley, A. (1982) Disruption of short-term memory by unattended speech: Implications for the structure of working memory. Journal of Verbal Learning and Verbal Behavior, 21, 150-164.
    Smith, E. E., & Jonides, J. (1997) Working memory: a view from neuroimaging. Cognitive Psychology, 33(1), 5-42.
    Smith, E. E., & Jonides, J. (1998) Neuroimaging analyses of human working memory. Psychology, Neurobiology, 95, 12061-12068.
    Shivde, G., & Thompson-Schill, L. (2004) Dissociating semantic and phonological maintenance using fMRI. Cognitive, Affective, & Behavioral Neuroscience, 4(1), 10-19.
    Shallice, T., & Vallar, G. (1990) The impairmemt of auditory-verbal short-term storage. In Vallar, G., & Shallice, T. (Eds.), Neuropsychological Impairmemts of Short-Term Memory. Cambridge Univ. Press, New York, 11-53.
    Tzeng, O. J. L. (1994) Chinese orthography and reading: A clarification. Annual International Language in Education Conference (Hong Kong 1993), FL 023 207.
    Tan, L. H., & Perfetti, C. A.(1998) Phonological codes as early sources of constraint in Chinese word identification: A review of current discoveries and theoretical accounts. Reading and Writing: An Interdisciplinary Journal, 10, 165-200
    Tan, L. H., Spink, J.A., Gao, J. H., Liu, H.L., Perfetti, C. A., Xiong, J., Stofer, K. A., Pu, Y., Liu, Y., & Fox, P. T. (2000) Brain activation in the processing of Chinese characters and words. A functional MRI study. Human Brain Mapping, 10, 16-27.
    Vallar, G., Betta, A., Catherina, M., & Silveri, C. (1997) The phonological short-term store-rehearsal system: Patterns of impairment and neural correlates. Neuropsycholagia, 35, 795-812.
    Zurowski, B., Gostomzyk, J., Gron, G., Weller, R., Schirrmeister, H., Neumeier, B., Spitzer, M., Reske, N., & Walter, H. (2002) Dissociating a common working memory network from different neural substrate of phonological and spatial stimulus processing. Neuroimage, 15, 45-47.

    QR CODE
    :::