초록방법우뇌언어기능평가를 한국어로 번안하고 건강한 성인 52명을 대상으로 검사하였다. 하위 검사인 강조강세검사의 검사자 신뢰도 분석을 위해 무작위로 채택한 35명의 발화 녹음 자료를 사용하였다. 검사자 간 신뢰도는 3명 검사자의 평가 결과를 바탕으로 분석하였다. 검사자 내 신뢰도 분석을 위해 검사자가 2주와 3개월의 간격으로 총 3회 평가하였다.
결과한국어판 우뇌언어기능평가 결과 전체 평균은 110.75± 2.90점(116점 만점)이었다. 하위검사별 정반응 백분율은 담화분석 99.9%, 은유글검사 99.6%, 어휘의미검사 99.3%, 은유그림검사 98.7%, 강조강세검사 94.4%, 추론검사 83.5%, 유머검사 76.5%였다. 검사자 간 신뢰도 지표로 사용한 Gwet AC1 통계량은 .83± .02 (p < 0.001)로 높게 나타났다. 검사자 내 일관성은 Gwet AC1이 .93± .01이었고 (p < .001), 검사 간격이 1개월 이상인 조건 에서 검사자 내 평가 결과의 변화가 통계적으로 유의하였다[Cochran’s Q(2) =13.82, p < .001].
AbstractObjectivesThis study presents the Korean version of the Right Hemisphere Language Battery (K-RHLB), reports the preliminary results in healthy subjects, and evaluates inter- and intra-rater reliability.
MethodsFifty-two healthy patients underwent the RHLB, which was adapted to the Korean language. The rater reliability of the Emphatic Stress Test, which is a subtest of the battery, was examined. For inter-rater reliability, three raters evaluated the focus prosody of 35 randomly chosen subjects. For intra-rater reliability, one rater re-evaluated the prosody within 2-week and 3-month intervals.
ResultsThe total mean score of the K-RHLB result was 110.75 ± 2.90 out of 116. The mean percentages of correct responses in the subtests were high and appeared in the following order: Discourse Analysis (99.9%), Written Metaphor Test (99.6%), Lexical Semantic Test (99.3%), Picture Metaphor Test (98.7%), Emphatic Stress Test (94.4%), Inference Test (83.5%), and Humor Test (76.5%). In addition, the inter-rater agreement was high (Gwet’s chance-corrected agreement coefficients AC1 of 0.83 ± 0.02, p < 0.001), as was the intra-rater consistency (Gwet’s AC1 0.93 ± 0.01, p < 0.001). However, some changes in evaluation criteria were confirmed for retest intervals longer than 2 months [Cochran’s Q (2) = 13.82, p < 0.001].
ConclusionThe preliminary results of the K-RHLB in healthy subjects showed overall high scores. Both inter- and intra-rater reliabilities were acceptable. The K-RHLB can be a starting point for more detailed assessment and elaborate intervention in patients with right hemisphere damage. The battery can also be used to evaluate neurodevelopmental disorders with symptoms such as deficits in understanding non-literal languages, semantic integration, and perception and production of appropriate prosody.
The left cerebral hemisphere is primarily responsible for language function. The phenomenon by which the unilateral cerebral hemisphere exerts more influence on language function is referred to as language lateralization (Knecht et al., 2000). The possibility of asymmetric functional roles of both hemispheres has been studied previously (Rasmussen & Milner, 1977), and various efforts have been made to measure these roles (Bradshaw, Thompson, Wilson, Bishop, & Woodhead, 2017).
Because of language laterality, several studies have been conducted targeting the left cerebral hemisphere in relation to language. However, only a few studies have been conducted to investigate the role of the right cerebral hemisphere in language function. Bryan (1988) noted that when an aphasia test was performed on subjects with right hemisphere damage (RHD), the results did not differ significantly compared with those of normal subjects. However, the same study reported that subtle language problems, such as those involving metaphorical comprehension and understanding of humor, appeared in subjects with right hemisphere injuries (Bryan, 1988). A language function assessment conducted on a split human brain with conditions involving transection of the corpus callosum revealed that the right hemisphere performs a language function different from that of the left hemisphere (Gazzaniga, 2000).
A stroke in the right cerebral hemisphere causes one or more types of language impairment (Dyukova, Glozman, Titova, Kriushev, & Gamaleya, 2010). Several studies have used various approaches to determine the role of the right hemisphere in language function. One test, the Right Hemisphere Language Battery (RHLB), was developed in British English to raise awareness about language and communication impairments in patients with RHD and evaluate these conditions qualitatively and quantitatively. Studies related to this test have also been conducted (Bryan, 1995; Bryan & Hale, 2001).
Ramsey and Blake (2020) reported the various standardized tests used by speech-language pathologists in the United States for the assessment and screening of cognitive-communication disorders associated with right hemisphere stroke. These tests are listed in Table 1 (adapted from Ramsey & Blake, 2020, p. 746).
Some of the tests in Table 1 were adapted to Korean. Table 2 shows a few such tests, as well as an original test, with their test domains. Among these, various versions of the Mini Mental State Examination (MMSE; Folstein, Folstein, & McHugh, 1975) or Montreal Cognitive Assessment (MoCA; Nasreddine et al., 2005) are widely used as screening tools. For the thorough assessment of cognitive deficits, neuropsychological assessment batteries such as the Korean version of the Consortium to Establish a Registry for Alzheimer’s Disease neuropsychological assessment battery [CERAD-K(N); Lee et al., 2002] or Seoul Neuropsychological Screening Battery (SNSB; Kang & Na, 2003) can be used. Although comprehensive and intensive, these batteries mainly focus on assessing symptoms of dementia. The Daegu Diagnostic Aphasia Examination (DDAE; Jeong, 2006), specifically the section for right hemisphere brain function, and the Korean Montreal Protocol for Evaluation of Communication (Korean MEC protocol; Woo & Kim, 2019) are more language- and communication-oriented tests that are associated with RHD traits. Additionally, Ahn (2008) reported using the Mini Inventory of Right Brain Injury (MIRBI; Pimental & Kinsbury, 1989), translated to Korean by the author, for participant screening in the study which pertained to comprehension of Korean proverbs in RHD patients. Furthermore, Yang and Van Lancker Sidtis (2016) reported test results in RHD patients using the Korean version of the MIRBI.
The evaluation tools for language function should be developed using the country’s native language because language is heavily influenced by sociocultural factors. However, in South Korea, there is currently no well-established test for right cerebral hemisphere language function. Therefore, for the quantitative evaluation of right hemisphere language function, the current study reports the adaptation protocol of the Korean version of the Right Hemisphere Language Battery (K-RHLB), the preliminary test results for each subtest, and the reliability of the K-RHLB.
METHODSTest MaterialsThe RHLB (Bryan, 1995) comprises seven subtests related to the symptoms reported for patients with RHD, particularly those for deficits in comprehension of metaphor (Winner & Gardner, 1977), semantic integration (Bryan, 1988; Caramazza, Gordon, Zurif, & DeLuca, 1976; Wapner, Hamby, & Gardner, 1981), appreciation of humor (Brownell, Michel, Powelson, & Gardner, 1983; Gardner, Ling, Flamm, & Silverman, 1975), lexical-semantic association (Coughlan & Warrington, 1978; Gainotti, Caltagirone, & Miceli, 1983; Joanette, Goulet, Hannequin, & Boeglin, 1990; Taylor & Warrington, 1973), and understanding or expressing intention based on situation and context (Bryan, 1988; Hirst, LeDoux, & Stein, 1984; Weintraub & Mesulam, 1983).
The original test materials were first translated into Korean and retained whenever possible. However, most non-literal phrases have been replaced with appropriate Korean expressions. Following the original battery, the K-RHLB (version 1.0) consists of seven subtests, six of which are formal tests (Picture Metaphor Test [PMT], Written Metaphor Test [WMT], Inference Test [IT], Humor Test [HT], Lexical Semantic Test [LST], and Emphatic Stress Test [EST]). The remaining subtest is a post-session evaluation (Discourse Analysis [DA]). Each formal test includes a practice item. The structures of the subtests and scoring system are analogous to the original RHLB (Bryan, 1995) and the Italian version of the RHLB (Batteria del Linguaggio dell’Emisfero Destro; Zanini, Bryan, De Luca, & Bava, 2005), except that the K-RHLB has a revision in the EST.
The EST evaluates prosody production by inducing emphatic stress on new information that contrasts with given information, where the stress can be delivered as changes in pitch, rhythm, and/or loudness. The K-RHLB (version 1.0) subdivided EST into the Emphatic Stress Test-Ga (EST-Ga) and Emphatic Stress Test-Na (EST-Na), with each comprising one practice item and five main items.
The EST-Ga was revised, as motivated by Lee and Park (2019), to include the induction of narrow-focus prosody using corrective focus. Narrow-focus prominence can be more salient than broad-focus prominence, which helps the examiner perceive and judge emphatic stress. For each item, a picture is presented, and the examiner asks the participant a simple yes-or-no question, emphasizing the target phrase that is always false (e.g., “Does the woman go to buy meat?”). The participant responds by correcting the target (e.g., “No, the woman goes to buy vegetables.”).
The EST-Na maintains the original form of the Production of Emphatic Stress (Bryan, 1995), wherein a set of two pictures with contrasting information is referred to for each item. The examiner points to the first picture and says the first half of the sentence; the subject then completes the second half, referring to the second picture. The maximum score is 5 for each section of the EST (Ga and Na), thus rendering a maximum of 10 points for the entire subtest.
ParticipantsA total of 52 native Korean speakers without language disorders participated in the study (mean age: 31.4± 7.6 years; 38 females; 48 right-handed, 1 left-handed, 3 ambidextrous). All the participants had normal or corrected-to-normal vision. Written informed consent was obtained from all the participants, and financial compensation was provided.
Test ProceduresThis study was approved by the Institutional Review Board (CNUSH 2021-04-002) and was conducted in June and July 2021. Both the examiner and the participant wore face masks during the session to prevent infectious disease transmission. Each participant was individually tested in a quiet room by an examiner trained in linguistics and phonetics (first author). Figure 1 illustrates the test procedures performed. After providing instructions and filling out the demographic questionnaire, the K-RHLB (version 1.0) was conducted. In this study, the battery was performed in a fixed sequence, specifically in the order of PMT, WMT, IT, HT, LST, and EST. The test was conducted with the test materials (pictures or text) being presented to the participant via a computer monitor. Feedback was provided only for the practice items at the beginning of each formal subtest. Each session took around 25–60 minutes (approximately 40 minutes on average), depending on the pace of the participant. The DA was performed by the examiner after the session.
Reliability TestsTo verify rater reliability, the EST was chosen from the formal subtests as it is most likely to be affected by examiners’ subjective judgment criteria due to the gradient and less categorical nature of prosody. As for the other five formal tests, four (PMT, WMT, HT, and LST) were multiple-choice tasks, thus being free from rater degree-of-freedom, and the IT was evaluated based on the preset range of responses. Thus, the EST was subjected to the estimation of inter- and intra-rater reliability.
The evaluation scores for the EST were obtained from three raters, namely the examiner who conducted the audio-recorded sessions (Rater 1) and two additional raters who were qualified speech-language pathologists with more than 10 years of experience (Raters 2 and 3). The latter two raters listened to the recordings of 35 randomly chosen subjects and evaluated the emphatic stress on each item by assigning a score of 1 (appropriate focus prosody) or 0 (no prosodic saliency on/around the target).
Test-retest reliability was investigated based on Rater 1’s repetitive evaluations. The first session (Session 1) was the original test session conducted in person by Rater 1, as described above. Rater 1 re-evaluated the EST based on audio recordings 1–2 weeks (Session 2) and 2–3 months (Session 3) after the first session.
Data AnalysisA total of 4,316 data points (52 subjects× 83 evaluation entries) were obtained. All statistical analyses were performed using R software (R Core Team, Vienna, Austria; https://www.R-project.org/). The scores were summarized for each subtest, and the mean percentages of correct responses are provided.
In analyzing rater reliabilities in the EST, each data point was coded 1 or 0 for appropriate or inappropriate emphatic stress, respectively. Gwet’s chance-corrected agreement coefficients AC1(Gwet, 2008) were calculated for inter-rater reliability using the gwet.ac1.raw () function in the R package irrCAC. A total of 1,050 data points (3 raters× 35 speakers×10 items) were used.
To evaluate intra-rater reliability, McNemar’s Chi-square tests of symmetry were performed to assess changes within the rater’s scores using the pairwiseMcnemar () function of the rcompanion package in R with the “fdr” option for repeated-measure correction using the Benjamini and Hochberg method (Benjamini & Hochberg, 1995). Along with Gwet’s AC1, the overall intra-rater variability across the three sessions was estimated using Cochran’ s Q using the cochran.qtest () function in the R package RVAide-Memoire. The number of data points used was 1,050 (3 sessions × 35 speakers×10 items).
RESULTSDescriptive StatisitcsThe total mean score of the K-RHLB in 52 healthy subjects was 110.75± 2.90 out of 116 points (mean percentage correct: 95.5± 2.5%). Table 3 shows the mean scores along with the proportions of correct responses for each subtest. The DA, which is a post-session assessment, revealed that the highest mean score reached 99.9% of the maximum score. Among the six formal subtests, the percentage of correct responses was highest for the WMT (99.6%), followed by the LST (99.3%), PMT (98.7%), and EST (94.4%). The IT obtained a relatively low percentage of correct responses (83.5%), and the HT had the lowest percentage of correct responses (76.5%).
Figure 2 shows the distribution of the participants’ scores in terms of the proportion of correct responses. The differences in their overall ranges and interquartile ranges of scores across subtests indicate that subject variability is greater in the IT, the HT, and the EST than in the other four subtests.
Inter-rater ReliabilityThe number of cases with correct placement of emphatic stress was 328 (93.7%), 293 (83.7%), and 338 (96.6%) according to the judgments of Raters 1, 2, and 3, respectively. The contingency table for the three raters (correct response: 1; incorrect response: 0) is shown in Table 4. The raw percentage agreement was 79.1% between the three raters, with 350 cases each (10 items× 35 subjects). Gwet’s AC1 was 0.83± 0.02 (95% CI: 0.80-0.87, p<0.001). Figure 3 compares the scores given by the three raters to each subject in the EST. The points given by Rater 1 ranged from 7 to 10 per subject, with 10 points being the most common and the counts decreasing towards 7 points. The points per subject given by Rater 2 also ranged from 7 to 10, but a score of 7 points was the most common, followed by 8 and 10. Rater 3 evaluated the subjects’ performance at 9 or 10 points. None of the participants gained a score lower than 7 from the three raters.
Intra-rater AgreementsThe contingency table of evaluations for the three sessions by Rater 1 is shown in Table 5 (correct response: 1, incorrect response: 0). The raw percentage of agreement between sessions was 96.6% for Sessions 1 and 2, 92.6% for Sessions 1 and 3, and 92.0% for Sessions 2 and 3. The raw intra-rater agreement across the three sessions was 90.6%. Gwet’s AC1 within the rater for the three sessions was 0.93± 0.01 (95% CI: 0.90-0.95, p<0.001).
The results of the McNemar tests showed that the evaluation results from Session 1 and 2 were similar [χ2 (1) = 0.33, p=0.56], whereas those of Session 3 significantly differed from those of both Sessions 1 [χ2 (1) = 7.54, p=0.009] and 2 [χ2 (1) = 9.14, p=0.008]. Overall, the evaluation scores varied within the rater across repeated evaluations, reflecting the differences between the earlier two sessions and the last session [Cochran’s Q(2) =13.82, p < 0.001].
DISCUSSIONEmphatic Stress and Rater ReliabilityThe EST was retained in the K-RHLB as it differentiated the RHD group from both the left hemisphere damage (LHD) and control groups, neither of which differed significantly from each other in terms of the Production of Emphatic Stress in the original battery [p. 21, Table 4.1 and p. 22, Table 4.2 in Bryan (1995)]. Although the results were lower than the scores obtained by neurotypical English subjects in Bryan (1995), the participants in this study obtained relatively high mean scores on the EST.
The current study provided novel results on the rater reliability of prosodic evaluation, wherein other factors were constant. The inter-rater reliability among the three raters was high, especially considering the difficulty of judging prosodic features in Korean (e.g., Lee & Cho, 2020). This positive result may be attributed to the fact that positive response rates were high across three raters (approximately 83–97%). Although not comparable in terms of study design, a previous report on rater reliabilities using the original RHLB (Bryan, 1995) similarly found a high concordance between two judges (Pearson correlation coefficient R= 0.89, p<0.001) in the DA of RHD and LHD subjects.
For intra-rater variability, the change in scores between two consecutive sessions held within 2 weeks of one another was trivial. In contrast, a statistically significant difference was observed between the second and third sessions. The total number of points given by the rater was 328 in Session 1, 330 in Session 2, and 314 in Session 3, with a decrease of 16 points noted from Sessions 2 to 3. It is important to note that the retest sessions (Sessions 2 and 3) were conducted based on the audio recordings. Since the study was in progress over the interval between the second and third evaluations, it is possible that the rater modified the judgment criteria. This result implies that an examiner’s judgment can vary with time and experience. Nevertheless, the assessment of emphatic stress was relatively stable in healthy subjects with good intra-rater consistency. A previous study on the original RHLB provided another example of test-retest reliability (Bryan, 1995), where the RHD and LHD groups were tested 1–6 weeks post-onset and re-examined 14–20 weeks post-onset. It yielded consistent results between the two sessions, except for significant differences in the LST and DA for the RHD group and the IT, LST, and EST for the LHD group.
Overall Test ResultsThe test scores of healthy subjects were high across the board, with noticeable individual variations in the IT and HT. The subjects obtained remarkably high mean scores in the two types of metaphor tests (PMT and WMT) and the LST. However, assessing for the IT was not without difficulties as subjects had more freedom in the manner and length of their responses, despite the preset criteria for evaluation. The HT was the most difficult among the formal tests. An explanation for this result might be that a multiple-choice test may not be straightforward enough to find the “correct” punchline of a humorous story. However, it does not explain the fact that the score for the Appreciation of Humor is much higher in Bryan (1995) with a mean score of 9.70± 0.47 in 30 neurologically normal subjects. Alternatively, the current result may be related, in part, to the fact that there were subjects who were not familiar with the type of jokes with a punchline, which involves the transition of interpretation and development against the initial set-up of the story.
The scores of the DA were very high, the mean of which reached nearly 100% correct responses. This result can be due to some confounding factors, such as lack of time for natural communication between the examiner and subject during the session and differences in sociocultural norms and expectations. For example, it is common not to use humor or jokes in the Korean culture to indicate sincerity. With this tendency to be “in the normal range,” most of the discourses would be accepted as typical in terms of humor (which is an evaluation criterion in the DA that is independent of the HT), whereas the discourse would be marked down for “offensive” humor (e.g., sarcasm or irony). Further discussion requires test data in patients with “Pragmatic Aphasia” (Joanette & Ansaldo, 1999), or “Apragmatism” (Myers, 2001), i.e., the symptoms associated with RHD.
The RHLB in Clinical UseAphasia is a typical symptom of a lesion that occurs in the left hemisphere, and the types of aphasia can be roughly classified. Therefore, several studies related to language function in the left hemisphere have been conducted. However, the language function of the right hemisphere is less obvious than that of the left hemisphere. In addition, since the right hemisphere is also related to cognitive function, its significance in language function has been clinically overlooked.
Communication problems caused by RHD are not limited to language issues. Patients with RHD display signs of cognitive decline, such as neglect syndrome, as well as deficits in concentration, memory, and executive ability (Myers, 1999; Tompkins, Klepousniotou, & Scott, 2013). It also causes problems in abstract language comprehension, such as metaphors, inference making, and understanding jokes. Patients with RHD show deficits in prosodic structures and have difficulty communicating using nonverbal elements (Baum & Dwivedi, 2003). These problems negatively affect the activities of daily living, social participation, and quality of life of the patients (Blake, 2006; Lehman & Tompkins, 2000).
According to a recent study, the recovery of aphasia after a stroke occurs not only in the left cerebral hemisphere but also in the right cerebral hemisphere through complex interrelationships (Li, Mukadam, & Kiran, 2022; Weiller et al., 1995). Each study has multiple heterogeneous results; however, it seems certain that the functional activity of the left and right cerebral hemispheres changes dynamically during recovery from aphasia (Hartwigsen & Saur, 2019). This means that the language function of the right cerebral hemisphere greatly affects the recovery from aphasia caused by lesions in the left cerebral hemisphere. That is, the preservation of the speech function of the right cerebral hemisphere can positively affect the patient’s recovery from aphasia.
Therefore, it is important to acknowledge the clinical significance of RHLB in patients with stroke. Detecting and evaluating these symptoms in the initial stages of right cerebral hemisphere injury is very important for establishing a treatment plan for the patient and providing early interventional treatment. In addition, it can provide vital information for understanding the recovery mechanism of aphasia caused by left brain lesions and predicting the prognosis.
A limitation of the present version of the K-RHLB is that, in principle, it does not impose any time limits on the subject’s response. Because the deficits in RHD are typically related to delays or inefficiencies rather than a total failure of the processes, Tompkins (2012) suggested emphasizing the speed of response in the treatment of the RHD population. As the current study is based on a healthy population, RHD and LHD patients should be examined using the test to discuss its validity and direction for refinement.
CONCLUSIONThis study reviewed the adaptation of the K-RHLB (version 1.0) for assessing language communication deficits and provides preliminary test results in healthy subjects, along with inter- and intra-rater reliabilities for the evaluation of emphatic stress. The mean scores were very high in metaphor comprehension and picture-word matching tasks, whereas they were relatively low in the integration of information and completion of jokes.
Pragmatic language and communication skills require the incorporation of linguistic knowledge and an understanding of interlocutors’ intentions and social norms in a particular context. This complexity complicates the quantification and evaluation of RHD syndromes. The K-RHLB can be a starting point for more detailed assessment and elaborate intervention in patients with RHD. In addition, the K-RHLB can be used to evaluate individuals with neurodevelopmental disorders with symptoms such as deficits in understanding non-literal languages, semantic integration, and perception and production of appropriate prosody [e.g., for schizophrenia (Pawełczyk, Kotlicka-Antczak, Łojek, Ruszpel, & Pawełczyk, 2018)]. The normative scores of the K-RHLB for healthy subjects and patients with right and left hemisphere damage should be established in future studies.
Table 1.
Table 2.MMSE=Mini Mental State Examination (Folstein et al., 1975); K-MMSE=the Korean MMSE (Kang, Na, & Hahn, 1997); MMSE-K=the Korean version of MMSE (Park & Kwon, 1990); MMSE-KC=the Korean version of MMSE in the CERAD-K(N) (Lee et al., 2002); MMSE-DS=the Korean version of MMSE for Dementia Screening (Kim et al., 2010); MoCA=Montreal Cognitive Assessment (Nasreddine et al., 2005); K-MoCA=Korean-Montreal Cognitive Assessment (Kang, Park, Yu, & Lee, 2009); MoCA-K=the Korean version of the MoCA (Lee et al., 2008); CERAD-K(N)=Consortium to Establish a Registry for Alzheimer’s Disease neuropsychological assessment battery; SNSB=Seoul Neuropsychological Screening Battery (Kang & Na, 2003); SNSB-II=SNSB 2nd edition (Kang, Jahng, & Na, 2012); SNSB-C=SNSB-Core (Jahng, Na, & Kang, 2015); SNSB-D=SNSB-Dementia Version (Ahn et al., 2010); DDAE=Daegu Diagnostic Aphasia Examination (Jeong, 2006); RH=right hemisphere; Korean MEC=the Korean Montreal Protocol for Evaluation of Communication (Woo & Kim, 2019; Joanette et al., 2004); K-RHLB=the Korean version of the Right Hemisphere Language Battery (this study). Table 3.REFERENCESAdamovich, B. B., & Henderson, J. (1992). Scales of cognitive ability for traumatic brain injury. Pro-Ed.
Ahn, H. J., Chin, J., Park, A., Lee, B. H., Suh, M. K., Seo, S. W., & Na, D. L. (2010). Seoul Neuropsychological Screening Battery-Dementia Version (SNSB-D): a useful tool for assessing and monitoring cognitive impairments in dementia patients. Journal of Korean Medical Science, 25(7), 1071–1076.
Ahn, J. B. (2008). Study on Korean proverb comprehension in patients with right hemisphere damage. Speech Sciences, 15(3), 67–78.
Baum, S. R., & Dwivedi, V. D. (2003). Sensitivity to prosodic structure in left- and right-hemisphere-damaged individuals. Brain and Language, 87(2), 278–289.
Burns, M. S. (1997). Burns brief inventory of communication and cognition. The Psychological Corporation.
Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of The Royal Statistical Society: Series B (Methodological), 57(1), 289–300.
Blake, M. L. (2006). Clinical relevance of discourse characteristics after right hemisphere brain damage. American Journal of Speech-Language Pathology, 15(3), 255–267.
Bradshaw, A. R., Thompson, P. A., Wilson, A. C., Bishop, D. V. M., & Woodhead, Z. V. J. (2017). Measuring language lateralisation with different language tasks: a systematic review. Peer J, 5, e3929.
Brownell, H. H., Michel, D., Powelson, J., & Gardner, H. (1983). Surprise but not coherence: sensitivity to verbal humor in right-hemisphere patients. Brain and Language, 18(1), 20–27.
Bryan, K. L. (1988). Assessment of language disorders after right hemisphere damage. International Journal of Language & Communication Disorders, 23(2), 111–125.
Bryan, K. L. (1995). The right hemisphere language battery (2nd ed .). London: Whurr.
Bryan, K. L., & Hale, J. B. (2001). Differential effects of left and right cerebral vascular accidents on language competency. Journal of the International Neuropsychological Society, 7(6), 655–664.
Caramazza, A., Gordon, J., Zurif, E. B., & DeLuca, D. (1976). Right-hemispheric damage and verbal problem solving behavior. Brain and Language, 3(1), 41–46.
Coughlan, A. K., & Warrington, E. K. (1978). Word-comprehension and word-retrieval in patients with localized cerebral lesions. Brain, 101(1), 163–185.
Dyukova, G. M., Glozman, Z. M., Titova, E. Y., Kriushev, E. S., & Gamaleya, A. A. (2010). Speech disorders in right-hemisphere stroke. Neuroscience and Behavioral Physiology, 40(6), 593–602.
Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975). “Mini-mental state”: a practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12(3), 189–198.
Gainotti, G., Caltagirone, C., & Miceli, G. (1983). Selective impairment of semantic-lexical discrimination in right-brain-damaged patients. In E. Perecman (Ed.), Cognitive processing in the right hemisphere (pp. 149–167). New York: Academic Press.
Gardner, H., Ling, P. K., Flamm, L., & Silverman, J. (1975). Comprehension and appreciation of humorous material following brain damage. Brain: a Journal of Neurology, 98(3), 399–412.
Gazzaniga, M. S. (2000). Cerebral specialization and interhemispheric communication: does the corpus callosum enable the human condition. Brain, 123(7), 1293–1326.
Gwet, K. L. (2008). Computing inter‐rater reliability and its variance in the presence of high agreement. British Journal of Mathematical and Statistical Psychology, 61(1), 29–48.
Halper, A. S., Cherney, L. R., & Burns, M. S. (2010). The rehabilitation institute of Chicago evaluation of communication problems in right hemisphere dysfunction (3rd ed.). Rehabilitation Institute of Chicago.
Hartwigsen, G., & Saur, D. (2019). Neuroimaging of stroke recovery from aphasia - insights into plasticity of the human language network. Neuroimage, 190, 14–31.
Helm-Estabrooks, N. (2017). Cognitive linguistic quick test plus (CLQT+). Pearson.
Hirst, W., LeDoux, J., & Stein, S. (1984). Constraints on the processing of indirect speech acts: evidence from aphasiology. Brain and Language, 23(1), 26–33.
Jahng, S., Na, D. L., & Kang, Y. (2015). Constructing a composite score for the Seoul Neuropsychological Screening Battery-Core. Dementia and Neurocognitive Disorders, 14(4), 137–142.
Jeong, O. R. (2006). Daegu Diagnostic Aphasia Examination Seoul: SigmaPress.
Joanette, Y., & Ansaldo, A. I. (1999). Clinical note: acquired pragmatic impairments and aphasia. Brain and Language, 68(3), 529–534.
Joanette, Y., Goulet, P., Hannequin, D., & Boeglin, J. (1990). Right hemisphere and verbal communication New York: Springer-Verlag.
Joanette, Y., Ska, B., Côté, H., Ferré, P., Lapointe, L., Coppens, P., & Small, S. (2015). Montreal protocol for the evaluation of communication (MEC). ASSBI Resources.
Joanette, Y., Ska, B., Cote, H., Lapointe, L., Coppens, P., & Small, S. (2004). Montreal protocol for the evaluation of communication Montreal, Canada: Ortho Edition.
Kang, Y., Jahng, S. M., & Na, D. L. (2012). Seoul Neuropsychological Screening Battery 2nd Edition (SNSB-II) Seoul: Human Brain Research & Consulting.
Kang, Y., & Na, D. L. (2003). Seoul Neuropsychological Screening Battery (SNSB) Seoul: Human Brain Research & Consulting Co.
Kang, Y., Na, D. L., & Hahn, S. H. (1997). A validity study on the Korean MiniMental State Examination (K-MMSE) in dementia patients. Journal of the Korean Neurological Association, 15(2), 300–308.
Kang, Y., Park, J. S., Yu, K. H., & Lee, B. C. (2009). A reliability, validity, and normative study of the Korean-Montreal Cognitive Assessment (K-MoCA) as an instrument for screening of vascular cognitive impairment (VCI). The Korean Journal of Clinical Psychology, 28(2), 549–562.
Kim, T. H., Jhoo, J. H., Park, J. H., Kim, J. L., Ryu, S. H., Moon, S. W., ..., & Kim, K. W. (2010). Korean version of Mini Mental Status Examination for dementia screening and its’ short form. Psychiatry Investigation, 7(2), 102–108.
Knecht, S., Deppe, M., Dräger, B., Bobe, L., Lohmann, H., Ringelstein, E., & Henningsen, H. (2000). Language lateralization in healthy right-handers. Brain, 123(1), 74–81.
Lee, Y., & Cho, S. (2020). Focus prosody varies by phrase-initial tones in Seoul Korean: production, perception, and automatic classification. Languages, 5(4), 64–82.
Lee, J. H., Lee, K. U., Lee, D. Y., Kim, K. W., Jhoo, J. H., Kim, J. H., ..., & Woo, J. I. (2002). Development of the Korean version of the Consortium to Establish a Registry for Alzheimer’s Disease Assessment Packet (CERAD-K): clinical and neuropsychological assessment batteries. The Journals of Gerontology: Series B, 57(1), 47–53.
Lee, J. Y., Lee, D. W., Cho, S. J., Na, D. L., Jeon, H. J., Kim, S. K., ..., & Cho, M. J. (2008). Brief screening for mild cognitive impairment in elderly outpatient clinic: validation of the Korean version of the Montreal Cognitive Assessment. Journal of Geriatric Psychiatry and Neurology, 21(2), 104–110.
Lee, M. S., & Park, H. (2019). Characteristics of right hemispheric damaged patients in Korean focused prosodic sentences. Therapeutic Science for Rehabilitation, 8(3), 69–81.
Lehman, M. T., & Tompkins, C. A. (2000). Inferencing in adults with right hemisphere brain damage: an analysis of conflicting result. Aphasiology, 14(5-6), 485–499.
Li, R., Mukadam, N., & Kiran, S. (2022). Functional MRI evidence for reorganization of language networks after stroke. Handbook of Clinical Neurology, 185, 131–150.
MacDonald, S. (2005). Functional assessment of verbal reasoning and executive strategies. CCD Publishers.
Milman, L. H., & Holland, A. L. (2012). Scales of cognitive and communicative ability for neurorehabilitation. Pro-Ed.
Myers, P. S. (1999). Right hemisphere damage: disorders of communication and cognition San Diego, CA: Singular.
Nasreddine, Z. S., Phillips, N. A., Bédirian, V., Charbonneau, S., Whitehead, V., Collin, I., ..., & Chertkow, H. (2005). The Montreal Cognitive Assessment (MoCA): a brief screening tool for mild cognitive impairment. Journal of the American Geriatrics Society, 53(4), 695–699.
Park, J.-H., & Kwon, Y. C. (1990). Modification of the mini-mental state examination for use in the elderly in a non-western society. Part 1. Development of Korean version of mini-mental state examination. International Journal of Geriatric Psychiatry, 5(6), 381–387.
Pawełczyk, A., Kotlicka-Antczak, M., Łojek, E., Ruszpel, A., & Pawełczyk, T. (2018) Schizophrenia patients have higher-order language and extralinguistic impairments. Schizophrenia Research, 192, 274-280.
Pimental, P. A., & Kingsbury, N. A. (1989). Mini inventory of right brain injury Texas: Pro-Ed.
Pimental, P. A., & Kingsbury, N. A. (2000). Mini inventory of right brain injury–second edition. Pro-Ed.
Ramsey, A., & Blake, M. L. (2020). Speech-language pathology practices for adults with right hemisphere stroke: what are we missing. American Journal of Speech-Language Pathology, 29(2), 741–759.
Randolph, C. (1998). Repeatable battery for the assessment of neuropsychological status. The Psychological Corporation.
Rasmussen, T., & Milner, B. (1977). The role of early left-brain injury in determining lateralization of cerebral speech functions. Annals of the New York Academy of Science, 299, 355–369.
Robertson, I. H., Ward, T., Ridgeway, V., & Nimmo-Smith, I. (1994). Test of everyday attention. Pearson.
Ross-Swain, D. (1996). Ross information processing assessment–second edition. Pro-Ed.
Stern, R. A., & White, T. (2003). Neuropsychological assessment battery. Psychological Assessment Resources.
Taylor, A. M., & Warrington, E. K. (1973). Visual discrimination in patients with localized cerebral lesions. Cortex, 9(1), 82–93.
Tompkins, C., Klepousniotou, E., & Scott, G. (2013). Treatment of right hemisphere disorders. In I. Papathanasiou, P. Coppens, & C. Potagas (Eds.), Aphasia and related neurogenic communication disorders (pp. 345–346). Sudbury, MA: Jones and Bartlett.
Tompkins, C. A. (2012). Rehabilitation for cognitive-communication disorders in right hemisphere brain damage. Archives of Physical Medicine and Rehabilitation, 93(1), S61–S69.
Wapner, W., Hamby, S., & Gardner, H. (1981). The role of the right hemisphere in the apprehension of complex linguistic materials. Brain and Language, 14(1), 15–33.
Weiller, C., Isensee, C., Rijntjes, M., Huber, W., Müller, S., Bier, D., ..., & Diener, H. C. (1995). Recovery from Wernicke’s aphasia: a positron emission tomographic study. Annals of Neurology, 37(6), 723–732.
Weintraub, S., & Mesulam, M. M. (1983). Developmental learning disabilities of the right hemisphere: emotional, interpersonal, and cognitive components. Archives of Neurology, 40(8), 463–468.
Winner, E., & Gardner, H. (1977). The comprehension of metaphor in brain-damaged patients. Brain, 100(4), 717–729.
Woo, H. R., & Kim, J. W. (2019). The performance of the Korean Montreal protocol for evaluation of communication in the stroke patients with right vs. left hemispheric groups: a qualitative and quantitative analysis. Journal of The Korean Data Analysis Society, 21(1), 437–449.
Yang, S. Y., & Van Lancker Sidtis, D. (2016). Production of Korean idiomatic utterances following left- and right-hemisphere damage: acoustic studie. Journal of Speech, Language, and Hearing Research, 59(2), 267–280.
|
|