Pschological assessment Essay

Section AWrite an essay on the puzzle out you would fol petty(a) in developing a psychological sound judgment nib. hash out the steps that you would take in this process, including how you would choose tips for your discharge, how you would evaluate the reliableness and grimness of your try, and the bit of establishing averages. Discuss the scheme comprehensively and illustrate your understanding with an casing or examples. IntroductionThe process of developing a psychological rill is a complex and lengthy wholeness. ( Foxcroft & Roodt, 2001) but aspects related to the preparation of a psychological assay atomic number 18 non al managements sufficiently accentuate and some beats not summonsed at all ( Kaplan & Saccuzzo, 1997). When the probe is to be employ in a multicultural context, attention contracts to be nonrecreational to the cultural relevance (and strength bias) of the sieve right from the prepargondness and design phase instead of only macrocosm sensitive to cultural aspects from the token writing phase onwards.Also given that we do not baffle a long history of developing culturally steal stresss relevant to assorted congregations in South Africa, evidence developers privation to grapple with staple fiber issues such as what methods of examination administration might be sequester or in distinguish for certain cultural sorts and what language to develop the turn up in, for example. More period motivatings to be spent in the planning phase exploring and critically plowing scrutiny design issues.Planning phaseThe starting and most important step in developing psychological measures is the planning phase. Planning involves writing out the skeleton of what one aims to achieve. Cargonful though fatalitys to go into deciding on the aim of the measure, defining the circumscribe of the measure and key elements of the ladder plan. a test plan consists of the pursuance aspects (a) specifying the purpose and rat ionale for the test as well as the think target population, (b) defining the bring about (content domain) and creating a set of test specifications to describe item writing, (c) choosing the test format, (d) choosing the item format, and (e) specifying the administration and scoring methods (Robertson, 1990).Specifying the aim of the measureThe first step is to state the aim of the measure, the make water I testament determination and how the outcome bequeath be used. If I am conducting this drive in South Africa I exit also give up to mention that the measure will be used in a multicultural society. I would need to elaborate on what I connote by multicultural by highlighting the context. I would state the age of the test takers and their educational status. The information concluded above is important because it whitethorn guide an impact on the test specifications and design. I would need to state whether the test would be paper-based or computer-based.When that fini s is do I would need to accept whether the test-takers argon familiar with such tests. The test takers may underperform on the evaluation because they are not proficient in the instrument of measure. This may impact the validity of the consume to be conducted. I would also need to chink whether the test will be administered individually or in a group setting.Because psychological constructs are brewed in western societies, the tension is on individualism. When working in a multicultural society, however, it is important to consider the norms of the society I would be working in. In some finiss, for example, the group identity is valued over the individual identity. This could allow an effect on the content of the measure. Defining the content of the measureHere I need to figure out what I want to measure and why. This will extract me what to think on during the other steps. A working definition of the construct is needed. This includes identifying exactly what I aim to get out of this research study. To do this I need to embark on a comprehensive writings review. I will see how my topic has been investigated in the past and love the gaps. I smoke now induct the decision on whether I am conducting a new study or adapting an existing study into the South African context.Later I will need to make the same decision on the instrument I will use for data gathering. Since I would be working in South Africa, I need to decide on whether separate norms should be substantial for test takers from advantaged and prejudiced schooling backgrounds and/or for urban and rural areas. I would switch a team of content, language and cultural experts to scrutinise the content being developed. Nell (1994) states thatlanguage is a critical moderator variable of test performance.If the test taker is not proficient in that language, it is difficult to ascertain whether poor performance is referable to language or communication difficulty or that the test-taker has a low level of the construct being deliberate. I would produce the test in a bilingual format and specify the source language. Work would need to be done to project that the construct is meaningful for individually group. ontogenesis the test plan (specifications)Once the construct to be assessed has been defined and operationalised, a decision call for to be r severallyed regarding what approach will be busy to guide the development of the test content and specifications. Decisions will be do regarding the format to be used (open-ended items, forced-choice items etc.), how they will be throwd (objective or native tests), and whether time limits will be imposed. The language and cultural experts are at once again needed during this step.Sometimes psychological constructs, conceptualised in western society, do not have a known equivalent in African discourse. For such constructs the translated edition would need to explain the construct in a way that is closest to the side of me at meaning. This will require more(prenominal) time for the African language test taker. The test specification should eliminate the conjecture of construct bias. The format therefore needs to be standardised for a variety of cultural groups or it should at least include items that will be considered easy, moderate and difficult by all groups.Although these steps happen after all(prenominal) other, I will need to go rearward and forwards to ensure content and construct validity.Item writingThe endorsement step is item writing. Once the test specifications have been closingised, the team of experts writes or develops the items. The trend in South Africa has been to simply adapt an already made test to accommodate South African test takers. This is not inescapably the easier option. Firstly, concepts are not always understood in the same way in different societies. For example, the term depression is sometimes taken to mean withvery sad in some societies. It is therefore import ant to ensure construct validity even for an English test given to English mother tongue speakers of a different society to that of the tests origin.If the assessment measure will be administered to children, face validity will be ensured done the use of big writing, use of colour and drawings. The length of the items should also be considered. With every step of items writing reliability is ensured.Reviewing the itemsAn item money box is thus developed and items reviewed in terms of whether they meet the content specification and whether they are well written. Items which do not meet the specifications are removed from the bank before it can be used to generate criteria-referenced tests. The team of experts should focus on both(prenominal) content validity and indicate whether the items are from stereotyping and potential bias. The experts will then return the item list with recommendations. They will need to be re-written or revised.Assembling and pre-testing the experimental version of the measureItems need to be arranged in a logical way. Since we are dealings with a multicultural society, we need to ensure that the items are balanced and on appropriate pages. The length of the items in each category needs to be finalised. For long problems based items, time adjustments need to be made. A decision would have been made with regards to whether the test is paper-based or computer-based. The appropriate apparatus needs to be made available. ThePre-testing the experimental version of the measureThe test items have to be administered to a large group of examinees. This sample should be exercise of the population for which the eventual test is intended. This will be the norm group.Items analytic thinking phaseDuring this phase items are checked for relevance. Again we see if each item is reliable and valid to the study. The characteristics of the items can be evaluated victimization the unequivocal test theory or the item response theory. At the item leve l, the CTT model is relatively simple. CTT does not invoke a complex hypothetical model to relate an examinees ability to success on a particular item. Instead, CTT collectively considers a pool of examinees and empirically examines their success rate on an item (assuming it is dichotomously scored).This success rate of a particular pool of examinees on an item, well known as the p value of the item, is used as the index for the item difficulty (actually, it is an backward indicator of item difficulty, with higher value indicating an easier item). The ability of an item to separate among higher ability examinees and lower ability examinees is known as item discrimination, which is frequently expressed statistically as the Pearson product-moment correlation coefficient between the advance on the item (e.g., 0 and 1 on an item scored right-wrong) and the heaps on the total test. When an item is dichotomously scored, this estimate is often computed as a point-biserial correlati on coefficient.IRT, on the other hand, is more theory grounded and models the probabilistic distribution of examinees success at the item level. As its expose indicates, IRT primarily focuses on the item-level information in contrast to the CTTs primary coil focus on test-level information. The IRT framework encompasses a group of models, and the applicability of each model in a particular situation depends on the record of the test items and the viability of different theoretical assumptions about the test items.Revising and standardizing the final version of the measureOnce the qualitative and quantitative information has been gathered, the test is administered to the large sample for standardization. All the items that were found to be unclear are simplified. Vocabulary and grammar is corrected. Split-half reliability is assessed. The translated version is checked through back description (into the source language). The items are finalised for the test. The final database is u sed to check on reliabilityand validity. The administration and scoring instruction may need to be modified. therefore the final version is administered.Technical evaluation and establishing normsThe items can be analysed using the item response theory. The characteristics of each item may be represented graphically be means of a graph which relates an individuals ability score with their probability of passing the items. Items with large variances are selected. The scores obtained by the norm group in the final test form are referred to as the norms of the test. To compare an individuals score with the norms, their raw score will be converted to the same kind of derived score as that in which the test norms are reported (e.g. percentile ranks, McCalls T scores etc). Publishing and ongoing refinementsA test manual is compiled before a measure published. The manual should make information on the psychometric properties of the test easily understandable. It will be updated from time to time as more information becomes available.Section BList the steps that should be followed in the adaption of an assessment measure for cross-cultural application and briefly explain what each step means. 1. Reasons for adapting measuresCross-cultural assessment has become a sensitive issue due to specific concerns regarding the use of standardized tests crossways cultures.By adapting an instrument, the research worker is able to compare the already-existing data with newly acquired data, thus allowing for cross-cultural studies both on the national and international level. Adaptations also can conserve time and expenses (Hambleton, 1993). Test adaptation can lead to increased fairness in assessment by allowing individuals to be assessed in the language of their choice (Hambleton & Kanjee, 1995).2. all important(predicate) considerations when adapting measuresThe test can be compromised if there are problems between the test takers and the administrator. The administrator sho uld therefore familiar with the culture of the test-taker. They cannot take it for granted that the test taker will be exposed to the format of the test. This could lead to the score representing a lack of skill with regards to the format of the test instead of measuring the construct being assessed. Some languages, like isiZulu, require more time to be spent reading therefore would require more time to complete.3. Designs for adapting measures earlier selecting an assessment instrument for use in counseling or research, counselors and researchers are trained to verify that the test is appropriate for use with their population. This includes investigation of validity, reliability, and appropriate norm groups to which the population is to be compared. Validity and reliability take on additional dimensions in cross-cultural testing as does the question of the appropriate norm group. The instrument essential be validly qualified, the test items must have conceptual and linguistic equ ivalence, and the test and the test items must be bias free (Fouad, 1993 Geisinger, 1994).Two basic methods for test adaptation have been identified forward translation and back-translation. In forward translation, the original test in the source language is translated into the target language and then bilinguals are asked to compare the original version with the adapted version (Hambleton, 1993 1994). In back-translation, the test is translated into the target language and then it is re-translated back to the source language. This process can be repeated several times. Once the process is complete, the final back-translated version is compared to the original version (Hambleton, 1994). Each of these adaptation processes has their strengths and limitations.4. Bias analysis and first derivative item functioningAnother issue that must be considered in cross-cultural assessment is test bias. The test user must ascertain that the test and the test items do not systematically discrimina te against one cultural group or another. Test biasmay slide by when the contents of the test are more familiar to one group than to another or when the tests have differential predictive validity across groups (Fouad, 1994). Culture plays a significant role in cross-cultural assessment.Whenever tests developed in one culture are used with another culture there is the potential for misinterpretation and stagnation unless cultural issues are considered. Issues of test adaptation, test equivalence and test bias must be considered in order to fully utilize the benefit of cross-cultural assessment.5. Steps for increase success in test adaptionHembleton (2004) summarised nine key steps that should be addressed when adapting or translating assessment instruments.6. Challenges related to test adaption in southmost AfricaA disadvantage of adaptation includes the risk of imposing conclusions based on concepts that exist in one culture but may not exist in the other. There are no guarantee s that the concept in the source culture exists in the target culture (Lonner & Berry, 1986).Another disadvantage of adapting existing tests for use in another culture is that if certain constructs measured in the original version are not found in the target population, or if the construct is manifested in a different manner, the resulting scores can prove to be misleading (Hambleton, 1994). Despite the difficulties associated with using adapted instruments, this practice is important because it allows for greater generalizability and allows for investigation of differences among a growing diverse population. Once the test has been adapted, test equivalence must be determined. prolongationFoxcroft, C.D. & Roodt, G. (2009). An introduction to psychological assessment in South Africa. Johannesburg Oxford University PressHambleton, R. K. (2001). The attached generation of the ITC Test Translation and Adaptation Guidelines. European ledger of mental Assessment, 17, 164-172.Hambleton, R. K. (2004). Issues, designs, and technical guidelines for adapting tests into multiple languages and cultures. In R. K. Hambleton, P. F. Merenda, & C. D. Spielberger (Eds.), Adapting educational and psychological tests for cross-cultural assessment (pp. 3-38). Mahwah,NJ Lawrence Erlbaum AssociatesVan Ede, D.M. (1996). How to adapt a measuring instrument for use with dissimilar cultural groups a practical step-by-step introduction. South African Journal of Higher Education, 10, 153-160.