Documente Academic
Documente Profesional
Documente Cultură
1. Development of CAI is based on the Competency Standard (CS). 2. Review/study all parts of the CS. 3. From the CS, develop the Evidence Plan 3.1 Know the stages in preparing the Evidence Plan 3.2 Consider the following as part of the evidence requirements: Elements Performance Criteria Underpinning Knowledge and Skills Critical Aspects of Competency Four Dimensions of Competency: Task Skills Task Management Skills Contingency Skills Job Role/Environment Skills 4. Identify the methods of assessment or evidence gathering methods 5. Select the appropriate evidence gathering method per evidence requirement 6. Develop the evidence gathering tools The evidence requirements indicated/listed in the evidence plan must be copied to the appropriate evidence gathering tool templates. 7. Consider the context of assessment 7.1 There may be instances where it is impractical to carry out the assessment in the workplace. 7.2Developers should provide guidance on appropriate simulation techniques. 7.3 The achievement of valid assessment in a simulated environment may require additional factors to be included in the assessment process.
8. In the formulation of questions, it is important to consider the following: 8.1 Adopt the 6 types of questions.(Extension, Contingency, Safety, Infrequent activities and regulations & procedures) 8.2 Questions must be simple that can be understood by all types of clients. 8.3 Answers to questions provide evidence of underpinning knowledge, application of skills and the capacity of the candidate to transfer knowledge and skill to different contexts.
9. All methods of assessment indicated in the CS must be used/considered. However, the may use other methods not indicated in the CS if deemed necessary. assessor
10. Consider the range of variables (CS) This defines the boundaries in which the unit of competency applies. 11. Package the complete CAI properly following the format.
How written test is formulated Multiple Choice Multiple choice questions are a great way to test a student's comprehension level of a particular subject matter. But, they can often be the most difficult and time consuming for the teacher to construct. Here are some ideas to utilize when constructing multiple choice test questions: Don't use excessive wording when creating the test question stem. Be clear and concise in your word and phrase choices. Make sure that there is only one clearly correct answer from the options given to the student. Provide between 3-5 plausible choices for the student to select from as their answer Minimize the use of 'all of the above' or 'none of the above' question answers. Randomly distribute the correct answer options i.e. A, B, C, D etc so that there is not a clear pattern that becomes obvious to the student Be sure to use test questions that test knowledge, application, comprehension, analysis and evaluation throughout your test to get the best overall sense of the student's understanding and mastery of a subject matter
Sample of Multiple Choice Test Negative Variety Type. This form is not suggested but, if used, always emphasize the negative word. 1. Which of the following is NOT considered a method of heat transfer? A. Diffusion. B. Conduction. C. Convection. Association Type. This form is useful if a limited number of associations are to be made. Sample 1. Association Type.
Which aircraft has the right-of-way over the other aircraft listed? A. Airship. B. Gyroplane. C. Aircraft towing other aircraft.
Definition Type. This form is used to determine knowledge of a specific definition. I. Aspect ratio of a wing is defined as the ratio of the A. Wingspan to the wing root. B. Wingspan to the mean chord. C. Square of the chord to the wingspan.
Fill-in-the-Blank Questions Fill in the blank questions require the student to know the correct answer rather than having the ability to guess from a list of possible answers.
Here are some tips to consider when writing good fill in the blank test questions: Ensure that there is only one possible correct answer to avoid confusion and difficulty grading Blanks should come at the end or as close to the end of the question or statement as possible Questions should recall important information taught within
Ask a direct question that has a definitive answer. Example Ms. Joyce has dinner with three of her friends. The four friends decide to split the cost equally. The bill comes to $32.80, and the women plan to leave a 15% tip. How much should Ms. Joyce pay for her share of the dinner? __________________
If using fill-in-the blank, use only one blank per item. Example Salt consists primarily of sodium and _____________.
Matching Test Items Matching test items are used to test a student's ability to recognize relationships and to make associations between terms, parts, words, phrases, clauses, or symbols in one column with related alternatives in another column. When using this form of test item, it is a good practice to provide alternatives in the response column that are used more than once, or not at all, to preclude guessing by elimination. Matching test items may have either an equal or unequal number of selections in each column.
Matching-Equal Columns. When using this form, providing for some items in the response column to be used more than once, or not at all, can preclude guessing by elimination.
Directions: In the blank before each electrical term in the left-hand column, write the letter corresponding to the unit of measurement which is most closely associated with that term. Each unit of measurement may be used more than once and some units may not be used at all. Column A 1. ____ Electromotive force 2. ____ Electrical power, apparent Column B A. Watt B. Volt C. Ampere D. Coulomb E. Ohm F. VAR G. Farad H. Henry
Evidence gathering tools(National Assessment) The following are examples of evidence gathering tools: Evidence Plan Observation checklist Third party Report Demonstration Work Related project Questioning Portfolio
Purpose of evidence gathering tools Help candidate understand what is expected Focus for the assessor in evidence gathering Record assessment outcome Identify what action is needed to address skill and knowledge gaps
Evidence Plan Planning tool First stage in developing an evidence gathering tool List of the evidence that the assessor must gather when conducting the assessment of a particular unit of competency
Stages in preparing evidence plan Select unit of competency Read full unit of competency Identify evidence requirements elements and performance criteria dimensions of competence underpinning skills and knowledge critical aspects of competence
Develop a list of evidence requirements Identify best ways of collecting evidence Document evidence plan
Evidence Plan
Observation Checklists
Checklists are extremely useful tools for structuring observations.
They can act as: a prompt for the assessor a guide for the candidate.
provided to concerned personnel following established procedures The candidates demonstration was: Satisfactory Not Satisfactory
QUESTIONS The candidate should answer the following questions: 1. What is overbooking? 2. What is an availability board? 3. What is a guaranteed reservation? 4. What is a central reservations system? 5. What is a confirmation number? 6. What is FIT? 7. Name at least four sources of reservations 8. What are the two forms of reservation system? 9. What is a no show? 10. Name at least two popular property management systems use by the hotel. The candidates underpinning knowledge was: Satisfactory Not Satisfactory Feedback to candidate: General Comments [Strengths/Improvements needed]
The candidates overall performance was: Satisfactory Not Satisfactory Candidate signature: Assessor signature: Date: Date:
What is a portfolio? A portfolio is a collection of evidence that may be presented to an assessor to prove your competence at a job or task.
What is portfolio evidence? Training results / certificates Training workbooks References from colleagues / employers Job descriptions / work experience Photos / videos Work journal / diary Awards Work samples - menus, letters, memos, budgets
Third party report Evidence provided by person who has first hand information on candidate performance Often supplied by person in authority Useful for verifying assessor observation Useful in assessing consistency of candidate performance
ACTIVITY: 1. 2. Familiarization of the National Competency Assessment Instrument. Development of Institutional Competency Assessment Instrument.
Sample template
EVIDENCE PLAN
Sector: Unit of Competency:
Demonstration
Portfolio
Written Test
Matching Type of Test
Instruction: Match column A and B write only the number on your answer sheet A
1. Are the building blocks of a unit of competency 2. It expands on information in the title. 3. It involves applying knowledge, skills and attitudes to perform work activities to the standard expected in the workplace.
B
1. A rule evidence authentic 2. Standard 3. Module 4. Competency 5. Elements
4. This requires performance of the task(s) to the required 6. Evidence standard as described in the unit of competency and 7. Descriptor expected 8. Criteria in that workplace. 9. Questioning 5. Is the information that is gathered and matched against a unit of competency to provided proof of competency. 6. Is the evidence presented the candidates own work?
Multiple choices
Instruction: Choose the correct answer and write only the letter that corresponds to
your choice.
1. A method of collecting evidence at real time and workplace. a. Third party report b. Portfolio c. Observation d. All of the above 2. First stage in developing an evidence gathering tool. a. Competency Assessment b. Evidence Plan c. Demonstration checklist d. None of the above 3. Evidence provided by person who has first hand information on candidate performance. a. Direct evidence b. Third party Report c. Current d. Task skill 4. When you verify your observation, what immediate evidence gathering method would prepare? a. Demonstration b. Questioning c. Third party report d. Written test
JOB SHEET #1
Unit Title
I. II. Objective: Tools Equipment and Materials:
A. Tools
DEMONSTRATION(50%)
Candidate Name: Assessor Name: Unit of competency: Qualification: Date of Assessment: Time of Assessment: Instructions for demonstration: Material and equipment OBSERVATION During the demonstration of skills, did the candidate: Identified competency standard which describe the work activities to be assessed. Read and interpreted relevant unit of competency to identify the required evidence. Identified evidence requirements which show full coverage and consistent performance of the relevant work activities. Identified evidence gathering method that are consistent with the evidence requirements and the advice provided in the Evidence Guide and relevant Assessment Guidelines Select evidence gathering method which are appropriate for the competency being assessed, the trainee and he assessment context. Prepared evidence gathering tools in line with the advice provided in the relevant Assessment Guidelines. Prepared clear and concise written instructions and materials for the assessor and the trainee, which accurately describe the evidence gathering activity. Checked evidence gathering tools for validity, fairness, safety and cost effectiveness Identified evidence gathering opportunities in the community. Workplace, training center or assessment center and planned in accordance with evidence guide. Estimated cost of assessment and evidence gathering process and evaluated to ensure compliance with budget. Estimated cost of assessment and evidence gathering process and evaluated to ensure compliance with budget
Calculation: Demo: Percentage Wt. 50% Demo RATING =Total Score x 100 x 50% Maximum Points The candidates demonstration Score was: Competent
Actual Score
Not Competent
POINTS/SCORE
Oral Questioning: Percentage Wt. 30%
TOTAL MAX.
Rating: _______
Oral Q. RATING =Total Score x 100 x 30% The candidates Oral Questioning Rating was:___ Maximum Points Final Rating = Demo rating + Oral Q Rating Competent Not Competent
Satisfactory
Not Satisfactory
Grades
A. Written Examination B. Demonstration of Skill with C. Questioning Did the candidates overall performance meet the required evidence?
Date: Date:
Sample NCAI
For
TESD Specialist II
TECHNICAL EDUCATION & SKILLS DEVELOPMENT AUTHORITY TESDA Complex Abucay, Tacloban City
August 18, 2005
TABLE OF CONTENTS
Contests Page
Cover Self assessment guide Competency Assessment Agreement Competency Assessment Result Summary Specific Instruction for the Assessor Specific Instruction for the Candidate Evidence Plan Evidence Gathering Tools Observation Checklist Questioning Demonstration Third Party Report Portfolio
_ _ _ _ _ _ _ _ _ _
SELF-ASSESSMENT GUIDE
Qualification
Units of Competency Covered Instruction: Can I? Determine the availability of the reservation and advise customer accordingly Offer alternatives, including waitlist options, if requested booking is not available. Handle and respond to inquiry regarding rates and other product features Record customer details against booking in a manner which ensures correct interpretation by anybody who may access the reservation details Check and use customer profile information in making the reservation to enhance customer service Record special request of guests Confirm all details of customer bookings. Reservation file in a manner which ensures easy access by others Prepare and issue documents and other materials to the customer Update the financial status of the reservation accurately Receive, process and record amended or cancelled reservations Communicate general and specific customer requirements and reservation details to appropriate departments and colleagues. Compile accurate and relevant reservation statistics and provide it to concerned personnel or departments. Date: Read each of the questions in the left-hand column of the chart. Place a check in the appropriate box opposite each question to indicate your answers. YES NO
Candidates Name:
FRONT OFFICE SERVICES NC II Qualification BASIC UNITS Participate in Workplace Communication Work in Team Environment Practice Career Professionalism Practice Occupational Health and Safety Procedures
COMMON UNITS
Develop and Update Industry Knowledge Observe Workplace Hygiene Procedures Perform Computer Operations Perform Workplace and Safety Practices Provide Effective Customer Service
CORE UNIT
Candidate to answer questions Have the context and purpose of assessment been explained? Do you understand the assessment procedure and evidence to be collected? Have your rights and appeal system been explained? Have you discussed any special needs to be considered during assessment?
YES
NO
I agree to undertake assessment in the knowledge that information gathered will only be used for professional development purposes and can only be accessed by concerned assessment personnel and my manager/supervisor.
Candidates Signature:
Date:
Assessors Signature:
Date:
Candidates Name: Assessors Name: Qualification Applied for Date of Assessment Assessment Center The performance of the candidate in the following assessment methods: Pls Tick ( ) appropriate box 1. Satisfactory Not Satisfact ory
UNITS OF COMPETENCY: Coordinate Implementation & Delivery of Programs, Projects services and Activities Facilitate evaluation of Program, Project and services
1. Prepare the necessary tools, materials, instruments and equipment in accordance with the job requirements, to wit: 1.1 1.2 1.3 1.4 _________________________________________ _________________________________________ _________________________________________ _________________________________________
Note: Demonstration can be done only on the important/critical components on the abovementioned units of competency.
2. Instruct the candidate on the tasks to be performed. Assessment can be done while the tasks are being undertaken. 3. Other evidence gathering methods will be used (if necessary) to address less critical areas, fill gaps or confirm judgement that strictly adhere in the Evidence Plan. Portfolio may be used to validate the claim of the candidate on his/her work Third Party Report This must be related to the work/tasks described. It contains the description of the work the candidate has done. This is to check the authenticity of the materials/documents presented, are the candidates own work or contribution.
4. After the assessment, the assessor must give the candidate feedback on the assessment result and this must be made either:
UNIT OF COMPETENCY:
________________________________________________________
1. Given the necessary materials, instruments, tools and equipment you are required to perform the following tasks within ___ (__) hours in accordance with set performance criteria: _________________________________ _________________________________ _________________________________ _________________________________
2. Method of Assessment is taken from units of competencies from the Competency Standards based on the Evidence Plan. ___________________________________ ___________________________________ ___________________________________ 3. You may prepare and bring existing evidence in the form of: Portfolio Evidence ( Training Certificate, Work Experience, Awards/ Certificate of Appreciation, COCs/NC Certification, Accreditation Certificate, photos or video and etc. ) Third Party 4. Final assessment will be the responsibility of Accredited Assessor At the end of the assessment, the assessor will give you feedback on your performance. The feedback will indicate either you are:
TESD Specialist II Coordinate Implementation and Delivery of Programs, Projects, Services and Activities Ways in which evidence will be collected: [tick (x) the column] Third party Report
Demonstration
Observation
Questioning
x x
Portfolio
Candidate name: Assessor name: Assessment Centre Competency standards Unit of competency: Instructions for the assessor: 1. Observe the candidate _____________________________________________________ . 2. Describe the assessment activity and the date on which it was undertaken. 3. Place a tick in the box to show that the candidate completed each aspect of the activity to the standard expected in the enterprise. 4. Complete the feedback sections of the form. Date of observation Description of assessment activity Location of assessment activity The candidate. Did the candidates overall performance meet the standard? Feedback to candidate:
Yes No
Assessor signature:
Date:
Yes N
o
Not Satisfactory
Candidate name: Name of third party: Position: Relationship with candidate: Contact no.
Employer
supervisor
colleague
ot
her
Please specify ________________________________________________ Please do not complete the form if you are a relative, close friend or have a conflict of interest. Dates the candidate worked with you Competency standards: Unit of competency: The candidate is being assessed against the competency standards for [insert title of competency standards]. We are seeking your support in the judgment of this candidates competence. Please answer these questions honestly as a record of the candidates performance while working with you. Thank you for your time. Comments regarding candidate performance and experience I can verify the candidates ability to: (tick the correct response] Third party signature: Send to: Yes No Not sure Comments to support my responses: From: To:
Date:
Template 5- Demonstration
Candidate name: Assessor name: Unit of competency: Competency standards: Date of assessment: Time of assessment: Instructions for demonstration Given the necessary materials, tools and equipment, the candidate must be able to perform the following tasks in_______ ( ) hours: (elements) a. b. c. d. Materials and equipment [insert details of materials and equipment needed for the demonstration]
Yes
No
N/A
Not Satisfactory
Demonstration [continued]
QUESTIONS The candidate should answer the following questions:
1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12.
No
Not Satisfactory
The candidates overall performance was: Satisfactory Candidate signature: Assessor signature:
Candidate: Assessor: Competency Standards: Unit[s] of Competency: Item number Type of evidence [insert information in the column] The evidence shows that I
Candidate name: Assessor name: Competency standards: Unit[s] of competency: The evidence provided by the candidate is:
Valid
current The contents of the portfolio provided satisfactory evidence that the candidate [tick () the box]:
Authentic
sufficient
Item no[s]
Date: Date:
Date: Date: