Professional Documents
Culture Documents
Dr. Mohammed Al-Ghonaim Dr. Faisal Al-Saif Dr. Nervana Bayoumy Dr. Ghadeer Al-Shaikh Prof. Ola Farouk Leheta -
Self Evaluation Scales High quality standards can only be achieved by honest evaluation of performance and commitment to improve, and by action planned and taken throughout an institution. In recognition of this faculty and staff responsible for various activities should rate their own performance. Although every effort should be made to form valid and reliable judgments based on evidence, a number of these evaluations will involve subjective judgments and to avoid a spurious illusion of precision it is recommended that a using a
starring system be used for rating these quality evaluations. It is expected that these self evaluation scales will be used by institutions and by those responsible for programs in their initial quality assessment, their continuing monitoring of performance, and in their more extensive periodic self studies prior to an accreditation review by the Commission. In this document information about the standards is presented at two levels. The first is a general statement of the standard as it applies to a broad area of activity and the second is a description of why it is important and the kinds of processes that are expected if the standard is achieved. This explanatory information is followed for each standard by a number of more specific statements of good practices that are typically carried out in a high quality institution with scales to indicate whether and how well the practice is followed. The scales are presented in groups that deal with major components or sub-sections of the general standards. The lists of specific practices are intended primarily as a guide for those responsible for particular activities to draw attention to things that are generally regarded as good practice, and to assist them in their self-evaluations. Some of these statements are relevant to certain institutions but not to others. Where an item is not applicable it should be simply marked NA, and ignored. Using the Rating Scales For each individual item two responses are called for. The first is to indicate whether the practice is followed in the institution. The possible responses are: NA -- the practice is not applicable or relevant for the institution or unit making the response. Y yes, the practice is followed; or N no, the practice is relevant but not followed. The second response is called for in cases where the practice is relevant to the institution (i.e. a Y or N response). It involves the use of a five-point rating scale to evaluate on a how consistently and how well the practice is carried out. Stars, rather than a numeric or alphabetic rating scale, are used for this purpose. The evaluations relate to: The extent and consistency with which processes are followed; The quality of the service or activity as assessed through systematic evaluations; The effectiveness of what is done in achieving intended outcomes. Using Stars for Evaluations Performance should be assessed by allocating from zero to five stars in accordance with the following descriptions: Improvement Required No Star The practice is relevant but not followed at all. A zero should be recorded on the scale. One Star The practice is followed occasionally but quality of the activity is poor or not evaluated. Two Stars -- The practice is usually followed but the quality is less than satisfactory.
Good Performance Three StarsThe practice is followed most of the time. Evidence of the effectiveness of the activity is usually obtained and indicates that satisfactory standards of performance are normally achieved although there is some room for improvement. Plans for improvement in quality are made and progress in implementation is monitored. High Quality Performance Four StarsThe practice is followed consistently. Indicators of quality of performance are established and suggest high quality but with still some room for improvement. Plans for this improvement have been developed and are being implemented, and progress is regularly monitored and reported on. Five StarsThe practice is followed consistently and at a very high standard, with direct evidence or independent assessments indicating superior quality in relation to other comparable institutions. Despite clear evidence of high standards of performance plans for further improvement exist with realistic strategies and timelines established. Converting Survey Responses to a Starring System. In a number of cases the individual items refer to evaluations of quality by students, faculty, or other stakeholders. The wording of survey instruments and items in rating scales can influence results significantly and interpretations of the data and independent verification of conclusions is important. However as a general guide where a five point rating scale is used with possibilities of positive and negative assessments evenly balanced, an overall rating from respondents to a survey might achieve star ratings as follows: Above 4.5 3.6-4.5 2.6-3.5 1.6-2.5 1.5 or below Five stars Four stars Three stars Two stars One star
****
Comment: The college of Medicine at King Saud University serves three main purposes: medical education (undergraduate, postgraduate, and continuance medical education), research, and healthcare. The mission and vision is very tightly related to the KSU mission and vision. Through innovative education, world class research, and high quality healthcare we can achieve the vision of KSU by contributing in building the knowledge based economy that our country desperately needs. The mission statement for the program is consistent with the mission of the college The mission of the college is translated into 10 strategic priorities for the years 2010-2013 for the college and ten strategic priorities for the hospitals. When the strategic objectives of our college and university hospitals were mapped against the strategic objectives of KSU there was a very significant match Priorities for improvement None Independent Opinion
At the initial stages of mission development two reviews By Cook and Mastricht were carried out, followed by two other independent reviews: The NCAAA Program Accreditation Review panel (Nov. 2008) commended the colleges mission as it accurately reflected the input of relevant shareholders and it was crafted based on broad consultations and soundly based on World Federation of Medical Education (WFNE) objectives. However, it needed to be fully conceptualized. The Huron consulting group (June 2009) pointed to the appropriateness of the mission statement for the educational programs to train outstanding physicians who have a wide evidence based knowledge, effective skills, high standard ethics, and lifelong commitment to learning and development.
**** **** **
***
Comment: The mission statement provides an effective guide to decision-making as in response to the program mission many changes in the curriculum has been done recently. In addition, significant student research programs have been encouraged and students are now commonly involved in research projects that end up in publications The mission of the college is translated into 10 strategic priorities for the years 2010-2013 for the college and ten strategic priorities for the hospitals with available resources. Priorities for improvement 1) Provide support for the Strategic Plan to activate its responsibilities toward the strategic objectives and to facilitate cooperation with students, staff and faculty initiatives relating to promotion of the public awareness of college vision and mission. 2) Criteria for evaluation of progress towards the goals and objectives of the program need to be in place. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) felt that the non-specific wording of the previous statement may make it difficult to use to guide decision-making in planning and evaluation strategies. However, this issue has been addressed by the new mission statement. The Huron consulting group (June 2009) highlighted the specific objectives that stemmed from the mission statement and their clear reflection of institutional, regional and national policy. In addition to having measurable outcomes.
1.3.3 The mission statement is periodically reaffirmed or amended if necessary in the light of changing circumstances. Overall Assessment
Yes
****
****
Comment: All relevant internal (staff and students) and external stakeholders (The Ministry of Health, the Saudi Commission for Health Specialties, the university officials, some other healthcare organizations in Riyadh, and members of the private healthcare system.) were consulted and support the mission. The strategic plan including the mission was approved by the College Board and the University Council. The strategic plan including the mission will be evaluated every 3 years. Priorities for improvement 1) Coordinate with external community organizations to increase the society involvement in college mission implementation and Strategic Plan. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) commended the college on its mission statement that was developed with broad consultation. However, they pointed to the lack of student participation in the crafting process.
1.4.1 The mission statement is used as a basis for a strategic plan for development of the program over a medium term planning period. (normally five to seven years) 1.4.2 The mission statement is known about and supported by faculty and staff. 1.4.3 Consistency with the mission is listed among criteria for consideration of program and project proposals by committees and decision makers. Overall Assessment
****
Comment: The most salient feature of the Use Made of the Plan is the strategic objectives that are guided by the mission statement. The mission, vision, and values are well communicated and visible in most locations in the college and hospital. Multiple open sessions has been organized to familiarize our staff about this mission. It is also clearly posted on the college website. This mission enjoys wide awareness from staff and students as evident by the results of related questionnaires, but it must provides an effective guide to staff decisions Priorities for improvement 1) Utilization of students and college alumni in promoting the college vision and mission Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) acknowledged the high visibility of the mission statement within the College and King Khalid Hospital. Furthermore, they pointed to the extensive awareness among college staff of the mission, goals and objectives. However, at that time, they didnt detect firm evidence that College objectives have penetrated sufficiently to the level of program objectives.
****
****
Comment: The vision, mission, and values are clear, appropriate, captures the three main function of the college and is aligned with the university mission The mission has been developed after wide consultation with internal and external stakeholders The mission is well disseminated in the college The mission has been the bases of a full strategic and operational plan
More benchmarking of indicators from the operational plan needs to be done. Indicators considered: 1) The average ratings of staff to the question I know the vision, mission, and objectives of the college in the staff satisfaction survey. 2) The average ratings of graduate to the question I know the vision, mission, and objectives of the college in the graduate satisfaction survey. 3) The average ratings of staff to the question I am involved in setting the colleges mission and vision in the staff satisfaction survey. 4) The average ratings of staff to the question The mission guide/influence my daily activities in the staff satisfaction survey. Priorities for improvement: 1) Provide support for the strategic plan to activate its responsibilities toward the strategic objectives and to facilitate cooperation with students, staff and faculty initiatives relating to promotion of the public awareness of college vision and mission. 2) Coordinate with external community organizations to increase the society involvement in college mission implementation and Strategic Plan. 3) Utilization of students and college alumni in promoting the college vision and mission Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008). An appropriate mission statement for the educational programs at the college is in place. It has been constructed and developed based on wide spread consultations. It is supported by an extensive list of specific objectives for the program. The objectives are clear measurable outcomes. There is praise for the high visibility of the mission statement within the College and King Khalid Hospital. Extensive awareness among college staff of the mission, goals and objectives has been detected.
10
11
2.1 Leadership
Program managers must provide effective and responsible leadership for the development and improvement of the program. 2.1.1 The responsibilities of program managers are clearly defined in position Yes **** descriptions 2.1.2 There should be sufficient flexibility at the level of the department or college offering the program to respond rapidly to course and program evaluations and changes in program learning outcome requirements, (eg. Departments should have Yes **** authority to change text and reference lists, modify planned teaching strategies, details of assessment tasks and updating of course content.) 2.1.3 Program managers should anticipate issues and opportunities and exercise Yes *** initiative in response. 2.1.4 Program managers should ensure that when action is needed it is taken in an Yes **** effective and timely manner. 2.1.5 Program managers have sufficient authority to ensure compliance with Yes **** formally established or agreed institutional or program policies and procedures. 2.1.6 Program managers should provide leadership, and encourage and reward Yes ** initiative on the part of teaching and other staff. 2.1.7 Program managers should accept responsibility for the effectiveness of action taken within their area of responsibility regardless of whether that action is Yes **** taken by them personally or by others responsible to them. 2.1.8 Regular feedback is given on performance of teaching and other staff by the Yes *** head of the department 2.1.9 Delegations of responsibility to program managers are formally specified in documents signed by the person delegating and the person given delegated Yes *** authority, that describe clearly the limits of delegated responsibility and responsibility for reporting on decisions made. 2.1.10 Regulations governing delegations of authority should be established for the institution and approved by the governing board. These regulations should indicate key functions that cannot be delegated, and specify that delegation of Yes ** authority to another person or organization does not remove responsibility for consequences of decisions made from the person giving the delegation. 2.1.11 Advice and support are made available to faculty and staff in a manner that Yes *** contributes to their personal and professional development 2.1.12 Proposals for program developments and recommendations on policy issues are presented to the appropriate decision making body in a form that clearly Yes **** identifies the issues for decision and the consequences of alternatives
12
Overall Assessment
****
Comment: The organizational structure of collage is well defined. Formal appointment procedures are followed for Deans, Vice Deans and Department Chairmen through selection committee based on clear guidelines. A new procedure of delegation of authority at all levels of KSUs management has been developed and approved. The responsibilities of Deans, Vice Deans and Department Chairmen are clear to every one of them and detailed in their job description, which provide full explanation of their roles and responsibilities, and are updated every two years. The University provides strong support for leadership development. Department Chairmen & deputy chairmen of departments and other academic administrators attend several Leadership Development Programs, and new staff members participate in the New Staff Members Program. Departments also encourage leadership development through various teams and committees within their structure. Priorities for improvement
1) The need for periodic studies dealing with issues relevant to organizational climate, job satisfaction
and confidence in future development.
2) Proper recognition of distinguished staff members and employees is deficient. 3) Sufficient resources, to assist the leadership, are lacking in some areas e.g. secretaries.
Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) commended the strong commitment from the leadership of the university and the college to improve the quality of its program, which was evident by the appointment of Vice-Dean of Quality and Development with clear responsibilities for guiding this process. The Panel was concerned that the majority of College staff did not have current position descriptions that accurately reflected their workload and responsibilities. Also, the insufficient administrative and secretarial support available to staff at the College to efficiently deliver all aspects of the program. The Panel recognized the high level of educational experience and expertise within the college, but thought that the governance structure did not fully utilize this expertise. A number of staff within the College held multiple key notes and sustainable workloads for them was a concern for the Panel. They recommended the College consider support and contingency, plans for its major portfolios as well as active succession planning to ensure program sustainable and development.
13
Assurance Arrangements. 2.2.5 Plans should be effectively communicated to all concerned with impacts and requirements for different constituencies made clear. 2.2.6 Implementation of plans is monitored with checks made against short term and medium term targets and outcomes evaluated. 2.2.7 Planning provides for reports on key performance indicators to be made on a regular basis to senior management within the institution. 2.2.8 Plans are reviewed, adapted and modified, with corrective action taken as required in response to operational developments, formative evaluation, and changing circumstances. 2.2.9 Risk management is included as an integral component of planning strategies with appropriate mechanisms developed for risk assessment and minimization. Overall Assessment Comment
**** *** ** **
***
The college has assigned a special unit for strategic planning headed by a fulltime director and a comprehensive strategic plan has been developed. It has been approved by both the college and hospital boards and by the university. The strategic plan (including the mission) has been formulated with wide consultation and participation of all stakeholders. A formal SWOT analyses, as well as, many meetings and interviews were undertaken with students, staff, nurses, employees, and faculty. In addition, all relevant external stakeholders were consulted including: the ministry of health, the Saudi commotion for health sciences, the university officials, some other healthcare organizations in Riyadh, and members of the private healthcare system. The approved strategic plan is available on the college web site. The plan and mission were discussed in details in all departments and approved by department boards. Benchmarking of the mission and key indicators were undertaken with three Canadian universities (UBC, McGill and Ottawa) as well as Manchester University-UK. The plan has been reviewed by an international expert Dr. Steve Watson (Professor of Strategic Planning University of Oklahoma). Priorities for improvement 1. To put in place a proper and formal risk management program. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008). The Panel acknowledged the difficulties in effectively communicating with the large number of staff distributed between the College and the hospital, but have identified this as a major priority for program planning and management.
14
2.3.3
Male and female sections are adequately represented in the membership of relevant committees and councils. 2.3.4 Plans for the program and course specifications require the same standards of delivery and are consistent for both sections, subject to any appropriate variations to meet differing needs of students. 2.3.5 Performance indicators and reports on courses and programs show results for each section, and also overall results for the program as a whole. Overall Assessment
****
Comment According to the Rectors decision in May 2008, the beginning of the academic year 2008- 2009, female faculty members participate in Department, College and University Councils with their male counterparts, sharing in decision making and voting. At the College level, by the commencing of the coming academic year all our students share the same facilities with no segregation. Currently, only 2nd year female students are based at Malaz with complete coordination and compatibility with the main Campus. Priorities for improvement None Independent Opinion The NCCAAA Program Accreditation Review panel (Nov. 2008). Panel members visited the all campuses and found there were cooperative planning and reporting processes in place with regular communication between staff delivering the same program. They reported that there appear to be comparable program standards but no specific data performance indicators have been identified. No major problems were raised with the Panel in relation to resource availability and the differing needs of the students were well accommodated.
2.4 Integrity
Teaching and other staff involved with the program must meet high ethical standards honesty and integrity including avoidance of conflicts of interest and avoidance of plagiarism in their teaching, research, administrative and service functions. These standards must be maintained in all dealings with students, teaching and other staff, and in relationships with other internal and external agencies including both government and non government organizations. 2.4.1 Codes of practice for ethical and responsible behaviour have been developed and are followed dealing with matters such as the conduct and reporting on Yes *** research, performance evaluation, student assessment, committee decision making, and the conduct of administrative and service activities. 2.4.2 Regulations dealing with declarations of pecuniary interest or conflict of Yes *** interest for faculty and staff are consistently followed. 2.4.3 Advertising and promotional material are always be truthful, avoid any actual or implied misrepresentations or exaggerated claims, or negative comments Yes *** about other programs or institutions Overall Assessment Comment KSU upholds and protects its integrity by abiding by the laws and regulations of the Civil Service Laws, the Ministry of Higher Educations policies, bylaws and regulations, Financial Bylaws, Student Academic Regulations, and other governing and regulating bodies and guidelines. Integrity is further ensured by follow-up
***
15
systems and internal financial auditing. Departments uphold their integrity by ensuring that students are provided with a course syllabus that outlines the course expectations and grading procedures. Departments also ensure that faculty members understand academic polices. The Collage is responsive to student complaints and student/staff grievances through committees in colleges and students rights bylaws, which have established clear policies and procedures for student grievances. In addition, the Dean and Vice deans have generic email accounts that are widely accessible to students and are used to respond to their grievancesan issue which is given a high priority. In general there are periodic meetings between the Dean and Vice deans and students in their locations to listen to their voices. The Deanship follows an open-door policy (once a week). In addition, he holds an open meeting three times per academic year for all staff and employees. All employees are welcomed to provide ideas and input into collage procedures, events and initiatives by contacting the appropriate committee, administrator or other governing body and to outline their weaknesses, strengths and futuristic visions for their departments/units. There is sufficient evidence that there are regulations dealing with declarations of financial issues or conflict of interest for faculty and staff at all levels of the University. Priorities for improvement None Independent Opinion The NCCAAA Program Accreditation Review panel (Nov. 2008). The Panel was pleased to hear from students regarding the high ethical standards of College staff in their interactions. The College was commended on the high standards of ethical behavior of staff in their interactions with students.
****
16
Priorities for improvement None Independent Opinion The NCCAAA Program Accreditation Review panel (Nov. 2008). The Panel expressed concerned that the College's committee structure was not well defined and suggested an improved committee structure to better support the quality delivery of the program, with regular monitoring and appropriate prompt adjustments in response to feedback and evaluation processes.
****
Comment: KSUs policies and procedures delineate categories of rules and regulations in effect at the University. Deanships of the University are keen on promoting a positive organizational climate at the department level through specifying office hours for meetings with administrative staff, faculty members and students. Evidence also exists concerning female participation in decision-making. At all administrative levels there is a culture, encouraging initiatives and innovative ideas. On the whole: 1) KSU upholds and protects its integrity by abiding by the laws and regulations of the Civil Service Laws, the Ministry of Higher Educations policies, bylaws and regulations, Financial Bylaws, Student Academic Regulations, and other governing and regulating bodies and guidelines. Integrity is further ensured by follow-up systems and internal financial auditing. 2) KSUs policies and procedures delineate categories of rules and regulations currently in force at the University. All these policies are easily accessible on the University website, and fall into the following categories: Student affairs, financial affairs, Faculty, Research and postgraduate studies and delegation regulations. 3) Vice Deans, Department Chairmen and other academic administrators attend several Leadership Development Programs arranged by Skills Development Deanship and new staff participate in Program of New Staff Members. In addition, establishment of clear policies and procedures for student/ staff grievances. 4) The administrative structure of the college is well designed and defined with clear responsibilities, reporting lines, and authorities. All major positions have clear job descriptions. Likewise, all major committees have clear terms of reference. The Deanship follows an open-door policy that encourages staff to discuss ideas, concerns or problems with their managers. All employees are welcome to provide ideas in weekly meeting. 5) The leadership support for the program is evident and reflected in several decisions and actions for
17
example: the creation and support of the Medical Education Department, the adoption of reformed educational methods, the creation of the skills lab and the introduction of the e-learning system. An important addition is the commencement of work on the new college building. This represents a state of the art extension of the current college with four dedicated educational floors with many lecture halls, small group discussion rooms, smart board facilities teleconferencing capabilities. Indicators considered: 1) The average ratings of staff to the questions (in staff satisfaction survey). The administration is understanding and cooperative. I can easily reach the administration. The head of my department is understanding and cooperative. I can easily reach the head of my department. Priorities for improvement 1) To put in place a proper and formal risk management program. 2) Creation of an efficient intranet system Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) commended the strong commitment from the leadership of the university and the college to improve. There was concern that the majority of College staff did not have accurate position descriptions. However, the Panel recognized the high level of educational experience and expertise within the college, which required full utilization. Apparent comparable program standards at the different campuses were noted. The College was commended on the high standards of ethical behaviour of staff in their interactions with students. The Panel expressed concern that the College's committee structure was not well defined.
18
19
Standard 3: Management of Program Quality Assurance Good Practices Relating to This Standard 3.1 Commitment to Quality Improvement in the Program
Program administrators and teaching and other staff must be committed to maintaining and improving the quality of the program. 3.1.1 All teaching and other staff participate in self-assessments and cooperate Yes *** with reporting and improvement processes in their sphere of activity. 3.1.2 Creativity and innovation combined with clear guidelines and accountability Yes *** processes are actively encouraged. 3.1.3 Mistakes and weaknesses are acknowledged, and dealt with constructively, Yes **** with help given for improvement. 3.1.4 Improvements in quality are appropriately acknowledged and outstanding Yes **** achievements recognized. 3.1.5 Evaluation and planning for quality improvement are integrated into normal Yes *** administrative processes. Overall Assessment Comment The highest level to quality commitment is driven by the highest University leadership in the form of the Rectors direct involvement and by the Vice Rectors of the University. At the college level, the Vice Dean of Development and Quality VDQD is primarily responsible for operating the quality management systems. The strong commitment to quality improvement amongst leadership resulted in increased awareness of all Quality measures that penetrated to all levels. The VDQD guides this important process and has set up a functional AQU supported by a full time quality consultant. Improvements in quality are appropriately acknowledged and great achievements recognized. Faculty members are involved in the quality improvement processes and their participation is required in all sorts of activities. Training programs relating to quality have been provided by Deanship for Quality, AQU and Medical Education Department. There is, certainly, a sustainable drive in the recognition and realization of Collage commitment to quality improvement by following a continuous and rigorous program of continuous improvements and innovations. Priorities for improvement
***
None
Independent Opinion The NCCAAA Program Accreditation Review panel (Nov. 2008) stated that there is a strong commitment to Quality Improvement amongst leadership in the College which resulted in increasing the awareness. The University's commitment to Quality Improvement has formalized and resources the College's efforts. The Vice Dean of Quality and Development was commended for excellent leadership. The Huron consulting group (June 2009). Highly regarded the Vice Dean for Quality and Development who undertook a major effort to correct many deficiencies. This effort described as Creating a Culture of Excellence has identified a large number of objectives to monitor all aspects of the educational program and to support innovations and improvements. In addition, they pointed to the detailed operational plan which has been developed to implement the changes.
20
***
In addition, The AQU deals with the administrative processes including: (preparation and updating of job descriptions of main academic positions and Terms of Reference of all college committees, creation and approval of policies and procedures related to academic functions of the College and monitoring compliance with policies and procedure). As for monitoring academic staff performance, it is carried out, through preparing the annual academic staff activities capture forms (AACF) and producing detailed comparative reports between Departments/Units and staff for academic loads and performance. This is based on the use preset indicators and benchmarking to improve academic staff performance. All quality planning, reports and surveys were discussed and approved by the College Board. These evaluations and reports provide an overview of performance for the program as a whole to guide in planning for improvements. Priorities for improvement
21
1) To hire qualified staff in the Academic Quality unit and provide needed training.
Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008). At the time of their visit, the panel expressed concern regarding the lack of adequate resources for quality implementation and management. They felt strongly that the two responsibilities (hospital and academic program) under a single Vice Dean were advantageous as it will allow synergies in development of expertise and documentation. The Huron consulting group (June 2009) addressed the need of the Quality Department to be defined within a framework of roles and responsibilities which supports the overall quality and safety activities of the institution. Those policies and procedures need to be developed and well defined to all departments, and create the necessary supporting systems that drive and sustain the entire quality and other systems (education, data gathering and analysis, etc.).
****
22
statistical data on indicators, including grade distributions, progression and completion rates are properly retained and regularly reviewed and reported in annual and periodic program reports. Priorities for improvement 1) An accessible central data base to retain statistical data on indicators, including grade distributions, progression and completion rates, needs to be set up. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) recommended that the college develops and implements organizational and committee structure for Quality Assurance that must codified in the College/University by-laws to ensure a sustainable program of Quality Assurance in the College. The Huron consulting group (June 2009) commended the efforts to establish an organized and effective structure overseeing the quality assurance processes.
***
23
part of the KSU-QMS Priorities for improvement None Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) comment on that the Quality Assurance effort of the College was relatively recent and stressed on the importance of putting in place processes for analysis and feedback should be included [the closing of the loop].
****
24
***
Comment: There is a strong commitment to Quality Improvement amongst leadership in the College. This resulted in increased awareness and penetration to all levels with an understanding of the need for consistent documentation at the program and individual levels. Course and program reports are regularly submitted. Program, courses, staff evaluation surveys are continuously conducted to the students and graduates. A system for staff self-evaluation is established by the use of certain criteria and scoring. The use of QAS-KSU annually will give opportunity for continuous improvement. The main KPIs need to be defined and finalized. A supporting area is that the comparative data in the form of benchmarks should be determined and used. Indicators considered: 1) The average rating of the overall quality of their program from answering the question in graduate evaluation survey 2) Proportion of courses in which student evaluations were conducted during the year. 3) Proportion of course reports conducted by the departments Priorities for improvement 1) To hire qualified staff in the Academic Quality unit and provide needed training. 2) To continue to use the approved set of KPI to continuously measure performance Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008). In general, the panel highlighted that it was only the early days of quality assurance processes at the college. They commended the leadership, commitment and efforts. They stressed on the importance of regular evaluations of quality within each course based on valid evidence and appropriate benchmarks, and plans for improvement made, implemented and reviewed. The Huron consulting group (June 2009) commended the efforts to establish an organized and effective structure overseeing the quality assurance. They acclaimed the VDQD who undertook a major effort to correct many deficiencies. This effort described as Creating a Culture of Excellence has identified a large number of objectives to monitor all aspects of the educational program and to support innovations and improvements. They pointed to the detailed operational plan which has been developed to implement the changes.
25
26
Standard 4: Learning and Teaching Good Practices Relating to This Standard 4.1 Student Learning Outcomes
Intended student learning outcomes must be consistent with the National Qualifications Framework, and with generally accepted standards for the field of study concerned including requirements for any professions for which students are being prepared.
Yes Yes
**** ****
Yes
****
Yes
****
Yes
***
****
Comment Learning outcomes are clearly defined, based on international standards and local needs and stem from the program mission Mapping of the whole program against the learning outcomes is still lacking Priorities for improvement 1) Mapping of the whole program against the learning outcomes Independent Opinion
The NCAAA Program Accreditation Review panel (Nov. 2008) mentioned that There were clear student learning
outcomes that were specified for the program and the individual courses. The management of these outcomes and the articulation between them was not always clear and particularly the developmental changes within courses are not always articulated and communicated either horizontally or vertically.
27
detailed program specifications that include knowledge and skills to be acquired, and strategies for teaching and assessment for the progressive development of learning in all the domains of learning. 4.2.2 Plans for courses are set out in course specifications that include knowledge and skills to be acquired and strategies for teaching and assessment for the domains of learning to be addressed in each course. 4.2.3 The content and strategies set out in course specifications are coordinated with other courses and followed in practice to ensure effective progressive development of learning for the total program in all the domains of learning. 4.2.4 Planning should include any action necessary to ensure that teaching staff are familiar with and are able to use the strategies included in the program and course specifications. 4.2.5 The academic and/or professional fields for which students are being prepared are monitored on a continuing basis with necessary adjustments made in programs and in text and reference materials to ensure continuing relevance and quality. 4.2.6 In professional programs continuing advisory panels that include leading practitioners from the relevant occupations or profession monitor and advice on content and quality of programs. 4.2.7 New program proposals are assessed and approved or rejected by the institutions senior academic committee using criteria that ensure thorough and appropriate consultation in planning and capacity for effective implementation. Overall Assessment
Yes
****
Yes Yes
**** ****
****
Comment Well-renowned, international consultants were invited to participate in the planning of the program development Internal stakeholders were heavily involved in the process. The curriculum committee has representatives from different basic and clinical specialties. The reformed curriculum was debated and discussed extensively among staff and has been benchmarked with curricula of world top universities. Continuance feedback about the curriculum is obtained through regular students satisfaction surveys and through direct feedback. The reformed curriculum prepares the students to be lifelong learners by adopting a gradual student centered approach. It adopts also new and internationally approved methods in medical education. The reformed curriculum delivery is in horizontally and vertically integrated multidisciplinary fashion and it uses small group and problem based learning which makes teaching and learning student-centered and in an enjoyable safe environment. Integration at every level of the curriculum needs to be improved. Feedback from students about the curriculum design and reform is needed. Priorities for improvement 1) Perform more extensive reform in the clinical years 2) Find channels to get more students feedback in the curriculum design and reform Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) emphasized on the importance of developing a curriculum management structure. The precise structure should be determined by the College but the authority and responsibilities, chairperson, membership and reporting obligations should be clearly stated and disseminated. They stated that staff of the College consistently reported that the foundation of a Department of Medical Education would be beneficial in promoting curriculum reforms. The location of individuals with educational expertise and interest would also provide a critical mass to maintain momentum and direction for reform efforts. The Panel acknowledged the strong and widespread support for this initiative within the College and supports the
28
formation of this department. One main point was noted by the Panel was that many staff and students would like to see the curriculum, particularly the early years, move to a more integrated, systems-based approach. This is seen as valuable for promoting clinical conceptualization and active learning behaviors. The Panel also noted that there was consistent feedback from students at all levels, staff, graduates and employers that resources, for delivering the curriculum have not kept pace with growth in student number.
4.3.10 Procedures are followed that ensure that in program reviews information about the appropriateness of learning outcomes sought and the extent to which they are achieved is sought from students and graduates through surveys and interviews, discussions with faculty, and other stakeholders such as employers. 4.3.11 If the program is offered in sections for male and female students evaluations should provide data for each section as well as for the program as a whole, and any deficiencies in one or the other section dealt with appropriately in recommendations for action.
Overall Assessment Comment The program is extensively evaluated internally and externally
Yes
****
Yes
***
***
29
Online surveys system is well established but full loop evaluations has not taken place in all courses Priorities for improvement 1) Strict enforcement of the evaluation process 2) More awareness of students about results of surveys and awareness of the improvement projects to increased their involvement and ownership of the process 3) Put a centralized system for the departmental external examiners to maximize the gain from these visits Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) highlighted that Evaluation instruments have recently been developed and implemented for the program and courses within it. Students reported that they do complete questionnaires on courses and teachers but that they get no feedback on the results other than their own observation of changes in teaching practices. There were no central process for analysis obtained, dissemination of the results or changes made as a result of the feedback at a College level. The College has initiated reviews of its activities most notably in the form of the recent visit by staff from University Maastricht. This review is further evidence of the willingness to embrace curriculums reform within the College. The Huron consulting group (June 2009) mentioned that they were the fourth experts from outside of the Kingdom to have reviewed the educational program for the College of Medicine in the preceding 13 months.
4.4.9
Yes
***
30
4.4.10 Criteria and processes for academic appeals should be made known to
students and administered equitably (see also item 5.3). Overall Assessment
Yes
*****
***
Comment Exam design based on well developed blue print with psychometric analysis There are faculty enhancement programs in the area of assessment. Assessment evaluation is not applied in all years and assessment is not always based on outcomes Priorities for improvement 1) Perform rigorous assessment evaluation of all exams 2) Disseminate and educate staff and students about the new assessment policy and procedure 3) Extend the centralized exam unit services for all academic years. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) highlighted that the assessment program was largely controlled at a department/course level rather than there being a central, coordinated approach stemming from a common assessment philosophy. Clear links and blueprinting between the curriculum objectives, teaching and learning opportunities and assessment needed to be developed. There was extensive coordination between course organizers to ensure that both curriculum and assessment are comparable when delivered separately to male and female students in the early years. There was a variety of assessments in the later years of the program although there were inconsistencies between departments/courses. There was a lot of individual interest in improving assessments but coordination and an overall framework for developing assessments is lacking. Training for staff in developing and using assessment forms was available but strong, central leadership in improving the quality of the items needed to be developed. Allocation of student grades and analysis of grade distribution was largely a departmental function although there was an annual meeting of departments with the Dean to discuss the grade distributions that have been given. This departmental approach meant that there were no clear and consistent pass/fail algorithms based on appropriate standard setting procedures. The Huron consulting group (June 2009) pointed to the central management of the course content, methods of pedagogy and student assessment was weak. The committee structure was not well-defined in terms of authority and responsibility and therefore did not function well. A central database of course content was lacking. An effective system to monitor the quality of courses and teaching was absent.
31
prepare students for study in a higher education environment. Particular attention is given to preparation for the language of instruction, self directed learning, and bridging programs if necessary for students transferring to the institution with credit for previous studies. Preparatory studies must not be counted within the credit hour requirements for programs. 4.5.6 If the language of instruction in the program is English, action is taken to ensure that language skills are adequate for instruction in that language when students begin their studies. (This may be done through language training prior to admission to the program. Language skills expected on entry should be benchmarked against other highly regarded institutions with the objective of skills at least comparable to minimum requirements for admission of international students in universities in English speaking countries. The benchmarking process should involve testing of at least a representative sample of students on major recognized English language tests) 4.5.7 If preparatory programs are outsourced to other providers the institution still accepts responsibility for ensuring the necessary standards are met and entry requirements to the program are maintained. 4.5.8 Systems are in place within each program for monitoring and coordinating student workload. 4.5.9 The progress of individual students is monitored and assistance and/or counselling provided to those facing difficulties 4.5.10 Year to year progression rates and program completion rates are monitored, and action taken to help any categories or types of students needing help. 4.5.11 Feedback on performance by students and results of assessments is given promptly to students and accompanied by mechanisms for providing assistance if needed. 4.5.12 Adequate facilities should be provided for private study with access to computer terminals and other necessary equipment. 4.5.13 Teaching staff are familiar with the range of support services available in the institution for students, and should refer them to appropriate sources of assistance when required. 4.5.14 The adequacy of arrangements for assistance to students should be periodically assessed through processes that include, but are not restricted to, feedback from students. Overall Assessment
Yes
****
***
Comment Academic guidance committee is established and two academic advisors are present for each year but without clear policy for students with significant academic difficulties. Academic advisory office hours are practiced. Priorities for improvement 1) Improve students supporting services (this has been identified as one of the strategic plan priorities). 2) Develop a mechanism to deal with students with sub-satisfactory performance. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) mentioned that Students report that staff, including the Vice Dean for Academic Affairs are available and approachable for assistance. Although students do not have a formal seat on College/Department committees they elect a student representative who maintains
32
communication between staff and students and report that this works well. However, staff reported that they would like to be able to offer more assistance to students for academic counseling and support. Orientation for new students is available in the form of a New Students Guide and an orientation programs is run by senior students. Both these methods are seen as effective for new students. Teachers in the early years of the program report that the transition to learning in English is not a major problem in this program with most students being comfortable within the first few weeks.
Yes
***
****
Comment: The academic quality unit is regularly monitoring the quality of teaching. Most courses have course surveys where student's feedback is given about their learning and this evaluation needs to be strictly implemented in all courses. Teachers who are underperforming are subjected to extensive training.
33
KPIs were established for monitoring the strategic objectives of the program. Feedback from some departments to reports of evaluations is suboptimal. The course report and program report plan of actions need to be monitored. Priorities for improvement: 1) Evaluation of the impact of the training courses on overall learning and teaching process. 2) All course reports should be submitted and a system of revision of how these reports reflected on the program must be followed. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) reported that course management was conducted at a departmental level and the provision of clear subject outlines was appreciated by students. New staff were provided with information relating to departmental activities but orientation about the over-arching program structures, philosophies and teaching and learning/assessment approaches should be developed. Course and teacher evaluations have recently been developed and have been welcomed. Some staff commented that advice on using the feedback obtained through these instruments to improve practice would be beneficial
****
Comment: There are dedicated active faculty development deanship in both the university and the college, but there is difficulty in attending the university programs because of timing issues. There is continuous training in medical education and teaching skills for all new teaching staff Staff guidance in developing a professional portfolio is currently in the process of being established. Awards for excellence in teaching needs to be increased and better announced. Priorities for improvement 1) Bring faculty enhancement programs to the departmental level. 2) Create new innovative ways to recognize excellence in teaching. Independent Opinion
The NCAAA Program Accreditation Review panel (Nov. 2008) stated that there were multiple approaches to
34
professional development in teaching and learning areas. Support was provided for staff to develop teaching skills through external courses and workshop and theses were widely attended. Central prioritization of these activities would better balance individual and program goals. Internal workshops run by staff with medical education expertise are also available. Staff indicated that these workshops are valued but workloads often made attendance difficult. Annual identification of priority areas may provide a structure to these workshop series and together with support for implementation of ideas arising from such sessions stimulate staff attendance.
****
Comment: The college has large number of superbly trained staff people. Most of them had graduated from top international universities. In addition, more than one hundred appointed demonstrators are currently on scholarship training abroad in different specialties and are expected to join the faculty in the next five years. There is increase in faculty salaries that occurred recently but still low when compared to other institution. The faculty service is reasonable but there is lack of adequate supporting staff. Ample opportunity for education and travel to scientific conferences and meetings. Priorities for improvement 1) Find innovative solutions for the hiring of supporting staff. 2) Improve housing for faculty. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) focused on teaching staff were well qualified and experienced both clinically and for teaching. There were 7 members of the School with formal qualifications in Medical Education who can provide overall leadership in learning and teaching activities. This number of staff has reduced from 14 in a relatively short time frame.
35
of teaching teams, and appropriate evaluation and course improvement strategies carried out. (Field experience includes any work based activity such as internships, cooperative training, practicums, clinical placements or other activities in a work or clinical setting under the supervision of staff employed in that work or professional setting) 4.9.1 In programs that include field experience activities the student learning to be developed through that experience is clearly specified and appropriate steps taken Yes **** to ensure that those learning outcomes and expected experiences to develop that learning are understood by students and supervising staff in the field setting. 4.9.2 Supervising staff in field locations are thoroughly briefed on their role and Yes **** the relationship of the field experience to the program as a whole. 4.9.3 Teaching staff from the institution visit the field setting for observations and Yes *** consultations with students and field supervisors often enough to provide proper oversight and support. (Normally at least twice during a field experience activity) 4.9.4 Students are thoroughly prepared through briefings and descriptive material Yes **** for participation in the field experience.. 4.9.5 Students are required to prepare a report on their field experience that is Yes *** appropriate for the nature of the activity and the learning outcomes expected 4.9.6 Follow up meetings or classes are organized in which students can reflect on Yes **** and generalize from their experience relate it to studies previously undertaken, and. apply that experience to situations likely to be faced in later employment. 4.9.7 Field experience placements are selected because of their capacity to Yes **** develop the learning outcomes sought and their effectiveness in doing so is evaluated. 4.9.8 In situations where the supervisors in the field setting and faculty from the institution are both involved in student assessments, criteria for assessment are Yes **** clearly specified and explained, and procedures established for reconciling differing opinions. 4.9.9 Provision is made for evaluations of the field experience activity by students, by supervising staff in the field setting, and by faculty of the post Yes *** secondary institution, and results of those evaluations considered in subsequent planning. 4.9.10 Preparation for the field experience includes thorough risk assessment for Yes * all parties involved, and planning to minimize and deal with those risks. Overall Assessment
***
Comment: A full day preparatory course is offered to all students explaining the objectives and expectations as well as rights and duties along with hands on training on basic skills. Only recognized training programs by Saudi commission for health specialties are accepted for training. The evaluation process is reassessed regularly and changed if necessary with consultation with supervisors and student representatives. Portfolio is done by students in some areas. Visit to training areas are usually done on need basis and not regular. Training experience evaluation by students is new and will be used to accredit training locations. Electronic system is not fully functional. Priorities for improvement: 1) Visit of interns to training areas are need to be conducted regularly. Independent Opinion
36
The NCAAA Program Accreditation Review panel (Nov. 2008) reported that there were consistent perceptions that the quality of clinical teaching is coming under pressure as a result of increasing student numbers and decreasing availability of patient resources due to new medical schools opening in Riyadh. There were discussions to use simulated patients and the new Clinical Skills Laboratory which was nearly complete. These initiatives were supported by the Panel. Planning for implementation of these initiatives should include adequate training of staff in their consistent use, incorporation into the curriculum framework, objectives and assessment. All of these initiatives provide valuable opportunities for maintaining quality of learning and outcomes for students whilst increasing efficiencies of teaching and so represent positive moves towards enabling greater sustainability within the program.
4.10
In situations in which local institutions deliver programs through cooperative arrangements with another institution these arrangements must be clearly specified, enforceable under Saudi Arabian law, and all requirements for programs in the Kingdom of Saudi Arabia must be fully complied with. 4.10.1 Responsibilities of the local institution and the partner are clearly defined Yes **** in formal agreements enforceable under the laws of Saudi Arabia.
4.10.2 The effectiveness of the arrangements is regularly evaluated. 4.10.3 Briefings and consultations on course requirements are adequate, with
mechanisms available for ongoing consultation on emerging issues. 4.10.4 Teaching staff familiar with the content of courses visit regularly for consultation about course details and standards of assessments. 4.10.5 If arrangements involve assessment of student work by the partner in addition to assessments within the institution, final assessments are completed promptly and results made available to students within the time specified for reporting of student results under Saudi Arabian regulations 4.10.6 If programs are based on those of partner institutions, courses, assignments and examinations are adapted to the local environment, avoiding colloquial expressions, and using examples and illustrations relevant to the setting where the programs are to be offered. 4.10.7 Programs and courses are consistent with the requirements of the Qualifications Framework for Saudi Arabia, and in professional programs, include regulations and conventions relevant to the Saudi environment. 4.10.8 If courses or a programs developed by a partner institution are delivered in Saudi Arabia adequate processes are followed to ensure that standards of student achievement are at least equal to those achieved elsewhere by the partner institution as well as by other appropriate institutions selected for benchmarking purposes. 4.10.9 If an international institution or other organization is invited to provide programs, or to assist in the development of programs for use in Saudi Arabia full information is provided in advance about relevant Ministry regulations and NCAAA requirements for the National Qualifications Framework and requirements for program and course specifications. Overall Assessment
Yes
****
Yes
****
Yes
****
NA
****
Comment There are excellent collaborative agreements and twining programs with world top universities, but many of these agreements are not best utilized especially when it comes to the undergraduate education part.
37
Also there is no special office that follows these agreements (this has been identified as one of the strategic priorities for the college in the current strategic plan). Priorities for improvement 1) Proper evaluation of the impact of partnership arrangements. 2) Proper follow up of implementation of these agreements. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) mentioned that To date, the partnership arrangements have largely centered on research activities. These are extensive and likely to expand. The College is also seeking an agreement with another University to provide assistance and guidance in further curriculum reform. Whilst external review and independent comment is always valuable the Panel emphasized that the College has considerable internal expertise in Medical Education. With appropriate adjustment of workload and structural realignment these individuals could take a leadership role in these processes and so decrease the reliance on external sources. This would be valuable for applying appropriate local context to the curriculum and developing a strong sense of ownership within the College. The development of a Department of Medical Education, as mentioned above, may provide a focal point for such leadership activity.
**** **** *** *** *** **** **** **** *** ****
****
Comment: The process of identifying student's outcomes in the College of Medicine has been derived from the program mission. The process initiated with the rapidly evolving culture of outcome based education, adopted world-wide. The mission of the program defines the broad outcome of expected in all graduates which is to be able to meet the healthcare expectations and needs of the Saudi community. The outcomes and competencies were designed after careful review of the different outcomes.
38
Individual course learning outcomes are put by specialists in each department under supervision of the medical education department but mapping of the whole program against the learning outcomes is lacking. Learning outcomes are based on international standards and local needs. The curriculum committee undertook the responsibility to debate and discuss the reformed curriculum. Well-renowned, international consultants were invited to participate in the planning of the program development. Curriculum is well integrated and utilizes the current methods of medical education. The program is evaluated internally and externally and online survey system is well established, but the process is still in its beginning and full loop evaluations have not taken place in all courses and students participation in the process is still suboptimal There is centralized exam unit with exam design based on well developed blue print and psychometric analysis for the block system. The same must be applied in all years. There is significant move to more objective assessment tools in clinical years. There are orientation programs for new students. Academic guidance committee is established and active but with only two academic advisors for each year. There is no clear policy for students with significant academic difficulties. Most of courses have course surveys where student's feedback is given about their learning. Students also assess most of teachers on regular bases. Course and faculty evaluations are sent to the teacher and discussed in departmental council, but feedback from some departments to reports of evaluations is suboptimal There is dedicated active faculty development deanship in the university and a dedicate faculty development unit in the college but there is difficulties in attending KSU faculty enhancement programs for our staff because of timing issues. Awards for excellence in teaching needs to be increased and better announced. They have ample opportunity for education and travel to scientific conferences and meetings. There is Recent increase in faculty income. There is lack of adequate supporting staff. A full day preparatory course is offered to all interns explaining the objectives and expectations as well as rights and duties along with hands on training on basic skills. Portfolio is done by students in some areas and visit to training areas are usually done on need basis and not regular. There is excellent collaborative agreements and twining programs with world top universities, but there is no proper evaluation of the impact of these arrangements. Indicators considered: 1) Ratio of students to teaching staff. 2) The overall rating on the quality of their courses from answering the question I am happy with this course in general in the course evaluation survey. 3) Proportion of teaching staff with verified doctoral qualifications. 4) Proportion of teaching staff trained in medical education. 5) Percentage of students entering programs who successfully complete first year. 6) Proportion of students entering undergraduate programs who complete those programs in minimum time. 7) Proportion of students entering post graduate programs who complete those programs in specified time. 8) The overall rating on the quality of their courses from answering the question I am happy with this course in general in the course evaluation survey 9) The overall rating on the quality of their program from answering the question I am satisfied with my experience in this college in the program evaluation survey. 10) The overall rating on the quality of their program from answering the question I received appropriate Academic guidance when I needed it in the program evaluation survey. 11) The overall rating on the quality of their program from answering the question I am satisfied with my experience in Internship in the intern evaluation survey. 12) The overall rating of students on the quality of small group sessions from answering the question:" These
39
activities helped me to improve my ability to think and solve problems rather than just memorizing information". 13) The overall rating of students on the quality of small group sessions from answering the question: The activities taught me life-long learning. Priorities for improvement:
1) 2) 3) 4) 5)
Mapping of the whole program against the learning outcomes Perform more extensive reform in the clinical years Find channels to get more students feedback in the curriculum design and reform Strict enforcement of the evaluation process More awareness of students about results of surveys and awareness of the improvement projects to increased their involvement and ownership of the process 6) Put a centralized system for the departmental external examiners to maximize the gain from these visits 7) Perform rigorous assessment evaluation of all exams 8) Disseminate and educate staff and students about the new assessment policy and procedure 9) Extend the centralized exam unit services for all academic years. 10) Improve students supporting services (this has been identified as one of the strategic plan priorities). 11) Develop a mechanism to deal with students with sub-satisfactory performance. 12) Evaluation of the impact of the training courses on overall learning and teaching process. 13) All course reports should be submitted and a system of revision of how these reports reflected on the program must be followed. 14) Bring faculty enhancement programs to the departmental level. 15) Create new innovative ways to recognize excellence in teaching. 16) Find innovative solutions for the hiring of supporting staff. 17) Improve housing for faculty. 18) Visit of interns to training areas are need to be conducted regularly 19) Proper evaluation of the impact of partnership arrangements. 20) Proper follow up of implementation of the agreements. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008). The College was commended for the strong support and enthusiasm shown by the staff for reform and development of the approaches to learning and teaching within the Medical program. And the strong rapport that exists between the staff and students and the availability of staff to assist students despite increasing student numbers and providing opportunity for student to experience clinical settings relatively early in their program. In addition to the high level of educational expertise that exists within the staff and the staff development opportunities provided by these individuals for their colleagues. The Panel made several recommendations in the area of Learning and Teaching most of which stem from a strong, central recommendation that a greater focus on the program as a single cohesive unit rather than a collection of disparate departments is necessary. They also suggested there be a more strategic balance between individual priorities and program needs in staff development activities, and be done as part of the annual academic and budget planning process.
40
41
5.1 Student Admissions Policies and procedures must be in place to ensure that resource materials and services needed to support student learning are adequate and appropriate for the program, regularly evaluated, and kept up to date as required.
5.1.1 Admission requirements are consistently and fairly applied for all students. 5.1.2 If programs or courses include components offered by distance education, or use of e-learning in blended programs information is provided before enrolment about any special skills or resources needed to study in these modes. (For distance education programs a separate set of standards that include requirements for that mode of program delivery are set out in a different document, Standards for Quality Assurance and Accreditation of Higher Education Programs Offered by Distance Education 5.1.3 Student advisors familiar with details of course requirements are available to provide assistance prior to and during the student registration process 5.1.4 . Rules governing admission with credit for previous studies are clearly specified. 5.1.5 Decisions on credit for previous studies are made known to students by qualified faculty or authorized staff before classes commence. 5.1.6 Complete information about the program, including the range of courses, program requirements, costs, services and other relevant information is publicly available to potential students and families prior to applications for admission. 5.1.7 A comprehensive orientation program is available for commencing students to ensure thorough understanding of program requirements and reasons for them, the range of services and facilities available to them, and of their obligations and responsibilities. Overall Assessment
Yes
****
NA
Yes
***
****
Comment: Admission information for the college is described clearly on the university and college websites, including the requirements and procedures. Complete information about the program is publicly available on the college website An admission guide is distributed to all high schools which contains information about admission requirements and procedures. There is a need for more student advisors who are familiar with the details of the course requirements in order to provide assistance prior to and during the student registration process Priorities for improvement 1) To make available more student advisors who are familiar with the details of the course requirements to provide assistance prior to and during the student registration process and to hire social workers and psychologist. Independent Opinion
42
The NCAAA Program Accreditation Review panel (Nov. 2008) Stated that the requirements for admission appear fair and transparent and are consistently applied. The interviews of candidates for the medical program are conducted by a committee of three including the Vice Dean for Academic Affairs thereby ensuring the quality of admitted students. Regarding the number of students, the College suggests the number yearly, based on the College capacity and available infrastructure, but the actual number is decided by the University. Currently the College receives a high number of students that stress the quality of the current teaching and learning methods and the outcome of the program. The process of admission is fully automated and totally supervised by the Deanship of Admission and Registration [KSU]. The Huron consulting group (June 2009) referred to the catalogue for the College clearly establishes admissions criteria, standards for progress within the medical education program and the requirements for graduation.
***
Comment: All electronic records are following the university system while the paper records are kept in fireproof cabinets and for confidentiality access confined only to the vice dean of academic affairs but automated procedures for monitoring student progress throughout their programs are not satisfactory in place Priorities for improvement: 1) To continually examine and adjust admissions and registration standards for the purpose of continuous improvement, including automating the processes for generation of statistical data, external reporting requirements, and generation of reports on student progress and achievements. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) reported on student records being automated with backup of paper documents. The availability of various levels of password access with the Vice Dean for Academic Affairs the only one with complete access to records 5.3 Student Management Policies and regulations must be established for fair and consistent processes of student management, with effective safeguards for independent consideration of disputes and appeals. 5.3.1 Attendance requirements for students are made clear to students, monitored Yes ***** and enforced. 5.3.2 Student appeal and grievance procedures are specified in regulations, Yes ***** published, and made widely known within the institution. The regulations make
43
clear the grounds on which academic appeals may be based, the criteria for decisions, and the remedies available. 5.3.3 Appeal and grievance procedures protect against time wasting on trivial issues, but still provide adequate opportunity for matters of concern to students to be fairly dealt with and supported by student counselling provisions. 5.3.4 Appeal and grievance procedures guarantee impartial consideration by persons or committees independent of the parties involved in the issue, or who made a decision or imposed a penalty that is being appealed against. 5.3.5 Procedures have been developed to ensure that students are protected against subsequent punitive action or discrimination following consideration of a grievance or appeal. 5.3.6 Appropriate policies and procedures are in place to deal with academic misconduct, including plagiarism and other forms of cheating. Overall Assessment
Comment: A code of behaviour is approved by the governing body and made widely available within the University specifying student rights and responsibilities of students Student appeal and grievance procedures are specified in regulations, published, and disseminated within the University. The regulations make clear the grounds on which academic appeals may be based, the criteria for decisions, and the remedies available Procedures have been developed to ensure that students are protected against subsequent punitive actions or discrimination following consideration of a grievance or appeal but there is need for disseminating and informing both staff and students about the availability of the items listed in this area. Priorities for improvement 1) There is need for disseminating and informing both staff and students about the availability of the items related to students management. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) commended the College on the vigorous implements the University's students rights policy for both male and female students. The appeal policies are in place and activated through the Vice Dean for Academic Affairs. However, the procedures to protect the students against subsequent punitive actions are not codified by the Vice Dean for Academic Affairs attempts to protect students are in an informal manner. The results of course examinations are reviewed at the departmental level with input by the Vice Dean of Academic Affairs.
44
Overall Assessment
***
Comment: In spite of the presence of academic advisor that is part of the Committee of Academic Guidance, and is responsible for monitoring students' progress for a fixed period it is limited to two academic staff for each academic year and individual efforts by dedicated staff. There are no social workers, psychologist, nor full time counselors available. Priorities for improvement 1) To make available more student advisors who are familiar with the details of the course requirements to provide assistance prior to and during the student registration process and to hire social workers and psychologist. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) highlighted the comprehensive financial, social plans and health coverage offered to all students.
***
Comment: Evidence about the quality of students and support services indicates that good levels of performance are normally achieved in all main components or areas of this standard (Student Administration and Support services). A high level of effective security of student records, clear rules for governing privacy of information and controlling access to student records, eligibility for graduation, and opportunities for students' participation in religious, cultural, sports and physical activities. Procedures at the University have been developed that are effective in ensuring that students are protected against subsequent punitive action or discrimination following consideration of a grievance or appeal. In spite of the presence of a Committee of Academic Guidance that is responsible for monitoring students progress, the student advisory system should be continuously revised and improved to reach the desired level. Automated procedures for monitoring student progress throughout their programs and for aggregating records to provide statistical data required for planning, reporting and quality assurance are in place, to some extent, but need to be improved. Indicators considered: 1) Ratio of students to administrative staff 2) The average rating on the adequacy of academic and career counselling from answering the question I received appropriate Academic guidance when I needed it in graduate evaluation survey
45
3) The average rating by students to the question: Students supporting services are adequate in graduate evaluation survey Priorities for improvement 1) To make available more student advisors who are familiar with the details of the course requirements to provide assistance prior to and during the student registration process and to hire social workers and psychologist. 2) To continually examine and adjust admissions and registration standards for the purpose of continuous improvement, including automating the processes for generation of statistical data, external reporting requirements, and generation of reports on student progress and achievements. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008). The Collage was commended on the process for student selection and the implementation of the University's student rights policy and comprehensive support to both male and female students. Suggestions were offered to better match student numbers with teaching and learning resources. In addition, to develop and apply policies and procedures for academic misconduct and protection of the students against punitive action and discrimination.
46
Main Components of this Standard as Applied to Educational Programs Planning and Evaluation Organization Support for Users Resources and Facilities Comment and General Description of Good Practice Adequate library and other learning resources and services for the needs of the program are essential requirements, and are particularly important in programs designed to develop capacity for independent learning and creative application of ideas. Collections must be up to date and regularly enhanced as new material becomes available, and there must be ready access to information located elsewhere. Basic collections should be adequate for the program, but go well beyond the immediate needs to provide access to research reports, data bases and journal and internet publications that capture the latest thinking in related areas of inquiry. If the program is postgraduate there must be adequate resources for research by students and by faculty in this and related fields. Orientation programs should be available to ensure that new students know how to make proper use of library and resource centre facilities. Ongoing assistance should be available to help students as they use these resources for studies in the program. Requirements for library services are changing in keeping with the rapid development of information technology and developments in flexible delivery of courses. Libraries are recognized as being not simply collections of books and periodicals, but gateways to information required for research and investigation in an international context. Evaluation of a program includes the availability of the range of services and materials that are needed to support it. The provision of services should be planned cooperatively between program developers, other faculty, and resource centre staff, so that the resources and services provided are matched to the requirements for teaching and learning and associated research and investigations. Proposals for new or substantially modified courses and programs should include an independent statement from the library or resource centre indicating cost and availability of the information resources required Evidence and Performance Indicators Evidence about the quality of learning resource provision and performance indicators derived from this evidence can be obtained from user satisfaction surveys, success rates for students in accessing course reference material, documents describing processes for identifying and responding to course requirements, and details of times when facilities are available for use by students and teaching staff. Information should be available about provision of orientation programs for new students and other users, and responsiveness to requests from groups of stakeholders. The institution should be able to provide information about comparisons of level of provision through books, periodicals and web-based resources with comparable institutions offering similar programs and an appropriate performance indicator would be whether that level of provision was equalled or exceeded.
47
***
Comment: The college Website serves faculty and students, as well as the community, with different learning resources, such as faculty lecture notes and research, University and the college policies and regulations, as well as college activities such as conferences and workshops. The college website is frequently maintained and updated. Course organizers provide advice on materials required and recommended to support teaching and learning and documented these informations in the course specifications approved by the department. Students participate in user surveys dealing with adequacy of resources and services and their appropriateness. Priorities for improvement None Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) stated that departmental course organizers monitor the resources for teaching and learning in their courses. There is neither auditing nor needs analysis to manage and prioritize distribution of resources at the College level. Annually each department requests teaching materials from the Vice Dean for Academic Affairs to be made available in the branch library at the College. Lowpriced learning materials are offered to the students at both campuses
6.2 Organization
The library or resource centre must be managed in a way that meets the requirements of the program for student access and availability of resources and services. 6.2.1 Library and resource centers and associated facilities and services are Yes ***
48
available for sufficient extended hours to ensure access when required by users in the program. 6.2.2 Heavy demand and required reading materials needed in the program are held in reserve collections. 6.2.3 Ready access to on-line data-bases and research and journal material relevant to the program is provided for Overall Assessment
Yes Yes
Comment: The college library has extended its daily opening periods. To be open from 8:00 am to 8:00 pm daily for males and females. Library collections and materials are acquired on a regular basis based on submitted requests from various academic departments which take into account the teaching and learning needs. KSU Web portal and E-learning services are available 24/7 to students and faculty, providing up-to-the-minute access to University activities and course material. Priorities for improvement 1) Improve utilization of E learning system. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008). The library resources of the University are centralized with a branch at the Medical College. The central library in the University is well equipped with computers. Medical books and periodicals are adequate and wide access to the internet is available. The Panel clarified with the Deanship of the Library that students may access the central library databases using the wireless network.
****
Comment: The new Information Literacy Program aims at instructing library users on how to make use of the wide range of different learning resources available The library orientation is being implemented in the reformed program curriculum and each student is required to undergo orientation to available learning resources including the library. Qualified librarian is available to help users and answer their questions. Furthermore electronic system is being
49
developed to assist users to search and allocate library collections. Priorities for improvement: None Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) reported that the central library had ongoing courses introducing students and staff to the use and breadth of learning resources. There were IT staff available in the central library to assist students and staff.
****
Comment: The library has up-to-date computers with computer workstations connected to a high-speed network internet and users have access to wireless Internet for their laptops. Other support facilities are provided such as photocopying or study rooms to help in study and research. It has suitable places to accommodate books and other information resources. To enable library users to get on the scientific material. Arabic and English periodicals are available and the library has services for individual or collective research and provides support services to meet the needs of faculty members and graduate students. Priorities for improvement None Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) judged the learning resources appropriate to meet the program requirements.
Overall Assessment
****
Comment: Learning resources at College of Medicine have now acquired high standards in supporting learning and research. The college library is undertaking new projects that attempt to improve access to information resources and services. The college site is updated regularly with information on activities and programs provided to students and faculty, and, increasingly, the E-learning environment has become the norm at the college to access learning resources. KSU is implementing some revolutionary projects that are going to transform the concept and reality of information services to College of Medicine. These projects include building a digital library, enhancing the Website with interactive features, providing a comprehensive information literacy program etc. Once the major projects that are being undertaken are completed, the University community will feel the freshness of learning resources in their libraries. Utilization of the library's automation system to its full potential, especially its interaction with users is considered an area for improvement. Indicators considered: 1) The average rating by the students to the question: The learning resources are adequate in course evaluation survey 2) The average rating by the graduates to the question: Learning sources were known to me and available in graduate evaluation survey 3) The average rating by the students to the question: The learning resources were appropriate and useful in course evaluation survey 4) The average rating by graduates to the question: The library facilities were adequate in graduate and intern evaluation surveys 5) The average rating by staff to the question: The library services are appropriate in staff evaluation survey Priorities for improvement 1) Improve utilization of E learning system Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) commended the College on the extent and quality of the central library and its facilities which are a significant asset. They, also, recommended the development of auditing and needs analysis procedures to prioritize the distribution of learning resources.
51
52
****
Comment: There are organized processes and procedures for the acquisition of equipments, including tendering process, procurement and invoicing procedures and inventory logging and tracking system. There is also a documented system for periodic maintenance and repair of facilities and equipments located throughout the college. Yearly; departmental needs are submitted to the university for approval. Priorities for improvement None Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) stated that eequipments availability meets program requirements and teaching staff are consulted prior to major equipment acquisitions. There is a planned schedule of servicing and replacement of teaching equipment. A wireless network has been installed and approval for an e-learning system has been obtained. The College will provide each student a laptop computer in the next academic year.
7.2.1 Facilities and equipment meet health and safety requirements and make adequate provision, including user training when necessary, for the personal security of faculty, staff and students. Provision is made for students, faculty and staff with physical disabilities or other special needs. 7.2.2 Quality assessment processes include both feedback from principal users about the adequacy and quality of facilities, and mechanisms for considering and responding to their views. 7.2.3 Standards of provision of teaching, laboratory and research facilities are
Yes
***
Yes Yes
**** **
53
adequate for the needs of the program and benchmarked through comparisons with other comparable institutions. (This includes such things as classroom space, laboratory facilities and equipment, access to computing facilities and associated software, private study facilities, and research equipment. 7.2.4 Adequate facilities are available for confidential consultations between faculty and students) 7.2.5 Provision is made for students, faculty and staff with physical disabilities or other special needs. Overall Assessment
Yes Yes
**** **
***
Comment: With curriculum reform, several small classrooms were added and supplied with the latest equipments. All classrooms are now smart classrooms. Underutilized labs were restructured and rearranged for better utilization by staff and students. A three story Medical Education Centre is fully functional now with numerous teaching classes and manikins for hands-on clinical training. College expansion project is ongoing and that will provide additional teaching areas, classrooms, labs and recreation areas. Priorities for improvement 1) Engineering department to formulate a plan to make the facility more handicapped-friendly especially parking spaces and rest rooms. 2) Bigger dining facilities and recreation areas for staff and student need to be allocated in the college and hospital expansion buildings. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) reported that the current teaching facilities on both the men's and women's campuses are well equipped and meet the requirements for high quality teaching. Currently there are not adequate small group rooms available They, also, mentioned that the current building is not readily handicap accessible and no restrooms are available for handicapped individuals.
54
Overall Assessment
****
Comment: All equipments and facilities are checked by engineering department prior to final approval to assure quality and compatibility. Complete inventory is kept and regular maintenance is provided. Security systems and cameras are provided throughout the whole facility around the clock to insure safety of workers and protection of equipments from improper use. Arrangements are made for sharing usage of facilities Priorities for improvement None Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) highlighted that there were neither auditing nor needs analysis to manage and prioritize distribution of resources at the College level. However, there were proper management and administration for maintenance of facilities and teaching equipment for the program.
****
Comment: Working in accordance with the college Strategic Plan, significant additions and enhancements were successfully implemented in the IT department such as E-register and Edugate, Madar, (a new administrative system), Internet bandwidth expansion and the Learning Management System (LMS) and E-learning portal Training programs are available for faculty and staff to ensure effective use of computing equipment and appropriate software for teaching, student assessment, and administration. Priorities for improvement 1) Training courses need to be compulsory and internet code of conduct need to be enforced. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) Stated that adequate computing equipment is
55
available and accessible for teaching staff and students in the program. There is no code of conduct for internet use. While there have been staff session on e-learning and elective instruction in available by request from University sources, the College has minimal and non-compulsory training programs for teaching staff to use computer equipment for teaching and student assessment and program administration. In addition the College does not keep records on which teaching staff have completed training in particular areas.
****
Comment: Most program needs in term of facilities and equipments are provided in timely manner and departments are usually consulted prior to any major purchasing or leasing projects. Teaching facilities are controlled by one department and security is provided at all time. Internet Security systems are installed and code of conduct has been established. Training courses on new equipments are offered. Indicators considered: 1-The average overall rating by the staff to the questions: a) I am satisfied with the available student services. b) The audiovisual aids in the lecture halls are appropriate. c) The lecture halls are appropriate. 2-The average overall rating by the students in graduate evaluation survey to the questions: a) The Audiovisual educational aids were suitable. b) Lecture halls were suitable and comfortable. Priorities for improvement 1) Engineering department to formulate a plan to make the facility more handicapped-friendly especially parking spaces and rest rooms. 2) Larger dining facilities and recreation areas for staff and student need to be allocated in the college and hospital expansion buildings. 3) Training courses need to be compulsory and internet code of conduct need to be enforced. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) commended the collage on the installation of a wireless network in medical teaching areas and in the hospital, obtaining approval for an e-learning system and beginning the process of selection of an appropriate system and for the decision to provide each student with a laptop computer in the next academic year. The Panel suggested the Collage to work with the University to develop a code of conduct for internet use and to develop a systematic ongoing training program for the teaching staff in the use of computer equipment and software and monitor the number of faculty obtaining training. In addition, the Panel suggests the College review plans for the new building to ensure handicap accessibility.
56
57
***
Comment: Most of the budget for the college is contained within the budget of the University in sections 1 (Salaries, allowances and wages), 3 (Programs and contracts of maintenance), and 4 (Projects) as an aggregate for all academic units. However, in accordance with the recommendation of the 2008 SSR review, the University has embarked on initiatives to give more financial independence and decision-making for the college to cover its nonbudget expenses for development and operations. The operating expenses (section 2) for laboratory equipment and chemicals, office furniture, teaching materials, raw material for maintenance, spare parts projects, repair projects and building rehabilitation plans are allocated based on the needs and requirements of the college. The budget allocated to the ongoing and new projects received a large proportion of last years budget. This is in alignment with the Mission and goals of the University in providing distinctive education and producing creative research in an environment more conducive to creative thinking. Priorities for improvement 1) Restructuring of KSUs financial planning and management system in order to delegate some level of financial autonomy to the college through the provision of its annual operational expenses budgets. 2) Embark on formal cost-benefit and cost-effectiveness analyses for proposed projects and programs.
58
3) The financial planning processes should include independently verified risk assessment. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) reported that There is insufficient delegation of budgetary authority given to the program manager for effective program administration. The College budget is primarily from University funds and is distributed by the University. The Panel is not aware of any formula for calculation or distribution of the budget. While the College does have some discretionary monies these are insufficient to stimulate new program and direct staff efforts. The Panel is concerned that the lack of such processes does not allow sufficient flexibility of the College to respond to unexpected events and to plan for term changes in the educational program.
****
Comment: At the university level financial delegations are clearly specified The University financial affairs are subject to internal and external auditing processes. Internal auditing is carried out through the auditing division of the Finance Directorate. The university budget is subjected to external auditing by the General Auditing Bureau of Saudi Arabia which execute auditing on the states revenues, expenditures, current and fixed assets and oversee the proper utilization and maintenance of these resources. In year 2008 King Saud University developed a set of financial Key Performance Indicators that covers the main parts of the financial management. Priorities for improvement None Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) stated that The College has tried other revenue sources but has found only in the dispersion of donations does the College have control. These are the monies the College uses to stimulate new program and to direct staff efforts. At this time the College has no plans for expanding revenue sources.
59
*** ****
****
Comment: Most of the funding comes directly from the university through various sources. All salaries are paid directly to staff. For all IT related services and equipment this is either funded from the IT department in the hospital or from the IT deanship at the university. For all e-learning material it is funded through the learning deanship. Similarly, most faculty development activities are funded through the deanship of faculty development. Other daily expenses are covered by the university through a special budget. Consistent with KSUs modern approach to strategic development and planning, the University should undertake restructuring of its financial planning and management system in order to delegate some level of financial autonomy to the colleges through, for example, the provision of annual operational expenses budgets for them. Indicators considered:
60
61
9.1 Recruitment
Recruitment processes must be designed to ensure that capable and appropriately qualified teaching and other staff are available for all teaching and administrative functions, administered fairly, and that new staff are thoroughly prepared for their responsibilities 9.1.1 Recruitment processes ensure that teaching staff have the specific areas of expertise, and the personal qualities, experience and skill to meet teaching Yes **** requirements. 9.1.2 Candidates for employment are provided with full position descriptions and conditions of employment, together with specific information about expectations for contributing to the program as part of the teaching team. (The information Yes *** provided should include details of employment expectations, indicators of performance, and processes of performance evaluation) 9.1.3 References are checked, and claims of experience and qualifications verified Yes **** before appointments are made. 9.1.4 Assessment of qualifications includes verification of the standing and reputation of the institutions from which they were obtained, taking account of Yes **** recognition of qualifications by the Ministry of Higher Education. 9.1.5 In professional programs there are sufficient teaching staff with successful experience in the relevant profession to provide practical advice and guidance to Yes **** students about work place requirements. 9.1.6 New teaching staff are given an effective orientation to the institution to ensure familiarity with the institution and its operating procedures, services and Yes *** priorities for development. 9.1.7 New teaching staff are given a thorough orientation and training to ensure they have a thorough understanding of the program as a whole, of the contributions to be made to it through the courses they teach, and of the Yes *** expectations for coordinated planning and delivery of courses and evaluation and reporting requirements. 9.1.8 The level of provision of teaching staff (i.e. the ratio of students per teaching staff member calculated as full time equivalents) should be adequate for the Yes **** program and benchmarked against comparable student/teaching staff ratios at good quality Saudi Arabian and international institutions. Overall Assessment
****
Comment The university has clear formal recruitment processes which deal with the employment of Saudi, non-Saudi and non-academic staff. These are well announced on the university website. Credentialing committees at the departmental level discuss every candidate and document their recommendations.
62
Detailed description of the job, selection criteria, indicators of performance, and processes of performance evaluations are not consistently included in the advertisements. However, they can be looked up in the regulations of the Ministry of Higher Education or the regulations of the Ministry of Civil Service on the University website. Moreover, the University has established several programs and units to recruit distinguished professors and scholars, including Nobel Prize laureates. The University is strict about verifying the standing and reputation of the institutions from which degrees were obtained. Although there has been considerable progress in the ability of the university and college to hire distinguished staff, there are still major difficulties in hiring skilled supporting staff because of low salaries and Saudization. For the last three years, orientation and induction has been provided at the University level to new faculty members at the beginning of each academic year by the Deanship of Skills Development. Priorities for improvement 1) Find innovative ways to hire skilled supporting staff. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) mentioned that the College recruitment process seems cumbersome and may hinder recruitment of a high quality staff. The Panel is aware of increasing competition within the Kingdom for high quality staff. The staff orientation to ensure familiarity with the institution and its operating procedures, services and priorities for development is not adequate. New teaching staffs undergo departmental orientation but this does not extend to broader program orientation other than booklet articulating wider orientation.
***
63
Comment: All faculty members are expected to participate in some form of career development every year. At a minimum, they are expected to stay current in their fields of expertise and maintain satisfactory levels of performance. For physicians and surgeons, it is the requirement of Saudi Commission for Health Specialities to acquire at least 30 hours of continuous medical education annually The Deanship of Skills Development provides workshops and activities that target a wide-range of skills, such as personal, technical and professional skills of the faculty and staff. In addition, leading, administrative, and active communication skills are also among the targeted areas. Moreover, there are other faculty and staff development activities that are held at colleges and departments levels. Although all the workshops that are organized by the Deanship of Skills Development are evaluated by participants, there is no feedback on its impact on the staff and faculty performance from the Deanship of Skills Development yet. The University has started adopting a policy to reward outstanding academic and administrative performance. Such rewards include recognition of their merit by announcing it on the website and in the University newspaper. Websites of deanships display the picture and the name of the employee of the month in recognition of his outstanding performance. Other forms of rewards include providing laptops to those who launched their personal pages on the KSU faculty website. Excellence in teaching was publicly recognized and rewarded at the levels of the department, college, and the institution. Criteria for selecting winners are clearly documented and made available on the website. In addition, faculty members whose research is published in international journals are financially rewarded and recognized. Priorities for improvement 1) Improve training programs for supporting staff (identified as a strategic priority for the college). 2) Support the universitys plans to develop the academic track system. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) reported That Annual confidential formal appraisals of staff work performance do not occur therefore no clear requirements may be established for improvement. Performance assessments of teaching are not documented or retained and outstanding academic or administrative performance is not recognized or regarded. As far as the Panel is aware contributions of teaching are not recognized for promotion criteria. Despite the flexibility of University appointments, physician staff feels overwhelmed by their teaching and clinical responsibilities with many feeling they must work additional hours in after hour's private practice to obtain an adequate income. This threatens retention of qualified staff particularly in the current environment of emerging new medical schools. There are positions of major responsibilities which are integral to the program which are not well remunerated. This further threatens retention of high quality staff profile within the College.
**** ***
***
Comment: There is a well-developed employment process. Credentialing of all employees is checked verified. The college has been able recently to attract distinguished staff with high international calibre. There are ample opportunities for professional development for academic and non academic staff. Faculty
64
development at the college level is handled by a devoted faculty development unit. A survey of the needs and expectations of the staff has been conducted. Based on that, a full educational and training program has been planned and executed. Feedback on each activity is collected and improvement plans carried out. There is difficulty in hiring skilled supporting staff. Indicators considered: 1) Proportion of teaching staff leaving the institution in the past year for reasons other than age retirement. 2) Proportion of teaching staff participating in professional development activities during the past year. 3) Proportion of Academic staff participating in professional development activities during the past year. Priorities for improvement: 1) Find innovative ways to hire skilled supporting staff. 2) Improve training programs for supporting staff (identified as a strategic priority for the college). 3) Support the universitys plans to develop the academic track system. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) Commended the University employment policies and practices for permitting physician faculty members flexibility over their employment profile. They recommended: The development and implementation within the next academic year of an annual College wide program of staff work performance evaluation with feedback by formal consultation and requirements established improvement if performance is less than satisfactory. Outstanding performance should be recognized and rewarded within the College and University. The University criteria for promotion to be expanded to include all staff activities that significantly contribute to achievement of the mission. Finally, they suggested, that teaching staffs orientation program be expanded to ensure familiarity with the broader College operating procedures, services and priorities for development.
65
66
Evaluations of the quality of research should include a review of the research strategy for the department or the college, and other supporting documents including details of the extent and quality of research output by staff associated with the program. Evidence about involvement in research can be obtained from staff and from departmental research reports and staff evaluation and promotion criteria. Further evidence can be obtained by consideration of agreements for cooperative research and for shared use of major equipment items. Staff and student surveys can provide evidence about the adequacy of provisions for research facilities and equipment. Performance indicators for research are commonly based on statistics on the volume of research publications per faculty member, the proportions of research-active teaching staff (a term that needs to be defined) and numbers of research citations. These figures should be compared with those at other comparable institutions and departments. In institutions with a commitment to research comparisons may include the extent to which research and scholarly activities are translated into applications within the academic or professional field concerned
67
Expectations for teaching staff involvement in research and scholarly activities must be made clear and provide for widespread participation. Encouragement and support must be provided to encourage research activity by junior teaching staff and postgraduate students. 10.1.1 Expectations of faculty involvement in research and scholarly activities are clearly specified and considered in performance evaluation and promotion Yes **** criteria. (For universities criteria require at least some research and/or appropriate scholarly activity of all full time faculty). 10.1.2 Clear policies are established in the institution for defining what is recognized as research, consistent with international standards and established norms in the field of study of the program. (This normally includes both selfYes **** generated and commissioned activity but requires creative original work, independently validated by peers, and published in media recognized internationally in the field of study) 10.1.3 Support is provided for junior staff in the development of their research Yes **** programs through mechanisms such as mentoring by senior colleagues, inclusion in project teams, assistance in developing research proposals, and seed funding. 10.1.4 Postgraduate research students are given opportunities for participation in Yes **** joint research projects. 10.1.5 When research students are involved in joint research projects their Yes **** contributions are appropriately acknowledged. When a significant contribution has been made reports and publications carry joint authorship. 10.1.6 Assistance is available for teaching staff to develop collaborative research Yes *** arrangements with colleagues in other institutions and in the international community. 10.1.7 Research and scholarly activities of teaching staff that are relevant to Yes *** courses they teach are reflected in their teaching together with other significant research developments in the field. 10.1.8 Strategies are developed for identifying and capitalizing on the expertise Yes *** of faculty and postgraduate students in providing research and development services to the community and generating financial returns to the institution. Overall Assessment
****
Comment: Research is one of the three arms on which the mission of the college of Medicine stands The college has a very well know reputation in the field of scientific medical research. The college has obtained the Universitys approval to establish the following 21 research chairs. These chairs are
68
funded mostly by the private sector The College has obtained a sizable fund from the City to finance five major pioneering projects over a five year period, and the projects will be carried out at the following Centres: University diabetic centre Sleep Disorder Studies Centre Obesity Diseases Studies Centre Liver Diseases Studies Centre Autism Studies Centre The college has excellent international research oriented agreements with many leading universities and institutions worldwide. The college has a GCP compliant IRB committee with all research conducted in the college of Medicine and university hospitals going through detailed review and approval. Research is recognized as an important skill that needs to be built in students to achieve the mission of the program in preparing physicians that can deal with future challenges of the healthcare in Saudi Arabia. A dedicated research course is offered as a compulsory course in year 2. Students are encouraged to do research outside this course throughout their studies in the college. An annual research day for undergraduate and another for postgraduate research is held Priorities for improvement: 1) Develop a research strategic plan. 2) Continue support and enhancement of the students and residents research days. 3) Development of combined clinical/ science program is underway. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) Stared that All College teaching staff are expected to be research active. This creates a significant problem where teaching loads are high. Whilst the volume of publications across the College is increasing annually, the number of high impact publications could be improved. Incentives for such publications have been implemented at the University level. With current plans for curriculum reform, there are opportunities for the College to encourage a strengthening of the teaching-research nexus. The research profile of all staff should be reviewed and documented as part of art annual performance appraisal system. The current promotion criteria require sole authorship of publications. Whilst this does not initially appear too demanding, it contradicts current international trends and the University's stated emphasis on collaborative research. College staff may also be disadvantaged these current promotion criteria that are virtually unachievable with their current teaching loads and other responsibilities. Students receive instructions on research methodologies and are expected to complete a research project. They also receive instruction in on-line database searches. The Panel reviewed a number of student projects which covered the quality spectrums. Students themselves have indicated a desire to increase the research component of their course to strengthen the research foundation for postgraduate training. Such changes would need to be carefully considered as part of curriculum refereed.
69
maintenance of equipment obtained through faculty research grants, commissioned research or other external sources. 10.2.4 Adequate budget and facilities for the conduct of research at a level consistent with institutional, program and departmental policies should be provided. Overall Assessment
Yes
***
***
Comment: The college has state of the art specialized laboratories in stem cell, immunology, and proteomics. A core facility research centre has been approved and is under construction Information technology is not up to the desired level in terms of patients cart coding and database creation and management. Most existing databases are run through private companies from outside the college. Security policy and arrangements are carried out in coordination with the department of security and safety of the university. In order to accomplish these objectives, the following safety measures are usually taken in all facilities:
1) Security: the Department of Safety and Security provides security systems and guards to secure the facilities.
Cameras are available thought the facilities with 24 hours monitoring. 2) Fire Safety: Fire evacuation policy and fire drills are practiced in all laboratories. 3) First Aid: First aid kits are available in all laboratories. 4) Personal Protective Equipment: Laboratories are equipped with personal protective equipment according to the needs in every laboratory such as coats, masks, safety goggles, safety gloves, earmuffs, helmets, and safety goggles 5) Others: The college also has emergency plans, safety signs, emergency exit signs and laboratory safety manuals. Finally, safety aspects are taken into consideration when purchasing new machinery and equipment. All medical equipment are regularly maintained through a very detailed system supervised by the biomedical engineering Adequate budget is available for research and has multiple sources. This has increased significantly in the recent years. Priorities for improvement 1) Create a policy for long term research priorities and plans 2) Improve utilization of current lab space and facilities Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) reported that The majority of the research conducted in the College is clinical with basic sciences lagging due to a lack of supporting staff and laboratory facilities. The Panel notes the institutional emphasis on research with twenty-one research Chairs appointed across a broad range of specialties. Strong research collaborations are also being developed with other international institutions.
Overall Assessment of Research 10.1 Teaching Staff and Student Involvement in Research 10.2 Research Facilities and Equipment
**** ***
70
Overall Assessment
****
Comment: 1) The college has outstanding researchers who have a lot of training and experience in clinical as well as basic science research. 2) The college has a well established research canter and a well structured and developed institutional review board/independent ethics committee. 3) The college is able to attract external funding from private sector and from King Abdul-Aziz City for science and Technology. 4) The college has excellent National and International connections with important research agencies and centres. 5) The approval of the Prince Naif research centre Indicators considered: 1) Number of publications in reviewed journals in the previous year per full time member of teaching staff. 2) Proportion of full time member of teaching staff with at least one publication in reviewed journals during the previous year. 3) Number of papers or reports presented at academic conferences during the past year per full time members of teaching staff 4) Research income from external sources in the past year as a proportion of the number of full time teaching staff members. Priorities for improvement
1) 2) 3)
Develop a research strategic plan. Continue support and enhancement of the students and residents research days. Development of combined clinical/ science program is underway. Independent Opinion
The NCAAA Program Accreditation Review panel (Nov. 2008) recommended a change in the current research criteria for promotion to better reflect international trends and encourage greater staff involvement in research. And suggested that the College consider innovative ways of supporting and rewarding staff to be more research active in their teaching roles. Another suggestion was that the College review current laboratory facilities to determine what strategies can be developed to increase research in the basic sciences.
71
72
factor in attracting and retaining high quality students and staff, seeking endowments, attracting research projects and funding, and in ensuring community support. It is also important in establishing and maintaining the public credibility of the qualifications that students receive. Evidence and Performance Indicators Evidence about quality of community relationships can be obtained from documents describing policies on service to the community, criteria for staff evaluation and promotion that include community contributions, and guidelines and processes for community media releases and other public comments on behalf of the institution. Reports on community relationships that include such matters as community use of institutional facilities, participation of staff on community committees or development projects and interactions with schools and other agencies can provide relevant information. The extent of community service activity, including formal courses and other services provided by the department or individuals within it should be documented and reported so records can be retained in a central data system. Community views about the quality of the institution and its standing as a respected member of the community can be obtained from surveys. A number of these forms of evidence include ratings that can be used directly as performance indicators. However in this area in particular the mission of the institution and the community within which it operates is important in deciding what aspects of performance should be closely monitored.
73
11.1 The service commitment of the program should be defined in a way that reflects the community or communities, within which the institution operates, and the skills and abilities of staff teaching in the program. 11.1.2 The contributions to the community made by staff teaching in the program are recorded and reported upon on an annual basis. 11.1.3 Promotion criteria and faculty assessments include contributions made to the community. 11.1.4 Departmental or program initiatives in working with the community should be coordinated with responsible units in the institution to avoid duplication and possible confusion. Overall Assessment Comment:
****
Community services other that the direct lines mentioned above are part of the main criteria for promotion in KSU. Main community service contributions have to be clearly mentioned in the promotion form that each staff fills up before promotion and it is considered an integral part in promotion. It represents 15% of the total requirements. In addition, each year, each faculty staff fills up an academic activity capture form which includes all the academic, scientific, and community services activities of the staff in the last year. This is then tabulated and trending and comparative data is generated Priorities for improvement: 1) The required amount and average expectations of pure community service is not well defined. 2) An overall coordination plan for all community activities is needed. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) Wrote that Currently, there are no programmatic decisions by the College to designate or direct staff in community relations. The Panel identified a lack of clarity of the definition of community beyond the hospital.
74
experience programs, part time employment opportunities, and identification of issues for analysis in student project activities.) 11.2.3 Local employers and members of professions associated with the program are invited to join appropriate advisory committees. 11.2.4 Contacts are established with schools in the region offering assistance and support in areas of specialization, providing information about the program and subsequent career opportunities for graduates, and arranging enrichment activities for students at the schools. (If a section within the institution has responsibility for coordinating these relationships these contacts are arranged in consultation with that section.) 11.2.5 Regular contact is maintained with alumni, keeping them informed about institutional developments, inviting their participation in activities, and encouraging their financial and other support for new initiatives. 11.2.6 Opportunities are taken in cooperation with institutional management to seek funding support from individuals and organizations in the community for research and other developments associated with the program. Overall Assessment
Yes
****
Yes
****
Yes Yes
* ****
****
Comment: The college graduates about 300 medical students per year, the largest number of medical graduates in the country. It has been the major provider of trained physicians for more than 30 years and has contributed in a major way to the current status of the health care system in the country. Over the years, more than 4000 medical students have graduated from this college (the majority of which trained in this hospital). In addition, more than 700 residents and fellows have finished their postgraduate training in this hospital over the years. It is estimated that more than 60% of all Saudi doctors in Saudi Arabia have either graduated or received training in this medical school and university hospital. The university hospitals are hosting training for at least 40 postgraduate training programs in various specialties in Medicine. More than 300 residents are being trained in the two hospitals. This is the largest number of training programs in a teaching hospital in the Middle East. Experts from our university hospitals are very commonly heads and members of various committees in the ministry of health as they are academic experts in their fields. In fact, the current minister of health and all his deputies are graduates from our medical school and did part of their training in this hospital. Many research chairs and research initiatives have strong scientific relationships with most of the large medical care facilities in the country. Students community activities are very active and strong. Many community based educational and health promotional activities have been done, all student based. The hospital delivers primary, secondary, and tertiary health care to any Saudi citizen free of charge. Priorities for improvement:
75
program for tracking its own alumni accomplishments and careers thus losing both an opportunity for self promotion of College accomplishments and to begin a development (fund raising) program among its alumni.
**** ****
Overall Assessment
****
Comment: 1) A very active community service programs that includes a major contribution in preparation of healthcare providers, training of physician and other healthcare providers, medical research, healthcare delivery, healthcare planning, patient education and many other very significant contributions. 2) A system to capture activities by staff and students. 3) Community service is considered in the promotion of teaching staff 4) A very active student community program Indicators considered: 1) Proportion of full time teaching and other staff actively engaged in community service activities 2) Number of community education programs provided as a proportion of the number of departments 3) Percentage of students involved in awareness campaigns/research directed to community health Priorities for improvement: 1. Finalize the community needs assessment plan. 2. Start an alumni program. Independent Opinion The NCAAA Program Accreditation Review panel (Nov. 2008) commended the College for the amount and variety of community service performed by teaching staff and students and graduates. Their suggestions were : The College should, establish targets for community services, communicate those targets to the staff and students and document the achievement of the targets in a centralized database. The College at the time of the annual performance appraisal of teaching staff should record the staff members' documentation of community service to the centralized database. Once the University's Office of Community Service supplies alumni data the College consider establishing an Office of Development as an opportunity for self promotion of College accomplishments and to begin a fund raising program.
76