The alignment of Generic, Specific and Language ... - tuning project

6 downloads 0 Views 3MB Size Report
4.3.2 Student perception of level of development of the generic competences. ..... following topics: Theoretical Electrical Engineering, Communications .... The objective of the application of the Tuning Methodology to the EIE discipline area was ..... a number of students declared they are studying for a Diploma qualification.
-

-

Task 1.1 of the EIE-Surveyor project has been dedicated to the application of the Tuning Methodology to the Electrical and Information Engineering discipline area. This report presents the approach taken to this application and an analysis of the results obtained from a pan-European survey of students, academics, graduates and employers. In total 3,275 completed questionnaires have been received and entered into a single SPSS dataset. The responses have enabled analyses in a number of different ways to be carried out including comparisons by gender, academic study level, country and by competence both individually and in groups they form through the application of standard statistical data reduction techniques. Attention has been paid to the clarification of the scope of the EIE area as the boundaries between technical degrees and broader arts degrees are blurred in places. The project has confirmed the appropriateness of the Tuning Methodology to the discipline area and, in line with other Tuning studies, has shown that the results do differ between countries and that clustering of countries does occur in some analyses. The analysis shows that, in terms of general preparedness for employment academic typically over-rate while students generally under-rate their view on how well they are preparing students relative to employers. This perhaps reflects a general optimism of employment potential by academics and pessimism by students. In general employers and academics rate competences higher in importance than students and graduates, even allowing for the unevenness in the average responses of these different stakeholders. The most important generic competence is problem solving followed by elementary computing skills and knowledge of a second language. A number of differences between rated importance and level of development of the competences emerge providing evidence that adjustment of curricula would be beneficial. Finally the analysis shows that the English language is the only second language that is rated as anything more than weakly important. This view is shared by all stakeholder groups. The value of the Tuning Methodology and of the analyses carried out has been demonstrated by this project task and the specific findings point clearly to areas where more work can be undertaken. There are gaps in the data for some countries and for some stakeholder groups within some countries. It is recommended that attempts are

The alignment of GENERIC, SPECIFIC and LANGUAGE SKILLS within the ELECTRICAL AND INFORMATION ENGINEERING discipline

made to fill these gaps so that the analysis can be extended to be more representative of the whole of Europe. The issue of clustering needs to be examined in more detail and a focussed study in this area may reveal some interesting European country clusters or some regional differences.

For any information and documentation http://www.eie-surveyor.org [email protected]

Application of the TUNING approach

Funded by the European Union 225997-CP-1-2005-1-FR-ERASMUS-TNPP October 2005 - September 2008, ISBN: 2-9516740-2-3

EIE Surveyor Project

Final Report for Task on: The alignment of generic, specific and language skills within the Electrical and Information Engineering discipline, Application of the TUNING approach A. Ward, University of York, England

Last corrections: Josef Jasenek (Bratislava, SK), Gert Jervan (Tallinn, EE), Jean-Marc Thiriet (Grenoble, FR)

EIE Surveyor

1

Tuning approach

EIE Surveyor

2

Tuning approach

Executive Summary Task 1.1 of the EIE-Surveyor project has been dedicated to the application of the Tuning Methodology to the Electrical and Information Engineering discipline area. This report presents the approach taken to this application and an analysis of the results obtained from a pan-European survey of students, academics, graduates and employers. In total 3,275 completed questionnaires have been received and entered into a single SPSS dataset. The responses have enabled analyses in a number of different ways to be carried out including comparisons by gender, academic study level, country and by competence both individually and in groups they form through the application of standard statistical data reduction techniques. Attention has been paid to the clarification of the scope of the EIE area as the boundaries between technical degrees and broader arts degrees are blurred in places. The project has confirmed the appropriateness of the Tuning Methodology to the discipline area and, in line with other Tuning studies, has shown that the results do differ between countries and that clustering of countries does occur in some analyses. The analysis shows that, in terms of general preparedness for employment academic typically over-rate while students generally under-rate their view on how well they are preparing students relative to employers. This perhaps reflects a general optimism of employment potential by academics and pessimism by students. In general employers and academics rate competences higher in importance than students and graduates, even allowing for the unevenness in the average responses of these different stakeholders. The most important generic competence is problem solving followed by elementary computing skills and knowledge of a second language. A number of differences between rated importance and level of development of the competences emerge providing evidence that adjustment of curricula would be beneficial. Finally the analysis shows that the English language is the only second language that is rated as anything more than weakly important. This view is shared by all stakeholder groups. The value of the Tuning Methodology and of the analyses carried out has been demonstrated by this project task and the specific findings point clearly to areas where more work can be undertaken. There are gaps in the data for some countries and for some stakeholder groups within some countries. It is recommended that attempts are made to fill these gaps so that the analysis can be extended to be more representative of the whole of Europe. The issue of clustering needs to be examined in more detail and a focussed study in this area may reveal some interesting European country clusters or some regional differences.

EIE Surveyor

3

Tuning approach

EIE Surveyor

4

Tuning approach

Contents 1. Introduction..................................................................................................................... 1 1.1 The European Association for Education in Electrical and Information Engineering ......................................................................................................................................... 1 1.2 The EIE-Surveyor Project......................................................................................... 2 1.3 The Tuning Methodology ......................................................................................... 2 1.4 Task 1.1 – The Tuning Methodology applied to the EIE area.................................. 3 1.5 The Electrical and Information Engineering area as a discipline ............................. 4 1.6 Report structure......................................................................................................... 4 2. Research Methodology ................................................................................................... 5 2.1 Introduction............................................................................................................... 5 2.2 Initial question sets ................................................................................................... 5 2.3 Questionnaire optimisation and delivery methods.................................................... 5 2.4 Data entry and analysis ............................................................................................. 6 2.5 Research questions.................................................................................................... 6 3. Overall data set ............................................................................................................... 9 3.1 Introduction............................................................................................................... 9 3.2 Responses in general................................................................................................. 9 3.3 Student responses.................................................................................................... 11 3.4 Academic responses................................................................................................ 13 3.5 Employer responses ................................................................................................ 13 3.6 Graduate responses ................................................................................................. 14 4. The student view ........................................................................................................... 15 4.1 Introduction............................................................................................................. 15 4.2 Student perception of employment potential .......................................................... 15 4.3 Student perception of generic competence development........................................ 17 4.3.1 Student perception of importance of the generic competences........................ 17 4.3.2 Student perception of level of development of the generic competences ......... 19 4.3.3 Student perception of ‘gap’ in the generic competences ................................. 20 4.4 Student perception of language competence development ..................................... 22 4.5 Student perception of specific competence development ....................................... 23 4.5.1 Student perception of importance of the specific competences ....................... 23 4.5.2 Student perception of level of development of the specific competences......... 24 4.5.3 Student perception of ‘gap’ in the specific competences ................................. 26 5. The academic view ....................................................................................................... 29 5.1 Introduction............................................................................................................. 29 5.2 Academic perception of employment potential ...................................................... 29 5.3 Academic perception of generic competence development.................................... 29 5.3.1 Academic perception of importance of the generic competences.................... 30 5.3.2 Academic perception of level of development of the generic competences ..... 31 5.3.3 Academic perception of ‘gap’ in the generic competences ............................. 32 5.4 Academic perception of language competence development ................................. 32 5.5 Academic perception of specific competence development ................................... 33 5.5.1 Academic perception of importance of the specific competences.................... 33 5.5.2 Academic perception of level of development of the specific competences ..... 34 5.5.3 Academic perception of ‘gap’ in the specific competences ............................. 35 6. The employer view ....................................................................................................... 37

EIE Surveyor

5

Tuning approach

6.1 Introduction............................................................................................................. 37 6.2 Employer perception of preparation for employment............................................. 37 6.3 Employer perception of generic competence development .................................... 37 6.3.1 Employer perception of importance of the generic competences .................... 37 6.3.2 Employer perception of level of development of the generic competences ..... 38 6.3.3 Employer perception of ‘gap in the generic competences ............................... 39 6.4 Employer perception of language competence development ................................. 40 6.5 Employer perception of specific competence development ................................... 40 6.5.1 Employer perception of importance of the specific competences.................... 41 6.5.2 Employer perception of level of development of the specific competences ..... 41 6.5.3 Employer perception of level of ‘gap in the specific competences .................. 42 7. The graduate view......................................................................................................... 45 7.1 Introduction............................................................................................................. 45 7.2 Graduate perception of preparation for employment.............................................. 45 7.3 Graduate perception of generic competence development ..................................... 45 7.3.1 Graduate perception of importance of the generic competences .................... 46 7.3.2 Graduate perception of level of development of the generic competences...... 46 7.3.3 Graduate perception of ‘gap in the generic competences ............................... 47 7.4 Graduate perception of language competence development .................................. 47 7.5 Graduate perception of specific competence development .................................... 48 7.5.1 Graduate perception of importance of the specific competences .................... 48 7.5.2 Graduate perception of level of development of the specific competences ..... 49 7.5.3 Graduate perception of level of ‘gap in the specific competences .................. 49 8. The supply demand balance.......................................................................................... 51 8.1 Introduction............................................................................................................. 51 8.2 The Bachelor level supply demand balance............................................................ 51 8.2.1 General perception of preparedness for employment...................................... 51 8.2.2 The generic competences ................................................................................. 52 8.2.3 The language competences .............................................................................. 55 8.2.4 The specific competences................................................................................. 55 8.3 The Masters level supply demand balance ............................................................. 58 8.3.1 General perception of preparedness for employment...................................... 58 8.3.2 The generic competences ................................................................................. 58 8.3.3 The language competences .............................................................................. 60 8.3.4 The specific competences................................................................................. 61 9. Conclusions and recommendations............................................................................... 65 Appendix 1 – Data Tables................................................................................................. 67 Appendix 2 – Questionnaires.......................................................................................... 145

EIE Surveyor

6

Tuning approach

1. Introduction The Electrical and Information Engineering (EIE) discipline area has been the focus of attention for the European Association for Education in Electrical and Information Engineering (EAEEIE) since its inception 20 years ago. As an Association, it dedicates itself to all matters relating to education at the Higher Education level, in the EIE area. Since 1996 it has successfully won a series of European Union Thematic Network projects to investigate aspects of EIE education and to share and disseminate findings and best practice. This report is the final report of one task, Task 1.1, of the current EAEEIE Thematic Network project called EIE-Surveyor. The project task and hence this report, addresses the alignment of the competences developed in students across Europe as part of academic programmes in the EIE area to the demand for graduates. By way of introduction, this section starts with a brief introduction to the EAEEIE, the EIE-Surveyor project and to Task 1.1, to the Tuning Methodology, which underpins the methodology used in this project. The special issues associated with the EIE area are also discussed in this section together with an overview of the structure and contents of this report.

1.1 The European Association for Education in Electrical and Information Engineering The European Association for Education in Electrical and Information Engineering (EAEEIE) is permanently working for the progressive development of higher education in the field of electrical and information engineering. During the last decade it has been trying to support and contribute to the process of harmonization of higher education across Europe. The main effort is to pull together the most significant players in HE – the universities. In this respect the main working method of the EAEEIE is the creation of wide networks of universities and other relevant partners (especially from industry) and to focus their creative potential for the solution of the contemporary problems of education in the field of EIE. In this respect it is worth mentioning the most significant projects it has led during the past few years: 1. INEIT-MUCON (1996-2000) – EU funded thematic network which stands for “Innovation for Education in Information Technology through Multimedia and Communication Networks“. The main idea consisted of developing some pedagogical resources and experimenting with them using examples from the following topics: Theoretical Electrical Engineering, Communications Technology, Power Systems, Computers, Sensors and Electronics. The INEIT-MUCON project included about fifty partner institutions in Higher Education from all over Europe. It was financed by these institutions and the European Commission within the framework of the SOCRATES Thematic Network programme. Within this project, six Thematic Network Packages (TNPs) were created. Co-operation between lecturers from many universities in Europe was established and maintained for the future. The Thematic Network Packages was supervised by academic staff and partially implemented by potential end-users, the students, within the student exchange programme between universities. Most of the TNPs were implemented in more than one language, to facilitate their dissemination in a multi-cultural environment. This educational material was made available on the web site of the EAEEIE and was at the disposal of all institutions, academic staff and students free of charge. 2. THEIERE (2000-05) – “Thematic Harmonisation in Electrical and Information EngineeRing in Europe” was also an EU funded network project. About 100 universities and other relevant partners were grouped together in the network. Among the main activities and results of the project was: a monograph containing a survey and analysis of EIE education at a European level, concerning organization, pedagogical issues, new pedagogical tools, and main trends in education systems in EIE; teaching packages in the form of short courses available via internet or on CD-ROM; a site for each of the participating leading site partners, with links to the TN packages already developed and links giving access to sites of professional engineering associations and networks. THEIERE was followed by the current Thematic Network project, EIE_Surveyor.

EIE Surveyor Final Report

1

Final Version

1.2 The EIE-Surveyor Project 3. EIE-Surveyor: Reference point for Electrical and Information Engineering in Europe – EU funded thematic network (2006-2008). This, current, project has more than 110 HE partners. The main objectives of the project are: 1

Reflection on generic competences and subject-specific competences in Electrical and Information Engineering (EIE)

2

Implementation of quality assessment on some educational resources available in EIE

3

Reflection and proposition of a methodology for accreditation, in order to enhance comparability and common certification procedures

4

Proposition of a census of the existing curricula in EIE in Europe, the multinational degrees, and the situation of the implementation of the Bologna-process in our fields, at the bachelor, master and PhD levels.

As indicated above one of the EIE-Surveyor main activities is the application of the TUNING methodology to EIE, which will result in an improved understanding of the subject-specific competences in EIE.

1.3 The Tuning Methodology In this paper we concentrate on the explanation of the basic principles of the Tuning methodology and on the application of these principles to the field of EIE. The background and context of the Tuning project is the implementation of the Bologna Process at university level [1]. The project aims to make study programmes comparable and compatible. The Tuning project proposes output-oriented programmes based on learning outcomes expressed in terms of generic and subject-generic competences as well as on ECTS workload-based credits. The Tuning project focuses not on educational systems, but on educational structures and content of studies. As a result of the Bologna declaration the educational systems in most European countries are in the process of reformation. This is the direct effect of the political decision to achieve convergence of the different national education systems in Europe. For HE institutions these reforms in their turn constitute the starting point for another discussion – about tuning the curricula in terms of structured degree programmes and approaches to teaching and assessment. The Tuning project aims at identifying reference points for generic and subject-specific competences for the first and second cycle graduates in a series of subject areas. At first it was accomplished in a group of subject areas like Business Administration, Chemistry and Earth sciences. The name of the project “Tuning” has been chosen in order to express the idea that universities are not attempting the harmonization of their degree programmes or planning to implement any sort of unified, prescriptive or definitive European curricula. They are rather interested in establishing reference points and encouraging convergence and common understanding. According to the Tuning methodology attention is devoted to the concept of profile. A degree profile should be based on a process of consultation with the most significant stakeholders for the degree programme. These stakeholders are not only academics and students but also graduates, employers and professional organizations. The latter three groups represent an important link to the needs of society. Formal university bodies as well as the academic faculty involved must ultimately be responsible for the realization of each programme. In the framework of the Tuning project a methodology has been designed to understand curricula and to make them comparable. Five lines of approach have been distinguished to organize the discussions in the subject areas: • • • • •

generic (general academic) competences subject-specific competences the role of ECTS as an accumulation system approaches to learning, teaching, and assessment and the role of quality enhancement in the educational process (emphasizing systems based on internal institutional quality culture).

EIE Surveyor Final Report

2

Final Version

In the first phase of the Tuning project the emphasis was on the first three lines. The fourth and fifth lines received less attention due to time constraints, but they had a central place in the second phase of the project (2003-2004). During the first phase of the Tuning project definitions of the terms “profile”, “learning outcomes”, and “competences” were formulated in order to ensure clarity and coherence. The definitions adopted were developed further during the second phase of the project. A clear distinction was made between the “learning outcomes” and “competences”. The introduction of a two or three cycle system makes it necessary to revise all existing study programmes which are not based on the concept of cycles. In practice these programmes have to be redesigned because in a cycle system each cycle should be seen as an entity in itself. The first two cycles should not only give access to the following cycle but also to the labour market. This shows the relevance of using the concept of competences as a basis for learning outcomes. Tuning makes the distinction between learning outcomes and competences to distinguish the different roles of the most relevant players: academic staff and students/learners. Desired learning outcomes of a process of learning are formulated by the academic staff, preferably involving student representatives in the process, on the basis of input of internal and external stakeholders. Competences are obtained or developed during the process of learning by the student/learner. In other words: Learning outcomes are statements of what a learner is expected to know, understand and/or be able to demonstrate after completion of learning. They can refer to a single course unit or module or else to a period of studies, for example, a first or a second cycle programme. Learning outcomes specify the requirements for award of credit. Competences represent a dynamic combination of knowledge, understanding, skills and abilities. Fostering competences is the object of educational programmes. Competences will be formed in various course units and assessed at different stages. Competences can be distinguished between subject specific and generic ones. Although Tuning acknowledges to the full the importance of building-up and developing subject specific knowledge and skills as the basis for university degree programmes, it has highlighted the fact that time and attention should also be devoted to the development of generic competences or transferable skills. This last component is becoming more and more relevant for preparing students well for their future role in society in terms of employability and citizenship. Tuning distinguishes three types of generic competences: • Instrumental competences: cognitive abilities, methodological abilities, technological abilities and linguistic abilities; • Interpersonal competences: individual abilities like social skills (social interaction and co-operation); • Systemic competences: abilities and skills concerning whole systems (combination of understanding, sensibility and knowledge; prior acquisition of instrumental and interpersonal competences required). Subject specific competences are the competences required for the discipline or profession that the programmes have been designed for and embrace the technical domain of the subject area.

1.4 Task 1.1 – The Tuning Methodology applied to the EIE area The objective of the application of the Tuning Methodology to the EIE discipline area was to explore the alignment of the competences of the EIE graduate with employers as the users of the end product of study programmes; of academics who are instrumental in the design of the curricula; and students as ‘customers’ of the programmes. The views of graduates were also sought as a link between students and employers. True to the ethos of the Tuning Methodology two main sets of competences were explored, the generic (general academic) competences and subject specific competences. In addition to these a third set was added, language competences, to explore in more detail one of Tuning’s generic competences, that of “Knowledge of a second language”.

EIE Surveyor Final Report

3

Final Version

In the early days of the project, and as a consequence of the EIE Monograph output of the THEIERE project an issue emerged – how is the EIE discipline area bounded? This question is addressed next.

1.5 The Electrical and Information Engineering area as a discipline The titles Electrical and Information Engineering are broad and somewhat ‘fuzzy’ terms. As was found in the creation of the first cycle degree programme monograph, there are many different academic programmes that clearly fall within common understanding of the terms and many that lie at its boundary. For the purposes of this project the definition of EIE has been aligned with the EIE Surveyor monograph definition which is encapsulated in a set of degree programme titles. These embrace Electrical and Electronic Engineering as would be expected. They embrace Information Engineering where it is of an electronic or computer science nature, and Computer Science. Excluded would be information engineering where it is directly and predominantly orientated towards information in the media (news, television, etc.) Subjects such as Media Technology, Communications (again where electronic in nature), Control, Aerospace, Mechatronics, and so on are included where the electrical or electronic technical content predominates. Subjects such as Business Management are included where it is a minor component (typically 25% or less) of a technical degree. The broadness of the discipline introduces the potential problems of comparing engineering subjects with more science (Computer Science) orientated subjects. This aspect is not included in this report but could be the subject of a more focussed study on the overall dataset in the future.

1.6 Report structure Section 2 explains the research methodology adopted in this project and describes the questionnaires used. It concludes with some of the research questions that were initially set for the survey. The following four sections then look at the responses of each respondent group starting with students, then academics, employers and finally graduates. In each section the response of the general overview questions and the more detailed questions on importance and level of development of the generic language and specific competences are considered in turn. For brevity in the main body of the report tables have been shortened to show the top and bottom 5 of any ranked list, the full ranked list of 32 in the case of the generic competences and 28 for the specific competences are given in Appendix 1. Additional tables associated with the analysis are also moved to the appendix. Finally tables of the numerical data supporting graphs in the main body are also included in Appendix 1 so the detail is present for those interested. To facilitate finding specific information in Appendix 1 a very intentional figure and table numbering system has been used. In the report figures and tables are numbered sequentially in combination. That is, if the first to appear in a section is figure 1 and the next is a table, the table will have the reference table 2. In the appendix the tabulated data supporting figure 1 will be table 1 and the full version of table 2 will be table 2. Any additional tables included, such as individual country tables are included as table x(a), etc. This convention ensures that the data supporting any main body figure or table can be found simply in Appendix 1. Section 8 looks are the supply demand balance by considering all the results and data presented in sections 4 to 7. This section is the heart of the report and the section upon which most of the conclusions and recommendations, Section 9, are based. For reference the full questionnaires are included in Appendix 2.

EIE Surveyor Final Report

4

Final Version

2. Research Methodology 2.1 Introduction The general process followed in this task was to produce an initial set of questions, create a set of pilot questionnaires, carry out a small pilot study, make appropriate modifications and then launch the full survey. This section describes this process in more detail and explains the rationale to the approach at each stage.

2.2 Initial question sets From the Tuning Methodology report it was clear that a set of the generic competences had been developed and used consistently across the studies carried out prior to the Surveyor project. The set of generic competences (32 in total) was discussed for applicability to the EIE area by the task team and it was agreed they should be used unchanged. Space was, however, added for additional competences respondents view as important as they complete the questionnaire. The specific competences used in Tuning are different for each discipline and a set was required for the EIE area. Just prior to the start of the EIE Surveyor project various activities had been undertaken in the UK to define sets of output standard statements for engineers as a whole. The Engineering Council set of statements (28 in total) was used as the list for this project, they were general enough in nature to allow respondents to apply them to their own subject within the breadth of the EIE area. The new set of competences, languages, was debated and was finally agreed to be the main language of each European country. Space was left for respondents to add additional countries important for them. In all cases the Tuning Methodology approach of using a 4-point Likert scale for the importance and level of development of each competence was retained. In the case of the languages respondents were asked to state their perception of the importance and level of development of written and spoken ability in each language (4 responses per language). To illustrate, the first generic competence is “Capacity for analysis and synthesis”. Respondents were asked to rate how important this is to them on a 4-point scale where 1 represents “none’, 2 “weak”, 3 “considerable” and 4 “strong”. They were then asked to indicate how well they feel “Capacity for analysis and synthesis” is being developed in their degree programme, also on a 1 to 4 scale with exactly the same meaning for each response number. The responses could only be 1, 2, 3 or 4. A set of general questions were asked of all respondents to capture their gender, age band, position in the organisation, country, etc. Four different questionnaires were created, one for students, one for academics, one for graduates and one for employers. The wording in each questionnaire was adjusted to make the whole questionnaire appropriate to the ‘stakeholder’ and to capture the important general information about them. Information not relevant to a particular stakeholder was removed to avoid confusion. For example, employers were not asked what level of study they are currently in (a student question) but they were asked to complete the questionnaire for one specific level (Bachelor, Master, Doctoral) and to identify the level. In this way comparative datasets should result. The initial questionnaires were tested in a small number of institutions on a small sample to test the logic, instructions and wording and to assess the completion time.

2.3 Questionnaire optimisation and delivery methods Following the pilot study changes were made to the wording to improve clarity and ease of completion. The time for completion was considered long but, other than removing questions from the list there were limited opportunities to reduce it and the decision was taken to progress to the main survey. A number of questionnaire delivery mechanisms were proposed. An online website was created for direct electronic entry. Electronic versions of the questionnaire were created for sending to potential respondents by email and finally paper versions were made available. There was some debate over whether paper versions should be produced. It was agreed that there would be a trade off between response rate and the

EIE Surveyor Final Report

5

Final Version

collection method and that a difference method would suit different collection approaches. For maximum flexibility all collections methods were offered. In the final form each questionnaire starts with an introductory page containing a brief overview of the objective of the study and the questionnaire and who the supporting body is (EIE-Surveyor funded by the EU). It then makes a statement about confidentiality and data protection and gives a name and contact details for more information. Finally there is a general instruction on how to complete the questionnaire. The questionnaires are divided into four sections: 1. Background information The background information section captures information about the respondent’s institution; the country they are in; gender; age (in bands); and some additional pieces of general information such as the degree programme and year of study for students, etc. There are two general questions at the end of this section that ask how the respondent feels the education they received prepares or prepared them for employment and how they rate their employment prospects. 2. Generic competences 32 generic competences are identified for which the respondent is asked to rank, one a 4 point Likert scale (none .. strong) how they rate the importance of each competence and the level to which they feel it is developed. Space is provided for the respondent to add new generic skills if they wish. Finally they are asked to identify the five most important generic skills and rank them in order of importance. 3. Language skills For every European language, the respondent is asked to rank the importance and level of development, as a compulsory part of their studies, of the written and spoken language, again on a 4 point Likert scale. 4. Specific competences 28 specific competences are identified for which the respondent is asked to rank, one a 4 point Likert scale (none .. strong) how they rate the importance of each competence and the level to which they feel it is developed. Space is provided for the respondent to add new specific skills if they wish. Finally they are asked to identify the five most important specific skills and rank them in order of importance. It is anticipated that, with sufficient returned questionnaires, the correlation can be tested between students, faculty, graduates and employers for the same, or generically similar academic programmes to enable us to assess the fit of current provision to industrial need.

2.4 Data entry and analysis Responses into the online website were collated into a set of Excel compatible spreadsheets. Paper and electronically completed responses were manually entered. All data were merged into a single SPSS data file. The responses for the different stakeholders being identified by a questionnaire code field. Each response was also given a unique reference code. A code book defining all the variable names and attributes was designed for the data set before the SPSS data file was created and was then updated as the analysis was undertaken.

2.5 Research questions The primary objective of this study is, in line with the Tuning methodology, to quantitatively assess the alignment of the supply and demand equation in the EIE discipline. Specific within this is the alignment of the generic and specific competences. In addition to these questions a number of subsidiary research questions will be addressed: •

Do the generic competences group to form meaningful and usable clusters?



Do the specific competences group to form meaningful and usable clusters?



How closely is the supply demand equation met as far as language skills are concerned?



How well aligned are the perceived most important skills between the four respondent groups?

EIE Surveyor Final Report

6

Final Version

The primary research questions and the above subsidiary ones will be tested using a combination of descriptive statistical methods, factor analysis and correlation tests. As might be expected from a study of the complexity of this one, the analysis that has been undertaken has led to many more possible questions being asked of the data set. It is expected that the analysis will be an ongoing activity for the EAEEIE as might the collection of additional data to fill in some of the gaps in the data set as it currently stands. This report should, therefore be read not as the last and final analysis of the task but as a summary of the findings and analysis undertaken up to the end of the project funding period.

EIE Surveyor Final Report

7

Final Version

EIE Surveyor Final Report

8

Final Version

3. Overall data set 3.1 Introduction This section describes the constitution of the overall responses. The section starts with an analysis of all responses in general and then considers a more detailed description for each of the four questionnaire types. This section therefore sets the scene for all subsequent analyses and reference will be made back to this overall demographic analysis during the rest of the report.

3.2 Responses in general A total of 3,275 questionnaires were either entered into the electronic data collection system or sent, electronically or in paper form, to the collection centre in York, England. Figure 3.1 shows the distribution of these returns across the four participating groups, Table 3.1 in Appendix 1 shows the actual numbers. Figure 3.1. Distribution of responses by questionnaire types.

Aca d emic Emp lo yer Gr ad u ate

Stu d en t

The ratio of returns planned in the design of the survey was approximately 71% student, 7% employer, 4% academic and 18% graduate. In numbers terms this represented a challenging target for all participants of the project. Three countries collected their actual target numbers of every type of questionnaire others collected a mixed balance across the types. The target balance was selected to allow comparisons to be drawn between the stakeholder groups in each country as well as across the whole of Europe. In terms of overall numbers of questionnaires, an ambitious target for every participating country was set. An overall number of 7,280 questionnaires would have been received had every partner met target. The actual number of returns is 45% of this target. Given the size of some of the participating countries the overall number of completed returns is considered to be good and has not compromised the ability to analyse the results and extract conclusions from them. What will not be possible is to look at the supply demand balance in detail for all participating countries. For those where the full quota, or close to the full quota has been achieved the supply demand picture is analysed in detail. These analyses can be found in Section 8 of this report. The distribution of responses by country is more complex as the country of the respondent varied depending on the questionnaire type. However, a meaningful comparison can be made between students, academics and graduates. In all these types the respondent was asked what country they are currently studying in, working in (as an academic) or studied in as a graduate. Employers were asked which country they are based in. But since they are likely to recruit employees from more than that country the question of country is less meaningful in a comparison. Table 3.2 shows the distribution of responses by country of academic institution.

EIE Surveyor Final Report

9

Final Version

Table 3.2. Distribution of returns by country Country Austria Belgium Bulgaria Cyprus Czech Republic Demark Estonia Finland France Germany Greece Hungary Iceland Ireland Italy Latvia Lithuania Poland Portugal Romania Slovak Republic Slovenia Spain Sweden Turkey United Kingdom Other

Academic

Graduate

1 10 4 1

50

6

2

14 1 15

1 1 29

10 8 4 8 11 7 1 20

9 3 50 1 62 1 41

34 14 10 3

33 1

Student 2 2 197 3 3 2 84 1 342 5 241 221 5 113 95 65 1 238 76 12 389 7 140 1 192 206

Total 2 3 257 7 4 2 92 1 357 7 285 221 5 123 112 72 9 299 84 13 471 8 215 1 239 217 3

The three countries that met the design target for returns in all four categories are Bulgaria, Poland and the Slovak Republic. As has already been noted the EIE discipline set is generally under represented by females across Europe. Figure 3.3 shows the overall gender balance across the four types of respondents, the numbers for these figures can be found in Table 3.3 in Appendix 1. This survey also shows a gender imbalance in all types. Gender is an analysis theme throughout this report so the breakdown shown in Table 3.3 is important from a contextual point of view.

Important note:

It is worth noting, as is common in almost all questionnaire based surveys, that not all questionnaires will be completed correctly, completely and meaningfully. This survey is no exception and a number of returns were only partly completed and some were obviously ‘spoiled’ in some way. All but the most obviously and totally unusable questionnaires have been entered into the overall dataset, however the ‘spoiled’ or uncompleted sections of questionnaires are excluded from analyses where their inclusion would distort the analysis and conclusions to be drawn. The clear manifestation of this approach will be where the number (usually n) is shown in any analysis or results table. The number in any table will not necessarily add up to be the same as in another table showing an analysis of a related point. Such differences are not errors, rather the consequence of the way the questionnaires have been completed.

EIE Surveyor Final Report

10

Final Version

Figure 3.3 Distribution of responses by gender. Male

Female

Aca d em i c Em p l o yer

Aca d emic Emp l o yer Gr ad u ate

Gr ad u at e

St u d en t

Stu d en t

3.3 Student responses As is noted in Table 3.1 the total number of questionnaires received from students is 2,691. Of these 2,641 stated their gender. Of these 14.5% are female and 85.5% male. The distribution of student returns by country is shown in Figure 3.4. The numerical values for Figure 3.4 including by gender are shown in Table 3.4 in Appendix 1. The percentage of females is shown where the total number of responses is greater than 12 (there is a natural breakpoint in the data between 12 and 64). For those countries with a response of 12 or less the percentage is considered to suffer too much from small sample inaccuracies to be meaningful. Figure 3.4. Distribution of student responses by country Au s t ria Be lg iu m Bu lg a ria Cz ech Rep u b lic Cyp r us Mis s in g

De ma rk

Un ite d King d o m

Es t o n ia Fin la n d

T u rke y Swed e n

Fran c e

Sp ain Slo ve n ia Ge rma n y Gr eec e

Slo va k Repu b lic

Rom an ia

Hu n g a ry Icelan d

Po rtu g al Po la n d

Ire lan d

Lit h u an ia

Italy Lat vi a

Students were asked to state their level of study. Figure 3.5 shows the distribution across the three main study levels (Bachelor, Masters and Doctoral). Table 3.5 in Appendix 1 shows the actual numbers. A EIE Surveyor Final Report

11

Final Version

degree of interpretation has been used in dealing with some responses, especially those from France where a number of students declared they are studying for a Diploma qualification. This is a first cycle qualification and has hence been interpreted in this study as ‘Bachelor’ level of study. Figure 3.5 Distribution of student responses by level of study

Mis s in g Do c to r al/ Ph D Ma s ter s

Ba ch elo r

As can be seen from Table 3.5 the size of the Doctoral level sample is quite small (n=23). As a consequence care is taken in this report in drawing conclusions about students studying at this level. Figure 3.6 and Table 3.6 (in Appendix 1) show the distribution of student responses by age band. As is expected the majority of responses (99.0%) are from individuals in the conventional age range for students. Figure 3.6 Distribution of student responses by age band

Mis s in g o v er 6 1 4 1- 50 3 1- 40

2 0 o r u n d er

2 1- 30

EIE Surveyor Final Report

12

Final Version

3.4 Academic responses Figure 3.7 and Table 3.7 (Appendix 1) shows how the academic responses are distributed around Europe.

Figure 3.7 Distribution of academic responses by country

Be lg iu m Bu lg a ria Cyp r us

Mis s in g 32

Cz ech Rep u b lic Es to n ia

Un ite d King d o m T u rke y

Fran c e Ge rm a n y Gr eec e Sp ain

Ire lan d Italy Latvia

Slo va k Repu b lic

Lith u an ia

Rom an ia

Po la n d

Po rtu g al

The largest number of academic responses is from Spain with the Slovak Republic, Greece, France and Turkey also providing sufficient number for a comparative analysis.

3.5 Employer responses Figure 3.8 and Table 3.8 (Appendix 1) shows how the academic responses are distributed around Europe. Figure 3.8 Distribution of employer responses by country

T u rke y Bu lg a ria Sp ain

Cz ech Rep u b lic

Slo va k Repu b lic

Po rtu g al Fran c e

Po la n d Ge rma n y

Latvia Italy

Ire lan d

The largest number of employer responses was obtained from Bulgaria with sufficient numbers also from Ireland, France, Poland, Germany and Spain.

EIE Surveyor Final Report

13

Final Version

Employers and graduates were asked to identify the country they are currently working in. Table 3 summarizes this distribution.

3.6 Graduate responses Figure 3.9 and Table 3.9 (Appendix 1) shows how the graduate responses are distributed around Europe. Figure 3. Distribution of graduate responses by country.

Mis s in g Un ite d King d o m T u rke y

Bu lg a ria Es t o n ia Fran c e Ge rma n y

Sp ai n Gr eec e

Slo ve n ia Italy Latvia

Slo va k Repu b lic

Po la n d Po rt u g al

The largest number of responses is from the Slovak Republic with Bulgaria, Spain, Turkey, Greece and Poland providing a sufficient number for a comparative analysis. It is anticipated that there may be some overlap between graduates and employers so Table 3.10 compares the returns between employers and graduates by country. A more detailed look at the similarities between these groups is considered in section 8. Table 3.10 Geographic dispersion of Employer and Graduate responses Country Belgium Bulgaria Czech Republic Demark Estonia Finland France Germany Greece Ireland Italy Latvia Norway Poland Portugal Slovak Republic Slovenia Spain Turkey

EIE Surveyor Final Report

Employer

Graduate 2 50 2 1 2 1 3 2 31

20 2

12 12 18 3 2

10 3 1 29 1 63 1 38 33

13 7 11 7

14

Total 2 70 4 1 2 1 15 14 31 18 13 5 1 42 1 70 1 49 40

Final Version

4. The student view 4.1 Introduction This section looks in detail at the student responses to the survey. Reference should be made to the constitution of the students who have responded in Section 3 of this report. Of particular interest is how students feel their study programme is preparing them for employment; how they rate their employment potential; and how they rate the competences that are being developed in them by their study programme. Three types of competences are considered, generic, language and specific. These aspects are considered in turn in this section.

4.2 Student perception of employment potential In response to the question “Do you feel that the degree programme is preparing you adequately for employment?” the overall mean response is 2.53 on a 1 to 5 scale where 1 indicates “very much”; 2 indicates “much”; 3 indicates “some”; 4 indicates “little”; and 5 indicates “very little”. The mean response by gender and level of study is summarized in Figure 4.1 (Tabulated results are shown in Table 4.1 in Appendix 1). Figure 4.1 Mean student response by gender and level of study 3

2.5

2

Male Female

1.5

1

0.5

0 Bachelor

Master

Doctoral

Figure 4.1 shows that there is very little difference (and no statistically significant differences) in the overall view of all students across Europe of the preparation their academic programme is giving them. The overall mean for Bachelor and Master level students is midway between “some” and “much”, a positive response but not an overwhelming vote of confidence in the level of preparation they are receiving for employment. Figure 4.2 (and Table 4.2 in Appendix 1) explores the variation in student perception of preparation across the different countries. Note in the table that only those countries where there is a number of responses above 12 are included to avoid the potential of small numbers suggesting meaning.

EIE Surveyor Final Report

15

Final Version

Figure 4.2 Mean student response to “Do you feel that the degree programme is preparing you adequately for employment?” by country. 3.5

3

2.5

All Male Female

2

1.5

Tu rk ey Ki ng do m *1

Sp ai n

U ni te d

Po Sl rt ov ug ak al Re pu bl ic

y

La tv ia Po la nd

al It

ce G re ec e H un ga ry Ir el an d

Fr an

Es to ni a

Bu

lg ar ia

1

Table 4.2 reveals some country differences but little variation between the genders in each country. The country differences may be a result of differences in the study programme or as a result of the general employment potential in that country. To try to answer this question, students were asked to answer the question “How would you rate the employment potential of your degree?” Table 4.3 shows the mean response by gender across the same country set. The table shows that the mean response is again midway between “some” and “much” and that there are variations between countries. A comparison of the mean of “Do you feel that the degree programme is preparing you adequately for employment?” and “How would you rate the employment potential of your degree?” says something about the alignment of the student perception of their study programme and employment. Table 4.3 Mean student response to “How would you rate the employment potential of your degree?” by country. Country Bulgaria Estonia France Greece Hungary Ireland Italy Latvia Poland Portugal Slovak Republic Spain Turkey United Kingdom*1

All 2.16 4.26 3.04 2.62 1.96 4.22 2.31 2.43 2.32 3.99 2.4 2.09 2.32 4.24

Male 2.06 4.23 3.03 2.65 1.91 4.2 2.34 2.44 2.33 4 2.41 2.03 2.35 4.31

Female 2.3 4.42 3.14 2.5 2.44 4.83 2.1 2.42 2.23 3.8 2.19 2.23 2.25 3

Notes: *1 Computer Science students only EIE Surveyor Final Report

16

Final Version

Taking France as an example, students rate their preparation for employment at 2.57 and their employment potential at 3.04. The employment potential is just worse than “some” and a numerical difference in this direction indicates the students perceive that they are more prepared for employment than their potential for employment. Contrast this with Greece, for example, where the mean rating of preparation for employment is 2.97 and the employment potential is 2.62. In the case of Greece the potential for employment is rated higher (numerically lower) than the level of preparation. The magnitude and direction (sign) of this difference is therefore an indicator of the perceived gap between preparation for employment and employment potential. The differences are summarized in Figure 4.4. (Tabulated data for this table can be found in Table 4.4 in Appendix 1.) Figure 4.4 Difference between “Do you feel that the degree programme is preparing you adequately for employment?” and “How would you rate the employment potential of your degree?” by country.

1 0.5

om gd Ki n

d

Tu rk ey

ni te

Sl

-1

U

Sp ai n

ic pu bl

al

Re

rt ug

ov ak

Po

la nd Po

a La tv i

It al y

an d Ir el

ry

ce re e

un ga H

e G

Fr an c

ia Es to n

Bu lg

-0.5

ar ia

0

-1.5 -2 -2.5 -3 -3.5

As a reminder, in Figure 4.4 in countries with lines above the zero line students feel they are more prepared for employment than their potential for employment. Where the lines are below zero students feel they are less prepared than their potential for employment.

4.3 Student perception of generic competence development For a set of 32 generic competences students were asked to rate how important they feel each is to the work they expect to do and on the level to which the competence is being developed by their study programme. Both questions are answered to a 4 point Likert scale where 1 indicates “none”; 2 indicates “weak”; 3 indicates “considerable”; and 4 indicates “strong”. An analysis of the responses to each question in isolation indicates the perceived value of each generic competence and in its level of development. An analysis of the difference between the rating of these questions for each competence indicates the gap between value and level of development and hence how well the student perceives the match of their degree programme to their need 1.

4.3.1 Student perception of importance of the generic competences Table 4.5 shows, in descending order of magnitude, the mean importance of the top and bottom 5 generic competences for all students. A full table is included as Table 4.5 in Appendix 1. Recall that 4 is the highest score (indicating “strong”). Note that the lowest ranked competence still has a mean of 2.52, midway between “weak” and “considerable” – hence no generic competence is really considered very low in importance. 1

The assumption here is that rating of importance is based on personal need.

EIE Surveyor Final Report

17

Final Version

Table 4.5 All student rating of importance of the generic competences. Rank 1 2 3 4 5 … 28 29 30 31 32

Generic competence Problem solving Elementary computing skills Capacity for applying knowledge in practice Teamworking Will to succeed

Mean 3.48 3.44 3.41 3.41 3.36

International Relations and Collaborations Patents and Intellectual Property Rights Appreciation of ethical issues Appreciation of diversity and multiculturality Understanding of cultures and customs of other countries

2.92 2.79 2.72 2.71 2.52

Table 4.5 shows that “Problem Solving” is rated as the most important competence by students and that “Understanding of cultures and customs of other countries” is rated least important. A look at the order of the means by gender does not show any material differences (all differences are small and not statistically significant). Further, a look at the order between Bachelor and Master level students also shows few differences. Overall the position of some of the generic competences merits comment: 1.

The competences usually associated with enterprise/entrepreneurship (“Initiative and entrepreneurial spirit” and “Patents and Intellectual Property Rights”) tend to lie to the bottom of the list with only “Capacity for generating new ideas (creativity)” being ranked important (7th in the list).

2.

All competences associated with internationalism (“Ability to work in an international context”, “International Relations and Collaborations”, “Appreciation of diversity and multiculturality”, and “Understanding of cultures and customs of other countries”) all score low. “Knowledge of a second language” lies midway in the list. Overall this placement should be a concern for mobility generally.

3.

“Research skills” is rated low in the list, a concern for those institutions with aspirations towards developing their students into future research careers. That said there may be many reasons for this particular placement, current year of study possibly being one.

In addition to rating the importance of each generic competence on a 1..4 scale, students were asked to identify the most importance competences for them and place them in order of importance. Since any specific generic competence can appear in any box a weighted scoring system has been used to produce an overall ranking of the competences. Any number that appeared in the first box, that is they were the respondents most important competence is weighted 5, the second choice 4, etc. The weighted sum of the score and the frequency of occurrence of a competence in that box gives an overall value for each competence. The highest indicates the most chosen competence. Table 4.6 shows the top and bottom 5, in descending order of popularity for students studying at the Bachelor level. The table also shows the value obtained from the weighting calculation, there is no real meaning in the magnitude of this value but the difference between the values indicates the separation between choices. A full list is shown in Table 4.6 in Appendix 1.

EIE Surveyor Final Report

18

Final Version

Table 4.6 Weighted ranking of importance of generic competences by Bachelor level students Rank 1 2 3 4 5 … 28 29 30 31 32

Generic Competence Problem solving Teamworking Capacity for applying knowledge in practice Knowledge of a second language Capacity for analysis and synthesis International Relations and Collaborations Appreciation of ethical issues Understanding of cultures and customs of other countries Appreciation of diversity and multiculturality Patents and Intellectual Property Rights

Score 1823 1624 1584 1231 1176 167 148 129 115 60

The results of this analysis should align with the ranking order that results from the analysis of means (i.e. the Bachelor level equivalent of Table 4.5). A comparison of these tables shows some many similarities but a few marked differences between the two ordered lists: 1.

3 of the top 5 appear in both lists, all of the bottom 5 are the same in both lists

2.

“Information management skills” appears 13 places lower in the chosen important competences compared to the 1..4 mean.

3.

“Elementary Computing Skills” appears 10 places lower

4.

“Research Skills” and “Leadership” both appear 11 places higher in the chosen important competences table

5.

“Knowledge of a second language” appears 12 places higher

6.

“Capacity for analysis and synthesis” appears 8 places higher

All other generic competences are within +/-6 places in both lists. This result, on the one hand confirms general consistency between the two ways of gaining an understanding of the relative importance students place on the generic competences. It does, however, beg the question, which is the more “accurate”. A review of the completed questionnaires shows that in a number of cases students have omitted to answer the 1..4 questions but have made a choice for their top 5. In some other cases, especially where the student has completed the 1..4 response questions in an obvious pattern (and hence “spoiled” that part of the questionnaire) there is no recognizable pattern to the free choice of top 5. This may suggest they have given some thought to their top 5 choices. On this basis it can be argued, although not conclusively proved, that the selection of the top 5 produces the more accurate view of student perception. There is, however, value in the 1..4 ratings as they permit more detailed comparisons to be made.

4.3.2 Student perception of level of development of the generic competences Table 4.7 shows, in descending order of magnitude, the mean level of development of the top and bottom 5 generic competences for all students. Here again 4 is the highest score (indicating “strong”). A full table is shown in Table 4.7 in Appendix 1. Note that the lowest ranked competence has a mean of 2.03, or “weak”. Students clearly feel that the level of development of, in particular “Understanding of cultures and customs of other countries” is weak on average across Europe. Whether it should he better developed is a point explored later in the comparative analysis sections. Table 4.7 shows that “Elementary computing skills” is rated as the best developed competence by students. This is perhaps, for some, a disappointment as the development of elementary computing skills is not a learning objective and is probably a competence assumed in the student body.

EIE Surveyor Final Report

19

Final Version

Table 4.7 All student rating of level of development of the generic competences. Rank 1 2 3 4 5 … 28 29 30 31 32

Generic competence Elementary computing skills Problem solving Capacity to learn Teamworking Basic general technical knowledge of the profession of your work area

Mean 3.2 2.97 2.96 2.94 2.91

Leadership International Relations and Collaborations Appreciation of ethical issues Patents and Intellectual Property Rights Understanding of cultures and customs of other countries

2.3 2.3 2.29 2.27 2.03

Second in the list is “Problem Solving”, a competence that probably does appear in the learning objectives of academic programmes in the EIE discipline and is top of the list of rated importance by students – so there is an immediate and clear indicator of good alignment between student rating of importance and their view on how well it is developed in them. A look at the order of the means by gender does not show any material differences (all differences are small and not statistically significant). Further, a look at the order between Bachelor and Master level students also shows few differences.

4.3.3 Student perception of ‘gap’ in the generic competences In the previous sections “Problem Solving” is rated most important and second most well developed of all the generic competences, suggesting a small ‘gap’ in how students need is being met. This notion of ‘gap’ can be quantified by looking at the numerical difference between the rated importance and level of development for each generic competence. The algorithm used is: Difference = Rated importance – Level of development Given that both rated importance and level of development are in the range 1..4, the valid range of the difference is -3..+3 and a positive difference indicates that the rated importance is greater than the level of development – or students need is greater than what they are receiving. Table 4.8 shows the ‘gap’ for all students and for males and females separately for the top and bottom 5 generic competences. A full table is shown in Table 4.8 in Appendix 1. Table 4.8 Comparison of mean difference between rated importance and level of development of the generic competences for all students by gender. Rank 1 2 3 4 5 28 29 30 31 32

Generic competence Knowledge of a second language Ability to work in an international context Capacity for generating new ideas (creativity) Leadership Capacity for applying knowledge in practice … Ability to work autonomously Research skills Basic general technical knowledge of the profession of your work area Grounding in basic knowledge of the profession of your work area Elementary computing skills

EIE Surveyor Final Report

20

All 0.79 0.76 0.74 0.67 0.63

Male 0.78 0.77 0.74 0.69 0.62

Female 0.81 0.72 0.77 0.61 0.69

0.38 0.37 0.34 0.28 0.25

0.38 0.36 0.33 0.26 0.25

0.41 0.42 0.43 0.39 0.26

Final Version

Across all students “Knowledge of a second language” is top of the ‘gap’ list. This indicates that academic institutions (at least those involved in this survey) are, on average, not delivering this competence to the level the students rate it as important. The next few at the top of the list are “Ability to work in an international context”, “Capacity for generating new ideas (creativity)” (3rd), “Leadership” (4th), “International Relations and Collaborations” (6th), and “Initiative and entrepreneurial spirit” (8th). These generally group to entrepreneurialism and internationalism and the results suggest academic institutions could be doing more in these two areas. Table 4.8 also shows the mean ‘gap’ for male and female students. Overall the differences between the genders is small and not statistically significant. Table 4.9 shows the mean for the top and bottom 5 generic competences for Bachelor and Master level students. A full version of Table 4.9 is shown in Appendix 1. Table 4.9 Comparison of mean difference between rated importance and level of development of the generic competences for all students by level of study. Generic competence Knowledge of a second language Capacity for generating new ideas (creativity) Ability to work in an international context Leadership Ability to work in an interdisciplinary team … Capacity for analysis and synthesis Research skills Basic general technical knowledge of the profession of your work area Grounding in basic knowledge of the profession of your work area Elementary computing skills

Bachelor 0.76 0.76 0.75 0.69 0.64

Master 0.88 0.72 0.83 0.66 0.49

0.41 0.4 0.37 0.28 0.28

0.38 0.28 0.29 0.27 0.2

In Table 4.9 the competences shown in bold italics are where there is a statistically significant difference between the Bachelor and Master level responses. The direction of the difference can be understood by looking at the value of the means. There are some significant differences between the study levels. “Knowledge of a second language” is top at both levels. At Master level students consider “International Relations and Collaborations” in the top 5 along with “Capacity for applying knowledge in practice”. This suggests that at Masters level capacity of applying knowledge in practice, for example, with a larger gap, is either being taken for granted at this level or is not being developed as much as the pure theoretical aspects of the discipline. Students clearly perceive the need for knowing how to apply this knowledge in practice. Table 4.10 shows the top and bottom 5 ‘gaps’ for the countries with the top 5 largest student responses. A full version of this table can be found in Table 4.10 in Appendix 1. Table 4.10 has been sorted by the French student’s responses – they being the first column alphabetically. However, this rather hides the wide differences between the countries in their student rating of the gap in provision. The largest ‘gap’ for French students is “International Relations and Collaborations” but for Hungarian and Slovak Republic students the largest gap is “Knowledge of a second language”, which for French students comes 15th in their ranking. For Greek and Polish students it is “Ability to work in an International Context” that is ranked top, although being ranked top means their perception of the importance of the competence to how well it is being developed in their institution is widest and hence merits attention by academic programme designers.

EIE Surveyor Final Report

21

Final Version

Table 4.10 Comparison of mean difference between rated importance and level of development for all students by country. Generic competence International Relations and Collaborations Capacity to adapt to new situations Ability to work in an interdisciplinary team Ability to work in an international context Capacity for generating new ideas (creativity) … Teamworking Grounding in basic knowledge of the profession of your work area Research skills Capacity to learn Elementary computing skills

France 1.1 1.06 1.01 1 0.95

Greece 0.63 0.74 0.69 0.96 0.88

Hungary 0.39 0.76 0.83 0.72 0.91

Poland 0.81 0.54 0.34 0.91 0.72

Slovak Republic 0.58 0.42 0.46 0.69 0.71

0.47 0.44 0.44 0.43 0.39

0.38 0.47 0.69 0.75 0.36

0.88 -0.21 0.32 0.48 0.15

0.35 0.26 0.19 0.32 0.16

0.6 0.19 0.25 0.31 0.31

4.4 Student perception of language competence development All students were asked to indicate their perception of the level of importance and level of development of written and spoken ability in each of the European languages except for their native language. Each answer (4 per language) is to a 4-point scale the same as for the generic and specific competences. Table 4.11 in appendix 1 shows the overall mean of all four questions for each language in descending order of rated importance. Most students also responded for their native language and this is not taken into account in Table 4.11. It should, however be noted that the number of native English and German speaking students (the top two languages) are small in number and the effect of their inclusion will not have a significant effect on these results. Clearly English is viewed as the most important written and spoken language with a mean of over 3.3 on a 1 to 4 scale. German is second with a mean of just below 2 where 2 indicates “weak”. France and Slovak Republic students, in the main, rated their own language as important and this needs to be taken into account as, to a lesser extent, did the respondents from Spain. Overall all languages except English score lower that “weak” in terms of rated importance. On level of development, English is again highest with a mean of 2.72 for written and 2.67 for spoken, with 2 representing “weak” and 3 “considerable”. The fact that there is a ‘gap’ between the mean rated importance and level of development again shows that students needs are not being currently met by their academic programmes. There are some statistically significant differences between the mean Bachelor and Master level of study responses but only the difference in English are worthy of note. Table 4.11 shows the difference by level of study. Table 4.11 Mean student importance and level of development response for the English language by level of study Ability in English language Importance of written Importance of spoken Level of development of written Level of development of spoken

Bachelor level 3.35* 3.36* 2.74 2.69

Master level 3.47* 3.49* 2.70 2.66

* Denotes statistically significant difference From Table 4.11 it can be seen that the ‘gap’ is wider at master level than at the bachelor level and the level of importance is rated as higher, in contrast the level of development at master level is considered lower.

EIE Surveyor Final Report

22

Final Version

Table 4.12 shows the mean responses by gender. Here again there are statistically significant differences with males considering English to be more important than females and to be more well developed in their study programmes, although the effect size is small in all cases. Table 4.12 Mean student importance and level of development response for the English language by gender Ability in English language Importance of written Importance of spoken Level of development of written Level of development of spoken

Male 3.41* 3.43* 2.75* 2.70*

Female 3.16* 3.15* 2.61* 2.54*

* Denotes statistically significant difference

4.5 Student perception of specific competence development For a set of 28 specific competences students were asked to rate how important they feel each is to the work they expect to do and on the level to which the competence is being developed by their study programme. Both questions are answered to a 4 point Likert scale where 1 indicates “none”; 2 indicates “weak”; 3 indicates “considerable”; and 4 indicates “strong”. An analysis of the responses to each question in isolation indicates the perceived value of each specific competence and in its level of development. An analysis of the difference between the rating of these questions for each competence indicates the gap between value and level of development and hence how well the student perceives the match of their degree programme to their need.

4.5.1 Student perception of importance of the specific competences Table 4.13 shows, the top and bottom 5 mean importance of all the specific competences for all students (a full table is included at Table 4.13 in Appendix 1). Recall that 4 is the highest score (indicating “strong”). Note that the lowest ranked competence has a mean of 2.78, which is close to “considerable” – hence no specific competence is really considered low in importance. Table 4.13 Student perception of the importance of the specific competences Rank 1 2 3 4 5 … 24 25 26

Specific competence Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems Ability to work in a group on a major project Ability to demonstrate practical engineering skills Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline

Mean 3.29

Ability to apply a systems approach to engineering problems

3.17

Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles

2.83

Ability to demonstrate knowledge and understanding of the commercial and economic context Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

2.82

3.29 3.24 3.2

2.81

27

Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context

2.8

28

Ability to demonstrate awareness of the nature of intellectual property and contractual issues

2.78

EIE Surveyor Final Report

23

Final Version

Table 4.13 shows that the specific competences rated least in importance are those that look beyond the technicalities of the discipline. The top 5 contrast well with the bottom 5. Those at the top are core classical engineering competences, those at the bottom are broader commercial competences which some students struggle to see the relevance of in engineering degrees. In addition to rating the importance of each specific competence on a 1..4 scale, students were asked to identify the most important competences in order of importance. Table 4.14 shows, using the same weighting system as was used for the generic competences, the top and bottom 5 rated important competences. A full version of the table is shown in Appendix 1. Table 4.14 Rank order of rated specific competences for all students and for Bachelor and Master level students. Rank 1 2

3

Specific competence Ability to work in a group on a major project Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline

All 1 2

Bachelor 2 1

Master 1 4

3

3

2

4 5 …

Ability to demonstrate practical engineering skills Ability to apply a systems approach to engineering problems

4 5

5 4

3 6

24

Ability to demonstrate understanding of appropriate codes of practice and industry standards

24

20

27

25 26

Ability to demonstrate awareness of quality issues Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products.

25 26

25 26

23 22

27

Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.)

27

27

18

28

Ability to demonstrate awareness of the nature of intellectual property and contractual issues

28

28

28

There is very little difference in the top and bottom 5 specific competences as shown in Table 4.14. Also a comparison of the top specific competences shown in Table 4.14 and Table 4.13 shows there is good agreement between the rank order and the order revealed by means.

4.5.2 Student perception of level of development of the specific competences Table 4.15 shows, in descending order of magnitude, the top and bottom 5 mean level of development of the specific competences for all students. The lowest ranked competence has a mean of 2.25, between “weak” and “considerable”, so students feel all the listed specific competences are being developed above the level of weak. A full version of this table can be found in Appendix 1. Table 4.15 shows that “Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline” is rated the best developed competence very closely followed by “Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems”. This second competence is in the top 2 for rated importance (see Table). This is an encouraging outcome and suggests a review of the difference between rated importance and level of development, or the ‘gap’ will again be useful. A ‘gap’ analysis is shown in the next section.

EIE Surveyor Final Report

24

Final Version

Table 4.15 Student perception of the level of development of the specific competences Rank 1

Specific competence Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline

Mean 2.9

2

Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems

2.89

3

Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline

2.86

4

Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques

2.72

5 … 24

Ability to apply a systems approach to engineering problems

2.71

Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement

2.33

Ability to demonstrate awareness of the nature of intellectual property and contractual issues Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context

2.33

25 26 27 28

2.32

Ability to demonstrate knowledge and understanding of the commercial and economic context Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

2.29 2.25

Table 4.16 shows the top and bottom 5 gender difference in means for the specific competences for students at all levels of study. Table 4.16 Student perception of the level of development of the specific competences by gender Rank 1

Specific competence Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline

Male 2.85

Female 2.91

2

Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline

2.91

2.9

3

Ability to apply and integrate knowledge and understanding of other engineering disciplines Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles

2.59

2.58

2.44

2.44

Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement

2.31

2.5

Ability to demonstrate awareness of the nature of intellectual property and contractual issues Ability to demonstrate understanding of appropriate codes of practice and industry standards Ability to demonstrate awareness of quality issues Ability to work with technical uncertainty Ability to work in a group on a major project

2.33

2.37

2.46

2.47

2.49 2.52 2.67

2.54 2.48 2.83

4 5

… 24 25 26 27 28

The three specific competences for which there are statistically significant differences are shown in bold.

EIE Surveyor Final Report

25

Final Version

4.5.3 Student perception of ‘gap’ in the specific competences As in the case of the generic competences, a top and bottom 5 ‘gap’ analysis is shown in Table 4.17 for all students. A full version of the table can be found in Appendix 1 Table 4.17 Comparison of mean difference between rated importance and level of development of the specific competences for all students by gender. Rank 1 2 3 4 5

Specific competence

All

Male

Female

Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process Ability to identify and manage cost drivers in designs and projects

0.67 0.64

0.68 0.65

0.59 0.6

Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs Ability to work in a group on a major project

0.61 0.6

0.61 0.61

0.59 0.51

Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development

0.56

0.55

0.62

Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques

0.37

0.37

0.4

… 24 25 26 27

28

Ability to demonstrate understanding of the use of technical literature and other information sources Ability to demonstrate awareness of quality issues Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline

0.37 0.36

0.37 0.39

0.36 0.25

0.34

0.34

0.37

Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline

0.09

0.08

0.15

There are no statistically differences in the magnitude of the ‘gap’ between the genders. However, the order of the gap is difference. Across all students “Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process” is top of the ‘gap’ list. This indicates that academic institutions (at least those involved in this survey) are, on average, not delivering this competence to the level the students rate it as important. The other specific competences at the top of the list also merit thought by academic institutions with competences ranked 1, 2 and 5 being related to the broader issues of design and the design process. Competences ranked 3rd and 4th are more generic in nature, 3rd being creativity and innovativeness in synthesis and solutions and in formulating solutions – this can be taken to imply that EIE education currently seeks more to applying standard approaches to problems. However, again caution should be taken in too narrowly interpreting this as the impact of study year could be an important consideration. Fourth in the list is “Ability to work in a group on a major project”, this could reflect an absence of opportunity to work in a group. Given the differences in student response in difference countries, caution is needed in applying these generalized findings locally. Table 4.18 shows the mean of the top 5 specific competences across the countries for which there is a meaningful number of usable returns for this analysis. Table 4.18 shows that for all the considered countries the largest gap in all five competences exists in Estonia followed by Spain and Italy.

EIE Surveyor Final Report

26

Final Version

Table 4.18 Mean of the top 5 specific competence ‘gap’ by country

In what country is your Institution

Estonia Spain Italy France Greece Poland Latvia Slovak Republic Hungary Portugal Ireland Turkey Bulgaria

Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 1.07 0.78 0.65 0.74 0.78 0.7 0.66 0.75 0.63 0.58 0.54 0.43 0.34

Ability to identify and manage cost drivers in designs and projects

Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs

Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development

Ability to work in a group on a major project

Overall mean

1.07 0.95 0.9 0.66 0.72 0.71 0.66

1.04 0.73 0.93 0.69 0.62 0.73 0.7

1 0.79 0.81 0.75 0.73 0.59 0.47

0.86 0.78 0.55 0.69 0.66 0.51 0.7

1.008 0.806 0.768 0.706 0.702 0.648 0.638

0.6 0.46 0.5 0.61 0.49 0.42

0.53 0.6 0.41 0.46 0.39 0.45

0.45 0.52 0.49 0.31 0.34 0.34

0.67 0.76 0.52 0.33 0.44 0.2

0.6 0.594 0.5 0.45 0.418 0.35

Table 4.19 shows the gap by level of study. Table 4.19 Comparison of mean difference between rated importance and level of development of the specific competences for all students by level of study. Specific competence Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process Ability to identify and manage cost drivers in designs and projects Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs Ability to work in a group on a major project Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development … Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques Ability to demonstrate understanding of the use of technical literature and other information sources Ability to demonstrate awareness of quality issues Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline

EIE Surveyor Final Report

27

All

Bachelor

Master

0.67 0.64

0.66 0.62

0.7 0.7

0.61 0.6

0.6 0.6

0.63 0.59

0.56

0.56

0.56

0.37

0.38

0.33

0.37 0.36

0.38 0.39

0.35 0.34

0.34

0.36

0.3

0.09

0.12

0.03

Tuning methodology in EIE

The gaps for which the difference is statistically significant are shown in bold. The differences are not of any significant size.

EIE Surveyor Final Report

28

Tuning methodology in EIE

5. The academic view 5.1 Introduction This section looks in detail at the academic responses to the survey. Reference should be made to the constitution of the academics who have responded in Section 3 of this report. Of particular interest is how academics feel their institution’s study programme is preparing their students for employment; how they rate the employment potential of their students; and how they rate the competences that are being developed in their students by their study programme. Three types of competences are considered, generic, language and specific. These aspects are considered in turn in this section.

5.2 Academic perception of employment potential In response to the question “Do you feel that the degree programme is preparing your students adequately for employment?” the overall mean response is 2.19 at the Bachelor level and 1.88 at the Master level. Note both are on a 1 to 5 scale where 1 indicates “very much”; 2 indicates “much”; 3 indicates “some”; 4 indicates “little”; and 5 indicates “very little”. Overall academics feel that Master level education is preparing students more for employment than Bachelor level. The difference is not, however statistically significant. A breakdown of mean response by country is shown in Figure 5.1 and Table 5.1 (Appendix 1) for the countries where there are sufficient returns to make the result meaningful. Figure 5.1 Mean academic perception of employment potential of their students

2.5

2

1.5

1

0.5

0 France

Lithuania

Portugal

Spain

UK

Country

5.3 Academic perception of generic competence development For a set of 32 generic competences academics were asked to rate how important they feel each is to the work they expect their students to do and on the level to which the competence is being developed by their study programme. Both questions are answered to a 4 point Likert scale where 1 indicates “none”; 2 indicates “weak”; 3 indicates “considerable”; and 4 indicates “strong”. An analysis of the responses to each question in isolation indicates the perceived value of each generic competence and in its level of development. An analysis of the difference between the rating of these questions for each competence indicates the gap between value and level of development and hence how well the academic perceives the match of their degree programme to their student’s need 2.

2

The assumption here is that rating of importance is based on personal need.

EIE Surveyor Final Report

29

Tuning methodology in EIE

5.3.1 Academic perception of importance of the generic competences Table 5.2 shows the mean of the importance of the top and bottom 5 generic competences for all academics. A full version of Table 5.2 is provided in Appendix 1. Table 5.2 Mean of the importance of the generic competences for all academics Rank 1 2 3 4 5 … 28 29 30 31 32

Generic competence Elementary computing skills Capacity for applying knowledge in practice Problem solving Capacity for analysis and synthesis Basic general technical knowledge of the profession of your work area

Mean 3.6 3.58 3.58 3.54 3.53

Leadership International Relations and Collaborations Appreciation of diversity and multiculturality Patents and Intellectual Property Rights Understanding of cultures and customs of other countries

2.82 2.79 2.66 2.65 2.5

Table 5.2 shows that academics rate all but 8 of the generic competences to be of “considerable” importance or stronger. The most important is “Elementary computing skills” with “Capacity for applying knowledge in practice” and “Problem solving” very close behind in joint second place. It is interesting to note that these top three are also the top three for all students – this comparative view is explored in more detail in section 8 of this report. The least important competence is “Understanding of cultures and customs of other countries” again in agreement with the views of all students. An analysis by gender for academics is not considered to be meaningful however, an analysis by level of study for which the response is being completed is. Figure 5.3 shows the distribution of academic responses by level. There are sufficient numbers of responses at the Bachelor and Master levels to allow a meaningful comparison. Figure 5.3 Distribution of academic responses by study level

Mi s s in g Do c to r al/ Ph D

Ba ch elo r

Ma s t er s

Table 5.4 shows the mean top and bottom 5 generic competences by level of study. A full version of this table is shown in Appendix 1. There is a statistically significant difference in 5 of the competences, shown in bold in Table 5.4. In all 5 cases the mean at the Bachelor level is higher than that at the Master level indicating academics feel the competences are more important for study at the Bachelor level. The

EIE Surveyor Final Report

30

Tuning methodology in EIE

difference in “Leadership” and “Appreciation of diversity and multiculturality” are both of medium effect size 3, the other three are small.

Table 5.4 Mean importance of the generic competence comparing the Bachelor and Master levels Rank 1 2 3 4 5 … 28 29 30 31 32

Generic competence Elementary computing skills Capacity for applying knowledge in practice Problem solving Basic general technical knowledge of the profession of your work area Capacity for analysis and synthesis Research skills Appreciation of diversity and multiculturality International Relations and Collaborations Patents and Intellectual Property Rights Understanding of cultures and customs of other countries

Bachelor 3.7 3.6 3.58 3.55 3.54

Master 3.51 3.6 3.57 3.49 3.52

2.85 2.84 2.83 2.67 2.62

2.85 2.45 2.69 2.62 2.31

5.3.2 Academic perception of level of development of the generic competences Table 5.5 shows the mean level of development of the top and bottom 5 generic competences as perceived by all academics and by study level. Table 5.5 Mean level of development of the generic competences for all academics and by level of study Rank 1 2 3 4 5 … 28 29 30 31 32

Generic competence Elementary computing skills Basic general technical knowledge of the profession of your work area Capacity for analysis and synthesis Grounding in basic knowledge of the profession of your work area Capacity for applying knowledge in practice

All 3.39 3.21 3.14 3.08 3.06

Bachelor 3.48 3.32 3.18 3.16 3.11

Master 3.37 3.05 3.11 3.03 3.06

Appreciation of ethical issues International Relations and Collaborations Leadership Understanding of cultures and customs of other countries Patents and Intellectual Property Rights

2.36 2.33 2.31 2.15 2.09

2.45 2.41 2.48 2.24 2.12

2.32 2.23 2.13 2.08 2.08

In Table 5.5 the level of development of three of the generic competences are rated as statistically significantly different between the Bachelor and Master study levels (shown in bold). In all three cases the level of development is considered higher at the Bachelor than the Master level and the difference in “Leadership” is a medium size effect. To gain a better picture of the significance of these results a ‘gap’ analysis between the rated importance and level of development is now considered.

3

As given by Cohen’s d

EIE Surveyor Final Report

31

Tuning methodology in EIE

5.3.3 Academic perception of ‘gap’ in the generic competences Table 5.6 shows the top and bottom 5 mean ‘gaps’ for all academics and by study level. None of the differences between study levels are statistically significant. A full version of this table can be found in Appendix 1.

Table 5.6 Mean gap between rated importance and level of development of the generic competences for all academics and by level of study Rank 1 2 3 4 5 … 28 29 30 31 32

Generic competence Knowledge of a second language Ability to work in an interdisciplinary team Initiative and entrepreneurial spirit Planning and time management Capacity to adapt to new situations

All 0.74 0.7 0.67 0.65 0.65

Bachelor 0.71 0.66 0.69 0.67 0.68

Master 0.68 0.72 0.65 0.62 0.58

Understanding of cultures and customs of other countries Basic general technical knowledge of the profession of your work area Appreciation of diversity and multiculturality Grounding in basic knowledge of the profession of your work area Elementary computing skills

0.35 0.32 0.3 0.24 0.21

0.38 0.22 0.38 0.19 0.22

0.23 0.45 0.14 0.32 0.14

Academics consider knowledge of a second language to be the competence with the highest mismatch between rated importance and level of development. Interestingly this is the same as for students. Next is ability to work in an interdisciplinary team. This competence is ranked 17th of all the generic competences (Table 5.2) with a mean of 3.22 – above “considerable”. Academics clearly recognize the value of this competence in their students but perhaps do not have the opportunity to develop it within their own institutions. Initiative and entrepreneurial spirit are next highest in ‘gap’ followed by “planning and time management” and “capacity to adapt to new situations”. Planning and time management is not ranked very high in the overall importance ranking (19th out of 32) yet is an important general student study skill. The competences at the bottom of the list indicate the smallest gap between importance and level of development indicating that their development is closely matched to need. Interestingly all gaps are positive indicating rated importance is higher than level of development (on the same rating scale) in all cases. There is some variation in the ranking of the ‘gap’ across Europe. For example, in Bulgaria the top 5 ranked gaps are: 1

“Planning and time management”

2

“Ability to work in an interdisciplinary team”

3

“Knowledge of a second language”

4

“Initiative and entrepreneurial spirit”

5

“Oral and written communications in your native language”

For French academics Capacity for generating new ideas (creativity)” is top with “Knowledge of a second language” second. Irish academics rank “Capacity to adapt to new situations” top. A full table of all the ‘gaps’ for all the generic competences across countries with sufficient responses to make the analysis meaningful is given in Table 5.7 in Appendix 1.

5.4 Academic perception of language competence development All academics were asked to indicate their perception of the level of importance and level of development of written and spoken ability in each of the European languages except for their native language. Each

EIE Surveyor Final Report

32

Tuning methodology in EIE

answer (4 per language) is to a 4 point scale the same as for the generic and specific competences. As is the case for students, academics only rated the English language as being important and being developed above a mean of 1.5, hence only English is considered in detail in this section. Table 5.8 shows the overall mean of all four questions for each language in descending order of rated importance.

Table 5.8 Mean rated importance and level of development of English for all academics and by level of study. Ability in English language Importance of written Importance of spoken Level of development of written Level of development of spoken

All academics 3.63 3.58 2.82 2.80

Bachelor level 3.63 3.59 2.77 2.75

Master level 3.71 3.63 2.86 2.81

Table 5.6 shows that academics consider that competence in the English language is more important at Master level than at Bachelor level. None of the differences between levels are statistically significant.

5.5 Academic perception of specific competence development For a set of 28 specific competences academics were asked to rate how important they feel each is for the work their students at the study level they are answering the questionnaire for expect to do and on the level to which the competence is being developed by their programme. Both questions are answered to a 4 point Likert scale where 1 indicates “none”; 2 indicates “weak”; 3 indicates “considerable”; and 4 indicates “strong”. An analysis of the responses to each question in isolation indicates the perceived value of each specific competence and in its level of development. An analysis of the difference between the rating of these questions for each competence indicates the gap between value and level of development and hence how well the academic perceives the match of their degree programme to need.

5.5.1 Academic perception of importance of the specific competences Table 5.9 shows, in descending order of magnitude, the top and bottom 5 mean importance of all the specific competences for all academics and by study level. Recall that 4 is the highest score (indicating “strong”). Note that the lowest ranked competence for all academics has a mean of 2.78, which is close to “considerable” – hence no specific competence is really considered low in importance. A full version of this table can be found in Appendix 1. Table 5.9 Academic perception of the importance of the specific competences Ran k 1 2

3

4 5 … 24 25

Specific competence Ability to demonstrate practical engineering skills Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems Ability to apply a systems approach to engineering problems Ability to work in a group on a major project Ability to demonstrate knowledge and understanding of the commercial and economic context Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context

EIE Surveyor Final Report

33

All 3.57

Bachelor 3.63

Master 3.55

3.45

3.48

3.43

3.45

3.43

3.49

3.43 3.4

3.42 3.48

3.52 3.4

2.94

3.07

2.85

2.93

2.97

2.91

Tuning methodology in EIE

26

Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues Ability to demonstrate awareness of the nature of intellectual property and contractual issues

27

28

2.82

2.78

2.83

2.79

2.9

2.68

2.78

2.84

2.74

The top 5 specific competences are all the direct application competences of the engineering discipline in practice whereas the bottom 5 are the broader commercial aspects of engineering. This can be taken as a positive indicator of the primary desire of EIE academics to produce technically able engineers. This is potentially, however, at the expense of their commercial awareness upon graduation. That said, the lowest ranked competence still has an importance rating close to “considerable”.

5.5.2 Academic perception of level of development of the specific competences Table 5.10 shows, in descending order of magnitude, the top and bottom 5 mean level of development of all the specific competences for all academics and by level of study for which they answered the questionnaire. The lowest ranked competence has a mean of 2.17, between “weak” and “considerable”, so academics in general feel all the listed specific competences are being developed above the level of weak. A full version of this table can be found in Appendix 1. Table 5.10 Academic perception of the level of development of the specific competences for all and by level of study Rank 1

2 3

4

5 … 24

25

26

27

28

Specific competences

All

Bachelor

Master

Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems Ability to demonstrate practical engineering skills

3.14 3.09

3.22 3.19

3.08 3

Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline

3.08

3.16

3.02

2.95

3.04

2.88

2.92

2.97

2.91

Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering

2.35

2.47

2.31

Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement

2.34

2.31

2.35

Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development

2.34

2.44

2.33

2.18

2.31

2.11

2.17

2.2

2.2

Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques Ability to demonstrate understanding of the use of technical literature and other information sources

Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues Ability to demonstrate awareness of the nature of intellectual property and contractual issues

EIE Surveyor Final Report

34

Tuning methodology in EIE

To a large extent the ranking of the level of development of the specific competences mirrors the rated importance with the technical competences at the top and the commercial and broader competences at the bottom. The mean score of the lowest ranked at 2.17 is close to “weak”, this reflects an overall academic view that the development of these more commercial dimensions in their students is only weakly needed. A comparison with the employer’s view on these competences is given in section 8.

5.5.3 Academic perception of ‘gap’ in the specific competences As in the case of the generic competences, a top and bottom 5 ‘gap’ analysis is shown in Table 5.11 for all academics. A full version of the table can be found in Appendix 1.

Table 5.11 Comparison of mean difference between rated importance and level of development of the specific competences for all academics and by level of study. Rank 1 2

3

Specific competence Ability to identify and manage cost drivers in designs and projects Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues Ability to demonstrate understanding of appropriate codes of practice and industry standards

All

Bachelor

Master

0.68

0.64

0.68

0.64

0.64

0.6

0.62

0.67

0.61

4

5 … 24

25

26

27

28

Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering

0.61

0.59

0.57

0.61

0.63

0.57

Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques

0.38

0.34

0.42

Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline

0.36

0.32

0.42

Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline

0.32

0.22

0.48

0.32

0.21

0.42

0.32

0.26

0.35

Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products.

The specific competence with the largest gap between rated importance and level of development is “Ability to identify and manage cost drivers in designs and projects”. Whilst this is ranked 15th in importance it is ranked 19th in level of development. The fact that this emerges as the competence with the largest gap is probably more a result of the similarity in rankings than this being a particularly weak aspect of curricula. Perhaps of most importance are those at the bottom of the table which indicate a good match between importance and level of development. In the bottom 5 there are, encouragingly, some of the foundation competences of the discipline.

EIE Surveyor Final Report

35

Tuning methodology in EIE

As was the case in the generic competences, there is variation in the way academics in different countries rate the gap between importance and level of development of the specific competences. The top ranked gap is: •

Bulgaria: “Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues.” • France: “Ability to demonstrate a appreciation of the wider multidisciplinary engineering context and its underlying principles.” • Greece and Spain: “Ability to identify and manage cost drivers in designs and projects.” • Ireland: “Ability to apply and integrate knowledge and understanding of other engineering disciplines.” • Poland: “Ability to apply a systems approach to engineering problems.” • Slovak Republic “Ability to demonstrate awareness of quality issues.” • UK: “Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development.” Table 5.12 (Appendix 1) shows a full list of all the specific competence gaps for these countries.

EIE Surveyor Final Report

36

Tuning methodology in EIE

6. The employer view 6.1 Introduction This section looks in detail at the employer responses to the survey. Reference should be made to the constitution of the employers who have responded in Section 3 of this report. Of particular interest is how employers feel that Higher Education Institutions have given their employees adequate preparation for working in this work area in their company as well as the usual set of questions relating to the importance and level of development of the generic, specific and language competences. These aspects are all considered in turn in this section.

6.2 Employer perception of preparation for employment In response to the question “Do you consider that Higher Education Institutions have given your employees adequate preparation for working in this work area in your company?” The overall mean response is 2.28 for all employers who responded to this question. They were also asked to identify which educational level of employee they are answering this question for. 50 of the employers completed the questionnaire for Bachelor level employees and 50 responded for Master level employees. The mean response at the Bachelor level is 2.26 while that at the Master level is 2.22. (The overall mean of 2.28, being higher than the means of both the Bachelor and Master level responses is explained by high means in the few respondents at the Doctoral level and those at other or no response academic levels.) Note that the mean is on a 1 to 5 scale in which 1 indicates “very much”; 2 indicates “much”; 3 indicates “some”; 4 indicates “little” and 5 indicates “very little”. The results show that employers consider Bachelor level education is preparation students better for employment than Bachelor level education but the difference is small and not statistically significant. For both levels the employers feel preparation is closer to “some” than “much”.

6.3 Employer perception of generic competence development For a set of 32 generic competences employers were asked to rate how important they feel each is to the work they expect their graduate recruits to do. The question is answered to a 4 point Likert scale where 1 indicates “none”; 2 indicates “weak”; 3 indicates “considerable”; and 4 indicates “strong”. An analysis of the responses indicates the perceived value of each generic competence and in its level of development. An analysis of the difference between the rating of these questions for each competence indicates the gap between value and level of development and hence how well the student perceives the match of their degree programme to their need 4.

6.3.1 Employer perception of importance of the generic competences Table 6.1 shows the top and bottom 5 mean of the importance of the generic competences for all employers and for the two main levels of study for which they completed the questionnaire. A full version of the table can be found in Appendix 1. Employers are in agreement with students that “Problem solving” is the most important generic competence. Second is “Concern for quality”, a very understandable competence for employers. Third equal are “Capacity to learn” and “Teamworking”. It should be noted that the mean for all of the top 5 overall are very similar. When the academic levels are considered separately “Elementary computing skills” is top for the Bachelor level and “Teamworking” for Master level students, both with “Problem solving” second. Bottom for all and for both academic levels is “Understanding of cultures and customs of other countries”. Others at the lower end of the list are the competences associated with Internationalisation, Entrepreneurship, Leadership and Research. Perhaps this reflects the view that EIE programmes should first and foremost focus on engineering and engineering practice although the majority of employer respondents were from large established firms into which new graduates can be placed in positions appropriate to an engineering degree.

4

The assumption here is that rating of importance is based on personal need.

EIE Surveyor Final Report

37

Tuning methodology in EIE

Table 6.1 Mean of importance of the generic competences for all employers and by level of study Rank 1 2 3 4 5 … 28 29 30 31 32

Generic competences Problem solving Concern for quality Capacity to learn Teamworking Capacity for applying knowledge in practice

All 3.62 3.61 3.6 3.6 3.59

Bachelor 3.54 3.51 3.54 3.46 3.46

Masters 3.73 3.73 3.63 3.76 3.71

Appreciation of diversity and multiculturality Leadership International Relations and Collaborations Patents and Intellectual Property Rights Understanding of cultures and customs of other countries

2.78 2.72 2.68 2.61 2.51

2.51 2.59 2.46 2.49 2.44

3.05 2.8 2.88 2.73 2.56

Table 6.2 shows the top and bottom 5 rank order of generic competences as revealed by the free choice of first to fifth preferred by each employer. The table also shows the rank position by academic level. A full version of the table can be found in Appendix 1. Table 6.2 Weighted ranking of importance of generic competences by employers for all and by study level Rank 1 2 3 4 5 … 28 29 30 31 32

Generic competence Capacity for applying knowledge in practice Capacity for analysis and synthesis Capacity to learn Teamworking Basic general technical knowledge of the profession of your work area Will to succeed Leadership Appreciation of ethical issues Patents and Intellectual Property Rights Understanding of cultures and customs of other countries

All 142 110 79 77 71

Bachelor 52 50 44 20 36

Masters 87 60 30 54 34

7 6 6 4 0

5 6 5 0 0

2 0 1 4 0

The alignment of the free ranked importance and the mean of the rated importance (Tables 6.1 and 6.2 respectively) differs more than in the students and academics cases. 3 of the top 5 from Table 6.2 are also in the top 5 of Table 6.1 however “Problem solving” and “Concern for quality” are not in the top 5. “Research skills” is rated 4th for Bachelor level students and 13th for Master students – which is an unexpected result. Also “Oral and written communications in your native language” falls from 7th to 21st place in rank order. There are no obvious reasons for these differences.

6.3.2 Employer perception of level of development of the generic competences Table 6.3 shows, in descending order of magnitude, the top and bottom 5 mean level of development of all the generic competences for all employers and by academic level. A full version of the table can be found in Appendix 1.

EIE Surveyor Final Report

38

Tuning methodology in EIE

Table 6.3 Employer view of mean level of development for the generic competences by academic level Rank 1 2 3 4 5 … 28 29 30 31 32

Generic competence Elementary computing skills Capacity to learn Oral and written communication in your native language Will to succeed Basic general technical knowledge of the profession of your work area

All 3.46 3.19 3.13 3 2.99

Bachelor 3.61 3.17 3.1 3.02 3.1

Master 3.34 3.2 3.15 2.98 2.95

Planning and time management Understanding of cultures and customs of other countries Leadership International Relations and Collaborations Patents and Intellectual Property Rights

2.48 2.36 2.26 2.26 2.18

2.59 2.29 2.29 2.12 2.05

2.39 2.39 2.17 2.34 2.27

Slightly in contrast to the rated important generic competences, those rated most developed are the personal skills of “Elementary computing skills”, “Capacity to learn”, “Oral and written communications in your native language” and “Will to succeed”. The more technical competences follow lower down in the rankings. Of those that lie at the bottom of the list are the competences employers feel are least well developed. Note that the lowest, “Patents and Intellectual Property Rights” scores a mean of 2.18, just above “weak”. For patents and IPR this is perhaps acceptable as the large employer respondents probably have professional staff or have secured the services of professionals to provide this service to their organisation. However, 5th form the bottom of the list is “Planning and time management”, a competence academics might feel they try hard to develop in their students and, as can be seen form Table 5.5, it does appear considerably higher in the academics view of its development. A clear difference in view. Again a gap analysis will show the real areas where employers feel the academic programme is not developing competences to the level they feel is important.

6.3.3 Employer perception of ‘gap in the generic competences As in the case of the generic competences, a top and bottom 5 ‘gap’ analysis is shown in Table 6.4 for all employers. A full version of the table can be found in Appendix 1 Table 6.4 Comparison of mean difference between rated importance and level of development of the generic competences for all employers and by academic level. Rank 1 2 3 4 5 … 28 29 30 31 32

Generic competence Concern for quality Planning and time management Capacity for applying knowledge in practice Problem solving Teamworking

All 0.79 0.75 0.74 0.72 0.72

Bachelor 0.66 0.56 0.54 0.63 0.76

Master 0.98 0.93 0.9 0.78 0.71

Research skills Grounding in basic knowledge of the profession of your work area Appreciation of diversity and multiculturality Understanding of cultures and customs of other countries Elementary computing skills

0.33 0.26 0.26 0.14 0.09

0.41 0.05 0.1 0.15 0.1

0.24 0.44 0.46 0.17 0.1

Top of the list overall is “Concern for quality”. This is dominated by a clear difference at the Masters level. At the Bachelor level the greatest gap is in “Teamworking”. “Planning and time management” is second overall, again principally because of the Master level responses, it is ranked 6th for Bachelor students. It is

EIE Surveyor Final Report

39

Tuning methodology in EIE

clear from the top few in the list where employers feel the academic programmes their graduate recruits have taken are falling short of their “need” in the generic competences. Encouragingly at the bottom of the list there appears to be no issue with Elementary computing skills although the academics who feel that this is not a core component of their degree programme will gain little comfort from this outcome. The other competences at the bottom of the Table 6.4 are generic competences employers feel are being developed in line with their rating of its importance. There is variation in the way employers in different countries rate the gap between importance and level of development of the generic competences. The top ranked gap is: •

Bulgaria: “Capacity for applying knowledge in practice”, “Decision making”, “Leadership” (equal top)



France: “Capacity to adapt to new situations”, “Teamworking” (equal top)



Germany: “Planning and time management”



Ireland: “Teamworking”



Poland: “Planning and time management”



Slovak Republic “Ability to work autonomously”

Table 6.4(a) (Appendix 1) shows a full list of all the generic competence gaps for these countries. Table 6.4(a) in Appendix 1 shows the gap in the generic competences by country where sufficient responses to be meaningful are available.

6.4 Employer perception of language competence development All employers were asked to indicate their perception of the level of importance and level of development of written and spoken ability in each of the European languages except for their native language. Each answer (4 per language) is to a 4 point scale the same as for the generic and specific competences. As is the case for students, employers rated the English language as being the most important and the most developed. German, Spanish, Bulgarian and French were the next most popular set of languages, but all have means indicating importance and development less than “weak”. Table 6.5 Shows the overall mean of all four questions for the English language for all employers and by academic level Ability in English language Importance of written Importance of spoken Level of development of written Level of development of spoken

All employers 3.46 3.54 2.91 2.95

Bachelor level 3.37 3.50 2.97 2.89

Master level 3.55 3.61 2.87 3.00

Table 6.5 shows that written and spoken English ability is rated as more important for Master than Bachelor level students. The level of development of written and spoken English is less than rated importance at both levels.

6.5 Employer perception of specific competence development For a set of 28 specific competences employers were asked to rate how important they feel each is for the work for which they are completing the questionnaire and the level to which the competence is being developed by the study programme of their graduate employees. Both questions are answered to a 4 point Likert scale where 1 indicates “none”; 2 indicates “weak”; 3 indicates “considerable”; and 4 indicates “strong”. An analysis of the responses to each question in isolation indicates the perceived value of each specific competence and in its level of development. An analysis of the difference between the rating of these questions for each competence indicates the gap between value and level of development and hence how well the employer perceives the match of their degree programme to need.

EIE Surveyor Final Report

40

Tuning methodology in EIE

6.5.1 Employer perception of importance of the specific competences Table 6.6 shows, in descending order of magnitude, the top and bottom 5 mean importance of all the specific competences for all employers and by academic level. Recall that 4 is the highest score (indicating “strong”). Note that the lowest ranked competence for all employers has a mean of 2.78, which is close to “considerable” – hence no specific competence is really considered low in importance. A full version of this table can be found in Appendix 1. Table 6.6 Employer perception of importance of the specific competences by academic level Ran k 1 2 3 4 5 … 24 25 26

27

28

Specific competence Ability to demonstrate awareness of quality issues Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process Ability to demonstrate understanding of the use of technical literature and other information sources Ability to work in a group on a major project Ability to apply a systems approach to engineering problems Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues Ability to demonstrate awareness of the nature of intellectual property and contractual issues

All 3.34

Bachelor 3.44

Master 3.23

3.28

3.33

3.2

3.27 3.25 3.24

3.47 3.36 3.31

3.03 3.13 3.13

2.91

3

2.8

2.9

2.97

2.8

2.87

2.81

2.93

2.79

2.72

2.87

2.76

2.83

2.67

The top 5 important specific competences are very general in nature. Top is “Ability to demonstrate awareness of quality issues” which aligns well with employers rating of “Concern for quality” in the generic competences. The more general applied technical competences of “Developing practical engineering skills”, “demonstrate knowledge and understanding of scientific facts, concepts, etc.”, etc. are all in the upper middle of the ranked order. The bottom of the list is again populated with the more commercial and entrepreneurial competences. The overall order of the ranking does not vary very much between the Bachelor and Master levels.

6.5.2 Employer perception of level of development of the specific competences Table 6.7 shows, in descending order of magnitude, the top and bottom 5 mean level of development for the specific competences for all employees and by academic level for which they answered the questionnaire. The lowest ranked competence has a mean of 2.22, between “weak” and “considerable”. A full version of the table is shown in Appendix 1. The top 5 competences in Table 6.7 are the fundamental engineering competences and it is encouraging to see employers recognise that these are the most well developed of all the specific competences. The top 5 also do not vary very significantly between academic levels. The bottom 5 are again the more commercial and entrepreneurial competences so there is a feel of alignment between importance and level of development. The actual alignment is considered in detail in the next subsection.

EIE Surveyor Final Report

41

Tuning methodology in EIE

Table 6.7 Employer perception of level of development of the specific competences by academic level Rank 1 2

3

4 5 … 24 25 26 27 28

Specific competences Ability to demonstrate understanding of the use of technical literature and other information sources Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline Ability to demonstrate practical engineering skills Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development Ability to manage the design process and evaluate outcomes Ability to demonstrate awareness of the nature of intellectual property and contractual issues Ability to identify and manage cost drivers in designs and projects Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

All

Bachelor

Master

3.01

3.19

2.8

2.9

2.83

2.97

2.87

2.97

2.73

2.82 2.78

2.92 2.94

2.7 2.57

2.33 2.31

2.44 2.47

2.17 2.1

2.3 2.22

2.36 2.36

2.2 2.03

2.22

2.33

2.07

6.5.3 Employer perception of level of ‘gap in the specific competences As in the case of the generic competences the top and bottom 5 ‘gap’ analysis is shown in Table 6.8 for all employers and by academic level. A full version of this table can be found in Appendix 1. Table 6.8 Comparison of mean difference between rated importance and level of development of the specific competences for all employers and by level of study. Rank 1 2 3 4 5 … 24

25 26

27 28

Specific competence Ability to identify and manage cost drivers in designs and projects Ability to demonstrate awareness of quality issues Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process Ability to demonstrate understanding of appropriate codes of practice and industry standards Ability to manage the design process and evaluate outcomes Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline Ability to demonstrate understanding of the use of technical literature and other information sources Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline

EIE Surveyor Final Report

42

All 0.91 0.7

Bachelor 0.83 0.78

Master 1.03 0.63

0.69

0.67

0.73

0.69 0.64

0.72 0.69

0.67 0.6

0.34

0.39

0.3

0.34

0.36

0.33

0.33

0.47

0.17

0.25

0.28

0.23

0.18

0.25

0.1

Tuning methodology in EIE

The top gap in the specific competences for employees is the same as that for academics, namely “Ability to identify and manage cost drivers in designs and projects”. This is top for both Bachelor and Master level students. “Awareness of quality issues” is second which aligns well with the gap in the generic competences where quality also featured strongly. At the bottom of the table are the fundamentals of the EIE discipline which appear to be being developed appropriately for their rated importance for employers. As was the case in the generic competences, there is variation in the way employers in different countries rate the gap between importance and level of development of the specific competences. The top ranked gap is: •

Bulgaria and Ireland: “Ability to identify and manage cost drivers in designs and projects”



France: “Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement.”



Germany: “Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline”



Slovak Republic “Ability to apply a systems approach to engineering problems.”

Table 6.9 (Appendix 1) shows a full list of all the specific competence gaps for these countries.

EIE Surveyor Final Report

43

Tuning methodology in EIE

EIE Surveyor Final Report

44

Tuning methodology in EIE

7. The graduate view 7.1 Introduction This section looks in detail at the graduate responses to the survey. Reference should be made to the constitution of the graduates who have responded in Section 3 of this report. Of particular interest is how graduates feel that Higher Education Institutions has prepared them for employment as well as the usual set of questions relating to the importance and level of development of the generic, specific and language competences. These aspects are all considered in turn in this section.

7.2 Graduate perception of preparation for employment In response to the question “Do you consider that University has given you adequate preparation for working in this work area in your company?” the overall mean response is 2.19 for all graduates who responded. Table 7.1 shows how this varies between gender and study level. Table 7.1 Mean preparedness for work for graduates by gender and study level Male Female

Bachelor 2.31 2.59

Master 2.16 1.94

The difference between Master and Bachelor levels for females is statistically significant and interestingly females consider they are less prepared for work at Bachelor level but more at Master level than their male peers. Note that the scale is 1 to 5 with 1 being “very much” and 5 “very little”. A breakdown of the mean response by country is shown in Table 7.2 for the countries where there are sufficient responses to make the result meaningful. Table 7.2 in Appendix 1 shows the corresponding numerical data. The figure shows considerable variation across the countries with Bulgarian and Irish graduates feeling very prepared whereas Polish and Spanish less so. Figure 7.2 Mean perception of preparedness for employment of graduates by country 2.8 2.6 2.4 2.2 2 1.8 1.6 1.4 1.2 1 Bulgaria

Greece

Ireland

Poland

Portugal

Slovak Republic

Spain

Turkey

7.3 Graduate perception of generic competence development For a set of 32 generic competences graduates were asked to rate how important they feel each is to the work they expect to do and on the level to which the competence was developed in the academic programme they undertook. Both questions are answered to a 4 point Likert scale where 1 indicates “none”; EIE Surveyor Final Report

45

Tuning methodology in EIE

2 indicates “weak”; 3 indicates “considerable”; and 4 indicates “strong”. An analysis of the responses to each question in isolation indicates the perceived value of each generic competence and in its level of development. An analysis of the difference between the rating of these questions for each competence indicates the gap between value and level of development and hence how well the graduate perceives the match of their degree programme to their need as defined by their current work 5.

7.3.1 Graduate perception of importance of the generic competences Table 7.3 shows the mean of the importance of the generic competences for all employers and for the two main levels of study for which they completed the questionnaire. A full version of this table is shown in Appendix 1. Table 7.3 Mean of importance of the generic competences for all graduates and by level of study Rank 1 2 3 4 5 … 28 29 30 31 32

Generic competence Problem solving Capacity for applying knowledge in practice Elementary computing skills Capacity for analysis and synthesis Capacity to learn

All 3.59 3.53 3.51 3.49 3.48

Bachelor 3.71 3.6 3.59 3.58 3.59

Master 3.53 3.49 3.47 3.45 3.42

International Relations and Collaborations Patents and Intellectual Property Rights Appreciation of ethical issues Appreciation of diversity and multiculturality Understanding of cultures and customs of other countries

2.9 2.8 2.68 2.67 2.43

2.88 2.73 2.64 2.62 2.39

2.92 2.83 2.72 2.71 2.47

In line with both students and employers, graduates rate “Problem solving” as the most important generic competence at both Bachelor and Masters levels. The general order of the competences is also very similar between levels as was for the case of students and employers with multinational and entrepreneurial competences well down in the importance ranking. Table 7.3(a) shows that there is also general agreement between the rankings of graduates form the analysed countries. Finally there is generally good agreement between the weighted ranking of the generic competences and the means for the 1..4 response questions. Table 7.4 in Appendix 1 shows the weighted ranking able for all graduates and by academic level.

7.3.2 Graduate perception of level of development of the generic competences Table 7.5 shows, in descending order of magnitude, the mean level of development of all the generic competences for all employers and by academic level. A full version of this table is shown in Appendix 1. There is generally good agreement between the level of development and the ranked importance. Graduates on average across all countries therefore feel their academic programmes have met their needs. Table 7.5(a) (Appendix 1) shows the table for all countries and also shows thag this view is held in each of the analysed countries.

5

The assumption here is that rating of importance is based on personal need.

EIE Surveyor Final Report

46

Tuning methodology in EIE

Table 7.5 Graduate view of mean level of development for the generic competences by academic level Rank 1 2 3 4 5 … 28 29 30 31 32

Generic competence Elementary computing skills Capacity to learn Problem solving Capacity for analysis and synthesis Teamworking

All 3.32 3.19 3.15 3.12 3.08

Bachelor 3.34 3.21 3.07 3.07 2.95

Master 3.32 3.18 3.15 3.13 3.12

Appreciation of diversity and multiculturality Leadership Patents and Intellectual Property Rights International Relations and Collaborations Understanding of cultures and customs of other countries

2.35 2.33 2.31 2.3 2.07

2.27 2.24 2.18 2.16 1.92

2.4 2.38 2.39 2.38 2.14

7.3.3 Graduate perception of ‘gap in the generic competences As in the case of the generic competences, a top and bottom 5 ‘gap’ analysis is shown in Table 7.6 (Appendix 1). The top 5 generic competences for the Bachelor level are: 1 2 3 4 5

Ability to work in an international context Planning and time management Ability to communicate with non-experts (in the field) Leadership Capacity for generating new ideas (creativity)

For the Masters level they are: 1 2 3 4 5

Ability to work in an international context Knowledge of a second language Planning and time management Capacity for generating new ideas (creativity) International Relations and Collaborations

There is variation in the way graduates in different countries rate the gap between importance and level of development of the generic competences. The top ranked gap is: •

Bulgaria: “Planning and time management”



Greece: “Capacity to adapt to new situations”



Ireland: “Ability to work in an interdisciplinary team”



Poland: “Capacity for applying knowledge in practice”



Slovak Republic and Spain: “Knowledge of a second language”



Turkey: “Ability to work in an international context”

Table 7.6(a) (Appendix 1) shows a full list of all the generic competence gaps for these countries.

7.4 Graduate perception of language competence development All employers were asked to indicate their perception of the level of importance and level of development of written and spoken ability in each of the European languages except for their native language. Each answer (4 per language) is to a 4 point scale the same as for the generic and specific competences. As is the case for students, employers rated the English language as being the most important and the most developed all other languages have means indicating importance and development less than “weak”. Table

EIE Surveyor Final Report

47

Tuning methodology in EIE

7.7 shows that English is rated more important than the level of development at both study levels and very little difference between the levels. Table 7.7 Shows the overall mean of all four questions for the English language for all graduates and by academic level Ability in English language Importance of written Importance of spoken Level of development of written Level of development of spoken

All graduate 3.48 3.43 2.81 2.72

Bachelor level 3.53 3.42 2.81 2.64

Master level 3.45 3.41 2.81 2.76

7.5 Graduate perception of specific competence development For a set of 28 specific competences graduates were asked to rate how important they feel each is for the work for which they are completing the questionnaire and the level to which the competence is being developed by their study programme. Both questions are answered to a 4 point Likert scale where 1 indicates “none”; 2 indicates “weak”; 3 indicates “considerable”; and 4 indicates “strong”. An analysis of the responses to each question in isolation indicates the perceived value of each specific competence and in its level of development. An analysis of the difference between the rating of these questions for each competence indicates the gap between value and level of development and hence how well the employer perceives the match of their degree programme to need.

7.5.1 Graduate perception of importance of the specific competences Table 7.8 shows, in descending order of magnitude, the mean importance of all the specific competences for all employers and by academic level. Recall that 4 is the highest score (indicating “strong”). Note that the lowest ranked competence for all employers has a mean of 2.61, which is close to “considerable” – hence no specific competence is really considered low in importance. Table 7.8 Graduate perception of importance of the specific competences by academic level Ran k 1

2 3 4 5 … 24 25 26

27 28

Specific competence Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems Ability to work in a group on a major project Ability to demonstrate understanding of the use of technical literature and other information sources Ability to demonstrate practical engineering skills Ability to demonstrate knowledge and understanding of the commercial and economic context Ability to demonstrate awareness of the nature of intellectual property and contractual issues Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

EIE Surveyor Final Report

48

All

Bachelor

Master

3.34

3.36

3.35

3.33 3.33

3.35 3.29

3.34 3.35

3.23 3.15

3.15 3.14

3.28 3.18

2.78

2.72

2.81

2.78

2.66

2.81

2.74

2.76

2.73

2.7

2.67

2.72

2.61

2.53

2.68

Tuning methodology in EIE

There is general agreement on the ranking of the specific competences between the academic levels (Table 7.8) and between countries (Table 7.8(a) Appendix 1). In all cases core engineering competences are towards the top and entrepreneurial, multicultural and the more wider business competences towards the bottom.

7.5.2 Graduate perception of level of development of the specific competences Table 7.9 shows, in descending order of magnitude, the top and bottom 5 mean level of development for the specific competences for all graduates and by academic level for which they answered the questionnaire. The lowest ranked competence has a mean of 2.16, between “weak” and “considerable”. A full version of the table is shown in Appendix 1. Table 7.9 Graduate perception of level of development of the specific competences by academic level Rank 1

2 3 4 5 … 24 25 26

27

28

Specific competences Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems Ability to demonstrate understanding of the use of technical literature and other information sources Ability to work in a group on a major project Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development Ability to identify and manage cost drivers in designs and projects Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

All

Bachelor

Master

3.16

3.05

3.23

3.09

3.07

3.13

3.02

3.04

3.04

2.93 2.9

2.85 2.72

3.02 3

2.32 2.3

2.15 2.12

2.41 2.38

2.28

2.19

2.33

2.25

2.07

2.31

2.16

2.04

2.22

Table 7.9 shows similarity with the ranked importance in Table 7.8 with core engineering competences considered to be the best developed. As before the next subsection considers the gap in more detail.

7.5.3 Graduate perception of level of ‘gap in the specific competences As in the case of the generic competences the top and bottom 5 ‘gap’ analysis is shown in Table 7.10 for all employers and by academic level. A full version of this table can be found in Appendix 1. The top ranked gap for graduates, “Ability to identify and manage cost drivers in designs and projects”, is the same as for employers and academics, a generally good alignment therefore exists at the very top. There is, however variation in the next few.

EIE Surveyor Final Report

49

Tuning methodology in EIE

Table 7.10 Comparison of mean difference between rated importance and level of development of the specific competences for all graduates and by level of study. Rank 1 2 3 4

5

… 24

Specific competence Ability to identify and manage cost drivers in designs and projects Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering Ability to demonstrate understanding of the use of technical literature and other information sources Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline

25 26 27

28

All 0.61

Bachelor 0.76

Master 0.53

0.55

0.69

0.46

0.52

0.64

0.45

0.51

0.68

0.45

0.48

0.69

0.42

0.3

0.34

0.29

0.29

0.31

0.26

0.22

0.29

0.23

0.18 0.02

0.32

0.12

0.04

-0.06

As was the case in the generic competences, there is variation in the way graduates in different countries rate the gap between importance and level of development of the specific competences. The top ranked gap is: •

Bulgaria and Turkey: “Ability to identify and manage cost drivers in designs and projects”



Greece: “Ability to identify and manage cost drivers in designs and projects” , “Ability to manage the design process and evaluate outcomes” (equal top)



Ireland: “Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process”



Poland: “Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement”



Slovak Republic “Ability to work in a group on a major project”



Spain: “Ability to demonstrate knowledge and understanding of the commercial and economic context”

Table 7.10(a) (Appendix 1) shows a full list of all the specific competence gaps for these countries.

EIE Surveyor Final Report

50

Tuning methodology in EIE

8. The supply demand balance 8.1 Introduction This section considers all the results and the analyses in the previous 4 sections to look in detail at the overall supply demand balance within the EIE discipline. The balance can be looked at in a number of different ways, by graduate level, by country or by type of type of competence. The approach adopted in this report is to look at the study level followed by competence type. A review by a small number of the countries is given where there are sufficient responses to make such a review meaningful.

8.2 The Bachelor level supply demand balance 8.2.1 General perception of preparedness for employment Table 8.1 shows the mean overall responses to the question about whether the academic programme is or has prepared the student for employment. For students and academics this question is aimed at employment after graduation, for graduates and employers actual employment. Table 8.1 General perception of preparedness for employment – overall means

Student

Male

Female

All

2.52

2.58

2.53

Academic

2.19

Employer

2.26

graduate

2.31

2.59

2.37

From Table 8.1 it can be seen that academics are over-rating (mean = 2.19) their view of how well they are preparing Bachelor level students for employment relative to the employers (mean = 2.26). Students on the other hand, are under-rating their level of preparation (mean = 2.53) relative to employers. Males typically rate their preparation as being better than females. Graduates also under-rate their preparation for employment (mean = 2.37) relative to employers but not by as much as students still studying. This perhaps suggests they have had time after graduating to realise that their programme prepared them more than they expected as students. Table 8.2 shows a country analysis where there is sufficient numbers of responses to allow a comparative analysis. Table 8.2 General perception of preparedness for employment – overall means Country

Students

Employers

Graduates

Male

Female

Bulgaria

2.40

2.57

2.00

France

2.62

2.57

2.90

Greece

3.03

2.76

Ireland

2.24

1.60

1.50

1.70

Italy

2.85

2.50

3.00

2.57

Spain

2.71

2.87

2.33

2.45

Turkey

2.54

2.59

2.00

2.63

EIE Surveyor Final Report

51

3.50 2.29

Tuning methodology in EIE

From an individual country perspective students from France and Italy think they are better prepared for employment than the employers in their own country. French graduates, on the other hand, rate themselves less prepared for employment then French employers. In all other countries (Bulgaria, Ireland, Spain and Turkey) students under-rate their preparation compared to employers.

8.2.2 The generic competences Top of the list for importance of the generic competences for all four stakeholders is “Problem solving” (Table 4.5). The mean importance for bachelor level students is 3.43 while for academics it is 3.58, for employers 3.54 and for graduates 3.71. Student and graduate males tend to rate the importance more than females. Given the scale is 1 is weak and 4 strong, students are slightly under rating the importance of problem solving and academics slightly over rating it but the differences are not large enough to be of concern. Students rate the level of development of their problem solving competence at a mean of 2.89 while academics rate it at 2.97, employers 2.90 and graduates 3.07. Again there is good alignment between all stakeholders in the level of development of this competence. Table 8.3 (Appendix 1) shows a comparison of the mean of the generic competences across all stakeholder groups at the Bachelor level. All students in general rank “Elementary computing skills” the second most important competence (Table 4.5). Both academics and employers rate this with a mean of 3.71. Comparatively students underrate the importance with a mean of 3.44. A possible explanation for this is that students tend to take elementary computing skills for granted. They also under rate the level of development (mean, male = 3.13, female = 3.19) compared to employers. Four generic competences stand out as having a large difference between academics mean and the employers mean. The largest difference is in “Knowledge of a second language” (Academic mean = 3.15, Employer mean = 2.56). The others are “Critical and self-critical abilities” (Academic mean = 3.23, Employer mean = 2.85), “International relations and collaborations” (Academic mean = 2.83, Employer mean = 2.46), “Leadership” (Academic mean = 2.96, Employer mean = 2.59) and “Project design and management” (Academic mean = 3.38, Employer mean = 3.02). In all cases academics rate the competence as more important than employers. It is perhaps important to restate that the employers who engaged in this survey are mostly from large organisations and this perhaps explains these differences – large employers can afford to recruit graduates into specific, often technical, roles. The difference between students and employers rating of importance varies even more widely with “Knowledge of a second language” being the greatest difference where students over-rate importance. Next over rated (relative to employers) is “International relations and collaborations” and then “Leadership”. At the other end of the difference range is “Oral and written communications in native language” (student mean = 3.09, employer mean = 3.46), “Elementary computing skills” and “Appreciation of ethical issues” (student mean = 2.7, employer mean = 2.98). In these later cases the students over rate the importance of the competence relative to employers. Table 6.1 shows the ranking of importance for employers. It is clear from the table that the responding employers are prioritising the competences of hands on technical activity work as most important and the general wider competences of business, internationalisation and entrepreneurialism as least. This would support the argument that the employers in this survey are, in the main looking for recruits to fill technical positions. Students rank the importance of the generic competences subtly differently and appear to be indicating a broader competence base. To understand this in a different way a factor analysis of the generic competences was carried out to ‘group’ them. The 32 generic competences can be put into 5 groups: Group 1: “Internationalisation” 1. 2. 3. 4. 5.

Understanding of cultures and customs of other countries. Appreciation of ethical issues. Appreciation of diversity and multiculturality International relations and collaborations Ability to work in an international context

EIE Surveyor Final Report

52

Tuning methodology in EIE

Group 2: “Entrepreneurship” 1. 2. 3.

Patents and IPR. Creativity Initiative and entrepreneurial spirit

Group 3: “Professional skills” 1. 2. 3. 4. 5.

Grounding in basic knowledge of the profession Basic general technical knowledge Capacity for analysis and synthesis Research skills Capacity to learn

Group 4: “Interpersonal skills” 1. 2. 3. 4. 5. 6.

Leadership Interpersonal skills Ability to communicate with non-experts Oral and written communications in native language Critical and self-critical capability teamworking

Group 5: “Personal skills” 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11.

Ability to work autonomously Problem solving Capacity to adapt to new situations Knowledge of a second language Concern for quality Will to succeed Elementary computing skills Capacity for applying knowledge in practice Decision making Project design and management Information management skills

Table 8.4 shows the mean of each generic competence group for each stakeholder group. For the employers the personal skills are the most importance group followed by professional skills and interpersonal skills. The table confirms that employers rank internationalisation and entrepreneurship lowest. Academics agree with the order of the competence groups but rate all of them more strongly important than employers. Students also rank the competence groups in the same order but rate internationalisation slightly higher than employers and entrepreneurship very slightly lower. Table 8.4 Mean of the importance of each generic competence group by stakeholder group Generic competence group Internationalization (Importance) Entrepreneurship (importance) Interpersonal skills (importance) Professional skills (importance) Personal skills (importance)

Academic 2.86 3.07 3.23 3.36 3.44

Employer 2.63 3.05 3.09 3.29 3.30

Graduate 2.73 3.04 3.17 3.39 3.39

Student 2.79 3.02 3.06 3.13 3.29

Table 8.5 in Appendix 1 shows the comparison of the level of development of all the individual generic competences across the stakeholder groups and Table 8.6 shows the mean of the level of development of each of the generic competence groups.

EIE Surveyor Final Report

53

Tuning methodology in EIE

Table 8.6 Mean of the level of development of each generic competence group by stakeholder group Generic competence group Internationalization (Development) Entrepreneurship (Development) Interpersonal skills (Development) Professional skills (Development) Personal skills (Development)

Academic 2.42 2.45 2.67 3.08 2.90

Employer 2.39 2.50 2.64 3.00 2.86

Graduate 2.19 2.42 2.58 2.99 2.82

Student 2.24 2.39 2.51 2.76 2.75

Table 8.6 shows that there is good agreement that Professional skills are the best developed of the skill groups followed by Personal skills and Interpersonal skills. As with importance the Entrepreneurship and Internationalisation skill groups are developed the least. There is clearly a difference between the rated importance and level of development of these groups in that the Personal skills group is rated most important but the Professional skills group is developed the most. Other than that the general structure of the supply demand balance of the generic competences is quite well aligned. At the detail level “Elementary computing skills” is rated highest in level of development by employers (Table 8.5 Appendix 1) with a mean of 3.61. Students (mean = 3.13) rate the level of development of this competence substantially lower. Academics (mean = 3.48) are more in line with the employers view. Academics differ in their perception of level of development most from employers in “International relations and collaborations”. The Academics (mean = 2.41) is substantially greater than employers (mean = 2.12), students are in the middle (mean = 2.31). So whilst no stakeholder group considers it to be an important competence academics do feel they develop it more than students and employers. Of more importance is “Project design and management” which is similarly rated higher in level of development by academics (mean = 2.88) than employers (mean = 2.63). In this competence students are in agreement with employers on the level of development. Why then do academics consider they develop the competence more than students and employers? Graduates (mean = 2.26) also support the over rating view of academics. At the other end of the range academics rate the level of development of “Oral and written communications in your native language” (mean = 2.83) lower than employers (mean = 3.10). Unfortunately students rate the level of development even lower (mean = 2.68) Academic can take some comfort in this outcome. Similarly other competences where academics rate the level of development lower than employers include “Ability to communicate with non-experts”, “Appreciation of ethical issues”, “Initiative and entrepreneurial spirit” and “Will to succeed”. Students can take comfort in the result that shows employers rate the level of development of a number of competences more strongly than they do. Amongst these are “Elementary computing skills”, “Grounding in basic knowledge of the profession of your work area”, “Appreciation of ethical issues” and “Capacity for analysis and synthesis”. Turning now to the gap analysis. Table 8.7 (Appendix 1) shows the comparison of the gap of all the individual generic competences across the stakeholder groups. The largest gaps between rated importance and level of development for employers are (in decreasing magnitude order): 1. 2. 3. 4. 5. 6.

Teamworking Concern for quality Capacity for generating new ideas (creativity) Problem solving Decision making Planning and time management

In contrast to this list both academics and students feel that “Knowledge of a second language” has the largest difference between rated importance and level of development.

EIE Surveyor Final Report

54

Tuning methodology in EIE

8.2.3 The language competences As has already been shown the English language is the only language that merits further analysis by all stakeholder groups. Table 8.8 shows the stakeholder views on the English language at the Bachelor level. Table 8.8 Stakeholder views on the English language Importance of written Importance of spoken Level of development of written Level of development of spoken

Academic 3.63 3.59 2.77 2.75

Employer 3.37 3.50 2.97 2.89

Graduate 3.53 3.42 2.81 2.64

Student 3.35 3.36 2.74 2.69

Table 8.8 shows that students and employers value the importance of written ability in English lower than academics and graduates. Employers consider ability in spoken English to be more important. Academics feel both written and spoken English is an important capability in their Bachelor level students a finding which aligns with the higher rating of importance of the internationalisation generic competence group. Students appear to be under-rating their perception of the importance and level of development of their English ability. It is worth noting that academics consider written English to be more important than spoken English whereas it is the other way round for employers. This may be a result of the specific needs of the majority employer group in this survey (large organisations). Overall These results suggests that the importance of both written and spoken English could be usefully increased in students to be more in line with needs.

8.2.4 The specific competences Table 8.9 (Appendix 1) shows the mean importance of each specific competence for all four stakeholders at the Bachelor level. The table shows that employers rate the most importance specific competence as “Ability to demonstrate understanding of the use of technical literature and other information sources” (mean = 3.47). Academics rank this 7th in their priority list (mean = 3.33) and students 10th (mean = 2.99). These results show that both academics and in particular students are under-rating the importance of this competence to employers. The second most important specific competence for employers is “Ability to demonstrate awareness of quality issues” (mean = 3.44). This aligns well with the importance of concern for quality as indicated in the generic competences list for employers. Academics rank this 8th (mean = 3.33) and students 21st (mean = 2.85). Here again students and to a lesser extent academics are under-rating the importance of this competence for employers. In all but one of the specific competences (“Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues”) students are under-rating their importance relative to employers. This could be a result of employers generally rating higher than students although calculating the average of all the means for each stakeholder group shows the highest average to be academics (3.18) followed by employers (3.17) then students (2.96) and graduates (2.95). From this employers and academics are rating competences higher than students and graduates on average. Even taking this difference in average rating into account does not change the above conclusions. Considering the difference between the mean for employers and students the largest difference is in “Ability to demonstrate awareness of quality issues” followed by “Ability to demonstrate understanding of the use of technical literature and other information sources”. As shown above these are also the top 2 most important competences for employers so this is an important outcome and it suggests effort needs to be directed to increasing student awareness of the importance of these competences of future employment. Table 8.10 (Appendix 1) shows the mean level of development of each specific competence for all four stakeholders at the Bachelor level. Employers rate “Ability to demonstrate understanding of the use of technical literature and other information sources” (mean = 3.19) as the most developed competence as they

EIE Surveyor Final Report

55

Tuning methodology in EIE

do its importance. This is an encouraging outcome from a supply demand balance viewpoint. Academics rank this competence lower in 6th position (mean = 2.97) and students 8th (mean = 2.61). As with the rating of importance, employers and academics typically score the competences higher than students and graduates. Even allowing for the differences in mean responses across the stakeholder groups there are still differences in the mean rating of level of development. The largest differences between academics and employers are in: •

Ability to demonstrate understanding of the use of technical literature and other information sources



Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering



Ability to demonstrate understanding of appropriate codes of practice and industry standards



Ability to demonstrate awareness of the nature of intellectual property and contractual issues



Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal

where employers rate the level of development higher than academics and: •

Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques



Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline



Ability to work in a group on a major project

where academics rate the level of development higher than employers. It is perhaps in this later group where a useful result emerges. In a similar comparison between students and employers, employers rate the development of the following competences higher than students: •

Ability to demonstrate understanding of the use of technical literature and other information sources



Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering



Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal



Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.)



Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs



Ability to demonstrate knowledge and understanding of the commercial and economic context



Ability to demonstrate practical engineering skills

and students over rate the following competences compared to employers: •

Ability to apply a systems approach to engineering problems



Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement



Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline



Ability to identify and manage cost drivers in designs and projects

EIE Surveyor Final Report

56

Tuning methodology in EIE



Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues



Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques

Work can be done in enhancing the development of those competences where the employer rates the level of development lower than the students as these represent a shortfall in need from the demand side of the supply demand balance. Considering the gap between rated importance and level of development for each competence, Table 8.11 (Appendix 1) shows the gap for all stakeholders. For employers the largest gaps are in: •

Ability to identify and manage cost drivers in designs and projects



Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques



Ability to demonstrate awareness of quality issues



Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement



Ability to demonstrate understanding of appropriate codes of practice and industry standards



Ability to manage the design process and evaluate outcomes

All gaps indicate that employers rate the competence more importantly than they rate the level of development. As shown in Table 8.11 all the specific competence gaps are positive indicating employers consider all m ore important than they are developed. In all cases therefore, there is a gap that could be usefully reduced. Academics see the gap subtly differently to employers with the following as top of their gap list: •

Ability to demonstrate understanding of appropriate codes of practice and industry standards



Ability to identify and manage cost drivers in designs and projects



Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues



Ability to demonstrate awareness of the nature of intellectual property and contractual issues



Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering

Students again see the gap differently, their top list is: •

Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process



Ability to identify and manage cost drivers in designs and projects



Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs



Ability to work in a group on a major project



Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development

These differences may be accounted for in the differing expectations of the type of employment expected of the stakeholders. In all cases though there exist gaps in the supply demand balance, which could usefully be narrowed. Table 8.11 provides the information to enable the important gaps to be identified for each stakeholder group and hence where the focus of attention should be for curriculum changes.

EIE Surveyor Final Report

57

Tuning methodology in EIE

8.3 The Masters level supply demand balance 8.3.1 General perception of preparedness for employment Table 8.12 shows the mean overall responses to the question about whether the academic programme is or has prepared the student for employment. For students and academics this question is aimed at employment after graduation, for graduates and employers actual employment. Table 8.12 General perception of preparedness for employment – overall means

Student

Male

Female

All

2.52

2.44

2.51

Academic

1.88

Employer

2.22

Graduate

2.16

1.94

From Table 8.12 it can be seen that academics are over-rating (mean = 1.88) their view of how well they are preparing Master level students for employment relative to the employers (mean = 2.22). Students on the other hand, are under-rating their level of preparation (mean = 2.51) relative to employers. Males typically rate their preparation as being lower than females. Graduates also over-rate their preparation for employment relative to employers.

8.3.2 The generic competences Table 8.13 (Appendix 1) shows the importance of the generic competences for all four stakeholders at the Masters level. Top of the rated list for employers is “Teamworking” followed by “Problem solving”, “Concern for quality” and “Capacity for applying knowledge in practice”. As at the Bachelor level employers have, on average, rated the importance of generic competences higher than the other three stakeholders. Even taking this difference into account neither students nor academics rate “Teamworking” as highly as employers. This suggests a difference in the perception of need for this competence in employment. A more general look at Table 8.13 reveals a number of competences where students under-rate its importance relative to employers, these include: •

Concern for quality



Oral and written communications in native language



Appreciation of ethical issues



Capacity to learn



Basic general technical knowledge of the profession of your work area



Capacity for applying knowledge in practice



These are all areas where a greater emphasis could be placed in the academic programme.

Table 8.14 (Appendix 1) shows the level of development of the generic competences for all four stakeholders at the Masters level. A look at the average of all the means for each stakeholder groups shows that for level of development students over-rate the level of development compared to employers whereas they under rate the importance of generic competences. Academics underrate both importance and level of development and are hence less positive in both respects. On the basis of this academics can be more positive in their views of both the importance and their level of development in the generic competences in their academic programmes. Table 8.14 shows that employers consider a number of competences to be being developed greater than students rate them as being, these include: •

Oral and written communication in your native language

EIE Surveyor Final Report

58

Tuning methodology in EIE



Understanding of cultures and customs of other countries



Appreciation of diversity and multiculturality



Ability to work in an international context



Appreciation of ethical issues

Students can be more confident in these competences. However, there are also competences in which employers do not rate the level of development as high as students, in these students may be over confident in their ability, the most significant of these are: •

Ability to work autonomously



Planning and time management



Decision making



Leadership



Project design and management



Patents and Intellectual Property Rights

An analysis of the generic competences by group (see section 8.2.2) is also considered to show how the importance varies between stakeholders. Table 8.15 shows the mean of the rated importance of each generic competence group for each stakeholder group and Table 8.16 the level of development. Table 8.15 Mean of the importance of each generic competence group by stakeholder group Generic competence group Internationalization (Importance) Entrepreneurship (importance) Interpersonal skills (importance) Professional skills (importance) Personal skills (importance)

Academic 2.66 2.96 3.04 3.36 3.36

Employer 2.94 3.06 3.26 3.31 3.47

Graduate 2.78 3.00 3.04 3.28 3.32

Student 2.89 3.15 3.14 3.19 3.41

As was the case at the Bachelor level, for employers the personal skills are the most importance group followed by professional skills and interpersonal skills. The table confirms that employers rank internationalisation and entrepreneurship lowest. Academics agree with the order of the competence groups. Students rank entrepreneurship slightly higher than interpersonal skills which may be a reflection of the type of employment graduates has or their difficulties in gaining employment and an attendant desire to look to entrepreneurship as a route for the future. Table 8.16 Mean of the level of development of each generic competence group by stakeholder group Generic competence group Internationalization (Development) Entrepreneurship (Development) Interpersonal skills (Development) Professional skills (Development) Personal skills (Development)

Academic 2.30 2.35 2.49 2.92 2.84

Employer 2.49 2.49 2.68 2.85 2.82

Graduate 2.35 2.49 2.68 3.03 2.94

Student 2.32 2.55 2.64 2.89 2.89

Table 8.6 shows that there is good agreement that Professional skills are the best developed of the skill groups followed by Personal skills and Interpersonal skills. As with importance the Entrepreneurship and Internationalisation skill groups are developed the least. There is clearly a difference between the rated importance and level of development of these groups in that the Personal skills group is rated most

EIE Surveyor Final Report

59

Tuning methodology in EIE

important but the Professional skills group is developed the most. Other than that the general structure of the supply demand balance of the generic competences is quite well aligned. Turning now to the gap analysis. Table 8.17 (Appendix 1) shows the comparison of the gap of all the individual generic competences across the stakeholder groups. The largest gaps between rated importance and level of development for employers are (in decreasing magnitude order): •

Concern for quality



Planning and time management



Capacity for applying knowledge in practice



Capacity to adapt to new situations



Problem solving



Ability to work autonomously

As with the importance, all the gaps are positive indicating that the level of development is below the rated importance of each competence. The gaps are also large, all being greater than 0.75 on a 0 to 3 range. In contrast to this list academics rank the following as the top 5 gaps: •

Ability to work in an interdisciplinary team



Knowledge of a second language



Initiative and entrepreneurial spirit



Oral and written communication in your native language



Concern for quality

While students top five is: •

Knowledge of a second language



Ability to work in an international context



Capacity for generating new ideas (creativity)



Capacity for applying knowledge in practice



International Relations and Collaborations

These lists clearly show very different perceptions at the Masters level. A possible explanation for this are the different paths Masters level students will take in their future careers. The employers list is focussed on more conventional work activities whereas the student list is more general and international in its content. The academics list is also more general but perhaps more general purpose in the utility of the competences that employers.

8.3.3 The language competences As has already been shown the English language is the only language that merits further analysis by all stakeholder groups. Table 8.18 shows the stakeholder views on the English language at the Masters level. Table 8.18 Stakeholder views on the English language Importance of written Importance of spoken Level of development of written Level of development of spoken

EIE Surveyor Final Report

Academic 3.71 3.63 2.86 2.81

60

Employer 3.55 3.61 2.87 3.00

Graduate 3.45 3.41 2.81 2.76

Student 3.47 3.49 2.70 2.66

Tuning methodology in EIE

Table 8.18 shows that students and employers value the importance of written ability in English lower than academics. Employers consider ability in written English to be more important than spoken, the reverse of the Masters level view. Academics feel both written and spoken English is an important capability in their Masters level students a finding which aligns with the higher rating of importance of the internationalisation generic competence group. Students appear to be under-rating their perception of the importance and level of development of their English ability. It is worth noting that academics consider written English to be more important than spoken English whereas it is the other way round for employers. This may be a result of the specific needs of the majority employer group in this survey (large organisations). As with the case for Bachelor level students, overall these results suggests that the importance of both written and spoken English could be usefully increased in Masters level students to be more in line with needs.

8.3.4 The specific competences Table 8.19 (Appendix 1) shows the mean importance of each specific competence for all four stakeholders at the Masters level. The table shows that employers rate the most importance specific competence as “Ability to demonstrate awareness of quality issues” (mean = 3.23). This aligns well with employers rating of importance in concern for quality as a generic competence. Academics rank this 9th in their priority list but with a higher mean importance (mean = 3.27) and students 25th out of 28 (mean = 2.89). These results show that students are very noticeably under-rating the importance of this competence to employers. The second most important specific competence for employers is “Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process” (mean = 3.20). Academics rank this 17th (mean = 3.06) and students 5th (mean = 3.25). Students rate this competence more important than both employers and academics. A look at the overall mean of the responses within each stakeholder group does, however reveal that academics and students are rating the importance of the specific competences higher than graduates and, in particular, employers. Allowing for this difference reverses the above result and shows students rate “Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process” as less important than do employers. In contrast to “Ability to demonstrate awareness of quality issues” in which employers rate its importance greater than students, students rate a number of competences more important than employers, the larger of these are: •

Ability to manage the design process and evaluate outcomes



Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems



Ability to demonstrate practical engineering skills



Ability to work in a group on a major project



Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline



Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques

Again this difference is possibly explainable by the different expectations of work at the Masters level. Table 8.20 (Appendix 1) shows the mean level of development of each specific competence for all four stakeholders at the Bachelor level. Employers rate “Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline” (mean = 2.97) as the most developed competence. Academics rank this competence lower in 2nd position (mean = 3.01) and students 3rd (mean = 2.96). On average students are rating the development of specific competences higher than both employers and academics. Graduates rate even higher than students. Academics also rate the importance higher than employers. Even allowing for the differences in mean responses across the stakeholder groups there are still

EIE Surveyor Final Report

61

Tuning methodology in EIE

differences in the mean rating of level of development. The largest differences between employers and students are in: •

Ability to manage the design process and evaluate outcomes



Ability to identify and manage cost drivers in designs and projects”



Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.)



Ability to work in a group on a major project



Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline



Ability to demonstrate understanding of appropriate codes of practice and industry standards



Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development



Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products

where employers rate the level of development lower than students and: •

Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement



Ability to demonstrate awareness of quality issues

where employers rate the level of development higher than students. It is in the first group where a useful result emerges and thought at the curriculum development level needs to be given. Work can be done in enhancing the development of those competences where the employer rates the level of development lower than the students as these represent a shortfall in need from the demand side of the supply demand balance. Considering the gap between rated importance and level of development for each competence, Table 8.21 (Appendix 1) shows the gap for all stakeholders. For employers the largest gaps are in: •

Ability to identify and manage cost drivers in designs and projects



Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues



Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.)



Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process



Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products

All gaps indicate that employers rate the competence more importantly than they rate the level of development. As shown in Table 8.21 all the specific competence gaps are positive indicating employers consider all m ore important than they are developed. In all cases therefore, there is a gap that could be usefully reduced. Of significant note is the magnitude of the gap. For “Ability to identify and manage cost drivers in designs and projects” the gap is 1.03 on a range of 0 to 3 – this is a very large gap. For academics the competences with the largest gaps are: •

Ability to apply a systems approach to engineering problems



Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles



Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process

EIE Surveyor Final Report

62

Tuning methodology in EIE



Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal



Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs

Students again see the gap differently, their top list is: •

Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process



Ability to identify and manage cost drivers in designs and projects



Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues



Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs



Ability to work in a group on a major project

There are some commonalities in the views but also some differences that merit further investigation. Table 8.21 provides the information to enable the important gaps to be identified for each stakeholder group and hence where the focus of attention should be for curriculum changes.

EIE Surveyor Final Report

63

Tuning methodology in EIE

EIE Surveyor Final Report

64

Tuning methodology in EIE

9. Conclusions and recommendations The objective of this study was to apply the Tuning Methodology to the EIE discipline set to test the alignment between the views of the importance and level of development of sets of competences between students, academics, employers and graduates. The results of this study show that the Tuning Methodology is a useful tool for assessing alignment in these subjects. In total 3,275 questionnaires have been collected from the four stakeholder groups from a range of European countries. The number of responses from each country is variable and a full by country analysis is not possible with the responses currently available, that said a range of analyses have been carried out and are reported herein. It is expected that the analysis will be an ongoing activity for the EAEEIE as might the collection of additional data to fill in some of the gaps in the data set as it currently stands. This report should, therefore be read not as the last and final analysis of the task but as a summary of the findings and analysis undertaken up to the end of the project funding period. Tests of the homogeneity of the responses across all countries show that there are country differences in some analyses and some of these are explored in this report, others merit further investigation. Many of the analyses presented in this report are aggregated results and therefore potentially suffer clustering problems. This too is a topic of further investigation on an ongoing basis and updates to this report and the research findings that emerge will be made available. The survey permits many different analysis options such as by study level, gender, country, competence (individually and by group) and all combinations of these dimensions. The following is a summary of the key conclusions drawn form the analyses presented in this report. On the question of general preparedness for employment, at the Bachelor and Masters levels, academics typically over-rate their view of how well they are preparing students for employment relative to employers of their graduates. Students, on the other hand, generally underrate their preparation. There are two notable country exceptions to this though. Undergraduates from France and Italy consider they are better prepared for employment than the employers in their country. There is clearly an opportunity here to build the confidence of students in their perception of the level of preparedness. Consistent top of importance of the generic competences for all four stakeholders is “Problem solving”. Second in the ranking for students is “Elementary computing skills”. Comparatively students under rate the importance of this skill, perhaps it is taken for granted in students than in academics and employers. The results show employers value it more than students and this message could be communicated to students. A number of gaps exist between the importance and level of development between the stakeholders. The largest gap is “Knowledge of a second language” and the evidence from the languages section suggests this view is strongly aimed at English. The generic competences group into 5 sets with “Personal skills” rated consistently as the most important set. This is followed, in descending order of importance, by “Professional skills”, “Interpersonal skills”, “Internationalisation” and “Entrepreneurship”. The smallest mean “Internationalisation” is just over midway between “weak” and “considerable”. Given the European Union’s desire to see greater student and employee mobility across Europe, it is clear there is scope for scope for improvement in the value placed in this skill set by curriculum designers. Curriculum designers and academics can take comfort in the finding that “Professional skills” are the best developed of the skill groups followed by “Personal skills” and “Interpersonal skills”. This not only aligns with the views of employers but aligns with anecdotal views on the real purpose of EIE education programmes. That said there is a trend in a number of countries across Europe away from large firm employment towards a Small to Medium Sized Enterprise culture. Curriculum designers may wish to reflect on the fact that entrepreneurial skills are very low in the list and perhaps merit more attention and emphasis in the curricula. In general the different stakeholders rate the importance and level of development on average differently. This difference has been taken into account in the conclusions drawn. The general unevenness in ranking reflects different perspectives and is, in itself not considered a major issue, of concern are the relative positions of competences and the relative gaps. In general and even allowing for this employers and

EIE Surveyor Final Report

65

Tuning methodology in EIE

academics tend to rate competences higher in importance than students and graduates a number of specific instances of differences are drawn out in section 8. In response to the questions on languages English is the only one other than the respondent’s native language, that scores above “weak’ in importance for all stakeholders. German is the closest second language. For all stakeholders there is a positive gap between rated importance and level of development indicating that students needs are not currently being met by their academic programmes. This gap is greatest at Masters level, a finding also shown by employers, and in general males consider English to be more important and more well developed than females. It is worth noting that academics consider written English to be more important than spoken English whereas it is the other way round for employers. This may be a result of the specific needs of the majority employer group in this survey (large organisations). Overall These results suggests that the importance of both written and spoken English could be usefully increased in students to be more in line with needs. The responses to the specific competence questions show a greater diversity of means and gaps although as with the generic competences some common themes emerge. Top for all stakeholder groups are the more core engineering oriented competences such as “Ability to demonstrate understanding of the use of technical literature and other information sources” and “Ability to demonstrate awareness of quality issues”, the later being of particular importance to employers and which aligns with their view that “Concern for quality” is one of the most important generic competences. Bottom of the ranked importance list for employers are again the broader activities relating to internationalisation and entrepreneurship. This is perhaps understandable knowing that the majority of the employers are from large organisations who can perhaps afford to employ EIE graduates into more tightly focussed engineering positions. With the move towards an SME employment base in some countries across Europe this may need to change and a lessening of the gaps between the core technical and the broader engineering competences may be needed. Curriculum designers are encouraged to look at the specific situation in their country to see to what level this adjustment may be needed. The country specific data available in this report should provide some evidence to help in such a review. The value of the Tuning Methodology and of the analyses carried out has been demonstrated by this project task and the specific findings point clearly to areas where more work can be undertaken. There are gaps in the data for some countries and for some stakeholder groups within some countries. It is recommended that attempts are made to fill these gaps so that the analysis can be extended to be more representative of the whole of Europe. The issue of clustering needs to be examined in more detail and a focussed study in this area may reveal some interesting European country clusters or some regional differences. A plan for the targeted collection of more results is being drawn up to further this objective. Finally, it is anticipated that the dataset will continue to be explored and publications produced on specific themed analyses of it in the near future.

EIE Surveyor Final Report

66

Tuning methodology in EIE

Appendix 1 – Data Tables Appendix 1 contains the data tables for the figures in the main report and complete tables for all the analyses including by country tables where the number of responses available make the results meaningful. Some additional information is provided in the data tables where appropriate, see notes below each table.

EIE Surveyor Final Report

67

Tuning methodology in EIE

Table 3.1. Distribution of returns by questionnaire type. Questionnaire type Academic Employer Graduate Student Total

Number of questionnaires 189 112 326 2691 3318

Percentage 5.7% 3.4% 9.8% 81.1% 100.0%

Target 4% 7% 18% 71% 100%

Table 3.3 Distribution of responses by gender. Male Academic Employer Graduate Student

151 103 252 2259

Female 82.1% 92.0% 77.5% 85.5%

33 9 73 382

17.9% 8.0% 22.5% 14.5%

Table 3.4. Distribution of student responses by country Gender

Country Male Austria Belgium Bulgaria Cyprus Czech Republic Demark Estonia Finland France Germany Greece Hungary Iceland Ireland Italy Latvia Lithuania Poland Portugal Romania Slovak Republic Slovenia Spain Sweden Turkey United Kingdom Total

EIE Surveyor Final Report

122 3 2 2 72 313 4 187 200 4 106 83 45 1 222 70 6 362 7 95 138 201 2245

Female 2 2 67

Total % Female

35.4

1 12 1 28 1 52 20 1 6 10 19 15 5 6 27 45 1 51 5 377

68

14.2 8.2 21.8 9.1 5.3 10.8 29.7 6.3 6.7 6.9 32.1 27.0 2.4 14.4

2 2 189 3 3 2 84 1 341 5 239 220 5 113 93 64 1 237 75 12 389 7 140 1 189 206 2623

Tuning methodology in EIE

Table 3.5. Distribution of student responses by level of study Level of study

Bachelor Masters Doctoral/PhD Total

Gender Male 1658 550 16 2224

Total

Female 271 95 7 373

% Female 14.0 14.7 30.4 14.4

1930 645 23 2598

Table 3.6. Distribution of student responses by age band Age band 20 or under 21-30 31-40 41-50 over 61 Total

Male 931 1303 10 8 2 2254

Gender Female 85 290 4 2 1 382

Total % Female 1

1

1016 1594 14 10 3 2637

Table 3.7. Distribution of academic responses by country Country Belgium Bulgaria Cyprus Czech Republic Estonia France Germany Greece Ireland Italy Latvia Lithuania Poland Portugal Romania Slovak Republic Spain Turkey United Kingdom Missing Total

EIE Surveyor Final Report

Frequency 1 10 4 1 6 15 1 15 12 8 4 8 11 7 1 20 34 14 10 7 189

69

Percent 0.5 5.3 2.1 0.5 3.2 7.9 0.5 7.9 6.3 4.2 2.1 4.2 5.8 3.7 0.5 10.6 18 7.4 5.3 3.7 100

Tuning methodology in EIE

Table 3.8. Distribution of employer responses by country Country Bulgaria Czech Republic France Germany Ireland Italy Latvia Poland Portugal Slovak Republic Spain Turkey

Frequency

Percent 17.9 1.8 11.6 10.7 16.1 2.7 1.8 11.6 3.6 6.3 9.8 6.3

20 2 13 12 18 3 2 13 4 7 11 7

Table 3.9. Distribution of graduate responses by country Country Belgium Bulgaria Czech Republic Demark Estonia Finland France Germany Greece Ireland Italy Latvia Norway Poland Portugal Slovak Republic Slovenia Spain Turkey

EIE Surveyor Final Report

Frequency 2 50 2 1 2 1 5 2 31 18 10 3 1 29 13 63 1 38 33

70

Percent 0.6 15.2 0.6 0.3 0.6 0.3 1.5 0.6 9.4 5.5 3 0.9 0.3 8.8 4 19.1 0.3 11.6 10

Tuning methodology in EIE

Table 4.1 Mean student response to “Do you feel that the degree programme is preparing you adequately for employment?” by level and gender.

Level

Male

Female

Total

Bachelor

2.52

2.58

2.53

Master

2.52

2.44

2.51

Doctoral Total

*1

2.07

1.33

2.52

*2

2.54

1.86*3 2.53

Notes: *1 n=15; *2 n=6; *3 n=21

Table 4.2 Mean student response to “Do you feel that the degree programme is preparing you adequately for employment?” by country.

Country Bulgaria Estonia France Greece Hungary Ireland Italy Latvia Poland Portugal Slovak Republic Spain Turkey United Kingdom*1 Total

All 2.33 2.38 2.57 2.97 2.08 2.22 2.74 2.89 2.5 2.51 2.58 2.8 2.43 1.94 2.53

Male 2.25 2.4 2.58 3.02 2.05 2.25 2.75 2.87 2.5 2.51 2.58 2.76 2.44 1.88 2.52

Female 2.43 2.25 2.43 2.77 2.44 1.67 2.6 2.95 2.54 2.6 2.48 2.89 2.4 3 2.55

Notes: *1 Computer Science students only

EIE Surveyor Final Report

71

Tuning methodology in EIE

Table 4.4 Difference between “Do you feel that the degree programme is preparing you adequately for employment?” and “How would you rate the employment potential of your degree?” by country. Country Bulgaria Estonia France Greece Hungary Ireland Italy Latvia Poland Portugal Slovak Republic Spain Turkey United Kingdom Total

EIE Surveyor Final Report

All 0.17 -1.88 -0.47 0.35 0.12 -2 0.43 0.46 0.18 -1.48 0.18 0.71 0.11 -2.3 -0.11

Male 0.19 -1.83 -0.45 0.37 0.14 -1.95 0.41 0.43 0.17 -1.49 0.17 0.73 0.09 -2.43 -0.14

72

Female 0.13 -2.17 -0.71 0.27 0 -3.16 0.5 0.53 0.31 -1.2 0.29 0.66 0.15 0 0.01

Tuning methodology in EIE

Table 4.5 All student rating of importance of the generic competences. Generic competence Problem solving – Importance Elementary computing skills – Importance Capacity for applying knowledge in practice – Importance Teamworking – Importance Will to succeed – Importance Capacity to adapt to new situations – Importance Capacity for generating new ideas (creativity) – Importance Capacity to learn – Importance Decision making – Importance Ability to work autonomously – Importance Concern for quality – Importance Basic general technical knowledge of the profession of your work area – Importance Capacity for analysis and synthesis – Importance Information management skills – Importance Project design and management – Importance Knowledge of a second language – Importance Planning and time management – Importance Interpersonal skills – Importance Oral and written communication in your native language – Importance Ability to work in an international context – Importance Grounding in basic knowledge of the profession of your work area – Importance Initiative and entrepreneurial spirit – Importance Ability to work in an interdisciplinary team – Importance Ability to communicate with non-experts (in the field) – Importance Research skills –Importance Critical and self-critical abilities – Importance Leadership – Importance International Relations and Collaborations – Importance Patents and Intellectual Property Rights – Importance Appreciation of ethical issues – Importance Appreciation of diversity and multiculturality – Importance Understanding of cultures and customs of other countries – Importance

EIE Surveyor Final Report

73

N 2481 2480 2486 2487 2478 2483 2483 2487 2481 2470 2477 2483 2488 2483 2481 2482 2482 2481 2484 2479 2480 2477 2472 2483 2478 2475 2487 2475 2476 2480 2482 2474

Mean 3.48 3.44 3.41 3.41 3.36 3.33 3.33 3.32 3.29 3.28 3.27 3.24 3.23 3.22 3.21 3.19 3.14 3.11 3.1 3.09 3.06 3.04 3.01 3 2.99 2.97 2.95 2.92 2.79 2.72 2.71 2.52

Std. Deviation 0.752 0.785 0.758 0.754 0.811 0.764 0.806 0.774 0.791 0.81 0.816 0.797 0.761 0.813 0.824 0.956 0.815 0.803 0.886 0.868 0.813 0.832 0.849 0.867 0.854 0.81 0.827 0.91 0.948 0.946 0.936 0.973

Tuning methodology in EIE

Table 4.6 Weighted ranking of importance of generic competences by Bachelor level students Generic Competence Problem solving Teamworking Capacity for applying knowledge in practice Knowledge of a second language Capacity for analysis and synthesis Capacity to learn Basic general technical knowledge of the profession of your work area Will to succeed Capacity for generating new ideas (creativity) Capacity to adapt to new situations Decision making Elementary computing skills Planning and time management Research skills Ability to work autonomously Leadership Concern for quality Project design and management Oral and written communication in your native language Grounding in basic knowledge of the profession of your work area Interpersonal skills Ability to work in an international context Critical and self-critical abilities Ability to work in an interdisciplinary team Initiative and entrepreneurial spirit Ability to communicate with non-experts (in the field) Information management skills International Relations and Collaborations Appreciation of ethical issues Understanding of cultures and customs of other countries Appreciation of diversity and multiculturality Patents and Intellectual Property Rights

EIE Surveyor Final Report

74

Score 1823 1624 1584 1231 1176 1094 997 911 887 760 729 708 685 640 598 593 467 466 465 434 357 317 302 260 239 217 214 167 148 129 115 60

Tuning methodology in EIE

Table 4.7 All student rating of level of development of the generic competences. Generic competence Elementary computing skills – Level Problem solving – Level Capacity to learn – Level Teamworking – Level Basic general technical knowledge of the profession of your work area – Level Ability to work autonomously – Level Capacity for analysis and synthesis – Level Will to succeed – Level Capacity for applying knowledge in practice – Level Grounding in basic knowledge of the profession of your work area – Level Information management skills – Level Concern for quality – Level Capacity to adapt to new situations – Level Decision making – Level Oral and written communication in your native language – Level Project design and management – Level Research skills – Level Capacity for generating new ideas (creativity) – Level Interpersonal skills – Level Planning and time management – Level Critical and self-critical abilities – Level Ability to communicate with non-experts (in the field) – Level Initiative and entrepreneurial spirit – Level Ability to work in an interdisciplinary team – Level Knowledge of a second language – Level Ability to work in an international context – Level Appreciation of diversity and multiculturality – Level Leadership – Level International Relations and Collaborations – Level Appreciation of ethical issues – Level Patents and Intellectual Property Rights – Level Understanding of cultures and customs of other countries – Level

EIE Surveyor Final Report

75

N 2479 2479 2481 2484 2479 2469 2481 2475 2480 2475 2475 2475 2477 2480 2478 2476 2475 2479 2479 2477 2472 2480 2476 2470 2477 2475 2475 2482 2469 2473 2468 2470

Mean 3.2 2.97 2.96 2.94 2.91 2.91 2.85 2.82 2.81 2.79 2.79 2.77 2.73 2.72 2.71 2.71 2.63 2.61 2.6 2.59 2.52 2.45 2.44 2.43 2.42 2.35 2.31 2.3 2.3 2.29 2.27 2.03

Std. Deviation 0.862 0.862 0.876 0.921 0.848 0.89 0.762 0.946 0.815 0.845 0.878 0.947 0.903 0.903 0.979 0.888 0.902 0.949 0.913 0.919 0.909 0.956 0.89 0.939 0.996 0.978 0.984 0.914 0.998 1.001 1 0.973

Tuning methodology in EIE

Table 4.8 Comparison of mean difference between rated importance and level of development for all students by gender. Generic competence Knowledge of a second language Ability to work in an international context Capacity for generating new ideas (creativity) Leadership Capacity for applying knowledge in practice International Relations and Collaborations Capacity to adapt to new situations Initiative and entrepreneurial spirit Ability to work in an interdisciplinary team Decision making Planning and time management Ability to communicate with non-experts (in the field) Will to succeed Problem solving Concern for quality Interpersonal skills Project design and management Patents and Intellectual Property Rights Understanding of cultures and customs of other countries Teamworking Critical and self-critical abilities Information management skills Appreciation of ethical issues Appreciation of diversity and multiculturality Capacity for analysis and synthesis Oral and written communication in your native language Capacity to learn Ability to work autonomously Research skills Basic general technical knowledge of the profession of your work area Grounding in basic knowledge of the profession of your work area Elementary computing skills

EIE Surveyor Final Report

76

All 0.79 0.76 0.74 0.67 0.63 0.63 0.62 0.62 0.6 0.59 0.57 0.56 0.55 0.54 0.53 0.52 0.51 0.51 0.5 0.49 0.45 0.44 0.42 0.41 0.4 0.4 0.38 0.38 0.37 0.34 0.28 0.25

Male 0.78 0.77 0.74 0.69 0.62 0.64 0.62 0.62 0.61 0.6 0.56 0.57 0.55 0.54 0.52 0.53 0.52 0.52 0.5 0.5 0.46 0.43 0.42 0.42 0.4 0.4 0.38 0.38 0.36 0.33 0.26 0.25

Female 0.81 0.72 0.77 0.61 0.69 0.57 0.66 0.63 0.56 0.54 0.64 0.53 0.58 0.54 0.63 0.47 0.52 0.46 0.5 0.4 0.43 0.49 0.48 0.37 0.42 0.38 0.37 0.41 0.42 0.43 0.39 0.26

Tuning methodology in EIE

Table 4.9 Comparison of mean difference between rated importance and level of development for all students by level of study. Generic competence Knowledge of a second language Capacity for generating new ideas (creativity) Ability to work in an international context Leadership Ability to work in an interdisciplinary team Capacity to adapt to new situations Initiative and entrepreneurial spirit International Relations and Collaborations Decision making Capacity for applying knowledge in practice Will to succeed Planning and time management Ability to communicate with non-experts (in the field) Concern for quality Problem solving Interpersonal skills Patents and Intellectual Property Rights Understanding of cultures and customs of other countries Project design and management Teamworking Information management skills Critical and self-critical abilities Appreciation of ethical issues Ability to work autonomously Oral and written communication in your native language Capacity to learn Appreciation of diversity and multiculturality Capacity for analysis and synthesis Research skills Basic general technical knowledge of the profession of your work area Grounding in basic knowledge of the profession of your work area Elementary computing skills

EIE Surveyor Final Report

77

Bachelor 0.76 0.76 0.75 0.69 0.64 0.63 0.63 0.61 0.6 0.59 0.59 0.57 0.56 0.55 0.54 0.53 0.53 0.52 0.51 0.5 0.46 0.46 0.44 0.43 0.42 0.42 0.42 0.41 0.4 0.37 0.28 0.28

Master 0.88 0.72 0.83 0.66 0.49 0.61 0.61 0.7 0.6 0.72 0.48 0.59 0.57 0.49 0.53 0.52 0.48 0.47 0.53 0.48 0.4 0.45 0.42 0.27 0.36 0.27 0.41 0.38 0.28 0.29 0.27 0.2

Tuning methodology in EIE

Table 4.10 Comparison of mean difference between rated importance and level of development for all students by country.

Generic competence International Relations and Collaborations Capacity to adapt to new situations Ability to work in an interdisciplinary team Ability to work in an international context Capacity for generating new ideas (creativity) Decision making Leadership Initiative and entrepreneurial spirit Will to succeed Critical and self-critical abilities Concern for quality Patents and Intellectual Property Rights Ability to communicate with non-experts (in the field) Understanding of cultures and customs of other countries Knowledge of a second language Planning and time management Interpersonal skills Appreciation of ethical issues Information management skills Oral and written communication in your native language Appreciation of diversity and multiculturality Project design and management Problem solving Ability to work autonomously Capacity for analysis and synthesis Basic general technical knowledge of the profession of your work area Capacity for applying knowledge in practice Teamworking Grounding in basic knowledge of the profession of your work area Research skills Capacity to learn Elementary computing skills

EIE Surveyor Final Report

78

France 1.1 1.06 1.01 1 0.95 0.93 0.89 0.86 0.8 0.78 0.78 0.78 0.77 0.72 0.7 0.68 0.68 0.68 0.66 0.61 0.6 0.6 0.58 0.58 0.53

Greece 0.63 0.74 0.69 0.96 0.88 0.7 0.59 0.79 0.72 0.6 0.78 0.61 0.56 0.49 0.9 0.65 0.45 0.65 0.48 0.51 0.56 0.72 0.78 0.77 0.71

Hungary 0.39 0.76 0.83 0.72 0.91 0.59 0.85 0.58 0.63 0.62 0.52 0.23 0.79 0.45 1.08 0.56 0.8 0.36 0.62 0.53 0.49 0.4 0.6 0.41 0.08

Poland 0.81 0.54 0.34 0.91 0.72 0.51 0.58 0.67 0.55 0.33 0.5 0.49 0.57 0.45 0.78 0.53 0.38 0.39 0.33 0.33 0.42 0.6 0.64 0.26 0.37

Slovak Republic 0.58 0.42 0.46 0.69 0.71 0.58 0.77 0.62 0.57 0.41 0.55 0.45 0.46 0.56 0.92 0.63 0.59 0.46 0.3 0.33 0.43 0.47 0.53 0.35 0.32

0.48 0.47 0.47

0.64 0.77 0.38

0.05 0.72 0.88

0.28 0.71 0.35

0.2 0.6 0.6

0.44 0.44 0.43 0.39

0.47 0.69 0.75 0.36

-0.21 0.32 0.48 0.15

0.26 0.19 0.32 0.16

0.19 0.25 0.31 0.31

Tuning methodology in EIE

Table 4.13 Student perception of the importance of the specific competences Specific competence

N

Mean

6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 28. Ability to work in a group on a major project 21. Ability to demonstrate practical engineering skills

2196 2182 2180

3.29 3.29 3.24

1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 8. Ability to apply a systems approach to engineering problems

2246 2195

3.2 3.17

10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process

2188

3.15

7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines

2199 2241

3.09 3.06

12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs

2180

3.05

23. Ability to demonstrate understanding of the use of technical literature and other information sources 11. Ability to identify and manage cost drivers in designs and projects

2192 2185

3.04 3.02

2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline

2244

2.99

9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 14. Ability to manage the design process and evaluate outcomes 27. Ability to work with technical uncertainty

2188 2184 2187

2.99 2.97 2.94

22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.)

2173

2.93

25. Ability to demonstrate understanding of appropriate codes of practice and industry standards

2177

2.92

13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal

2182

2.91

17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development

2192

2.91

20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products.

2178

2.91

5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 26. Ability to demonstrate awareness of quality issues

2224 2181

2.85 2.85

19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering

2178

2.84

4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles

2219

2.83

15. Ability to demonstrate knowledge and understanding of the commercial and economic context

2200

2.82

18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

2185

2.81

16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues

2192 2177

2.8 2.78

EIE Surveyor Final Report

79

Tuning methodology in EIE

Table 4.14 Rank order of rated specific competences for all students and for Bachelor and Master level students. Specific competence 28. Ability to work in a group on a major project 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 21. Ability to demonstrate practical engineering skills 8. Ability to apply a systems approach to engineering problems 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 11. Ability to identify and manage cost drivers in designs and projects 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 14. Ability to manage the design process and evaluate outcomes 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 23. Ability to demonstrate understanding of the use of technical literature and other information sources 27. Ability to work with technical uncertainty 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal

All 1

Bachelor 2

Master 1

2

1

4

3 4 5

3 5 4

2 3 6

6

7

7

7

6

8

8

9

5

9

8

9

10

10

11

11 12

11 13

10 14

13

12

19

14

15

12

15 16

14 16

20 13

17

17

17

18 19

18 19

16 25

20

21

15

19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering

21

22

26

16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context

22

24

21

18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

23

23

24

25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 26. Ability to demonstrate awareness of quality issues

24 25

20 25

27 23

20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products.

26

26

22

22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.)

27

27

18

24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues

28

28

28

EIE Surveyor Final Report

80

Tuning methodology in EIE

Table 4.15 Student perception of the level of development of the specific competences Specific competence 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 8. Ability to apply a systems approach to engineering problems 21. Ability to demonstrate practical engineering skills 28. Ability to work in a group on a major project 23. Ability to demonstrate understanding of the use of technical literature and other information sources 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 27. Ability to work with technical uncertainty 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 26. Ability to demonstrate awareness of quality issues

N

Mean

2242

2.9

2195

2.89

2242

2.86

2198 2193 2179 2180

2.72 2.71 2.7 2.69

2190 2239

2.67 2.58

2174 2185

2.51 2.51

2177

2.5

2186 2175

2.49 2.49

2186 2180

2.48 2.46

2176

2.46

12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs

2179

2.45

4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles

2216

2.44

13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 11. Ability to identify and manage cost drivers in designs and projects

2181 2183

2.42 2.38

19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering

2176

2.38

17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development

2189

2.36

2222

2.33

2174

2.33

2190

2.32

2197

2.29

2184

2.25

9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 14. Ability to manage the design process and evaluate outcomes 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards

5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

EIE Surveyor Final Report

81

Tuning methodology in EIE

Table 4.16 Student perception of the level of development of the specific competences by gender Specific competence

Male

Female

1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline

2.85

2.91

2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines

2.91 2.59

2.9 2.58

4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles

2.44

2.44

5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement

2.31

2.5

6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems

2.89

2.89

7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 8. Ability to apply a systems approach to engineering problems

2.72 2.72

2.75 2.64

9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues

2.48

2.46

10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 11. Ability to identify and manage cost drivers in designs and projects

2.48 2.37

2.59 2.46

12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs

2.44

2.49

2.43 2.47

2.39 2.45

13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 14. Ability to manage the design process and evaluate outcomes 15. Ability to demonstrate knowledge and understanding of the commercial and economic context

2.28

2.36

16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context

2.32

2.31

17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development

2.37

2.32

18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

2.26

2.25

19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering

2.37

2.43

20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 21. Ability to demonstrate practical engineering skills

2.51 2.71

2.51 2.71

2.52

2.49

2.66

2.7

2.33

2.37

2.46 2.49 2.52 2.67

2.47 2.54 2.48 2.83

22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 23. Ability to demonstrate understanding of the use of technical literature and other information sources 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 26. Ability to demonstrate awareness of quality issues 27. Ability to work with technical uncertainty 28. Ability to work in a group on a major project

EIE Surveyor Final Report

82

Tuning methodology in EIE

Table 4.17 Comparison of mean difference between rated importance and level of development for all students by gender. Specific competence

All

Male

Female

10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 11. Ability to identify and manage cost drivers in designs and projects

0.67 0.64

0.68 0.65

0.59 0.6

12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 28. Ability to work in a group on a major project

0.61 0.6

0.61 0.61

0.59 0.51

17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development

0.56

0.55

0.62

0.56 0.54

0.54 0.54

0.63 0.49

0.53

0.53

0.53

5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement

0.52

0.52

0.52

9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 14. Ability to manage the design process and evaluate outcomes

0.51 0.51

0.5 0.5

0.61 0.56

0.49

0.48

0.52

0.48

0.48

0.47

0.48 0.47

0.48 0.46

0.51 0.55

0.47

0.47

0.46

18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues 21. Ability to demonstrate practical engineering skills 15. Ability to demonstrate knowledge and understanding of the commercial and economic context

13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 8. Ability to apply a systems approach to engineering problems 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 27. Ability to work with technical uncertainty

0.46

0.46

0.46

0.45 0.43

0.44 0.42

0.51 0.48

22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.)

0.42

0.41

0.5

6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems

0.41

0.41

0.41

20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products.

0.41

0.41

0.38

4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles

0.39

0.39

0.46

7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques

0.37

0.37

0.4

23. Ability to demonstrate understanding of the use of technical literature and other information sources 26. Ability to demonstrate awareness of quality issues

0.37 0.36

0.37 0.39

0.36 0.25

1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline

0.34

0.34

0.37

2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline

0.09

0.08

0.15

EIE Surveyor Final Report

83

Tuning methodology in EIE

Table 4.19 Comparison of mean difference between rated importance and level of development of the specific competences for all students by level of study. Specific competence 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 11. Ability to identify and manage cost drivers in designs and projects 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 28. Ability to work in a group on a major project 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues 21. Ability to demonstrate practical engineering skills 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 14. Ability to manage the design process and evaluate outcomes 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 8. Ability to apply a systems approach to engineering problems 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 27. Ability to work with technical uncertainty 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 23. Ability to demonstrate understanding of the use of technical literature and other information sources 26. Ability to demonstrate awareness of quality issues 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin

EIE Surveyor Final Report

84

All

Bachelor

Master

0.67 0.64

0.66 0.62

0.7 0.7

0.61 0.6

0.6 0.6

0.63 0.59

0.56

0.56

0.56

0.56 0.54

0.53 0.52

0.65 0.57

0.53

0.54

0.53

0.52

0.52

0.54

0.51 0.51

0.53 0.5

0.48 0.54

0.49

0.47

0.53

0.48

0.49

0.47

0.48 0.47

0.47 0.47

0.55 0.47

0.47

0.45

0.54

0.46

0.47

0.47

0.45 0.43

0.45 0.42

0.44 0.44

0.42

0.41

0.42

0.41

0.41

0.4

0.41

0.42

0.38

0.39

0.41

0.35

0.37

0.38

0.33

0.37 0.36

0.38 0.39

0.35 0.34

0.34

0.36

0.3

Tuning methodology in EIE

the engineering discipline 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline

EIE Surveyor Final Report

85

0.09

0.12

0.03

Tuning methodology in EIE

Table 5.2 Mean of the importance of the generic competences for all academics Generic competence Elementary computing skills – Importance Capacity for applying knowledge in practice – Importance Problem solving – Importance Capacity for analysis and synthesis – Importance Basic general technical knowledge of the profession of your work area – Importance Capacity to learn – Importance Information management skills – Importance Capacity to adapt to new situations – Importance Teamworking – Importance Ability to work autonomously – Importance Concern for quality – Importance Oral and written communication in your native language – Importance Capacity for generating new ideas (creativity) – Importance Grounding in basic knowledge of the profession of your work area – Importance Project design and management – Importance Knowledge of a second language – Importance Ability to work in an interdisciplinary team – Importance Decision making – Importance Planning and time management – Importance Will to succeed – Importance Critical and self-critical abilities – Importance Interpersonal skills – Importance Initiative and entrepreneurial spirit – Importance Ability to communicate with non-experts (in the field) – Importance Ability to work in an international context – Importance Research skills -Importance Appreciation of ethical issues – Importance Leadership – Importance International Relations and Collaborations – Importance Appreciation of diversity and multiculturality – Importance Patents and Intellectual Property Rights – Importance Understanding of cultures and customs of other countries – Importance

EIE Surveyor Final Report

86

N 185 185 184 185 184 185 185 185 185 185 185 185 185 183 185 185 184 185 184 182 184 181 183 184 185 185 185 184 182 184 184 185

Mean 3.6 3.58 3.58 3.54 3.53 3.52 3.46 3.43 3.41 3.41 3.39 3.36 3.33 3.32 3.29 3.23 3.22 3.21 3.2 3.17 3.12 3.07 3.07 3.01 2.97 2.86 2.83 2.82 2.79 2.66 2.65 2.5

Tuning methodology in EIE

Table 5.2(a) Mean of the importance of the generic competences for all academics by country Generic competence Capacity for applying knowledge in practice – Importance Problem solving – Importance Basic general technical knowledge of the profession of your work area – Importance Elementary computing skills – Importance Capacity to learn – Importance Capacity for analysis and synthesis – Importance Information management skills – Importance Capacity to adapt to new situations – Importance Ability to work autonomously – Importance Concern for quality – Importance Teamworking – Importance Grounding in basic knowledge of the profession of your work area – Importance Oral and written communication in your native language – Importance Knowledge of a second language – Importance Capacity for generating new ideas (creativity) – Importance Project design and management – Importance Planning and time management – Importance Ability to work in an interdisciplinary team – Importance Decision making – Importance Will to succeed – Importance Critical and self-critical abilities – Importance Interpersonal skills – Importance Ability to work in an international context – Importance Initiative and entrepreneurial spirit – Importance Ability to communicate with non-experts (in the field) – Importance Appreciation of ethical issues – Importance Research skills -Importance Leadership – Importance International Relations and Collaborations – Importance Appreciation of diversity and multiculturality – Importance Patents and Intellectual Property Rights – Importance Understanding of cultures and customs of other countries – Importance

EIE Surveyor Final Report

France

Greece

Slovak Republic

Spain

Turkey

Total

3.6 3.67

3.47 3.6

3.7 3.55

3.65 3.76

3.71 3.43

3.63 3.63

3.87 3.47 3.8 3.73 3.6 3.73 3.6 3.4 3.6

3.27 3.6 3.33 3.47 3.13 3.4 3.4 3.53 3.33

3.7 3.65 3.55 3.55 3.55 3.45 3.4 3.6 3.35

3.65 3.74 3.59 3.5 3.71 3.53 3.5 3.56 3.53

3.57 3.5 3.57 3.64 3.57 3.21 3.5 3.14 3.43

3.62 3.62 3.57 3.56 3.55 3.48 3.48 3.48 3.46

3.67

3.47

3.55

3.47

2.86

3.43

3.47 3.47

3.27 3.07

3.5 3.2

3.38 3.53

3.29 3.36

3.39 3.36

3.53 3.4 3.27

3.33 3.13 3.33

3.3 3.2 3.2

3.44 3.38 3.26

3.07 3.21 3.14

3.36 3.29 3.24

3.4 3.33 3.31 3.4 2.82

3.33 3.13 3.33 3 3.13

3.05 3.05 3.3 3.15 3.3

3.24 3.32 3.18 3.18 3.15

3.29 3.21 3 3 3.14

3.24 3.22 3.22 3.15 3.14

3.27 3.07

2.8 2.87

3 3.2

3.09 3.15

3.07 2.71

3.05 3.04

2.87 2.47 3 2.93

3.07 3 2.53 2.93

2.9 3.25 3.15 2.85

3.18 3.03 2.97 2.74

3 2.5 2.29 2.93

3.03 2.91 2.85 2.85

3.27

2.53

3

2.76

2.5

2.82

2.57 2.67

2.67 2.8

2.9 3.1

2.74 2.62

2.5 2.29

2.7 2.7

2.73

2.4

2.85

2.65

2.21

2.6

87

Tuning methodology in EIE

Table 5.4 Mean importance of the generic competence comparing the Bachelor and Master levels Generic competence Elementary computing skills – Importance Capacity for applying knowledge in practice – Importance Problem solving – Importance Basic general technical knowledge of the profession of your work area – Importance Capacity for analysis and synthesis – Importance Capacity to learn – Importance Ability to work autonomously – Importance Capacity to adapt to new situations – Importance Teamworking – Importance Information management skills – Importance Concern for quality – Importance Oral and written communication in your native language – Importance Capacity for generating new ideas (creativity) – Importance Project design and management – Importance Grounding in basic knowledge of the profession of your work area – Importance Decision making – Importance Will to succeed – Importance Ability to work in an interdisciplinary team – Importance Planning and time management – Importance Critical and self-critical abilities – Importance Interpersonal skills – Importance Knowledge of a second language – Importance Initiative and entrepreneurial spirit – Importance Ability to communicate with non-experts (in the field) – Importance Ability to work in an international context – Importance Leadership – Importance Appreciation of ethical issues – Importance Research skills -Importance Appreciation of diversity and multiculturality – Importance International Relations and Collaborations – Importance Patents and Intellectual Property Rights – Importance Understanding of cultures and customs of other countries – Importance

EIE Surveyor Final Report

88

Bachelor 3.7 3.6 3.58 3.55 3.54 3.54 3.51 3.48 3.48 3.45 3.45 3.43 3.41 3.38 3.34 3.3 3.29 3.26 3.24 3.23 3.19 3.15 3.12 3.09 3.02 2.96 2.93 2.85 2.84 2.83 2.67 2.62

Master 3.51 3.6 3.57 3.49 3.52 3.54 3.37 3.4 3.34 3.48 3.35 3.31 3.18 3.15 3.35 3.05 3.06 3.15 3.11 3.02 2.94 3.31 3.02 2.89 2.86 2.61 2.78 2.85 2.45 2.69 2.62 2.31

Tuning methodology in EIE

Table 5.5 Mean level of development of the generic competences for all academics and by level of study Generic competence Elementary computing skills – Level Basic general technical knowledge of the profession of your work area – Level Capacity for analysis and synthesis – Level Grounding in basic knowledge of the profession of your work area – Level Capacity for applying knowledge in practice – Level Capacity to learn – Level Problem solving – Level Ability to work autonomously – Level Information management skills – Level Teamworking – Level Project design and management – Level Oral and written communication in your native language – Level Capacity to adapt to new situations – Level Concern for quality – Level Capacity for generating new ideas (creativity) – Level Will to succeed – Level Decision making – Level Interpersonal skills – Level Critical and self-critical abilities – Level Planning and time management – Level Research skills – Level Ability to work in an interdisciplinary team – Level Knowledge of a second language – Level Ability to work in an international context – Level Initiative and entrepreneurial spirit – Level Ability to communicate with non-experts (in the field) – Level Appreciation of diversity and multiculturality – Level Appreciation of ethical issues – Level International Relations and Collaborations – Level Leadership – Level Understanding of cultures and customs of other countries – Level Patents and Intellectual Property Rights – Level

EIE Surveyor Final Report

89

All 3.39 3.21 3.14 3.08 3.06 3.01 2.99 2.92 2.86 2.86 2.81 2.78 2.78 2.76 2.7 2.7 2.66 2.63 2.56 2.55 2.51 2.51 2.49 2.45 2.4 2.36 2.36 2.36 2.33 2.31 2.15 2.09

Bachelor 3.48 3.32 3.18 3.16 3.11 3.08 2.97 2.95 2.89 2.92 2.88 2.83 2.79 2.77 2.79 2.84 2.7 2.77 2.63 2.57 2.57 2.6 2.45 2.51 2.43 2.43 2.46 2.45 2.41 2.48 2.24 2.12

Master 3.37 3.05 3.11 3.03 3.06 2.92 3.05 2.95 2.86 2.88 2.75 2.69 2.82 2.75 2.58 2.52 2.62 2.53 2.43 2.49 2.48 2.43 2.63 2.45 2.37 2.32 2.31 2.32 2.23 2.13 2.08 2.08

Tuning methodology in EIE

Table 5.5(a) Mean level of development of the generic competences for all academics and by country Generic competence Elementary computing skills – Level Basic general technical knowledge of the profession of your work area – Level Capacity for analysis and synthesis – Level Grounding in basic knowledge of the profession of your work area – Level Capacity to learn – Level Problem solving – Level Capacity for applying knowledge in practice – Level Ability to work autonomously – Level Teamworking – Level Information management skills – Level Concern for quality – Level Capacity to adapt to new situations – Level Project design and management – Level Will to succeed – Level Oral and written communication in your native language – Level Capacity for generating new ideas (creativity) – Level Interpersonal skills – Level Decision making – Level Critical and self-critical abilities – Level Knowledge of a second language – Level Planning and time management – Level Ability to work in an international context – Level Research skills – Level Ability to work in an interdisciplinary team – Level Appreciation of ethical issues – Level Appreciation of diversity and multiculturality – Level Initiative and entrepreneurial spirit – Level Ability to communicate with non-experts (in the field) – Level International Relations and Collaborations – Level Leadership – Level Understanding of cultures and customs of other countries – Level Patents and Intellectual Property Rights – Level

EIE Surveyor Final Report

France 3.2

Greece 3.27

Slovak Republic 3.7

Spain 3.56

Turkey 3.5

Total 3.48

3.33 3.33

3.27 3.33

3.45 3.45

3.21 3.06

3.29 3.43

3.3 3.28

3.27 3.07 3.27

3.27 3.33 3.13

3.45 3.25 3.25

3.09 2.97 2.97

2.79 3.14 3.14

3.17 3.12 3.12

3.4 3.07 3.27 2.87 2.8 2.93 3 2.46

3.2 3.07 3.07 2.67 3 3 2.8 3

3.35 3.2 3.05 3.15 3.1 3.05 2.9 3.15

2.82 2.94 2.79 2.97 2.88 2.79 2.76 2.76

3.07 3.07 2.71 2.86 2.71 2.5 2.86 2.64

3.11 3.05 2.95 2.93 2.91 2.86 2.85 2.82

2.6

2.8

3.32

2.74

2.57

2.81

2.6 2.09 2.67 2.6 2.6 2.53 2.8 2.67

2.8 2.73 2.6 2.8 2.6 2.73 2.73 2.53

2.95 3.15 2.95 2.95 2.9 2.8 2.75 2.85

2.62 2.68 2.59 2.44 2.65 2.59 2.47 2.59

2.64 2.57 2.57 2.64 2.29 2.36 2.36 2.07

2.71 2.7 2.67 2.65 2.63 2.61 2.6 2.57

2.6 2.07

3 2.8

2.65 2.9

2.35 2.59

2.5 2.21

2.57 2.55

2.43 2.4

2.67 2.4

2.8 2.8

2.35 2.41

2.5 2.36

2.53 2.48

2.2 2.6 2.14

2.8 2.53 2.6

2.55 2.6 2.5

2.41 2.26 2.26

2.36 2.21 2.21

2.46 2.42 2.34

2.13 2

2.4 2.33

2.65 2.6

2.32 1.85

2 1.79

2.33 2.09

90

Tuning methodology in EIE

Table 5.6 Mean gap between rated importance and level of development of the generic competences for all academics and by level of study Generic competence Knowledge of a second language Ability to work in an interdisciplinary team Initiative and entrepreneurial spirit Planning and time management Capacity to adapt to new situations Ability to communicate with non-experts (in the field) Capacity for generating new ideas (creativity) Concern for quality Information management skills Oral and written communication in your native language Problem solving Critical and self-critical abilities Decision making Teamworking Patents and Intellectual Property Rights Capacity for applying knowledge in practice Capacity to learn Leadership Ability to work in an international context Ability to work autonomously Project design and management Appreciation of ethical issues Will to succeed International Relations and Collaborations Interpersonal skills Capacity for analysis and synthesis Research skills Understanding of cultures and customs of other countries Basic general technical knowledge of the profession of your work area Appreciation of diversity and multiculturality Grounding in basic knowledge of the profession of your work area Elementary computing skills

EIE Surveyor Final Report

91

All 0.74 0.7 0.67 0.65 0.65 0.65 0.63 0.63 0.6 0.58 0.58 0.57 0.55 0.55 0.55 0.53 0.52 0.51 0.51 0.49 0.48 0.47 0.47 0.46 0.44 0.41 0.36 0.35 0.32 0.3 0.24 0.21

Bachelor 0.71 0.66 0.69 0.67 0.68 0.66 0.62 0.67 0.55 0.61 0.62 0.59 0.61 0.55 0.55 0.51 0.47 0.47 0.51 0.57 0.5 0.49 0.45 0.43 0.43 0.37 0.28 0.38 0.22 0.38 0.19 0.22

Master 0.68 0.72 0.65 0.62 0.58 0.57 0.6 0.6 0.62 0.62 0.52 0.58 0.43 0.46 0.54 0.54 0.62 0.48 0.42 0.42 0.4 0.46 0.54 0.46 0.4 0.42 0.37 0.23 0.45 0.14 0.32 0.14

Tuning methodology in EIE

Table 5.7 Mean ‘gap’ in generic competences by country Generic competence Ability to communicate with nonexperts (in the field) Ability to work autonomously Ability to work in an interdisciplinary team Ability to work in an international context Appreciation of diversity and multiculturality Appreciation of ethical issues Basic general technical knowledge of the profession of your work area Capacity for analysis and synthesis Capacity for applying knowledge in practice Capacity for generating new ideas (creativity) Capacity to adapt to new situations Capacity to learn Concern for quality Critical and self-critical abilities Decision making Elementary computing skills Grounding in basic knowledge of the profession of your work area Information management skills Initiative and entrepreneurial spirit International Relations and Collaborations Interpersonal skills Knowledge of a second language Leadership Oral and written communication in your native language Patents and Intellectual Property Rights Planning and time management Problem solving Project design and management Research skills Teamworking Understanding of cultures and customs of other countries Will to succeed

EIE Surveyor Final Report

Bulgaria

France

Greece

Ireland

Poland

Slovak Republic

Spain

Turkey

United Kingdom

0.8 0.5

0.67 0.53

0.27 0.33

1 0.83

0.64 0.73

0.35 0.2

0.76 0.56

0.64 0.43

0.88 0.4

1.2

0.8

0.33

0.75

0.91

0.4

0.88

0.79

0.63

0.6

0.47

0.07

0.83

0.36

0.25

0.62

0.71

0.7

0 0.7

0.14 0.4

0 0.2

0.42 0.42

0.45 0.82

0.1 0.35

0.38 0.44

0 0.29

0.9 0.7

0.3 0.9

0.53 0.4

0 0.13

0.42 0.58

0.45 0.55

0.25 0.1

0.44 0.44

0.29 0.21

0.25 0.22

0.6

0.2

0.27

0.58

0.64

0.35

0.82

0.64

1

0.5 0.6 0.4 0.7 0.5 0.6 0.6

0.93 0.8 0.73 0.6 0.8 0.67 0.27

0.53 0.4 0 0.53 0.2 0.53 0.33

0.92 1.25 0.67 0.5 1.08 0.58 0.25

0.73 0.55 0.73 0.91 0.55 0.45 0.18

0.35 0.4 0.3 0.5 0.2 0.1 -0.05

0.82 0.74 0.62 0.68 0.74 0.74 0.18

0.43 0.71 0.43 0.43 0.36 0.64 0

0.7 0.5 1.1 0.7 0.8 1 0.4

0.3 0.5 1.1

0.4 0.73 0.67

0.2 0.47 0.47

0.17 0.75 0.75

0.36 0.82 0.73

0.1 0.4 0.4

0.38 0.74 0.74

0.07 0.71 0.36

0.44 0.4 0.6

0.5 0.8 1.1 1

0.67 0.73 0.87 0.79

0 0.4 0.47 0.33

0.67 0.08 0.67 0.25

0.73 0.55 0.91 0.64

0.4 0.15 0.3 0.35

0.5 0.47 0.88 0.47

0.29 0.57 1.07 0.71

0.89 0.78 0.9 0.67

1

0.87

0.47

0.58

0.55

0.16

0.65

0.71

1.1

0.6 1.3 0.8 0.7 0.7 0.4

0.67 0.73 0.4 0.4 0.33 0.33

0.47 0.6 0.47 0.33 0 0.27

0.33 0.75 1 0.58 0.67 0.67

0.73 0.64 0.64 0.64 0.36 0.82

0.5 0.4 0.3 0.3 0.3 0.3

0.76 0.68 0.79 0.62 0.38 0.74

0.5 0.79 0.29 0.36 0.21 0.71

0.7 0.6 0.8 0.4 0.3 0.3

0.5 0.5

0.6 0.85

0 0.33

0.67 0.42

0.27 0.73

0.2 0.15

0.32 0.41

0.21 0.36

1 0.78

92

Tuning methodology in EIE

Table 5.9 Academic perception of the importance of the specific competences Specific competence 21. Ability to demonstrate practical engineering skills 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 8. Ability to apply a systems approach to engineering problems 28. Ability to work in a group on a major project 23. Ability to demonstrate understanding of the use of technical literature and other information sources 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 26. Ability to demonstrate awareness of quality issues 14. Ability to manage the design process and evaluate outcomes 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 11. Ability to identify and manage cost drivers in designs and projects 27. Ability to work with technical uncertainty 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues

EIE Surveyor Final Report

93

All 3.57

Bachelor 3.63

Master 3.55

3.45

3.48

3.43

3.45 3.43 3.4

3.43 3.42 3.48

3.49 3.52 3.4

3.34

3.33

3.37

3.33

3.38

3.3

3.25

3.24

3.29

3.22 3.22 3.18

3.3 3.33 3.24

3.17 3.28 3.25

3.16

3.19

3.12

3.12

3.1

3.18

3.11 3.11 3.09

3.14 3.15 3.11

3.11 3.12 3.12

3.04

3.11

3.05

3.04

3.05

3.05

3.02

3.11

3.09

2.99

3.03

3.03

2.98

3.07

2.98

2.96

3.1

2.88

2.95

3.04

2.91

2.94

3.07

2.85

2.93

2.97

2.91

2.82

2.78

2.83

2.79

2.9

2.68

2.78

2.84

2.74

Tuning methodology in EIE

Table 5.9(a) Academic perception of the importance of the specific competences by country Specific competence 21. Ability to demonstrate practical engineering skills 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 8. Ability to apply a systems approach to engineering problems 28. Ability to work in a group on a major project 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 23. Ability to demonstrate understanding of the use of technical literature and other information sources 26. Ability to demonstrate awareness of quality issues 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 14. Ability to manage the design process and evaluate outcomes 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 27. Ability to work with technical uncertainty 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 11. Ability to identify and manage cost drivers in designs and projects 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 15. Ability to demonstrate knowledge and understanding of the commercial and economic context

EIE Surveyor Final Report

94

France

Greece

Slovak Republic

Spain

Turkey

Total

3.67

3.53

3.45

3.5

3.43

3.51

3.53

3.67

3.45

3.44

3.36

3.48

3.73 3.53

3.4 3.67

3.2 3.35

3.5 3.35

3.5 3.36

3.46 3.43

3.47

3.27

3.35

3.41

3.43

3.39

3.64

3.47

3.15

3.29

3.57

3.38

3.53 3.53

3.53 3.67

3.2 3.05

3.18 3.26

3.29 3.07

3.31 3.3

3.4

3.4

3.2

3.24

3.21

3.28

3.4

3.33

3.05

3.24

3.14

3.22

3.07

3.33

3.1

3.35

2.86

3.18

3.33

3.33

3.05

3.09

3.07

3.15

3.4 3.33

3.2 3.2

3 2.9

3.09 3.21

3.21 3

3.15 3.13

3.33

3.47

2.8

3.03

3.21

3.12

3.2

3.47

2.75

3.12

3.21

3.12

3.07

3.27

2.7

3.12

3.29

3.07

3.27

3.4

2.85

2.85

3.29

3.06

3.2

3.13

2.89

3.09

2.93

3.05

3

3.4

2.75

2.94

2.86

2.97

3.33

3.4

2.7

2.88

2.71

2.97

3.43

2.87

2.55

3

3.07

2.96

3.13

3.4

2.65

2.82

2.86

2.93

2.73

3.4

2.65

2.91

3

2.92

Tuning methodology in EIE

19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

EIE Surveyor Final Report

95

3

3.4

2.75

2.82

2.64

2.9

3

3

2.85

2.91

2.57

2.88

2.8

3.27

2.65

2.68

2.86

2.81

2.6

3.4

2.55

2.65

2.71

2.74

Tuning methodology in EIE

Table 5.10 Academic perception of the level of development of the specific competences for all and by level of study Specific competences 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 21. Ability to demonstrate practical engineering skills 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 23. Ability to demonstrate understanding of the use of technical literature and other information sources 28. Ability to work in a group on a major project 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 8. Ability to apply a systems approach to engineering problems 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 26. Ability to demonstrate awareness of quality issues 27. Ability to work with technical uncertainty 14. Ability to manage the design process and evaluate outcomes 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 11. Ability to identify and manage cost drivers in designs and projects 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues

EIE Surveyor Final Report

96

All

Bachelor

Master

3.14 3.09

3.22 3.19

3.08 3

3.08

3.16

3.02

2.95

3.04

2.88

2.92 2.89

2.97 2.99

2.91 2.85

2.84 2.83

2.97 2.91

2.65 2.75

2.8

2.84

2.83

2.7

2.84

2.6

2.65

2.74

2.62

2.61 2.61 2.6 2.59

2.65 2.76 2.67 2.71

2.55 2.62 2.6 2.58

2.49

2.64

2.37

2.48

2.51

2.51

2.44 2.43

2.56 2.52

2.34 2.45

2.43

2.55

2.38

2.43

2.48

2.4

2.4

2.55

2.26

2.36

2.4

2.38

2.35

2.47

2.31

2.34

2.31

2.35

2.34

2.44

2.33

2.18

2.31

2.11

2.17

2.2

2.2

Tuning methodology in EIE

Table 5.10(a) Academic perception of the level of development of the specific competences for all and by country Specific competence 21. Ability to demonstrate practical engineering skills 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 23. Ability to demonstrate understanding of the use of technical literature and other information sources 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 8. Ability to apply a systems approach to engineering problems 28. Ability to work in a group on a major project 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 26. Ability to demonstrate awareness of quality issues 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 27. Ability to work with technical uncertainty 14. Ability to manage the design process and evaluate outcomes 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 11. Ability to identify and manage cost drivers in designs and projects 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal

France 3.4

Greece 3

Slovak Republic 3.1

Spain 3.18

Turkey 3.36

Total 3.19

3.2

3.13

3.05

3.21

3.36

3.18

3.13

3.2

3

3.24

3.36

3.18

2.87

2.93

2.9

3.18

3.07

3.02

2.67

3.2

2.8

3.21

3

3.01

3.14

3

2.7

3.09

3.07

3

3.07 3

2.93 2.93

2.7 2.95

3.12 2.91

2.86 2.86

2.96 2.93

3

3

2.75

2.97

2.64

2.89

2.67 2.8

2.87 3

2.7 2.45

2.85 2.85

2.79 2.5

2.79 2.73

2.67

2.87

2.6

2.71

2.64

2.69

2.8 2.47

2.53 2.67

2.58 2.6

2.79 2.79

2.57 2.57

2.68 2.65

2.67

2.8

2.65

2.62

2.5

2.64

2.6

2.73

2.35

2.53

2.43

2.52

2.4

2.73

2.35

2.56

2.29

2.48

2.47

2.67

2.4

2.53

2.29

2.48

2.53

2.4

2.3

2.56

2.5

2.47

2.43

2.47

2.1

2.62

2.57

2.45

2.53

2.6

2.2

2.47

2.5

2.45

EIE Surveyor Final Report

97

Tuning methodology in EIE

15. Ability to demonstrate knowledge and understanding of the commercial and economic context 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

EIE Surveyor Final Report

2.13

2.8

2.35

2.41

2.36

2.41

2.4

2.6

2.2

2.5

2.29

2.41

2.4

2.6

2.3

2.44

2.29

2.41

2.07

2.07

2.5

2.65

2.07

2.36

2.27

2.73

2.15

2.53

1.93

2.36

2

2.47

2.2

2.35

1.86

2.21

1.87

2.4

2.1

2.35

1.86

2.16

98

Tuning methodology in EIE

Table 5.11 Comparison of mean difference between rated importance and level of development of the specific competences for all academics and by level of study. Specific competence Ability to identify and manage cost drivers in designs and projects Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues Ability to demonstrate understanding of appropriate codes of practice and industry standards Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering Ability to demonstrate awareness of quality issues Ability to apply a systems approach to engineering problems Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development Ability to demonstrate awareness of the nature of intellectual property and contractual issues Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal Ability to manage the design process and evaluate outcomes Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles Ability to demonstrate knowledge and understanding of the commercial and economic context Ability to apply and integrate knowledge and understanding of other engineering disciplines Ability to work in a group on a major project Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement Ability to work with technical uncertainty Ability to demonstrate practical engineering skills Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) Ability to demonstrate understanding of the use of technical literature and other information sources Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products.

EIE Surveyor Final Report

99

All 0.68

Bachelor 0.64

Master 0.68

0.64

0.64

0.6

0.62

0.67

0.61

0.61

0.59

0.57

0.61 0.61 0.6

0.63 0.57 0.51

0.57 0.66 0.77

0.6

0.5

0.68

0.6

0.6

0.58

0.6

0.64

0.54

0.59 0.59

0.56 0.53

0.72 0.66

0.56

0.47

0.68

0.55

0.47

0.69

0.54

0.52

0.58

0.52 0.51

0.46 0.49

0.57 0.55

0.49

0.48

0.51

0.48 0.48 0.47

0.47 0.44 0.44

0.48 0.52 0.55

0.43

0.41

0.49

0.41

0.36

0.46

0.38

0.34

0.42

0.36

0.32

0.42

0.32

0.22

0.48

0.32

0.21

0.42

0.32

0.26

0.35

Tuning methodology in EIE

Table 5.12 Mean ‘gap’ in specific competences by country United Kingdom

Turkey

Spain

Slovak Republic

Poland

Ireland

Greece

EIE Surveyor Final Report

France

Bulgaria 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 8. Ability to apply a systems approach to engineering problems 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 11. Ability to identify and manage cost drivers in designs and projects 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 14. Ability to manage the design process and evaluate outcomes 15. Ability to demonstrate knowledge and understanding of the commercial and economic context

0.6

0.33

0.53

0.58

0.64

0.4

0.24

0

0.44

0.9

0.4

0.13

0.67

0.45

0.3

0.15

0.14

0.22

0.7

0.73

0.53

0.92

0.55

0.5

0.38

0.43

0.56

0.8

1

0.4

0.75

0.82

0.45

0.38

0.5

0.5

0.4

0.93

0.93

0.42

0.82

0.35

0.26

0.5

0.89

0.6

0.33

0.07

0.58

0.55

0.35

0.18

0.07

0.22

0.7

0.5

0.47

0.75

0.36

0.45

0.21

0.5

0

0.6

0.67

0.47

0.5

1.18

0.5

0.38

0.64

0.78

0.8

0.73

0.73

0.75

1

0.45

0.5

0.79

0.56

0.7

0.67

0.53

0.42

0.91

0.35

0.56

1

0.62

0.6

0.67

1.07

0.75

0.82

0.45

0.56

0.71

0.44

0.8

0.73

0.47

0.75

1.09

0.45

0.53

0.5

0.25

0.8

0.47

0.8

0.42

0.73

0.55

0.47

0.36

0.89

0.5

0.67

0.53

0.67

0.73

0.4

0.47

0.57

0.56

0.4

0.6

0.6

0.67

0.73

0.3

0.5

0.64

0.89

100

Tuning methodology in EIE

16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 21. Ability to demonstrate practical engineering skills 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 23. Ability to demonstrate understanding of the use of technical literature and other information sources 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 26. Ability to demonstrate awareness of quality issues 27. Ability to work with technical uncertainty 28. Ability to work in a group on a major project

EIE Surveyor Final Report

0.3

0.87

0.73

0.58

0.64

0.3

0.35

0.43

0.78

0.5

0.73

0.8

0.5

1

0.45

0.32

0.57

1.11

0.6

0.73

1

0.67

0.91

0.45

0.29

0.86

0.78

0.7

0.73

0.67

0.83

0.64

0.6

0.29

0.71

1

0.3

0.4

0.2

0.17

0.45

0.25

0.12

0.57

0.44

0.6

0.27

0.53

0.5

1.09

0.35

0.32

0.07

0.33

0.5

0.4

0.6

0.33

0.64

0.32

0.29

0.36

0.33

0.4

0.67

0.6

0.58

1.09

0.3

0

0.21

0

0.6

0.8

0.8

0.5

0.64

0.45

0.32

1

0.89

0.5

0.87

0.8

0.42

0.73

0.55

0.41

1

0.67

0.2

0.73

0.67

0.67

0.91

0.6

0.41

0.57

0.78

0.4

0.87

0.53

0.5

0.55

0.3

0.41

0.43

0.56

0.6

0.53

0.73

0.58

1.09

0.4

0.44

0.5

0.11

101

Tuning methodology in EIE

Table 6.1 Mean of importance of the generic competences for all employers and by level of study Generic competences Problem solving – Importance Concern for quality – Importance Capacity to learn – Importance Teamworking – Importance Capacity for applying knowledge in practice – Importance Elementary computing skills – Importance Oral and written communication in your native language – Importance Capacity to adapt to new situations – Importance Capacity for analysis and synthesis – Importance Basic general technical knowledge of the profession of your work area – Importance Information management skills – Importance Ability to work autonomously – Importance Capacity for generating new ideas (creativity) – Importance Will to succeed – Importance Decision making – Importance Planning and time management – Importance Interpersonal skills – Importance Grounding in basic knowledge of the profession of your work area – Importance Initiative and entrepreneurial spirit – Importance Ability to communicate with non-experts (in the field) – Importance Project design and management – Importance Ability to work in an interdisciplinary team – Importance Appreciation of ethical issues – Importance Critical and self-critical abilities – Importance Ability to work in an international context – Importance Knowledge of a second language – Importance Research skills -Importance Appreciation of diversity and multiculturality – Importance Leadership – Importance International Relations and Collaborations – Importance Patents and Intellectual Property Rights – Importance Understanding of cultures and customs of other countries – Importance

EIE Surveyor Final Report

102

All 3.62 3.61 3.6 3.6 3.59 3.55 3.49 3.44 3.4 3.4 3.4 3.4 3.36 3.36 3.26 3.24 3.24 3.21 3.2 3.16 3.12 3.06 3.02 2.98 2.95 2.91 2.87 2.78 2.72 2.68 2.61 2.51

Bachelor 3.54 3.51 3.54 3.46 3.46 3.71 3.46 3.27 3.39 3.37 3.39 3.29 3.44 3.34 3.22 3.15 3.17 3.24 3.22 3.15 3.02 2.93 2.98 2.85 2.78 2.56 2.9 2.51 2.59 2.46 2.49 2.44

Masters 3.73 3.73 3.63 3.76 3.71 3.44 3.51 3.63 3.46 3.49 3.41 3.46 3.27 3.39 3.32 3.32 3.34 3.17 3.17 3.22 3.17 3.2 3.07 3.1 3.12 3.2 2.8 3.05 2.8 2.88 2.73 2.56

Tuning methodology in EIE

Table 6.1(a) Mean of importance of the generic competences for all employers and by country Generic competence Problem solving – Importance Elementary computing skills – Importance Capacity to learn – Importance Concern for quality – Importance Teamworking – Importance Capacity for applying knowledge in practice – Importance Oral and written communication in your native language – Importance Capacity to adapt to new situations – Importance Capacity for generating new ideas (creativity) – Importance Information management skills – Importance Capacity for analysis and synthesis – Importance Basic general technical knowledge of the profession of your work area – Importance Ability to work autonomously – Importance Will to succeed – Importance Decision making – Importance Interpersonal skills – Importance Initiative and entrepreneurial spirit – Importance Planning and time management – Importance Grounding in basic knowledge of the profession of your work area – Importance Project design and management – Importance Ability to communicate with non-experts (in the field) – Importance Appreciation of ethical issues – Importance Critical and self-critical abilities – Importance Ability to work in an interdisciplinary team – Importance Research skills -Importance Ability to work in an international context – Importance Knowledge of a second language – Importance Leadership – Importance Appreciation of diversity and multiculturality – Importance Patents and Intellectual Property Rights – Importance International Relations and Collaborations – Importance Understanding of cultures and customs of other countries – Importance

EIE Surveyor Final Report

Bulgaria 3.8 3.85 3.7 3.75 3.7

France 3.71 3.71 3.71 2.86 4

Germany 3.4 3.5 3.2 3.6 3

Ireland 3.78 3.78 3.67 3.78 3.56

Poland 3.31 2.92 3.54 3.46 3.46

Total 3.63 3.59 3.59 3.59 3.54

3.75

3.14

3.3

3.72

3.31

3.53

3.6 3.6

3.43 3.43

3.3 2.9

3.72 3.44

3.08 3.46

3.47 3.41

3.55 3.5 3.4

3.57 3.71 3.29

3.3 3.2 3

3.56 3.67 3.72

3 2.85 3.23

3.41 3.4 3.38

3.65 3.4 3.3 3.55 3.35 3.35 3.25

3.14 3 3.29 3.29 3 3.14 3

3.4 3.3 3.5 3.1 3 3.3 3.1

3.33 3.56 3.44 3.39 3.5 3.28 3.33

3.08 3.23 3.08 2.85 3 3 3.08

3.37 3.35 3.32 3.28 3.24 3.24 3.19

3.2 2.9

3.29 3.43

3.2 3

3.28 3.33

3 3

3.19 3.1

3.2 3.25 2.95 3.05 3 3.15 3.3 3

3.43 2.57 3.14 3 2.86 3.14 3.29 2.86

2.8 3 2.9 2.8 2.9 2.5 2 2.3

3.28 3.06 3 3.11 2.78 2.5 2 2.78

2.69 2.77 2.85 2.62 2.69 2.85 3.23 2.38

3.09 3 2.96 2.94 2.85 2.82 2.75 2.71

3 2.75 2.85

2.43 2.29 2.43

2.3 2.8 2.6

2.5 2.67 2.28

2.62 2 2.46

2.63 2.54 2.54

2.35

2.57

2.3

2.28

2.38

2.35

103

Tuning methodology in EIE

Table 6.2 Weighted ranking of importance of generic competences by employers for all and by study level Generic competence Capacity for applying knowledge in practice – Importance Capacity for analysis and synthesis – Importance Capacity to learn – Importance Teamworking – Importance Basic general technical knowledge of the profession of your work area – Importance Problem solving – Importance Concern for quality – Importance Research skills -Importance Planning and time management – Importance Ability to work autonomously – Importance Decision making – Importance Information management skills – Importance Capacity for generating new ideas (creativity) – Importance Grounding in basic knowledge of the profession of your work area – Importance Knowledge of a second language – Importance Elementary computing skills – Importance Project design and management – Importance Capacity to adapt to new situations – Importance Interpersonal skills – Importance Ability to communicate with non-experts (in the field) – Importance Oral and written communication in your native language – Importance Initiative and entrepreneurial spirit – Importance Ability to work in an interdisciplinary team – Importance International Relations and Collaborations – Importance Ability to work in an international context – Importance Appreciation of diversity and multiculturality – Importance Critical and self-critical abilities – Importance Will to succeed – Importance Leadership – Importance Appreciation of ethical issues – Importance Patents and Intellectual Property Rights – Importance Understanding of cultures and customs of other countries – Importance

EIE Surveyor Final Report

104

All 142 110 79 77 71 67 66 61 60 53 52 51 48 42 37 27 24 22 18 17 16 14 12 12 10 8 7 7 6 6 4 0

Bachelor 52 50 44 20 36 38 35 42 27 35 19 29 31 20 12 16 16 4 11 6 3 9 10 2 8 8 1 5 6 5 0 0

Masters 87 60 30 54 34 24 31 19 22 11 33 20 16 22 25 11 6 18 7 11 13 0 2 10 2 0 6 2 0 1 4 0

Tuning methodology in EIE

Table 6.3 Employer view of mean level of development for the generic competences by academic level Generic competence Elementary computing skills – Level Capacity to learn – Level Oral and written communication in your native language – Level Will to succeed – Level Basic general technical knowledge of the profession of your work area – Level Grounding in basic knowledge of the profession of your work area – Level Capacity for analysis and synthesis – Level Information management skills – Level Problem solving – Level Teamworking – Level Capacity for applying knowledge in practice – Level Concern for quality – Level Capacity to adapt to new situations – Level Capacity for generating new ideas (creativity) – Level Interpersonal skills – Level Ability to work autonomously – Level Decision making – Level Project design and management – Level Appreciation of ethical issues – Level Ability to communicate with non-experts (in the field) – Level Initiative and entrepreneurial spirit – Level Research skills – Level Ability to work in an interdisciplinary team – Level Appreciation of diversity and multiculturality – Level Ability to work in an international context – Level Knowledge of a second language – Level Critical and self-critical abilities – Level Planning and time management – Level Understanding of cultures and customs of other countries – Level Leadership – Level International Relations and Collaborations – Level Patents and Intellectual Property Rights – Level

EIE Surveyor Final Report

105

All 3.46 3.19 3.13 3 2.99 2.95 2.93 2.92 2.91 2.88 2.85 2.82 2.79 2.76 2.74 2.74 2.66 2.64 2.64 2.6 2.58 2.54 2.52 2.52 2.52 2.51 2.51 2.48 2.36 2.26 2.26 2.18

Bachelor 3.61 3.17 3.1 3.02 3.1 3.2 3.07 2.95 2.9 2.71 2.93 2.85 2.8 2.8 2.76 2.76 2.63 2.63 2.68 2.68 2.66 2.49 2.54 2.41 2.41 2.39 2.44 2.59 2.29 2.29 2.12 2.05

Master 3.34 3.2 3.15 2.98 2.95 2.73 2.8 2.88 2.95 3.05 2.8 2.76 2.78 2.73 2.76 2.71 2.63 2.61 2.56 2.51 2.46 2.56 2.49 2.59 2.56 2.59 2.54 2.39 2.39 2.17 2.34 2.27

Tuning methodology in EIE

Table 6.3(a) Employer view of mean level of development for the generic competences by country Generic competence Elementary computing skills – Level Capacity to learn – Level Oral and written communication in your native language – Level Basic general technical knowledge of the profession of your work area – Level Grounding in basic knowledge of the profession of your work area – Level Capacity for analysis and synthesis – Level Information management skills – Level Will to succeed – Level Problem solving – Level Capacity for applying knowledge in practice – Level Teamworking – Level Concern for quality – Level Capacity for generating new ideas (creativity) – Level Capacity to adapt to new situations – Level Ability to work autonomously – Level Interpersonal skills – Level Decision making – Level Appreciation of ethical issues – Level Project design and management – Level Ability to communicate with non-experts (in the field) – Level Initiative and entrepreneurial spirit – Level Research skills – Level Ability to work in an interdisciplinary team – Level Critical and self-critical abilities – Level Planning and time management – Level Appreciation of diversity and multiculturality – Level Knowledge of a second language – Level Ability to work in an international context – Level Understanding of cultures and customs of other countries – Level Leadership – Level Patents and Intellectual Property Rights – Level International Relations and Collaborations – Level

EIE Surveyor Final Report

106

Bulgaria 3.65 3.25

France 3.57 3.43

Germany 3.6 2.9

Ireland 3.83 3.44

Poland 2.69 2.92

Total 3.5 3.21

3.5

3.43

3.1

3.06

2.69

3.16

3.35

3.14

3.3

3.11

2.15

3.03

3.2 2.95 3.1 3.05 3.15 3 3.2 3.05 2.85 2.9 2.9 2.9 2.8 2.9 2.75

3 3 3 2.57 3 2.71 3.14 2.71 3.14 2.57 2.71 2.86 3 2.71 2.86

3.2 3.1 3 3.3 3.2 2.9 2.7 2.9 2.7 2.7 2.8 2.8 2.6 2.4 2.7

3.33 3.39 3.33 3.28 3 3.22 2.61 2.94 3.06 3.11 3.11 2.94 2.78 2.61 2.67

2.23 2.31 2.08 2.23 2.15 2.31 2.77 2.31 2.31 2.31 2.08 2.08 2.15 2.54 2.23

3.03 2.97 2.94 2.94 2.91 2.88 2.88 2.82 2.81 2.78 2.76 2.74 2.66 2.66 2.63

2.9 2.65 2.45 2.6 2.6 2.65 2.95 2.6 2.8

2.86 2.43 2.71 3.14 2.43 2.71 2.57 3 2.71

2.4 2.7 2.9 2.3 2.5 2.2 1.8 2.1 2

2.72 2.83 2.39 2.5 2.61 2.89 2.44 2.39 2.28

2 2.23 2.46 2.31 2.23 1.77 2.31 2.23 2.31

2.6 2.6 2.53 2.53 2.5 2.49 2.49 2.44 2.44

2.4 2.25 2.5 2.45

2.57 2.86 2 2.43

1.9 2.2 2 2

2.22 2.39 2.06 1.83

2.38 1.77 1.92 1.92

2.29 2.25 2.15 2.12

Tuning methodology in EIE

Table 6.4 Comparison of mean difference between rated importance and level of development of the generic competences for all employers and by academic level. Generic competence Concern for quality Planning and time management Capacity for applying knowledge in practice Problem solving Teamworking Ability to work autonomously Capacity to adapt to new situations Initiative and entrepreneurial spirit Capacity for generating new ideas (creativity) Decision making Ability to communicate with non-experts (in the field) Ability to work in an interdisciplinary team Interpersonal skills Information management skills Project design and management Capacity for analysis and synthesis Critical and self-critical abilities Leadership Ability to work in an international context Patents and Intellectual Property Rights International Relations and Collaborations Basic general technical knowledge of the profession of your work area Capacity to learn Knowledge of a second language Appreciation of ethical issues Oral and written communication in your native language Will to succeed Research skills Grounding in basic knowledge of the profession of your work area Appreciation of diversity and multiculturality Understanding of cultures and customs of other countries Elementary computing skills

EIE Surveyor Final Report

107

All 0.79 0.75 0.74 0.72 0.72 0.66 0.65 0.62 0.6 0.6 0.56 0.54 0.49 0.48 0.48 0.47 0.47 0.46 0.44 0.44 0.42 0.41 0.41 0.4 0.39 0.36 0.36 0.33 0.26 0.26 0.14 0.09

Bachelor 0.66 0.56 0.54 0.63 0.76 0.54 0.46 0.56 0.63 0.59 0.46 0.39 0.41 0.44 0.39 0.32 0.41 0.29 0.37 0.44 0.34 0.27 0.37 0.17 0.29 0.37 0.32 0.41 0.05 0.1 0.15 0.1

Master 0.98 0.93 0.9 0.78 0.71 0.76 0.85 0.71 0.54 0.68 0.71 0.71 0.59 0.54 0.56 0.66 0.56 0.63 0.56 0.46 0.54 0.54 0.44 0.61 0.51 0.37 0.41 0.24 0.44 0.46 0.17 0.1

Tuning methodology in EIE

Table 6.4(a) Comparison of mean difference between rated importance and level of development of the generic competences for all employers and by country (sorted by total). Generic competence Concern for quality Planning and time management Capacity for applying knowledge in practice Problem solving Teamworking Ability to work autonomously Capacity to adapt to new situations Initiative and entrepreneurial spirit Capacity for generating new ideas (creativity) Decision making Ability to communicate with nonexperts (in the field) Ability to work in an interdisciplinary team Interpersonal skills Information management skills Project design and management Capacity for analysis and synthesis Critical and self-critical abilities Leadership Ability to work in an international context Patents and Intellectual Property Rights International Relations and Collaborations Basic general technical knowledge of the profession of your work area Capacity to learn Knowledge of a second language Appreciation of ethical issues Oral and written communication in your native language Will to succeed Research skills Grounding in basic knowledge of the profession of your work area Appreciation of diversity and multiculturality Understanding of cultures and customs of other countries Elementary computing skills

EIE Surveyor Final Report

Bulgaria 0.7 0.6

France 0.14 0.29

Germany 0.7 0.9

Ireland 0.83 0.44

Poland 1.15 1.31

Slovak Republic 0.86 0.71

Total 0.79 0.75

0.75 0.65 0.5 0.5 0.7 0.7

0.43 0.71 0.86 0.29 0.86 0.71

0.4 0.2 0.3 0.5 0.2 0.6

0.5 0.78 0.94 0.44 0.33 0.44

1 1.15 0.69 1.15 1.15 0.77

0.86 0.71 0.71 1.14 0.71 0.43

0.74 0.72 0.72 0.66 0.65 0.62

0.7 0.75

0.43 0.29

0.6 0.5

0.5 0.61

0.69 0.69

0.57 0.57

0.6 0.6

0.3

0.57

0.4

0.56

0.69

0.29

0.56

0.45 0.45 0.4 0.15 0.45 0.35 0.75

-0.14 0.14 0.71 0.57 0.29 0.71 0

0.5 0.2 0.2 0.3 -0.1 0.4 0.1

0.61 0.56 0.33 0.67 0.33 0.39 0.39

0.31 0.92 0.77 0.77 0.92 0.62 0.62

0.86 0.14 0.57 0.71 0.43 0.57 0.29

0.54 0.49 0.48 0.48 0.47 0.47 0.46

0.35

0.43

0.5

0.22

0.54

0.71

0.44

0.25

0.29

0.8

0.61

0.08

0.43

0.44

0.4

0

0.6

0.44

0.54

0.43

0.42

0.3 0.45 0.7 0.35

0 0.29 0.29 -0.14

0.1 0.3 -0.1 0.6

0.22 0.22 -0.39 0.44

0.92 0.62 1 0.23

0.86 0.29 0.86 0.29

0.41 0.41 0.4 0.39

0.1 0.25 0.55

0 0.71 0.14

0.2 0.2 0

0.67 0.17 0.39

0.38 0.85 0.23

0.57 0.43 0.14

0.36 0.36 0.33

0

0.29

0

-0.06

0.77

0.57

0.26

0.05

-0.14

0.5

0.06

0.31

0.57

0.26

-0.05 0.2

0 0.14

0.4 -0.1

0.06 -0.06

0 0.23

0.29 0.29

0.14 0.09

108

Tuning methodology in EIE

Table 6.6 Employer perception of importance of the specific competences by academic level Specific competence 26. Ability to demonstrate awareness of quality issues 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 23. Ability to demonstrate understanding of the use of technical literature and other information sources 28. Ability to work in a group on a major project 8. Ability to apply a systems approach to engineering problems 21. Ability to demonstrate practical engineering skills 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 11. Ability to identify and manage cost drivers in designs and projects 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 27. Ability to work with technical uncertainty 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 14. Ability to manage the design process and evaluate outcomes 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues

EIE Surveyor Final Report

109

All 3.34

Bachelor 3.44

Master 3.23

3.28

3.33

3.2

3.27 3.25 3.24 3.24

3.47 3.36 3.31 3.42

3.03 3.13 3.13 3.03

3.22

3.31

3.13

3.21

3.28

3.13

3.21

3.36

3.03

3.19

3.28

3.1

3.15 3.13

3.36 3.19

2.87 3.07

3.12

3.08

3.13

3.09

3.11

3.03

3.09

3.28

2.87

3.06 3.04

3.06 3.11

3.07 2.97

3.01

3.06

2.93

3

3.17

2.8

3

3.08

2.9

2.99

3.06

2.9

2.97 2.96

3.11 3.17

2.8 2.7

2.91

3

2.8

2.9

2.97

2.8

2.87

2.81

2.93

2.79

2.72

2.87

2.76

2.83

2.67

Tuning methodology in EIE

Table 6.6(a) Employer perception of importance of the specific competences by country Specific competence 26. Ability to demonstrate awareness of quality issues 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 21. Ability to demonstrate practical engineering skills 23. Ability to demonstrate understanding of the use of technical literature and other information sources 28. Ability to work in a group on a major project 11. Ability to identify and manage cost drivers in designs and projects 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 8. Ability to apply a systems approach to engineering problems 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 27. Ability to work with technical uncertainty 14. Ability to manage the design process and evaluate outcomes 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues

EIE Surveyor Final Report

110

Bulgaria 3.4

France

Germany

3.4

3.3

Ireland 3.44

Total 3.4

3.3 3.25

3.8 3.6

3.3 3.3

3.39 3.33

3.38 3.32

3.2 3.25

3.4 3.4

3.3 3.4

3.44 3.22

3.32 3.28

3.25

3.4

3

3.39

3.26

3.1

3.4

3.3

3.33

3.25

3.05 3.25

3.4 3.6

3.2 3.2

3.44 3.17

3.25 3.25

2.9

3.4

3.5

3.39

3.23

3

3.6

3.2

3.28

3.19

2.9

3.4

3.1

3.39

3.15

3

3.6

3.1

3.17

3.13

3.1

3.4

2.9

3.22

3.13

2.9

3.4

3.3

3.22

3.13

3 2.95 2.9

3.6 2.8 3.6

3.2 3.3 3.1

2.94 3.17 3.06

3.08 3.08 3.06

3

3.2

3

3.11

3.06

2.7

3.6

3.2

3.17

3.04

2.95

3.2

3

3.11

3.04

2.9

3.4

2.9

3.11

3.02

2.7

3.2

3.1

3.22

3

2.6

3.2

3.2

3

2.91

2.65

3.2

2.9

3.11

2.91

2.7

2.8

2.9

3.11

2.89

2.65

3

2.7

3

2.81

Tuning methodology in EIE

18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

2.55

3.2

2.6

3

2.77

Table 6.7 Employer perception of level of development of the specific competences by academic level Specific competences 23. Ability to demonstrate understanding of the use of technical literature and other information sources 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 21. Ability to demonstrate practical engineering skills 8. Ability to apply a systems approach to engineering problems 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 26. Ability to demonstrate awareness of quality issues 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 28. Ability to work in a group on a major project 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 27. Ability to work with technical uncertainty 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 14. Ability to manage the design process and evaluate outcomes 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 11. Ability to identify and manage cost drivers in designs and projects 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

EIE Surveyor Final Report

111

All

Bachelor

Master

3.01

3.19

2.8

2.9

2.83

2.97

2.87

2.97

2.73

2.82 2.78 2.69 2.66 2.64

2.92 2.94 2.72 2.69 2.67

2.7 2.57 2.6 2.6 2.6

2.61 2.61

2.58 2.72

2.6 2.47

2.6

2.67

2.47

2.6

2.67

2.5

2.57

2.64

2.47

2.57

2.72

2.33

2.52

2.5

2.53

2.51 2.51

2.61 2.56

2.37 2.43

2.49

2.69

2.23

2.48

2.44

2.47

2.45 2.45 2.4

2.33 2.5 2.56

2.53 2.37 2.2

2.37

2.36

2.37

2.33 2.31 2.3 2.22

2.44 2.47 2.36 2.36

2.17 2.1 2.2 2.03

2.22

2.33

2.07

Tuning methodology in EIE

Table 6.7(a) Employer perception of level of development of the specific competences by country Specific competence 23. Ability to demonstrate understanding of the use of technical literature and other information sources 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 21. Ability to demonstrate practical engineering skills 8. Ability to apply a systems approach to engineering problems 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 26. Ability to demonstrate awareness of quality issues 28. Ability to work in a group on a major project 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 27. Ability to work with technical uncertainty 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 14. Ability to manage the design process and evaluate outcomes 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 11. Ability to identify and manage cost drivers in designs and projects 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

EIE Surveyor Final Report

112

Bulgaria

France

Germany

Ireland

Total

2.7

3.2

3.2

3.44

3.09

2.7

3

2.9

3.11

2.91

2.8

3

2.5

3.06

2.85

2.7 2.45 2.55

3.2 3.4 3.2

2.6 2.9 2.8

3.06 2.94 2.78

2.85 2.79 2.74

2.55

3.2

2.4

2.83

2.68

2.55

3

2.6

2.72

2.66

2.6

3.2

2.8

2.5

2.66

2.45 2.6 2.2

3 3 2.6

2.8 2.6 2.9

2.67 2.61 3

2.64 2.64 2.64

2.4

2.8

2.5

2.83

2.6

2.35

2.8

2.5

2.83

2.58

2.35

2.8

2.7

2.67

2.57

2.5

2.4

2.7

2.56

2.55

2.4

3

2.6

2.56

2.55

2.4 2.35

2.8 2.6

2.6 2.8

2.5 2.5

2.51 2.51

2.65

2.2

2.3

2.5

2.49

2.35

2.8

2.7

2.44

2.49

2.1

3

2.7

2.56

2.45

2.3 2.2

2.2 3.2

2.8 2.4

2.39 2.33

2.42 2.38

2.1

2.4

2.6

2.44

2.34

2.05 2.1

2.4 2.6

2.7 2.4

2.39 2.28

2.32 2.26

1.85

2.8

2.5

2.44

2.26

Tuning methodology in EIE

Table 6.8 Comparison of mean difference between rated importance and level of development for all employers and by level of study. Specific competence 11. Ability to identify and manage cost drivers in designs and projects 26. Ability to demonstrate awareness of quality issues 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 14. Ability to manage the design process and evaluate outcomes 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 28. Ability to work in a group on a major project 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 8. Ability to apply a systems approach to engineering problems 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 27. Ability to work with technical uncertainty 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 21. Ability to demonstrate practical engineering skills 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 23. Ability to demonstrate understanding of the use of technical literature and other information sources 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline

EIE Surveyor Final Report

113

All 0.91 0.7

Bachelor 0.83 0.78

Master 1.03 0.63

0.69 0.69 0.64

0.67 0.72 0.69

0.73 0.67 0.6

0.64 0.64

0.67 0.64

0.63 0.67

0.61

0.67

0.57

0.6

0.61

0.6

0.57

0.72

0.4

0.57 0.55 0.55

0.39 0.58 0.58

0.8 0.53 0.53

0.55

0.44

0.7

0.55

0.36

0.8

0.54

0.78

0.27

0.54 0.54

0.56 0.56

0.53 0.53

0.51

0.39

0.67

0.49 0.46 0.46

0.44 0.47 0.47

0.57 0.47 0.47

0.37

0.47

0.27

0.34

0.39

0.3

0.34

0.36

0.33

0.33

0.47

0.17

0.25

0.28

0.23

0.18

0.25

0.1

Tuning methodology in EIE

Table 6.9 Comparison of mean difference between rated importance and level of development of the specific competences for all employers and by country (sorted by total). Specific competence 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 8. Ability to apply a systems approach to engineering problems 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 27. Ability to work with technical uncertainty 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 21. Ability to demonstrate practical engineering skills 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 23. Ability to demonstrate understanding of the use of technical literature and other information sources 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline

Bulgaria

France

Germany

Ireland

Slovak Republic

Total

0.25

1.2

0.6

0.61

0.17

0.57

0.7

0.4

0.1

0.56

0.33

0.57

0.5

0.2

0.8

0.61

0.33

0.55

0.7

0.4

0.4

0.39

1

0.55

0.6

0.6

0.6

0.39

0.33

0.55

0.65

0.4

0.1

0.56

0.67

0.55

0.45

0.6

0.6

0.56

0.5

0.54

0.9 0.6

0.2 0.2

0.3 0.5

0.56 0.67

0 0

0.54 0.54

0.6

0.4

0.3

0.44

0.67

0.51

0.4 0.8

0.6 0.2

0.1 0.4

0.72 0.39

0.33 -0.17

0.49 0.46

0.55

0.6

0.1

0.56

0.17

0.46

0.1

0.8

0.5

0.44

0.33

0.37

0.2

0.4

0.6

0.28

0.17

0.34

0.3

0.4

0.4

0.28

0.33

0.34

0.3

0.4

0.8

0.28

-0.17

0.33

0.5

0.2

0.1

0

0

0.25

0

0.4

0.6

0.11

-0.33

0.18

EIE Surveyor Final Report

114

Tuning methodology in EIE

26. Ability to demonstrate awareness of quality issues 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 11. Ability to identify and manage cost drivers in designs and projects 14. Ability to manage the design process and evaluate outcomes 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 28. Ability to work in a group on a major project

EIE Surveyor Final Report

0.8

0.4

0.7

0.83

0

0.7

0.5

0.6

0.6

0.56

0.33

0.6

0.6

0.8

0.5

0.67

0

0.61

0.7

0.6

0.5

0.89

0.33

0.69

1.15

0.8

0.6

1.11

0.5

0.91

0.7

0.4

0.7

0.72

0.17

0.64

0.65

0.8

0.4

0.83

0.33

0.64

0.55 1.05

0.6 0.8

0.6 0.5

0.78 0.22

0.67 0.17

0.69 0.64

115

Tuning methodology in EIE

Table 7.2 Mean preparedness for work by graduates by country Country Bulgaria Greece Ireland Poland Portugal Slovak Republic Spain Turkey

Mean 1.50 2.21 1.56 2.71 2.15 2.38 2.56 2.03

Table 7.3 Mean of importance of the generic competences for all graduates and by level of study Generic competence Problem solving – Importance Capacity for applying knowledge in practice – Importance Elementary computing skills – Importance Capacity for analysis and synthesis – Importance Capacity to learn – Importance Information management skills – Importance Teamworking – Importance Planning and time management – Importance Capacity for generating new ideas (creativity) – Importance Basic general technical knowledge of the profession of your work area – Importance Capacity to adapt to new situations – Importance Will to succeed – Importance Decision making – Importance Ability to work autonomously – Importance Concern for quality – Importance Oral and written communication in your native language – Importance Research skills -Importance Grounding in basic knowledge of the profession of your work area – Importance Knowledge of a second language – Importance Project design and management – Importance Ability to work in an international context – Importance Ability to work in an interdisciplinary team – Importance Interpersonal skills – Importance Critical and self-critical abilities – Importance Ability to communicate with non-experts (in the field) – Importance Initiative and entrepreneurial spirit – Importance Leadership – Importance International Relations and Collaborations – Importance Patents and Intellectual Property Rights – Importance Appreciation of ethical issues – Importance Appreciation of diversity and multiculturality – Importance Understanding of cultures and customs of other countries – Importance

EIE Surveyor Final Report

116

All 3.59 3.53 3.51 3.49 3.48 3.42 3.36 3.33 3.33 3.32 3.32 3.28 3.27 3.27 3.26 3.19 3.19 3.17 3.15 3.14 3.08 3.06 3.04 3.02 2.99 2.91 2.9 2.9 2.8 2.68 2.67 2.43

Bachelor 3.71 3.6 3.59 3.58 3.59 3.44 3.52 3.4 3.39 3.39 3.52 3.28 3.29 3.32 3.31 3.2 3.27 3.13 3.02 3.22 3.12 3.15 3.12 3.15 3.09 3 2.98 2.88 2.73 2.64 2.62 2.39

Master 3.53 3.49 3.47 3.45 3.42 3.41 3.31 3.29 3.31 3.28 3.21 3.29 3.28 3.27 3.27 3.17 3.1 3.15 3.2 3.13 3.07 3.01 2.99 2.97 2.93 2.86 2.86 2.92 2.83 2.72 2.71 2.47

Tuning methodology in EIE

Table 7.3(a) Mean of importance of the generic competences for all graduates and by country Generic competence Problem solving – Importance Capacity for applying knowledge in practice – Importance Elementary computing skills Capacity for analysis and Capacity to learn – Importance Information management skills Teamworking – Importance Capacity for generating new ideas (creativity) – Importance Planning and time management – Importance Basic general technical knowledge of the profession of your work area – Importance Capacity to adapt to new situations – Importance Ability to work autonomously – Importance Concern for quality – Importance Will to succeed – Importance Decision making – Importance Oral and written communication in your native language – Importance Grounding in basic knowledge of the profession of your work area – Importance Research skills -Importance Knowledge of a second language – Importance Project design and management – Importance Ability to work in an international context – Importance Ability to work in an interdisciplinary team – Importance Critical and self-critical abilities – Importance Interpersonal skills – Importance Ability to communicate with nonexperts (in the field) – Importance Initiative and entrepreneurial spirit – Importance International Relations and Collaborations – Importance Leadership – Importance Patents and Intellectual Property Rights – Importance Appreciation of diversity and multiculturality – Importance Appreciation of ethical issues – Importance Understanding of cultures and customs of other countries – Importance

EIE Surveyor Final Report

Bulgaria 3.66

Greece 3.79

Ireland 3.78

Poland 3.04

Slovak Republic 3.73

Spain 3.63

Turkey 3.7

Total 3.59

3.68 3.52 3.62 3.52 3.58 3.66

3.48 3.76 3.62 3.52 3.38 3.59

3.83 3.83 3.61 3.83 3.72 3.33

3.08 3.12 3 2.96 3.02 2.98

3.55 3.58 3.48 3.52 3.58 3.39

3.51 3.41 3.46 3.61 3.29 3.27

3.67 3.7 3.7 3.64 3.48 3.27

3.51 3.51 3.47 3.47 3.42 3.35

3.42

3.45

3.56

2.94

3.44

3.24

3.42

3.33

3.48

3.24

3.67

2.86

3.29

3.46

3.36

3.3

3.52

3.52

3.39

2.6

3.48

3.39

3.3

3.3

3.36

3.62

3.44

2.98

3.27

3.2

3.36

3.28

3.38 3.46 3.58 3.6

3.66 3.31 3.34 3.38

3.33 3.67 3.72 3.5

2.96 3 2.86 3.02

3.32 3.37 3.29 3.19

3.12 2.83 2.98 2.95

3.21 3.36 3.3 3.24

3.26 3.25 3.25 3.24

3.58

3.17

3.61

2.72

3.39

2.76

3.06

3.17

3.44 3.36

3.14 3.55

3.33 3.61

2.38 2.12

3.42 3.27

3.12 3.15

3.27 3.52

3.14 3.14

3.36

3.55

1.5

2.5

3.53

3.34

3.24

3.13

3.26

3.24

3.56

2.74

3.19

3.1

3.12

3.13

3.44

3.41

3.28

2.42

3.21

2.85

3.15

3.08

3.18

3.17

3.56

2.54

3.16

2.93

3.12

3.04

3.18 3.32

3.14 3.07

3.44 3.28

2.48 2.72

3.13 3.05

2.93 2.83

3.09 2.94

3.01 3.01

3.12

3.17

3.33

2.68

3

2.9

2.94

2.98

3.04

2.97

3.22

2.68

2.85

2.78

2.82

2.88

3.42 3.18

3.03 2.93

3.22 3.28

2.42 2.56

2.87 2.85

2.61 2.54

2.76 2.85

2.88 2.85

3.16

2.72

3.22

2.64

2.71

2.34

2.88

2.78

3.2

2.86

2.94

2.5

2.48

2.22

2.61

2.66

3.16

2.55

3

2.5

2.68

2.24

2.58

2.66

3.08

2.55

2.94

2.18

2.23

1.98

2.24

2.41

117

Tuning methodology in EIE

Table 7.4 Weighted ranking of importance of generic competences by graduates for all and by study level Generic competence Capacity for applying knowledge in practice Problem solving Capacity for analysis and synthesis Teamworking Capacity to learn Decision making Knowledge of a second language Capacity for generating new ideas (creativity) Planning and time management Research skills Basic general technical knowledge of the profession of your work area Capacity to adapt to new situations Elementary computing skills Ability to work autonomously Project design and management Will to succeed Information management skills Grounding in basic knowledge of the profession of your work area Concern for quality Leadership Interpersonal skills Initiative and entrepreneurial spirit Ability to work in an interdisciplinary team Ability to work in an international context Ability to communicate with non-experts (in the field) Oral and written communication in your native language Critical and self-critical abilities International Relations and Collaborations Appreciation of diversity and multiculturality Understanding of cultures and customs of other countries Patents and Intellectual Property Rights Appreciation of ethical issues

EIE Surveyor Final Report

118

All 458 451 403 369 300 233 201 191 177 160 159 132 124 112 112 104 100 90 76 71 70 67 66 52 46 42 39 27 20 18 15 10

Bachelor 116 118 113 82 88 45 48 74 51 29 34 31 48 20 38 29 33 32 33 35 10 18 24 13 16 9 12 1 7 8 5 5

Masters 304 292 250 253 187 170 137 96 103 112 110 92 70 83 65 71 60 53 38 34 48 46 36 37 26 29 27 24 10 7 10 5

Tuning methodology in EIE

Table 7.5 Graduate view of mean level of development for the generic competences by academic level Generic competence Elementary computing skills – Level Capacity to learn – Level Problem solving – Level Capacity for analysis and synthesis – Level Teamworking – Level Information management skills – Level Capacity for applying knowledge in practice – Level Basic general technical knowledge of the profession of your work area – Level Ability to work autonomously – Level Grounding in basic knowledge of the profession of your work area – Level Will to succeed – Level Oral and written communication in your native language – Level Research skills – Level Concern for quality – Level Decision making – Level Capacity to adapt to new situations – Level Project design and management – Level Capacity for generating new ideas (creativity) – Level Critical and self-critical abilities – Level Planning and time management – Level Interpersonal skills – Level Ability to work in an interdisciplinary team – Level Knowledge of a second language – Level Ability to communicate with non-experts (in the field) – Level Appreciation of ethical issues – Level Initiative and entrepreneurial spirit – Level Ability to work in an international context – Level Appreciation of diversity and multiculturality – Level Leadership – Level Patents and Intellectual Property Rights – Level International Relations and Collaborations – Level Understanding of cultures and customs of other countries – Level

EIE Surveyor Final Report

119

All 3.32 3.19 3.15 3.12 3.08 3.01 2.99 2.99 2.98 2.95 2.94 2.9 2.87 2.86 2.82 2.8 2.71 2.69 2.68 2.66 2.66 2.51 2.45 2.45 2.43 2.4 2.38 2.35 2.33 2.31 2.3 2.07

Bachelor 3.34 3.21 3.07 3.07 2.95 2.86 2.89 2.94 2.88 2.89 2.84 2.87 2.84 2.79 2.62 2.79 2.68 2.65 2.59 2.64 2.67 2.44 2.29 2.33 2.28 2.42 2.32 2.27 2.24 2.18 2.16 1.92

Master 3.32 3.18 3.15 3.13 3.12 3.06 3 3.01 3.01 2.98 2.97 2.92 2.85 2.89 2.9 2.78 2.72 2.69 2.69 2.63 2.66 2.52 2.53 2.45 2.49 2.39 2.37 2.4 2.38 2.39 2.38 2.14

Tuning methodology in EIE

Table 7.5(a) Graduate view of mean level of development for the generic competences by country Generic competence Elementary computing skills – Level Capacity to learn – Level Problem solving – Level Capacity for analysis and synthesis Teamworking – Level Information management skills – Level Capacity for applying knowledge in practice – Level Basic general technical knowledge of the profession of your work area – Level Ability to work autonomously – Level Grounding in basic knowledge of the profession of your work area – Level Will to succeed – Level Oral and written communication in your native language – Level Research skills – Level Concern for quality – Level Decision making – Level Capacity to adapt to new situations – Level Project design and management – Level Capacity for generating new ideas (creativity) – Level Critical and self-critical abilities – Level Interpersonal skills – Level Planning and time management – Level Ability to work in an interdisciplinary team – Level Ability to communicate with non-experts (in the field) – Level Knowledge of a second language – Level Appreciation of ethical issues – Level Ability to work in an international context – Level Initiative and entrepreneurial spirit Appreciation of diversity and multiculturality – Level Leadership – Level Patents and Intellectual Property Rights – Level

EIE Surveyor Final Report

Bulgaria

Greece

Ireland

Poland

Slovak Republic

Spain

Turkey

Total

3.2 3.06 3.46

3.24 3.14 3.1

3.56 3.33 3.33

3.34 3.1 2.94

3.24 3.18 3.08

3.37 3.41 2.98

3.64 3.3 3.39

3.34 3.2 3.16

3.18 3.34

3.07 2.97

3.11 2.94

3.02 3.32

3.05 2.9

3.22 2.95

3.27 3

3.12 3.08

3

2.76

3.11

3.12

3.05

2.9

3.15

3.02

3.4

2.9

2.94

2.72

2.92

2.88

3.15

2.99

3.02

3.28

2.94

2.74

3.19

2.76

2.97

2.99

2.96

2.9

3.11

3.06

3.02

2.85

2.94

2.98

2.8 3.12

2.97 3.03

3.06 3.17

2.88 3.06

3.15 2.79

2.83 2.61

3 3

2.95 2.94

3.08 2.98 3.1 3.36

2.79 2.72 2.79 2.69

3 3.11 2.94 2.5

2.98 2.68 2.98 2.86

2.94 2.87 2.77 2.68

2.76 2.73 2.61 2.39

2.85 3.12 2.91 3.03

2.92 2.87 2.87 2.82

2.74

2.66

2.72

2.92

2.79

2.63

3.06

2.8

2.78

2.55

2.89

2.88

2.63

2.49

2.79

2.71

2.84

2.62

2.44

2.78

2.65

2.41

2.88

2.68

2.66 2.8

2.55 2.66

2.56 2.56

2.86 2.96

2.58 2.52

2.54 2.39

2.88 2.7

2.67 2.66

2.74

2.66

2.56

2.72

2.52

2.63

2.7

2.65

2.58

2.48

2.11

2.66

2.6

2.2

2.67

2.51

2.62

2.55

2.39

2.6

2.37

2.12

2.45

2.45

2.78

2.59

1.5

2.28

2.48

2.12

2.85

2.44

2.62

2.14

1.78

2.66

2.39

2.32

2.45

2.41

2.84

2.45

2

2.2

2.35

2.15

2.33

2.37

2.56

2.28

2.33

2.38

2.23

2.24

2.58

2.37

2.66 2.62

2.24 2.21

2.06 2.11

2.62 2.56

2.19 2.15

2.2 1.93

2.3 2.58

2.36 2.33

2.62

2.21

1.89

2.98

2

1.73

2.33

2.3

120

Tuning methodology in EIE

International Relations and Collaborations – Level Understanding of cultures and customs of other countries – Level

EIE Surveyor Final Report

2.94

2.21

2.22

2.14

2.21

1.88

2.12

2.27

2.7

2.07

1.56

2

1.89

1.76

2

2.04

121

Tuning methodology in EIE

Table 7.6 Comparison of mean difference between rated importance and level of development of the generic competences for all graduates and by academic level. Generic competence Will to succeed Understanding of cultures and customs of other countries Teamworking Research skills Project design and management Problem solving Planning and time management Patents and Intellectual Property Rights Oral and written communication in your native language Leadership Knowledge of a second language Interpersonal skills International Relations and Collaborations Initiative and entrepreneurial spirit Information management skills Grounding in basic knowledge of the profession of your work area Elementary computing skills Decision making Critical and self-critical abilities Concern for quality Capacity to learn Capacity to adapt to new situations Capacity for generating new ideas (creativity) Capacity for applying knowledge in practice Capacity for analysis and synthesis Basic general technical knowledge of the profession of your work area Appreciation of ethical issues Appreciation of diversity and multiculturality Ability to work in an international context Ability to work in an interdisciplinary team Ability to work autonomously Ability to communicate with non-experts (in the field)

EIE Surveyor Final Report

122

All 0.34 0.37 0.28 0.31 0.42 0.44 0.67 0.49 0.28 0.56 0.7 0.38 0.59 0.51 0.41 0.22 0.19 0.46 0.34 0.41 0.29 0.51 0.64 0.54 0.36 0.33 0.26 0.32 0.7 0.55 0.29 0.54

Bachelor 0.45 0.47 0.56 0.44 0.54 0.64 0.76 0.55 0.33 0.74 0.73 0.45 0.72 0.58 0.58 0.24 0.25 0.67 0.56 0.52 0.38 0.73 0.74 0.71 0.51 0.45 0.35 0.35 0.8 0.72 0.44 0.76

Master 0.32 0.33 0.18 0.25 0.41 0.38 0.66 0.44 0.24 0.49 0.67 0.33 0.55 0.47 0.35 0.17 0.15 0.38 0.28 0.38 0.24 0.43 0.61 0.49 0.32 0.27 0.24 0.31 0.7 0.5 0.25 0.49

Tuning methodology in EIE

Table 7.6(a) Comparison of mean difference between rated importance and level of development of the generic competences for all graduates and by country. Generic competence Ability to work in an international context Knowledge of a second language Planning and time management Capacity for generating new ideas (creativity) International Relations and Collaborations Leadership Ability to work in an interdisciplinary team Capacity for applying knowledge in practice Ability to communicate with non-experts (in the field) Capacity to adapt to new situations Initiative and entrepreneurial spirit Patents and Intellectual Property Rights Decision making Problem solving Project design and management Information management skills Concern for quality Interpersonal skills Understanding of cultures and customs of other countries Capacity for analysis and synthesis Critical and self-critical abilities Will to succeed Basic general technical knowledge of the profession of your work area Research skills Appreciation of diversity and multiculturality Capacity to learn Ability to work autonomously Oral and written communication in your native language Teamworking Appreciation of ethical issues Grounding in basic knowledge of the profession of your work area Elementary computing skills

EIE Surveyor Final Report

Bulgaria

Greece

Ireland

Poland

Slovak Republic

Spain

Turkey

Total

0.6

0.97

1.28

0.22

0.85

0.71

0.82

0.73

0.58 0.74

0.97 0.59

0 1.11

0.22 0.14

1.05 0.77

1.22 0.83

0.39 0.67

0.7 0.68

0.58

0.83

1.11

0.16

0.79

0.83

0.55

0.64

0.48 0.56

0.83 0.72

1 1.17

0.28 0

0.66 0.71

0.73 0.61

0.64 0.27

0.6 0.56

0.6

0.69

1.44

-0.12

0.56

0.73

0.45

0.56

0.28

0.59

0.89

0.36

0.63

0.63

0.52

0.54

0.5

0.62

0.94

0.08

0.63

0.78

0.48

0.53

0.62

0.97

0.72

0.06

0.48

0.56

0.3

0.52

0.48

0.69

0.89

0.3

0.63

0.54

0.24

0.52

0.54 0.24 0.2 0.48 0.58 0.36 0.52

0.52 0.69 0.69 0.69 0.62 0.52 0.41

1.33 1 0.44 0.67 0.61 0.72 0.72

-0.34 0.16 0.1 -0.14 -0.1 0.02 -0.24

0.71 0.52 0.65 0.56 0.53 0.6 0.53

0.61 0.56 0.66 0.61 0.39 0.22 0.44

0.55 0.21 0.3 0.33 0.33 0.45 0.24

0.49 0.47 0.45 0.43 0.42 0.42 0.38

0.38

0.48

1.39

0.18

0.34

0.22

0.24

0.38

0.44

0.55

0.5

-0.02

0.44

0.24

0.42

0.37

0.52 0.46

0.59 0.31

0.89 0.56

-0.38 -0.2

0.55 0.5

0.39 0.37

0.21 0.3

0.36 0.35

0.5 0.38

0.24 0.83

0.44 0.5

-0.14 -0.56

0.29 0.4

0.63 0.41

0.33 0.39

0.33 0.32

0.54 0.46 0.42

0.62 0.38 0.76

0.89 0.5 0.22

-0.12 -0.14 -0.1

0.29 0.34 0.31

0.02 0.2 0.27

0.3 0.33 0.27

0.32 0.3 0.3

0.5 0.32 0.54

0.38 0.62 0.41

0.61 0.39 1.22

-0.26 -0.34 -0.16

0.45 0.48 0.29

0 0.32 -0.07

0.21 0.27 0.12

0.28 0.28 0.26

0.64 0.32

0.17 0.52

0.28 0.28

-0.5 -0.22

0.27 0.34

0.29 0.05

0.27 0.06

0.21 0.19

123

Tuning methodology in EIE

Table 7.8 Graduate perception of importance of the specific competences by academic level Specific competence 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 28. Ability to work in a group on a major project 23. Ability to demonstrate understanding of the use of technical literature and other information sources 21. Ability to demonstrate practical engineering skills 8. Ability to apply a systems approach to engineering problems 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 26. Ability to demonstrate awareness of quality issues 14. Ability to manage the design process and evaluate outcomes 11. Ability to identify and manage cost drivers in designs and projects 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 27. Ability to work with technical uncertainty 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

EIE Surveyor Final Report

124

All

Bachelor

Master

3.34

3.36

3.35

3.33 3.33

3.35 3.29

3.34 3.35

3.23 3.15 3.13

3.15 3.14 3.26

3.28 3.18 3.1

3.1

3.13

3.09

3.08

3.05

3.11

3.07

3.11

3.07

3.07

3.2

3.07

3.06

3.06

3.06

3.01

3.15

2.98

2.96 2.95 2.93 2.91

2.91 2.85 2.87 2.88

3 3.03 2.93 2.91

2.9

2.84

2.98

2.88

2.79

2.92

2.87 2.87

2.78 2.65

2.94 2.96

2.83

2.89

2.83

2.8

2.87

2.78

2.8

2.65

2.87

2.78

2.72

2.81

2.78

2.66

2.81

2.74

2.76

2.73

2.7

2.67

2.72

2.61

2.53

2.68

Tuning methodology in EIE

Table 7.8(a) Graduate perception of importance of the specific competences by country Generic competence 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 28. Ability to work in a group on a major project 23. Ability to demonstrate understanding of the use of technical literature and other information sources 21. Ability to demonstrate practical engineering skills 8. Ability to apply a systems approach to engineering problems 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 26. Ability to demonstrate awareness of quality issues 14. Ability to manage the design process and evaluate outcomes 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products.

EIE Surveyor Final Report

Bulgaria

Greece

Ireland

Poland

Slovak Republic

Spain

Turkey

Total

3.78

3.38

3.67

2.62

3.6

3.17

3.36

3.35

3.54

3.17

3.61

2.68

3.5

3.44

3.55

3.33

3.66

3.21

3.78

2.86

3.42

3.39

3.18

3.33

3.48

3.03

3.39

2.76

3.44

3.22

3.42

3.25

3.4

3.07

3.61

2.68

3.23

3.2

3.24

3.17

3.28

3.14

3.5

2.34

3.45

3

3.39

3.12

3.6

3.38

3.39

2.66

2.97

3.02

3.03

3.11

3.38

3.14

3.22

2.56

3.34

2.9

3.12

3.09

3.66

3.28

3.06

2.44

3.24

2.88

3

3.08

3.48

3.03

3.5

2.14

3.27

3.07

3.24

3.07

3.3

2.97

3.44

2.6

3.06

3.2

3.15

3.07

3.44

2.83

3.28

2.52

3.06

2.78

3.12

2.99

3.44

3.07

2.78

2.3

3.06

3.02

3.12

2.98

3.48

2.97

2.94

2.62

2.94

2.83

3.09

2.98

3.36

3.03

3.28

2.4

2.89

2.8

2.91

2.92

3.3

2.83

2.67

2.34

3.05

2.98

3.15

2.92

125

Tuning methodology in EIE

4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 11. Ability to identify and manage cost drivers in designs and projects 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 27. Ability to work with technical uncertainty 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

EIE Surveyor Final Report

3.34

2.72

2.83

2.62

2.97

2.71

2.91

2.89

3.32

3

3

2.46

2.77

2.71

3.18

2.89

3.24

2.86

2.89

2.62

2.85

2.83

2.97

2.89

3.22

2.38

3.06

2.5

3.03

2.88

3

2.88

3.2

2.79

3.11

2.48

2.73

2.98

2.64

2.82

3.32

2.69

2.67

2.5

2.9

2.56

2.94

2.82

3.28

3

3.11

2.52

2.65

2.66

2.67

2.81

3.24

2.55

3.17

2.4

2.79

2.63

3.06

2.81

3.4

2.79

2.83

2.28

2.9

2.59

2.55

2.78

3.38

2.9

2.94

2.28

2.63

2.59

2.58

2.73

3.28

2.72

3

2.38

2.66

2.44

2.67

2.72

3.28

2.55

2.72

2.14

2.65

2.34

2.64

2.62

126

Tuning methodology in EIE

Table 7.9 Graduate perception of level of development of the specific competences by academic level Specific competences 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 23. Ability to demonstrate understanding of the use of technical literature and other information sources 28. Ability to work in a group on a major project 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 8. Ability to apply a systems approach to engineering problems 21. Ability to demonstrate practical engineering skills 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 27. Ability to work with technical uncertainty 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 26. Ability to demonstrate awareness of quality issues 14. Ability to manage the design process and evaluate outcomes 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 11. Ability to identify and manage cost drivers in designs and projects 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

EIE Surveyor Final Report

127

All

Bachelor

Master

3.16

3.05

3.23

3.09

3.07

3.13

3.02

3.04

3.04

2.93 2.9

2.85 2.72

3.02 3

2.86 2.79 2.77 2.68

2.91 2.88 2.62 2.54

2.84 2.77 2.86 2.74

2.66

2.48

2.74

2.59

2.47

2.68

2.55

2.39

2.62

2.55

2.44

2.63

2.55 2.55

2.39 2.31

2.65 2.67

2.54 2.49 2.46

2.42 2.32 2.24

2.61 2.58 2.56

2.4

2.33

2.43

2.4 2.4 2.36

2.33 2.27 2.15

2.43 2.5 2.46

2.32

2.14

2.38

2.32 2.3

2.15 2.12

2.41 2.38

2.28

2.19

2.33

2.25

2.07

2.31

2.16

2.04

2.22

Tuning methodology in EIE

Table 7.9(a) Graduate perception of level of development of the specific competences by country Generic competence 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 23. Ability to demonstrate understanding of the use of technical literature and other information sources 28. Ability to work in a group on a major project 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 21. Ability to demonstrate practical engineering skills 8. Ability to apply a systems approach to engineering problems 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 27. Ability to work with technical uncertainty 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs

EIE Surveyor Final Report

Bulgaria

Greece

Ireland

Poland

Slovak Republic

Spain

Total

Turkey

3.54

3

3.11

2.92

3.18

3.2

3.15

3.17

3.36

3.31

2.89

2.88

3.16

3.15

2.91

3.11

3.12

2.76

3.11

2.82

2.94

3.22

3.21

3.01

2.98

2.69

3

3.08

3

2.88

2.94

2.95

3.44

2.59

2.83

3.08

2.74

2.61

2.88

2.91

3.02

2.9

2.89

2.62

2.71

2.88

3.09

2.85

2.94

2.66

3.22

2.66

2.82

2.61

2.94

2.81

2.82

2.66

3.11

2.58

2.77

2.8

2.97

2.78

3.02

2.76

2.28

2.44

2.82

2.59

2.64

2.69

2.9

2.48

2.56

2.78

2.53

2.46

3

2.68

2.78

2.48

2.11

2.72

2.66

2.34

2.61

2.59

3.26

2.66

2.22

2.42

2.44

2.15

2.7

2.58

2.96

2.38

2.22

2.46

2.66

2.41

2.48

2.57

2.92

2.31

2.22

2.56

2.58

2.44

2.55

2.56

2.78

1.9

2.67

2.6

2.58

2.39

2.82

2.55

2.8

2.24

2.44

2.44

2.55

2.44

2.67

2.53

128

Tuning methodology in EIE

26. Ability to demonstrate awareness of quality issues 14. Ability to manage the design process and evaluate outcomes 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 11. Ability to identify and manage cost drivers in designs and projects 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

EIE Surveyor Final Report

2.94

2.45

2.39

2.48

2.35

2.24

2.61

2.51

3

2.17

2.5

2.5

2.29

2.29

2.45

2.47

2.72

2.21

2.06

2.42

2.44

2.34

2.48

2.43

2.72

2.41

2.33

2.54

2.26

2.2

2.3

2.41

2.74

2.24

2.17

2.44

2.26

2.32

2.42

2.4

2.98

2.03

2.28

2.48

2.16

1.9

2.7

2.38

2.72

2.03

2.11

2.46

2.32

1.85

2.64

2.34

2.7

2.14

2

2.44

2.19

2.05

2.45

2.32

2.98

2.28

1.83

2.32

2.34

1.71

2.36

2.32

2.68

2.48

2.06

2.22

2.23

2

2.33

2.3

2.8

2.17

2

2.26

2.16

1.83

2.27

2.25

2.72

2.21

1.94

2.06

2.15

1.78

2.27

2.19

129

Tuning methodology in EIE

Table 7.10 Comparison of mean difference between rated importance and level of development of the specific competences for all graduates and by level of study. Specific competence 11. Ability to identify and manage cost drivers in designs and projects 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 14. Ability to manage the design process and evaluate outcomes 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 26. Ability to demonstrate awareness of quality issues 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 28. Ability to work in a group on a major project 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 21. Ability to demonstrate practical engineering skills 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 8. Ability to apply a systems approach to engineering problems 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 27. Ability to work with technical uncertainty 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 23. Ability to demonstrate understanding of the use of technical literature and other information sources 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline

EIE Surveyor Final Report

130

All 0.61

Bachelor 0.76

Master 0.53

0.55

0.69

0.46

0.52

0.64

0.45

0.51

0.68

0.45

0.48

0.69

0.42

0.48 0.47

0.49 0.64

0.46 0.37

0.47

0.58

0.42

0.47 0.46

0.51 0.53

0.44 0.45

0.45

0.49

0.45

0.43

0.68

0.3

0.43 0.43

0.56 0.58

0.4 0.35

0.42

0.51

0.35

0.4 0.38

0.51 0.52

0.36 0.32

0.35 0.34

0.45 0.38

0.33 0.33

0.33 0.32

0.4 0.34

0.3 0.29

0.31

0.32

0.29

0.31

0.42

0.26

0.3

0.34

0.29

0.29

0.31

0.26

0.22

0.29

0.23

0.18 0.02

0.32

0.12

0.04

-0.06

Tuning methodology in EIE

Table 7.10(a) Comparison of mean difference between rated importance and level of development of the specific competences for all and by country (sorted by total). Generic competence 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 14. Ability to manage the design process and evaluate outcomes 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 26. Ability to demonstrate awareness of quality issues 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 28. Ability to work in a group on a major project 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 21. Ability to demonstrate practical engineering skills

EIE Surveyor Final Report

Ireland

Spain

Turkey

Total

Greece

0.34

0.72

1.17

0.24

0.53

0.88

0.33

0.55

0.5

0.72

1

0.16

0.52

0.76

0.48

0.52

0.6

0.52

1.06

0.3

0.42

0.66

0.33

0.51

0.58

0.72

0.94

0.02

0.47

0.76

0.3

0.49

0.6

0.66

0.56

0.04

0.58

0.71

0.3

0.48

0.36

0.86

0.78

-0.1

0.6

0.51

0.45

0.47

0.42

0.52

1

-0.04

0.56

0.88

0.18

0.47

0.52

0.66

0.83

0.2

0.42

0.49

0.48

0.47

0.54

0.52

0.56

0.14

0.58

0.59

0.48

0.47

0.56

0.34

0.78

0.08

0.5

0.56

0.36

0.45

0.26

0.52

0.89

-0.08

0.63

0.73

0.36

0.43

0.46

0.55

0.94

0.04

0.47

0.66

0.21

0.42

0.22

0.62

0.94

-0.22

0.68

0.78

0.3

0.42

0.48

0.69

0.56

-0.16

0.4

0.61

0.64

0.41

0.46

0.41

0.39

0.02

0.4

0.59

0.3

0.36

131

Poland

Slovak Republic

Bulgaria

Tuning methodology in EIE

20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 8. Ability to apply a systems approach to engineering problems 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 27. Ability to work with technical uncertainty 23. Ability to demonstrate understanding of the use of technical literature and other information sources 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 11. Ability to identify and manage cost drivers in designs and projects

EIE Surveyor Final Report

0.52

0.34

0.56

-0.38

0.39

0.63

0.55

0.35

0.42

0.41

0.61

0.06

0.39

0.27

0.36

0.34

0.46

0.48

0.39

-0.24

0.68

0.2

0.42

0.34

0.42

0.41

0.5

-0.14

0.56

0.22

0.33

0.31

0.44

0.48

0.39

-0.1

0.45

0.49

0.18

0.31

0.5

0.34

0.39

-0.32

0.44

0.34

0.48

0.28

0.46

0.14

0.61

-0.48

0.56

0.2

0.15

0.22

0.24

0.38

0.56

-0.3

0.42

-0.02

0.21

0.17

0.36

0.38

0.94

0.12

0.52

0.32

0.48

0.4

0.56

0.31

0.67

-0.16

0.4

0.24

0.36

0.3

0.54

0.34

0.72

-0.26

0.53

0.32

0.12

0.3

0.3

-0.03

0.17

-0.44

0.08

-0.27

0.09

-0.03

0.62

0.86

1

0.02

0.58

0.66

0.73

0.61

132

Tuning methodology in EIE

Table 8.3 Comparison of importance of the generic competences across the stakeholders Generic competence

Students

Capacity for analysis and synthesis – Importance Capacity for applying knowledge in practice – Importance Planning and time management – Importance Basic general technical knowledge of the profession of your work area – Importance Grounding in basic knowledge of the profession of your work area – Importance Oral and written communication in your native language – Importance Knowledge of a second language – Importance Elementary computing skills – Importance Research skills -Importance Capacity to learn – Importance Information management skills – Importance Critical and self-critical abilities – Importance Capacity to adapt to new situations – Importance Capacity for generating new ideas (creativity) – Importance Problem solving – Importance Decision making – Importance Teamworking – Importance Interpersonal skills – Importance Leadership – Importance Ability to work in an interdisciplinary team – Importance Ability to communicate with non-experts (in the field) – Importance Appreciation of diversity and multiculturality – Importance Ability to work in an international context – Importance Understanding of cultures and customs of other countries – Importance Ability to work autonomously – Importance Project design and management – Importance Initiative and entrepreneurial spirit – Importance Appreciation of ethical issues – Importance Concern for quality – Importance Will to succeed – Importance Patents and Intellectual Property Rights – Importance International Relations and Collaborations – Importance

EIE Surveyor Final Report

133

Male 3.18 3.38 3.08 3.24 3 3.09 3.22 3.4 2.93 3.28 3.14 2.94 3.3 3.28 3.46 3.24 3.36 3.05 2.96 2.98 2.98 2.7 3.1 2.52 3.3 3.14 3.02 2.7 3.25 3.38 2.77 2.92

Tuning methodology in EIE

Female 3.23 3.41 3.2 3.23 3.09 3.17 3.27 3.44 3.1 3.36 3.22 2.94 3.3 3.35 3.33 3.26 3.38 3.15 2.92 3.09 3.01 2.75 3.11 2.68 3.21 3.15 3.03 2.82 3.3 3.35 2.78 2.9

Male 3.6 3.57 3.46 3.34 3.1 3.26 2.97 3.59 3.25 3.62 3.46 3.15 3.51 3.4 3.72 3.32 3.51 3.19 2.97 3.15 3.07 2.66 3.13 2.38 3.34 3.15 3.04 2.66 3.43 3.34 2.82 2.87

Graduates Female 3.47 3.71 3.18 3.59 3.24 2.94 3.24 3.59 3.35 3.47 3.35 3.18 3.53 3.35 3.65 3.18 3.53 2.82 3 3.18 3.18 2.47 3.06 2.41 3.24 3.53 2.82 2.53 2.82 3.06 2.35 2.94

Academics Mean 3.54 3.6 3.24 3.55 3.34 3.43 3.15 3.7 2.85 3.54 3.45 3.23 3.48 3.41 3.58 3.3 3.48 3.19 2.96 3.26 3.09 2.84 3.02 2.62 3.51 3.38 3.12 2.93 3.45 3.29 2.67 2.83

Employers Mean 3.39 3.46 3.15 3.37 3.24 3.46 2.56 3.71 2.9 3.54 3.39 2.85 3.27 3.44 3.54 3.22 3.46 3.17 2.59 2.93 3.15 2.51 2.78 2.44 3.29 3.02 3.22 2.98 3.51 3.34 2.49 2.46

Table 8.5 Comparison of level of development of the generic competences across the stakeholders Generic competence Capacity for analysis and synthesis – Level Capacity for applying knowledge in practice – Level Planning and time management – Level Basic general technical knowledge of the profession of your work area – Level Grounding in basic knowledge of the profession of your work area – Level Oral and written communication in your native language – Level Knowledge of a second language – Level Elementary computing skills – Level Research skills – Level Capacity to learn – Level Information management skills – Level Critical and self-critical abilities – Level Capacity to adapt to new situations – Level Capacity for generating new ideas (creativity) – Level Problem solving – Level Decision making – Level Teamworking – Level Interpersonal skills – Level Leadership – Level Ability to work in an interdisciplinary team – Level Ability to communicate with non-experts (in the field) – Level Appreciation of diversity and multiculturality – Level Ability to work in an international context – Level Understanding of cultures and customs of other countries – Level Ability to work autonomously – Level Project design and management – Level Initiative and entrepreneurial spirit – Level Appreciation of ethical issues – Level Concern for quality – Level Will to succeed – Level Patents and Intellectual Property Rights – Level International Relations and Collaborations – Level

EIE Surveyor Final Report

134

Students Male 2.77 2.8 2.52 2.88 2.74 2.68 2.47 3.13 2.55 2.88 2.7 2.47 2.67 2.54 2.92 2.64 2.84 2.52 2.26 2.32 2.42 2.27 2.34 2 2.87 2.63 2.39 2.27 2.72 2.8 2.23 2.31

Tuning methodology in EIE

Female 2.8 2.73 2.56 2.82 2.71 2.77 2.49 3.19 2.6 2.85 2.68 2.49 2.63 2.48 2.74 2.69 3.02 2.62 2.28 2.48 2.48 2.36 2.4 2.16 2.75 2.62 2.36 2.32 2.61 2.72 2.31 2.3

Graduates Male 3.06 2.96 2.65 3.01 2.93 2.96 2.35 3.37 2.91 3.28 2.94 2.62 2.87 2.71 3.18 2.66 3.06 2.81 2.35 2.5 2.44 2.35 2.31 2 2.93 2.75 2.49 2.34 2.88 2.94 2.35 2.26

Female 3.12 2.65 2.59 2.65 2.76 2.53 2.06 3.24 2.53 2.94 2.53 2.47 2.47 2.41 2.65 2.47 2.53 2.12 1.76 2.18 1.88 1.94 2.35 1.59 2.71 2.41 2.18 2.06 2.41 2.41 1.47 1.76

Academics Mean 3.18 3.11 2.57 3.32 3.16 2.83 2.45 3.48 2.57 3.08 2.89 2.63 2.79 2.79 2.97 2.7 2.92 2.77 2.48 2.6 2.43 2.46 2.51 2.24 2.95 2.88 2.43 2.45 2.77 2.84 2.12 2.41

Employers Mean 3.07 2.93 2.59 3.1 3.2 3.1 2.39 3.61 2.49 3.17 2.95 2.44 2.8 2.8 2.9 2.63 2.71 2.76 2.29 2.54 2.68 2.41 2.41 2.29 2.76 2.63 2.66 2.68 2.85 3.02 2.05 2.12

Table 8.7 Comparison of the gap of the generic competences across the stakeholders Generic competence Capacity for analysis and synthesis Capacity for applying knowledge in practice Planning and time management Basic general technical knowledge of the profession of your work area Grounding in basic knowledge of the profession of your work area Oral and written communication in your native language Knowledge of a second language Elementary computing skills Research skills Capacity to learn Information management skills Critical and self-critical abilities Capacity to adapt to new situations Capacity for generating new ideas (creativity) Problem solving Decision making Teamworking Interpersonal skills Leadership Ability to work in an interdisciplinary team Ability to communicate with non-experts (in the field) Appreciation of diversity and multiculturality Ability to work in an international context Understanding of cultures and customs of other countries Ability to work autonomously Project design and management Initiative and entrepreneurial spirit Appreciation of ethical issues Concern for quality Will to succeed Patents and Intellectual Property Rights International Relations and Collaborations

EIE Surveyor Final Report

135

Academic 0.37 0.51 0.67 0.22 0.19 0.61 0.71 0.22 0.28 0.47 0.55 0.59 0.68 0.62 0.62 0.61 0.55 0.43 0.47 0.66 0.66 0.38 0.51 0.38 0.57 0.5 0.69 0.49 0.67 0.45 0.55 0.43

Tuning methodology in EIE

Employer 0.32 0.54 0.56 0.27 0.05 0.37 0.17 0.1 0.41 0.37 0.44 0.41 0.46 0.63 0.63 0.59 0.76 0.41 0.29 0.39 0.46 0.1 0.37 0.15 0.54 0.39 0.56 0.29 0.66 0.32 0.44 0.34

Graduate 0.51 0.71 0.76 0.45 0.24 0.33 0.73 0.25 0.44 0.38 0.58 0.56 0.73 0.74 0.64 0.67 0.56 0.45 0.74 0.72 0.76 0.35 0.8 0.47 0.44 0.54 0.58 0.35 0.52 0.45 0.55 0.72

Student 0.41 0.59 0.57 0.37 0.28 0.42 0.76 0.28 0.4 0.42 0.46 0.46 0.63 0.76 0.54 0.6 0.5 0.53 0.69 0.64 0.56 0.42 0.75 0.52 0.43 0.51 0.63 0.44 0.55 0.59 0.53 0.61

Table 8.9 Comparison of importance of the specific competences across the stakeholders Specific competence 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 8. Ability to apply a systems approach to engineering problems 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 11. Ability to identify and manage cost drivers in designs and projects 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 14. Ability to manage the design process and evaluate outcomes 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 21. Ability to demonstrate practical engineering skills 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 23. Ability to demonstrate understanding of the use of technical literature and other information sources 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 26. Ability to demonstrate awareness of quality issues 27. Ability to work with technical uncertainty 28. Ability to work in a group on a major project

EIE Surveyor Final Report

136

Tuning methodology in EIE

Academic

Employer

Graduate

Student

3.48 3.19 3.3 3.03

3.31 3.17 3.28 2.97

3.36 3.11 3.05 2.79

3.18 2.98 3.05 2.83

2.78 3.43

3.06 3.36

2.87 3.35

2.84 3.27

3.38 3.42

3.36 3.31

3.2 3.26

3.09 3.15

3.14 3.11 3.15 3.24

3.11 3.33 3.19 3.28

3.15 3.13 2.88 3.06

2.99 3.13 2.99 3.01

3.11 3.24 3.07

3.08 3.17 3.06

2.89 2.87 2.72

2.88 2.93 2.79

2.97 3.04

2.81 3.11

2.76 2.65

2.76 2.89

2.9 3.1 3.1 3.63

2.72 3 3.06 3.42

2.53 2.67 2.84 3.14

2.79 2.81 2.87 3.19

3.05 3.33 2.84 3.07 3.33 3.11 3.48

3.08 3.47 2.83 3.28 3.44 3.11 3.36

2.91 3.15 2.66 2.78 2.85 2.65 3.29

2.87 2.99 2.75 2.89 2.85 2.89 3.25

Table 8.10 Comparison of level of development of the specific competences across the stakeholders Specific competence 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 8. Ability to apply a systems approach to engineering problems 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 11. Ability to identify and manage cost drivers in designs and projects 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 14. Ability to manage the design process and evaluate outcomes 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 21. Ability to demonstrate practical engineering skills 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 23. Ability to demonstrate understanding of the use of technical literature and other information sources 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 26. Ability to demonstrate awareness of quality issues 27. Ability to work with technical uncertainty 28. Ability to work in a group on a major project

EIE Surveyor Final Report

137

Tuning methodology in EIE

Academic

Employer

Graduate

Student

3.16 2.97 2.84 2.56

2.83 2.92 2.69 2.5

3.05 3.07 2.54 2.39

2.81 2.86 2.57 2.41

2.31

2.33

2.19

2.32

3.22

2.97

3.04

2.85

3.04 2.91

2.58 2.72

2.91 2.88

2.71 2.68

2.51 2.64 2.52 2.74

2.44 2.67 2.36 2.67

2.47 2.44 2.12 2.42

2.46 2.47 2.37 2.41

2.55 2.71 2.55

2.69 2.47 2.5

2.33 2.24 2.14

2.41 2.43 2.25

2.48 2.44

2.36 2.44

2.07 2.15

2.29 2.33

2.31 2.47 2.84 3.19

2.33 2.64 2.61 2.94

2.04 2.33 2.39 2.62

2.26 2.34 2.45 2.67

2.65 2.97 2.2 2.4 2.76 2.67 2.99

2.72 3.19 2.36 2.56 2.67 2.56 2.72

2.48 2.85 2.15 2.27 2.32 2.31 2.72

2.45 2.61 2.3 2.44 2.47 2.48 2.65

Table 8.11 Comparison of gap of the specific competences across the stakeholders Specific competence 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 8. Ability to apply a systems approach to engineering problems 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 11. Ability to identify and manage cost drivers in designs and projects 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 14. Ability to manage the design process and evaluate outcomes 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 21. Ability to demonstrate practical engineering skills 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 23. Ability to demonstrate understanding of the use of technical literature and other information sources 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 26. Ability to demonstrate awareness of quality issues 27. Ability to work with technical uncertainty 28. Ability to work in a group on a major project

EIE Surveyor Final Report

138

Tuning methodology in EIE

Academic

Employer

Graduate

Student

0.32 0.22 0.46 0.47

0.47 0.25 0.58 0.47

0.32 0.04 0.51 0.4

0.36 0.12 0.49 0.41

0.47 0.21

0.72 0.39

0.68 0.32

0.52 0.41

0.34 0.51

0.78 0.58

0.29 0.38

0.38 0.47

0.64 0.47 0.64 0.5

0.67 0.67 0.83 0.61

0.68 0.69 0.76 0.64

0.53 0.66 0.62 0.6

0.56 0.53 0.52

0.39 0.69 0.56

0.56 0.64 0.58

0.47 0.5 0.54

0.48 0.6

0.44 0.67

0.69 0.49

0.47 0.56

0.59 0.63 0.26 0.44

0.39 0.36 0.44 0.47

0.49 0.34 0.45 0.52

0.53 0.47 0.42 0.52

0.41 0.36 0.64 0.67 0.57 0.44 0.49

0.36 0.28 0.47 0.72 0.78 0.56 0.64

0.42 0.31 0.51 0.51 0.53 0.34 0.58

0.41 0.38 0.45 0.45 0.39 0.42 0.6

Table 8.13 Comparison of importance of the generic competences across the stakeholders (Masters level) Generic competence Capacity for analysis and synthesis – Importance Capacity for applying knowledge in practice – Importance Planning and time management – Importance Basic general technical knowledge of the profession of your work area – Importance Grounding in basic knowledge of the profession of your work area – Importance Oral and written communication in your native language – Importance Knowledge of a second language – Importance Elementary computing skills – Importance Research skills – Importance Capacity to learn – Importance Information management skills – Importance Critical and self-critical abilities – Importance Capacity to adapt to new situations – Importance Capacity for generating new ideas (creativity) – Importance Problem solving – Importance Decision making – Importance Teamworking – Importance Interpersonal skills – Importance Leadership – Importance Ability to work in an interdisciplinary team – Importance Ability to communicate with non-experts (in the field) – Importance Appreciation of diversity and multiculturality – Importance Ability to work in an international context – Importance Understanding of cultures and customs of other countries – Importance Ability to work autonomously – Importance Project design and management – Importance Initiative and entrepreneurial spirit – Importance Appreciation of ethical issues – Importance Concern for quality – Importance Will to succeed – Importance Patents and Intellectual Property Rights – Importance International Relations and Collaborations – Importance

EIE Surveyor Final Report

139

Academic 3.54 3.61 3.13 3.51 3.36 3.33 3.3 3.52 2.87 3.55 3.46 3.04 3.42 3.21 3.57 3.06 3.36 2.95 2.62 3.13 2.91 2.48 2.9 2.36 3.37 3.18 3.03 2.79 3.37 3.08 2.64 2.73

Tuning methodology in EIE

Employer 3.46 3.71 3.32 3.49 3.17 3.51 3.2 3.44 2.8 3.63 3.41 3.1 3.63 3.27 3.73 3.32 3.76 3.34 2.8 3.2 3.22 3.05 3.12 2.56 3.46 3.17 3.17 3.07 3.73 3.39 2.73 2.88

Graduate 3.45 3.49 3.29 3.28 3.15 3.17 3.2 3.47 3.1 3.42 3.41 2.97 3.21 3.31 3.53 3.28 3.31 2.99 2.86 3.01 2.93 2.71 3.07 2.47 3.27 3.13 2.86 2.72 3.27 3.29 2.83 2.92

Student 3.32 3.45 3.22 3.23 3.11 3.16 3.38 3.51 2.95 3.36 3.34 3.04 3.45 3.47 3.57 3.41 3.51 3.2 2.99 3.04 3.05 2.82 3.22 2.59 3.39 3.3 3.09 2.81 3.35 3.32 2.9 3.02

Table 8.14 Comparison of the level of development of the generic competences across the stakeholders (Masters level) Generic competence Capacity for analysis and synthesis – Level Capacity for applying knowledge in practice – Level Planning and time management – Level Basic general technical knowledge of the profession of your work area – Level Grounding in basic knowledge of the profession of your work area – Level Oral and written communication in your native language – Level Knowledge of a second language – Level Elementary computing skills – Level Research skills – Level Capacity to learn – Level Information management skills – Level Critical and self-critical abilities – Level Capacity to adapt to new situations – Level Capacity for generating new ideas (creativity) – Level Problem solving – Level Decision making – Level Teamworking – Level Interpersonal skills – Level Leadership – Level Ability to work in an interdisciplinary team – Level Ability to communicate with non-experts (in the field) – Level Appreciation of diversity and multiculturality – Level Ability to work in an international context – Level Understanding of cultures and customs of other countries – Level Ability to work autonomously – Level Project design and management – Level Initiative and entrepreneurial spirit – Level Appreciation of ethical issues – Level Concern for quality – Level Will to succeed – Level Patents and Intellectual Property Rights – Level International Relations and Collaborations – Level

EIE Surveyor Final Report

140

Academic 3.1 3.06 2.52 3.04 3.01 2.69 2.6 3.37 2.51 2.94 2.85 2.43 2.82 2.6 3.01 2.63 2.9 2.55 2.15 2.42 2.31 2.33 2.45 2.1 2.96 2.78 2.37 2.33 2.76 2.54 2.09 2.25

Tuning methodology in EIE

Employer 2.8 2.8 2.39 2.95 2.73 3.15 2.59 3.34 2.56 3.2 2.88 2.54 2.78 2.73 2.95 2.63 3.05 2.76 2.17 2.49 2.51 2.59 2.56 2.39 2.71 2.61 2.46 2.56 2.76 2.98 2.27 2.34

Graduate 3.13 3 2.63 3.01 2.98 2.92 2.53 3.32 2.85 3.18 3.06 2.69 2.78 2.69 3.15 2.9 3.12 2.66 2.38 2.52 2.45 2.4 2.37 2.14 3.01 2.72 2.39 2.49 2.89 2.97 2.39 2.38

Student 2.94 2.73 2.63 2.94 2.84 2.8 2.5 3.31 2.67 3.09 2.94 2.59 2.84 2.75 3.04 2.81 3.03 2.68 2.33 2.55 2.48 2.42 2.39 2.12 3.12 2.77 2.49 2.39 2.86 2.83 2.42 2.32

Table 8.17 Comparison of the gap of the generic competences across the stakeholders (Masters level) Generic competence Capacity for analysis and synthesis Capacity for applying knowledge in practice Planning and time management Basic general technical knowledge of the profession of your work area Grounding in basic knowledge of the profession of your work area Oral and written communication in your native language Knowledge of a second language Elementary computing skills Research skills Capacity to learn Information management skills Critical and self-critical abilities Capacity to adapt to new situations Capacity for generating new ideas (creativity) Problem solving Decision making Teamworking Interpersonal skills Leadership Ability to work in an interdisciplinary team Ability to communicate with non-experts (in the field) Appreciation of diversity and multiculturality Ability to work in an international context Understanding of cultures and customs of other countries Ability to work autonomously Project design and management Initiative and entrepreneurial spirit Appreciation of ethical issues Concern for quality Will to succeed Patents and Intellectual Property Rights International Relations and Collaborations

EIE Surveyor Final Report

141

Academic 0.43 0.55 0.61 0.46 0.34 0.64 0.7 0.15 0.36 0.61 0.61 0.61 0.6 0.61 0.55 0.43 0.46 0.41 0.47 0.72 0.6 0.15 0.45 0.25 0.42 0.4 0.66 0.46 0.61 0.54 0.55 0.48

Tuning methodology in EIE

Employer 0.66 0.9 0.93 0.54 0.44 0.37 0.61 0.1 0.24 0.44 0.54 0.56 0.85 0.54 0.78 0.68 0.71 0.59 0.63 0.71 0.71 0.46 0.56 0.17 0.76 0.56 0.71 0.51 0.98 0.41 0.46 0.54

Graduate 0.32 0.49 0.66 0.27 0.17 0.24 0.67 0.15 0.25 0.24 0.35 0.28 0.43 0.61 0.38 0.38 0.18 0.33 0.49 0.5 0.49 0.31 0.7 0.33 0.25 0.41 0.47 0.24 0.38 0.32 0.44 0.55

Student 0.38 0.72 0.59 0.29 0.27 0.36 0.88 0.2 0.28 0.27 0.4 0.45 0.61 0.72 0.53 0.6 0.48 0.52 0.66 0.49 0.57 0.41 0.83 0.47 0.27 0.53 0.61 0.42 0.49 0.48 0.48 0.7

Table 8.19 Comparison of the importance of the specific competences across the stakeholders (Masters level) Specific competence 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 8. Ability to apply a systems approach to engineering problems 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 11. Ability to identify and manage cost drivers in designs and projects 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 14. Ability to manage the design process and evaluate outcomes 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 21. Ability to demonstrate practical engineering skills 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 23. Ability to demonstrate understanding of the use of technical literature and other information sources 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 26. Ability to demonstrate awareness of quality issues 27. Ability to work with technical uncertainty 28. Ability to work in a group on a major project

EIE Surveyor Final Report

142

Tuning methodology in EIE

Academic

Employer

Graduate

Student

3.45 3.13 3.18 3.06

3.13 2.8 3.13 2.8

3.35 3.07 3.11 2.92

3.26 3.03 3.09 2.86

2.84 3.51

2.93 3.03

2.78 3.34

2.91 3.37

3.29 3.54

2.87 3.13

3.07 3.1

3.09 3.23

3.1 3.06 3.13 3.3

3.03 3.2 3.07 3.1

2.98 3.09 2.91 3.06

3 3.25 3.1 3.19

3.06 3.25 2.85

2.9 2.7 2.9

2.83 2.93 2.81

2.98 3.08 2.93

2.91 2.91

2.93 2.8

2.73 2.87

2.92 3

2.66 2.88 3.15 3.55

2.87 2.8 3.07 3.03

2.68 2.72 2.98 3.18

2.89 2.92 3.02 3.35

3.03 3.39 2.78 2.98 3.27 3.12 3.42

3.13 3.03 2.67 2.87 3.23 2.97 3.13

3 3.28 2.81 2.94 3.03 2.96 3.35

3.1 3.17 2.86 3.04 2.89 3.05 3.42

Table 8.20 Comparison of the level of development of the specific competences across the stakeholders (Masters level) Specific competence 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 8. Ability to apply a systems approach to engineering problems 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 11. Ability to identify and manage cost drivers in designs and projects 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 14. Ability to manage the design process and evaluate outcomes 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 21. Ability to demonstrate practical engineering skills 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 23. Ability to demonstrate understanding of the use of technical literature and other information sources 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 26. Ability to demonstrate awareness of quality issues 27. Ability to work with technical uncertainty 28. Ability to work in a group on a major project

EIE Surveyor Final Report

143

Tuning methodology in EIE

Academic

Employer

Graduate

Student

3.01 2.64 2.6 2.34

2.97 2.7 2.6 2.53

3.23 3.13 2.74 2.62

2.96 3.01 2.62 2.51

2.34 3.07

2.53 2.73

2.33 3.04

2.36 2.97

2.85 2.76

2.6 2.6

2.84 2.77

2.76 2.77

2.51 2.36 2.46 2.6

2.47 2.47 2.03 2.5

2.68 2.63 2.38 2.61

2.52 2.56 2.4 2.56

2.36 2.6 2.27

2.23 2.1 2.37

2.43 2.56 2.38

2.45 2.54 2.4

2.39 2.32

2.37 2.17

2.31 2.41

2.37 2.44

2.09 2.31 2.82 3.01

2.07 2.47 2.37 2.57

2.22 2.43 2.65 2.86

2.24 2.45 2.63 2.78

2.54 2.91 2.22 2.36 2.61 2.6 2.85

2.33 2.8 2.2 2.2 2.6 2.43 2.47

2.74 3.02 2.46 2.5 2.58 2.67 3

2.68 2.82 2.42 2.5 2.55 2.61 2.82

Table 8.21 Comparison of the gap of the specific competences across the stakeholders (Masters level) Specific competence 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline 2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline 3. Ability to apply and integrate knowledge and understanding of other engineering disciplines 4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles 5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems 7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques 8. Ability to apply a systems approach to engineering problems 9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues 10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process 11. Ability to identify and manage cost drivers in designs and projects 12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs 13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal 14. Ability to manage the design process and evaluate outcomes 15. Ability to demonstrate knowledge and understanding of the commercial and economic context 16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context 17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development 18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues 19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering 20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products. 21. Ability to demonstrate practical engineering skills 22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc.) 23. Ability to demonstrate understanding of the use of technical literature and other information sources 24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues 25. Ability to demonstrate understanding of appropriate codes of practice and industry standards 26. Ability to demonstrate awareness of quality issues 27. Ability to work with technical uncertainty 28. Ability to work in a group on a major project

EIE Surveyor Final Report

144

Tuning methodology in EIE

Academic

Employer

Graduate

Student

0.43 0.49 0.58 0.72

0.17 0.1 0.53 0.27

0.12 -0.06 0.36 0.3

0.3 0.03 0.47 0.35

0.49 0.43

0.4 0.3

0.45 0.29

0.54 0.4

0.44 0.78

0.27 0.53

0.23 0.33

0.33 0.47

0.6 0.7 0.67 0.7

0.57 0.73 1.03 0.6

0.3 0.46 0.53 0.45

0.48 0.7 0.7 0.63

0.7 0.66 0.58

0.67 0.6 0.53

0.4 0.37 0.42

0.53 0.54 0.53

0.52 0.59

0.57 0.63

0.42 0.46

0.55 0.56

0.57 0.57 0.33 0.54

0.8 0.33 0.7 0.47

0.45 0.29 0.33 0.32

0.65 0.47 0.38 0.57

0.49 0.48 0.55 0.62 0.66 0.52 0.57

0.8 0.23 0.47 0.67 0.63 0.53 0.67

0.26 0.26 0.35 0.44 0.45 0.29 0.35

0.42 0.35 0.44 0.54 0.34 0.44 0.59

Appendix 2 – Questionnaires

EIE Surveyor Final Report

145

Tuning methodology in EIE

EIE Surveyor Final Report

146

Tuning methodology in EIE

EIE-Surveyor Student Questionnaire We are asking you to participate in a study into the competencies required for success in future careers. The methodology being used follows that of the Tuning Project, an EU funded project which established an approach to comparing the perception of the importance of generic and specific skills, and how well they are developed. The study asks similar questions of students, academics, graduates and employers to establish a statistical dataset which is then used to make comparisons. In this questionnaire the questions asked deal with your perception of the importance of competences to you and your perception of the level to which these are developed within the degree programme you are currently studying at your institution. The information it provides is very valuable in helping to improve planning for future students. The following questionnaire should take around 10 minutes to complete. Participation in this study is voluntary and you have the right not to answer any question or item, or to withdraw your consent and terminate participation at any time. The research is supported by the EIE-Surveyor Project, an EU funded project that includes partner institutions across the whole of Europe. No personal identifier information is requested so your response to this questionnaire cannot be connected with you personally in any way. We will ensure the confidentiality of all information provided in your response.

********************* By continuing, I agree to participate voluntarily in this survey. I understand the research purpose of the survey and the protection that will be given to any information I provide. I understand that any information provided by me will remain confidential with regard to my identity. I also understand that by participating in this study I am not waiving any of my legal rights. I have been informed that I may contact Tony Ward, Department of Electronics, University of York, Heslington, York, YO10 5DD if I have questions or comments about this survey. Please read the instructions for each of the following questions. Review the response options carefully before you mark your answers. There are no right or wrong answers. Answer the questions as quickly and honestly as possible. Please answer all the questions in the questionnaire.

Questionnaire code = S

EIE Surveyor Final Report

147

Tuning methodology in EIE

Background Information

1. Name of the educational institution: . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2. In what Country is your institution? Tick

Country 1. Austria 2. Belgium 3. Bulgaria 4. Cyprus 5. Czech Republic 6. Denmark 7. Estonia 8. Finland 9. France 10. Germany 11. Greece 12. Hungary 13. Iceland 14. Ireland 15. Italy 16. Latvia

Tick

Country 17. Liechtenstein 18. Lithuania 19. Luxembourg 20. Malta 21. Netherlands 22. Norway 23. Poland 24. Portugal 25. Romania 26. Slovak Republic 27. Slovenia 28. Spain 29. Sweden 30. Turkey 31. United Kingdom

Other (please specify) ……………………………………

3. What is your Sex/Gender?: Male 1. † Female 2. †

4. What is your age? 20 or under 21 – 30 31 – 40 41 – 50 51 – 60 over 61

1. † 2. † 3. † 4. † 5. † 6. †

5. What is the title of the academic programme you are studying for?: . . . . . . . . . . . . . . .

6. What ‘level’ is the degree you are studying? Bachelor Masters Doctoral/PhD EIE Surveyor Final Report

1. † 2. † 3. † 148

Tuning methodology in EIE

Other

4. † (please specify) ………………………………………..

7. What academic year of study are you currently in? (Please circle only one) 1

2

3

4

5

6

Other …..

8. What is the standard (or nominal) length of your degree programme? (Please circle only one) 1

2

3

4

5

6

Other …..

9. Do you feel that the degree programme is preparing you adequately for employment? (Please circle only one) Very much 1

Much 2

Some 3

Little 4

Very little 5

10. How would you rate the employment potential of your degree? (Please circle only one) Very poor 1

EIE Surveyor Final Report

Poor 2

Fair 3

149

Good 4

Very good 5

Tuning methodology in EIE

Generic Competences Question For each of the generic competences listed below, please estimate: —the importance of the competence, in your opinion, for work you would expect to get when you successfully completed your degree programme; —the level to which each competence is developed by the degree programme you are taking at your university. The blank spaces may be used to indicate any other competences that you consider important but which do not appear in the list. Please use the following scale: 1 = none; 2 = weak; 3 = considerable; 4 = strong.

Competence

Importance to work you expect to get 1 2 3 4

1.Capacity for analysis and synthesis

Level to which competence is being developed 1 2 3 4

2.Capacity for applying knowledge in practice

1

2

3

4

1

2

3

4

3.Planning and time management

1

2

3

4

1

2

3

4

4. Basic general technical knowledge of the profession of your work area

1

2

3

4

1

2

3

4

5.Grounding in basic knowledge of the profession of your work area

1

2

3

4

1

2

3

4

6.Oral and written communication in your native language

1

2

3

4

1

2

3

4

7.Knowledge of a second language

1

2

3

4

1

2

3

4

8.Elementary computing skills

1

2

3

4

1

2

3

4

9.Research skills

1

2

3

4

1

2

3

4

10.Capacity to learn

1

2

3

4

1

2

3

4

11.Information management skills (ability to retrieve and analyse information from different sources)

1

2

3

4

1

2

3

4

12.Critical and self-critical abilities

1

2

3

4

1

2

3

4

13.Capacity to adapt to new situations

1

2

3

4

1

2

3

4

14.Capacity for generating new ideas (creativity)

1

2

3

4

1

2

3

4

15.Problem solving

1

2

3

4

1

2

3

4

16.Decision-making

1

2

3

4

1

2

3

4

17.Teamworking

1

2

3

4

1

2

3

4

1 = none; 2 = weak; 3 = considerable; 4 = strong

EIE Surveyor Final Report

150

Tuning methodology in EIE

Competence

Importance to work you expect to get

Level to which competence is being developed 1 2 3 4

18.Interpersonal skills

1

2

3

4

19.Leadership

1

2

3

4

1

2

3

4

20.Ability to work in an interdisciplinary team

1

2

3

4

1

2

3

4

21.Ability to communicate with non-experts (in the field)

1

2

3

4

1

2

3

4

22.Appreciation of diversity and multiculturality

1

2

3

4

1

2

3

4

23.Ability to work in an international context

1

2

3

4

1

2

3

4

24.Understanding of cultures and customs of other countries

1

2

3

4

1

2

3

4

25.Ability to work autonomously

1

2

3

4

1

2

3

4

26.Project design and management

1

2

3

4

1

2

3

4

27.Initiative and entrepreneurial spirit

1

2

3

4

1

2

3

4

28.Appreciation of ethical issues

1

2

3

4

1

2

3

4

29.Concern for quality

1

2

3

4

1

2

3

4

30.Will to succeed

1

2

3

4

1

2

3

4

31. Patents and Intellectual Property Rights

1

2

3

4

1

2

3

4

32. International Relations and Collaborations

1

2

3

4

1

2

3

4

33.

1

2

3

4

1

2

3

4

34.

1

2

3

4

1

2

3

4

Please rank below the five most important competences according to your opinion. Please write the number of the item within the box. Mark on the first box the most important, on the second box the second most important and so on. 1 2 3 4 5

EIE Surveyor Final Report

Item number Item number Item number Item number Item number

151

Tuning methodology in EIE

Ability in Languages other than Native Language For each of the languages listed below, please estimate: —the importance of being able to communicate effectively verbally and in written form, in your opinion, for work you would expect to get when you successfully completed your degree programme — the level to which each competence is developed by the degree you are taking at your university Please use the following scale: 1 = none; 2 = weak; 3 = considerable; 4 = strong.

Importance

Language Bulgarian Czech Danish Dutch English Estonian Finnish French German Greek Hungarian Icelandic Irish Italian Latvian Lithuanian Maltese Norwegian Polish Portuguese Romanian Slovak Slovene Spanish Swedish Turkish

EIE Surveyor Final Report

Written 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2

3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3

Level of development as a compulsory part of your degree programme

Spoken 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4

1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2

3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3

152

Written 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4

1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2

3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3

Spoken 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4

1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2

3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3

4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4

Tuning methodology in EIE

Specific Competences Question For each of the competences listed below, please estimate: —the importance of the competence, in your opinion, for work you would expect to get when you successfully completed your degree programme; — the level to which each competence is developed by the degree programme you are taking at your university. The blank spaces may be used to indicate any other competences that you consider important but which do not appear in the list. Please use the following scale: 1 = none; 2 = weak; 3 = considerable; 4 = strong.

Competence

Importance to work you expect to get

Level to which competence is being developed

Fundamentals 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline

1

2

3

4

1

2

3

4

2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline

1

2

3

4

1

2

3

4

3. Ability to apply and integrate knowledge and understanding of other engineering disciplines

1

2

3

4

1

2

3

4

4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles

1

2

3

4

1

2

3

4

5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement

1

2

3

4

1

2

3

4

EIE Surveyor Final Report

153

Tuning methodology in EIE

1 = none; 2 = weak; 3 = considerable; 4 = strong Competence

Importance to work you expect to get

Level to which competence is being developed

Engineering Analysis 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems

1

2

3

4

1

2

3

4

7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques

1

2

3

4

1

2

3

4

8. Ability to apply a systems approach to engineering problems

1

2

3

4

1

2

3

4

9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues

1

2

3

4

1

2

3

4

10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process

1

2

3

4

1

2

3

4

11. Ability to identify and manage cost drivers in designs and projects

1

2

3

4

1

2

3

4

12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs

1

2

3

4

1

2

3

4

13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal

1

2

3

4

1

2

3

4

14. Ability to manage the design process and evaluate outcomes

1

2

3

4

1

2

3

4

Design

EIE Surveyor Final Report

154

Tuning methodology in EIE

1 = none; 2 = weak; 3 = considerable; 4 = strong Competence

Importance to work you expect to get

Level to which competence is being developed

Economic, social and environmental context 15. Ability to demonstrate knowledge and understanding of the commercial and economic context

1

2

3

4

1

2

3

4

16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context

1

2

3

4

1

2

3

4

17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development

1

2

3

4

1

2

3

4

18. Ability to demonstrate awareness of the legal framework relevant to engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

1

2

3

4

1

2

3

4

19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering

1

2

3

4

1

2

3

4

20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products

1

2

3

4

1

2

3

4

21. Ability to demonstrate practical engineering skills.

1

2

3

4

1

2

3

4

22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc)

1

2

3

4

1

2

3

4

23. Ability to demonstrate understanding of the use of technical literature and other information sources

1

2

3

4

1

2

3

4

24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues

1

2

3

4

1

2

3

4

EIE Surveyor Final Report

155

Tuning methodology in EIE

1 = none; 2 = weak; 3 = considerable; 4 = strong Competence

Importance to work you expect to get

Level to which competence is being developed 1 2 3 4

25. Ability to demonstrate understanding of appropriate codes of practice and industry standards

1

2

3

4

26. Ability to demonstrate awareness of quality issues

1

2

3

4

1

2

3

4

27. Ability to work with technical uncertainty

1

2

3

4

1

2

3

4

28. Ability to work in a group on a major project

1

2

3

4

1

2

3

4

29.

1

2

3

4

1

2

3

4

30.

1

2

3

4

1

2

3

4

31.

1

2

3

4

1

2

3

4

32.

1

2

3

4

1

2

3

4

33.

1

2

3

4

1

2

3

4

34.

1

2

3

4

1

2

3

4

Please rank below the five most important competences according to your opinion. Please write the number of the item within the box. Mark on the first box the most important, on the second box the second most important and so on. 1 2 3 4 5

Item number Item number Item number Item number Item number

Many thanks for your co-operation

EIE Surveyor Final Report

156

Tuning methodology in EIE

EIE-Surveyor Academics Questionnaire We are asking you to participate in a study into the skills and competencies required for success in future careers. The methodology being used follows that of the Tuning Project, an EU funded project which established an approach to comparing the perception of the importance of generic and specific skills, and how well they are developed. The study asks similar questions of students, academics, graduates and employers to establish a statistical dataset which is then used to make comparisons. In this questionnaire the questions asked deal with your perception of the importance of skills and competences to you and your perception of the level to which these are developed within the degree programmes at your institution. Participation in this study is voluntary and you have the right not to answer any question or item, or to withdraw your consent and terminate participation at any time. The research is supported by the EIE-Surveyor Project, an EU funded project that includes partner institutions across the whole of Europe. No personal identifier information is requested so your response to this questionnaire cannot be connected with you personally in any way. We will ensure the confidentiality of all information provided in your response.

********************* By continuing, I agree to participate voluntarily in this survey. I understand the research purpose of the survey and the protection that will be given to any information I provide. I understand that any information provided by me will remain confidential with regard to my identity. I also understand that by participating in this study I am not waiving any of my legal rights. I have been informed that I may contact Tony Ward, Department of Electronics, University of York, Heslington, York, YO10 5DD, email [email protected] if I have questions or comments about this survey. Please read the instructions for each of the following questions. Review the response options carefully before you mark your answers. There are no right or wrong answers. Answer the questions as quickly and honestly as possible. Please answer all the questions in the questionnaire. Please complete this questionnaire for a specific academic programme. If you would like to provide a response for more than one academic programme please complete a separate questionnaire for each.

Questionnaire code = A

EIE Surveyor Final Report

157

Tuning methodology in EIE

Background Information

1. Name of the educational institution: . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2. Your position within the institution: (Please tick the first position in the list that best describes you. Please tick only ONE position) Tick 17. 18. 19. 20. 21. 22. 23. 24. 25.

Your Position Head of Institution Head of Faculty Head of Department Professor (Teaching) Senior Academic (Teaching) Junior Academic (Teaching) Administrator associated with academic activities Technical staff member associated with academic activities Other, please specify : ……………………………………………….

2a. Are you responsible for the academic design of the degree programme or a module within the degree programme? 1.Yes F

2.No

F

3. In what Country is your institution? (Please tick only one) Tick

Country 1. Austria 2. Belgium 3. Bulgaria 4. Cyprus 5. Czech Republic 6. Denmark 7. Estonia 8. Finland 9. France 10. Germany 11. Greece 12. Hungary 13. Iceland 14. Ireland 15. Italy 16. Latvia

Tick

Country 32. Liechtenstein 33. Lithuania 34. Luxembourg 35. Malta 36. Netherlands 37. Norway 38. Poland 39. Portugal 40. Romania 41. Slovak Republic 42. Slovenia 43. Spain 44. Sweden 45. Turkey 46. United Kingdom

Other (please specify) …………………………………… 4. What is your Sex/Gender?: Male 1. † Female 2. †

EIE Surveyor Final Report

158

Tuning methodology in EIE

5. What is your age? 20 or under 21 – 30 31 – 40 41 – 50 51 – 60 over 61

1. † 2. † 3. † 4. † 5. † 6. †

6. What is the specific name of the academic programme for which you are completing this questionnaire?

.............................

6a. What ‘level’ is the academic degree programme you are completing this questionnaire for? Bachelor Masters Doctoral/PhD Other

1. † 2. † 3. † 4. † (please specify) ………………………………………..

7. Approximately how many students enrolled in this academic programme this year?

.............................

8. Do you consider that university is preparing your students adequately for employment? (Please circle one number) Very much 1

EIE Surveyor Final Report

Much 2

Some 3

159

Little 4

Very little 5

Tuning methodology in EIE

Generic Skills Question For each of the generic skills listed below, please estimate: —the importance of the skill or competence, in your opinion, for work you would expect your graduates to get having successfully completed your degree programme; —the level to which each skill or competence is developed by your degree programme at your university. The blank spaces may be used to indicate any other skills that you consider important but which do not appear in the list. Please use the following scale: 1 = none; 2 = weak; 3 = considerable; 4 = strong.

Skill/Competence

Importance for your graduates

Level to which skill is developed in your degree programme 1 2 3 4

1.Capacity for analysis and synthesis

1

2

3

4

2.Capacity for applying knowledge in practice

1

2

3

4

1

2

3

4

3.Planning and time management

1

2

3

4

1

2

3

4

4. Basic general technical knowledge of the profession of your work area

1

2

3

4

1

2

3

4

5.Grounding in basic knowledge of the profession of your work area

1

2

3

4

1

2

3

4

6.Oral and written communication in your native language

1

2

3

4

1

2

3

4

7.Knowledge of a second language

1

2

3

4

1

2

3

4

8.Elementary computing skills

1

2

3

4

1

2

3

4

9.Research skills

1

2

3

4

1

2

3

4

10.Capacity to learn

1

2

3

4

1

2

3

4

11.Information management skills (ability to retrieve and analyse information from different sources)

1

2

3

4

1

2

3

4

12.Critical and self-critical abilities

1

2

3

4

1

2

3

4

13.Capacity to adapt to new situations

1

2

3

4

1

2

3

4

14.Capacity for generating new ideas (creativity)

1

2

3

4

1

2

3

4

15.Problem solving

1

2

3

4

1

2

3

4

16.Decision-making

1

2

3

4

1

2

3

4

17.Teamworking

1

2

3

4

1

2

3

4

1 = none; 2 = weak; 3 = considerable; 4 = strong

EIE Surveyor Final Report

160

Tuning methodology in EIE

Skill/Competence

Importance for your graduates

Level to which skill is developed in your degree programme 1 2 3 4

18.Interpersonal skills

1

2

3

4

19.Leadership

1

2

3

4

1

2

3

4

20.Ability to work in an interdisciplinary team

1

2

3

4

1

2

3

4

21.Ability to communicate with non-experts (in the field)

1

2

3

4

1

2

3

4

22.Appreciation of diversity and multiculturality

1

2

3

4

1

2

3

4

23.Ability to work in an international context

1

2

3

4

1

2

3

4

24.Understanding of cultures and customs of other countries

1

2

3

4

1

2

3

4

25.Ability to work autonomously

1

2

3

4

1

2

3

4

26.Project design and management

1

2

3

4

1

2

3

4

27.Initiative and entrepreneurial spirit

1

2

3

4

1

2

3

4

28.Appreciation of ethical issues

1

2

3

4

1

2

3

4

29.Concern for quality

1

2

3

4

1

2

3

4

30.Will to succeed

1

2

3

4

1

2

3

4

31. Patents and Intellectual Property Rights

1

2

3

4

1

2

3

4

32. International Relations and Collaborations

1

2

3

4

1

2

3

4

33.

1

2

3

4

1

2

3

4

34.

1

2

3

4

1

2

3

4

Please rank below the five most important competences according to your opinion. Please write the number of the item within the box. Mark on the first box the most important, on the second box the second most important and so on. 1 2 3 4 5

EIE Surveyor Final Report

Item number Item number Item number Item number Item number

161

Tuning methodology in EIE

Ability in Languages other than Native Language

For each of the languages listed below, please estimate: —the importance of being able to communicate effectively verbally and in written form, in your opinion, for work you would expect your graduates to get having successfully completed your degree programme; —the level to which ability is typically developed by your graduates as a compulsory part of your degree programme. Please use the following scale: 1 = none; 2 = weak; 3 = considerable; 4 = strong.

Importance

Language 1. Bulgarian 2. Czech 3. Danish 4. Dutch 5. English 6. Estonian 7. Finnish 8. French 9. German 10. Greek 11. Hungarian 12. Icelandic 13. Irish 14. Italian 15. Latvian 16. Lithuanian 17. Maltese 18. Norwegian 19. Polish 20. Portuguese 21. Romanian 22. Slovak 23. Slovene 24. Spanish 25. Swedish 26. Turkish 27. 28.

EIE Surveyor Final Report

Written 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2

3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3

Level of development as a compulsory part of your degree programme Written Spoken

Spoken 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4

1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2

3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3

162

4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4

1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2

3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3

4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4

1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2

3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3

4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4

Tuning methodology in EIE

Specific Skills Question For each of the skills listed below, please estimate: —the importance of the skill or competence, in your opinion, for work you would expect your graduates to get having successfully completed your degree programme; —the level to which each skill or competence has been developed as demonstrated by the graduates you have recruited over the past three years to this work area. The blank spaces may be used to indicate any other skills that you consider important but which do not appear in the list. Please use the following scale: 1 = none; 2 = weak; 3 = considerable; 4 = strong.

Skill/Competence

Importance for your graduates

Level to which skill is developed in your degree programme

Fundamentals 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline

1

2

3

4

1

2

3

4

2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline

1

2

3

4

1

2

3

4

3. Ability to apply and integrate knowledge and understanding of other engineering disciplines

1

2

3

4

1

2

3

4

4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles

1

2

3

4

1

2

3

4

5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement

1

2

3

4

1

2

3

4

EIE Surveyor Final Report

163

Tuning methodology in EIE

1 = none; 2 = weak; 3 = considerable; 4 = strong Skill/Competence

Importance for your graduates

Level to which skill is developed in your degree programme

Engineering Analysis 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve engineering problems

1

2

3

4

1

2

3

4

7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques

1

2

3

4

1

2

3

4

8. Ability to apply a systems approach to engineering problems

1

2

3

4

1

2

3

4

9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues

1

2

3

4

1

2

3

4

10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process

1

2

3

4

1

2

3

4

11. Ability to identify and manage cost drivers in designs and projects

1

2

3

4

1

2

3

4

12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs

1

2

3

4

1

2

3

4

13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal

1

2

3

4

1

2

3

4

14. Ability to manage the design process and evaluate outcomes

1

2

3

4

1

2

3

4

Design

EIE Surveyor Final Report

164

Tuning methodology in EIE

1 = none; 2 = weak; 3 = considerable; 4 = strong Skill/Competence

Importance for your graduates

Level to which skill is developed in your degree programme

Economic, social and environmental context 15. Ability to demonstrate knowledge and understanding of the commercial and economic context

1

2

3

4

1

2

3

4

16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context

1

2

3

4

1

2

3

4

17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development

1

2

3

4

1

2

3

4

18. Ability to demonstrate awareness of the framework of relevant legal requirements governing engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

1

2

3

4

1

2

3

4

19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering

1

2

3

4

1

2

3

4

20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products

1

2

3

4

1

2

3

4

21. Ability to demonstrate practical engineering skills.

1

2

3

4

1

2

3

4

22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc)

1

2

3

4

1

2

3

4

23. Ability to demonstrate understanding of the use of technical literature and other information sources

1

2

3

4

1

2

3

4

24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues

1

2

3

4

1

2

3

4

EIE Surveyor Final Report

165

Tuning methodology in EIE

1 = none; 2 = weak; 3 = considerable; 4 = strong Skill/Competence

Importance for your graduates

Level to which skill is developed in your degree 1 2 3 4

25. Ability to demonstrate understanding of appropriate codes of practice and industry standards

1

2

3

4

26. Ability to demonstrate awareness of quality issues

1

2

3

4

1

2

3

4

27. Ability to work with technical uncertainty

1

2

3

4

1

2

3

4

28. Ability to work in a group on a major project

1

2

3

4

1

2

3

4

29.

1

2

3

4

1

2

3

4

30.

1

2

3

4

1

2

3

4

31.

1

2

3

4

1

2

3

4

32.

1

2

3

4

1

2

3

4

33.

1

2

3

4

1

2

3

4

34.

1

2

3

4

1

2

3

4

Please rank below the five most important competences according to your opinion. Please write the number of the item within the box. Mark on the first box the most important, on the second box the second most important and so on. 1 2 3 4 5

Item number Item number Item number Item number Item number

Many thanks for your co-operation

EIE Surveyor Final Report

166

Tuning methodology in EIE

EIE-Surveyor Graduates Questionnaire We are asking you to participate in a study into the skills and competencies of the graduates of Higher Education programmes. We are particularly interested in how well the degree programme(s) you took prepared you for the work you are currently undertaking. The methodology being used follows that of the Tuning Project, an EU funded project which established an approach to comparing the perception of the importance of generic and specific skills, and how well they are developed. The study asks similar questions of students, academics, graduates and employers to establish a statistical dataset which is then used to make comparisons. In this questionnaire the questions asked deal with your perception of the importance of skills and competences to you and your perception of the level to which these were developed in your degree programme. The information it provides is very valuable in helping to improve course planning for future students. The following questionnaire should take around 10 minutes to complete. Participation in this study is voluntary and you have the right not to answer any question or item, or to withdraw your consent and terminate participation at any time. The research is supported by the EIE-Surveyor Project, an EU funded project that includes 115 partner institutions across the whole of Europe. No personal identifier information is requested so your response to this questionnaire cannot be connected with you personally in any way. We will ensure the confidentiality of all information provided in your response.

********************* By continuing, I agree to participate voluntarily in this survey. I understand the research purpose of the survey and the protection that will be given to any information I provide. I understand that any information provided by me will remain confidential with regard to my identity. I also understand that by participating in this study I am not waiving any of my legal rights. I have been informed that I may contact Tony Ward, Department of Electronics, University of York, Heslington, York, YO10 5DD, email: [email protected] if I have questions or comments about this survey. Please read the instructions for each of the following questions. Review the response options carefully before you mark your answers. There are no right or wrong answers. Answer the questions as quickly and honestly as possible. Please answer all the questions in the questionnaire.

Questionnaire code = G

EIE Surveyor Final Report

167

Tuning methodology in EIE

Background Information

1. Name of the organization in which you work: . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2. Your position within the organization: (Please tick the first position in the list that best describes you. Please tick only ONE position) Tick 26. 27. 28. 29. 30. 31. 32. 33. 34.

Your Position Head of the organization Member of the Management Team Head of Department Head of Group or Section Manager Supervisor Engineer Worker Other, please specify : ……………………………………………….

2a. Number of employees in your organization: . . . . . . . . . . . . . . . . . . . . . . . . . . 2b. Are you directly involved in the recruitment of graduates?

1.Yes F 2.No F

2c. Are you directly involved in the supervision of graduates?

1.Yes F 2.No F

3. In what Country are you working (in alphabetical order)? Tick

Country 1. Austria 2. Belgium 3. Bulgaria 4. Cyprus 5. Czech Republic 6. Denmark 7. Estonia 8. Finland 9. France 10. Germany 11. Greece 12. Hungary 13. Iceland 14. Ireland 15. Italy 16. Latvia

Tick

Country 17. Liechtenstein 18. Lithuania 19. Luxembourg 20. Malta 21. Netherlands 22. Norway 23. Poland 24. Portugal 25. Romania 26. Slovak Republic 27. Slovenia 28. Spain 29. Sweden 30. Turkey 31. United Kingdom

Other (please specify) ……………………………………

4. What is your Sex/Gender?:

EIE Surveyor Final Report

168

Tuning methodology in EIE

1. † 2. †

Male Female 5. What is your age? 20 or under 21 – 30 31 – 40 41 – 50 51 – 60 over 61

1. † 2. † 3. † 4. † 5. † 6. †

6. What is the name of the educational institution at which you studied for your highest qualification?

..................................

7. In what Country did you study for your highest qualification? Tick

Country 1. Austria 2. Belgium 3. Bulgaria 4. Cyprus 5. Czech Republic 6. Denmark 7. Estonia 8. Finland 9. France 10. Germany 11. Greece 12. Hungary 13. Iceland 14. Ireland 15. Italy 16. Latvia

Tick

Country 17. Liechtenstein 18. Lithuania 19. Luxembourg 20. Malta 21. Netherlands 22. Norway 23. Poland 24. Portugal 25. Romania 26. Slovak Republic 27. Slovenia 28. Spain 29. Sweden 30. Turkey 31. United Kingdom

Other (please specify) ……………………………………

8. What is the title of the highest qualification you studied?:

..................................

EIE Surveyor Final Report

169

Tuning methodology in EIE

8a. What ‘level’ is that qualification? Bachelor Masters Doctoral/PhD Other

1. † 2. † 3. † 4. † (please specify) ………………………………………..

9. What is the specific work area in which you work?

..................................

10. Do you consider that university has given you adequate preparation for working in this work area in your company? (Please circle one number) Very much 1

EIE Surveyor Final Report

Much 2

Some 3

170

Little 4

Very little 5

Tuning methodology in EIE

Generic Skills Question For each of the skills listed below, please estimate: —the importance of the skill or competence, in your opinion, for carrying out work in the area of your employment work within your organisation; —the level to which each skill or competence was developed as part of the degree programme(s) you have taken. The blank spaces may be used to indicate any other skills that you consider important but which do not appear in the list. Please use the following scale: 1 = none; 2 = weak; 3 = considerable; 4 = strong.

Skill/Competence

Importance in your work area

Level to which skill was developed by your degree programme

1.Capacity for analysis and synthesis

1

2

3

4

1

2

3

4

2.Capacity for applying knowledge in practice

1

2

3

4

1

2

3

4

3.Planning and time management

1

2

3

4

1

2

3

4

4. Basic general technical knowledge of the profession of your work area

1

2

3

4

1

2

3

4

5.Grounding in basic knowledge of the profession of your work area

1

2

3

4

1

2

3

4

6.Oral and written communication in your native language

1

2

3

4

1

2

3

4

7.Knowledge of a second language

1

2

3

4

1

2

3

4

8.Elementary computing skills

1

2

3

4

1

2

3

4

9.Research skills

1

2

3

4

1

2

3

4

10.Capacity to learn

1

2

3

4

1

2

3

4

11.Information management skills (ability to retrieve and analyse information from different sources)

1

2

3

4

1

2

3

4

12.Critical and self-critical abilities

1

2

3

4

1

2

3

4

13.Capacity to adapt to new situations

1

2

3

4

1

2

3

4

14.Capacity for generating new ideas (creativity)

1

2

3

4

1

2

3

4

15.Problem solving

1

2

3

4

1

2

3

4

16.Decision-making

1

2

3

4

1

2

3

4

17.Teamworking

1

2

3

4

1

2

3

4

1 = none; 2 = weak; 3 = considerable; 4 = strong

EIE Surveyor Final Report

171

Tuning methodology in EIE

Skill/Competence

Importance in your work area

Level to which skill was developed by your degree programme

18.Interpersonal skills

1

2

3

4

1

2

3

4

19.Leadership

1

2

3

4

1

2

3

4

20.Ability to work in an interdisciplinary team

1

2

3

4

1

2

3

4

21.Ability to communicate with non-experts (in the field)

1

2

3

4

1

2

3

4

22.Appreciation of diversity and multiculturality

1

2

3

4

1

2

3

4

23.Ability to work in an international context

1

2

3

4

1

2

3

4

24.Understanding of cultures and customs of other countries

1

2

3

4

1

2

3

4

25.Ability to work autonomously

1

2

3

4

1

2

3

4

26.Project design and management

1

2

3

4

1

2

3

4

27.Initiative and entrepreneurial spirit

1

2

3

4

1

2

3

4

28.Appreciation of ethical issues

1

2

3

4

1

2

3

4

29.Concern for quality

1

2

3

4

1

2

3

4

30.Will to succeed

1

2

3

4

1

2

3

4

31. Patents and Intellectual Property Rights

1

2

3

4

1

2

3

4

32. International Relations and Collaborations

1

2

3

4

1

2

3

4

33. Professional Ethics

1

2

3

4

1

2

3

4

34.

1

2

3

4

1

2

3

4

Please rank below the five most important competences according to your opinion. Please write the number of the item within the box. Mark on the first box the most important, on the second box the second most important and so on. 1 2 3 4 5

EIE Surveyor Final Report

Item number Item number Item number Item number Item number

172

Tuning methodology in EIE

Ability in Languages other than Native Language

For each of the languages listed below, please estimate: —the importance of being able to communicate effectively verbally and in written form, in your opinion, for carrying out work in the area of your work in your professional employment in your organisation; —the level to which ability was developed as a compulsory part of your degree programme. Please use the following scale: 1 = none; 2 = weak; 3 = considerable; 4 = strong.

Importance

Language Bulgarian Czech Danish Dutch English Estonian Finnish French German Greek Hungarian Icelandic Irish Italian Latvian Lithuanian Maltese Norwegian Polish Portuguese Romanian Slovak Slovene Spanish Swedish Turkish

EIE Surveyor Final Report

Written 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2

3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3

Level of development as a compulsory part of your degree programme

Spoken 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4

1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2

3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3

173

Written 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4

1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2

3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3

Spoken 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4

1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2

3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3

4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4

Tuning methodology in EIE

Specific Skills Question For each of the skills listed below, please estimate: —the importance of the skill or competence, in your opinion, for work in your professional employment in your organisation; —the level to which each skill or competence was developed as part of the degree programme(s) you have taken. The blank spaces may be used to indicate any other skills that you consider important but which do not appear in the list. Please use the following scale: 1 = none; 2 = weak; 3 = considerable; 4 = strong.

Skill/Competence

Importance in your work area

Level to which skill was developed by your degree programme

Fundamentals 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline of the work area

1

2

3

4

1

2

3

4

2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline of the work area

1

2

3

4

1

2

3

4

3. Ability to apply and integrate knowledge and understanding of other engineering disciplines appropriate to the work area

1

2

3

4

1

2

3

4

4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles

1

2

3

4

1

2

3

4

5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement in the work area

1

2

3

4

1

2

3

4

EIE Surveyor Final Report

174

Tuning methodology in EIE

1 = none; 2 = weak; 3 = considerable; 4 = strong Skill/Competence

Importance in your work area

Level to which skill was developed by your degree programme

Engineering Analysis 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve problems in the work area

1

2

3

4

1

2

3

4

7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques in the work area

1

2

3

4

1

2

3

4

8. Ability to apply a systems approach to engineering problems in the work area

1

2

3

4

1

2

3

4

9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues

1

2

3

4

1

2

3

4

10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process

1

2

3

4

1

2

3

4

11. Ability to identify and manage cost drivers in designs and projects

1

2

3

4

1

2

3

4

12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs

1

2

3

4

1

2

3

4

13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal

1

2

3

4

1

2

3

4

14. Ability to manage the design process and evaluate outcomes

1

2

3

4

1

2

3

4

Design

EIE Surveyor Final Report

175

Tuning methodology in EIE

1 = none; 2 = weak; 3 = considerable; 4 = strong Skill/Competence

Importance in your work area

Level to which skill was developed by your degree programme

Economic, social and environmental context 15. Ability to demonstrate knowledge and understanding of the commercial and economic context of the work area

1

2

3

4

1

2

3

4

16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context in the work area

1

2

3

4

1

2

3

4

17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development

1

2

3

4

1

2

3

4

18. Ability to demonstrate awareness of the framework of relevant legal requirements governing engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

1

2

3

4

1

2

3

4

19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering

1

2

3

4

1

2

3

4

20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products relevant to the work area

1

2

3

4

1

2

3

4

21. Ability to demonstrate practical engineering skills relevant to the work area.

1

2

3

4

1

2

3

4

22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc)

1

2

3

4

1

2

3

4

23. Ability to demonstrate understanding of the use of technical literature and other information sources in your work area

1

2

3

4

1

2

3

4

24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues

1

2

3

4

1

2

3

4

EIE Surveyor Final Report

176

Tuning methodology in EIE

1 = none; 2 = weak; 3 = considerable; 4 = strong Skill/Competence

Importance in your work area

Level to which skill was developed by your degree programme 1 2 3 4

25. Ability to demonstrate understanding of appropriate codes of practice and industry standards

1

2

3

4

26. Ability to demonstrate awareness of quality issues

1

2

3

4

1

2

3

4

27. Ability to work with technical uncertainty

1

2

3

4

1

2

3

4

28. Ability to work in a group on a major project

1

2

3

4

1

2

3

4

29.

1

2

3

4

1

2

3

4

30.

1

2

3

4

1

2

3

4

31.

1

2

3

4

1

2

3

4

32.

1

2

3

4

1

2

3

4

33.

1

2

3

4

1

2

3

4

34.

1

2

3

4

1

2

3

4

Please rank below the five most important competences according to your opinion. Please write the number of the item within the box. Mark on the first box the most important, on the second box the second most important and so on. 1 2 3 4 5

Item number Item number Item number Item number Item number

Many thanks for your co-operation

EIE Surveyor Final Report

177

Tuning methodology in EIE

EIE Surveyor Final Report

178

Tuning methodology in EIE

EIE-Surveyor Employers Questionnaire We are asking you to participate in a study into the skills and competencies graduates of Higher Education programmes require for success in careers in your organisation. The methodology being used follows that of the Tuning Project, an EU funded project which established an approach to comparing the perception of the importance of generic and specific skills, and how well they are developed. The study asks similar questions of students, academics, graduates and employers to establish a statistical dataset which is then used to make comparisons. In this questionnaire the questions asked deal with your perception of the importance of skills and competences to you and your perception of the level to which these have been developed in graduates of Higher Education Institutions you have recently employed. The information it provides is very valuable in helping to improve course planning for future students. The research is supported by the EIE-Surveyor Project, an EU funded project that includes partner institutions for across the whole of Europe. Participation in this study is voluntary and you have the right not to answer any question or item, or to withdraw your consent and terminate participation at any time. No personal identifier information is requested so your response to this questionnaire cannot be connected with you personally in any way. We will ensure the confidentiality of all information provided in your response. ********************* By continuing, I agree to participate voluntarily in this survey. I understand the research purpose of the survey and the protection that will be given to any information I provide. I understand that any information provided by me will remain confidential with regard to my identity. I also understand that by participating in this study I am not waiving any of my legal rights. I have been informed that I may contact Tony Ward, Department of Electronics, University of York, Heslington, York, YO10 5DD, email [email protected] if I have questions or comments about this survey. Please read the instructions for each of the following questions. Review the response options carefully before you mark your answers. There are no right or wrong answers. Answer the questions as quickly and honestly as possible. Please answer all the questions in the questionnaire.

Please complete this questionnaire for a specific work area (such as process engineer; printed circuit board designer; etc.) and for one specific level of graduate (please see the questionnaire for an explanation of level). If you would like to provide a response for more than one specific work area or level please complete a separate questionnaire for each. Questionnaire code = E

EIE Surveyor Final Report

179

Tuning methodology in EIE

Background Information

1. Name of the organization: . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2. Your position within the organization: (Please tick the first position in the list that best describes you. Please tick only ONE position) Tick 35. 36. 37. 38. 39. 40. 41. 42.

Your Position Head of the organization Member of the Management Team Head of Department Head of Group or Section Manager Supervisor Worker Other, please specify : ……………………………………………….

2a. Are you directly involved in the recruitment of graduates?

1.Yes F 2.No F

2b. Are you directly involved in the supervision of graduates?

1.Yes F 2.No F

2c. Number of employees in your organization: . . . . . . . . . . . . . . . . . . . . . . . . . . 3. In what Country are you working? Tick

Country 1. Austria 2. Belgium 3. Bulgaria 4. Cyprus 5. Czech Republic 6. Denmark 7. Estonia 8. Finland 9. France 10. Germany 11. Greece 12. Hungary 13. Iceland 14. Ireland 15. Italy 16. Latvia

Tick

Country 47. Liechtenstein 48. Lithuania 49. Luxembourg 50. Malta 51. Netherlands 52. Norway 53. Poland 54. Portugal 55. Romania 56. Slovak Republic 57. Slovenia 58. Spain 59. Sweden 60. Turkey 61. United Kingdom

Other (please specify) ……………………………………

4. What is your Sex/Gender?: Male 1. † Female 2. †

EIE Surveyor Final Report

180

Tuning methodology in EIE

5. What is your age? 20 or under 21 – 30 31 – 40 41 – 50 51 – 60 over 61

1. † 2. † 3. † 4. † 5. † 6. †

6. What is the specific work area for which you are completing this questionnaire?

.............................

7. What ‘level’ of employee are you completing this questionnaire for? Bachelor Masters Doctoral/PhD Other

1. † 2. † 3. † 4. † (please specify) ………………………………………..

8. Approximately how many graduates of Higher Education Institutions have you recruited into this work area in the past three years?

………………………

9. Do you consider that Higher Education Institutions have given your employees adequate preparation for working in this work area in your company? (Please circle one number) Very much 1

EIE Surveyor Final Report

Much 2

Some 3

181

Little 4

Very little 5

Tuning methodology in EIE

Generic Skills Question For each of the skills listed below, please estimate: —the importance of the skill or competence, in your opinion, for work in the work area you have chosen in your organisation; —the level to which each skill or competence has been developed as demonstrated by the graduates you have recruited over the past three years to this work area. The blank spaces may be used to indicate any other skills that you consider important but which do not appear in the list. Please use the following scale: 1 = none; 2 = weak; 3 = considerable; 4 = strong.

Skill/Competence

Importance to the work area

Level to which skill is demonstrated by recent graduates 1 2 3 4

1.Capacity for analysis and synthesis

1

2

3

4

2.Capacity for applying knowledge in practice

1

2

3

4

1

2

3

4

3.Planning and time management

1

2

3

4

1

2

3

4

4. Basic general technical knowledge of the profession of your work area

1

2

3

4

1

2

3

4

5.Grounding in basic knowledge of the profession of your work area

1

2

3

4

1

2

3

4

6.Oral and written communication in your native language

1

2

3

4

1

2

3

4

7.Knowledge of a second language

1

2

3

4

1

2

3

4

8.Elementary computing skills

1

2

3

4

1

2

3

4

9.Research skills

1

2

3

4

1

2

3

4

10.Capacity to learn

1

2

3

4

1

2

3

4

11.Information management skills (ability to retrieve and analyse information from different sources)

1

2

3

4

1

2

3

4

12.Critical and self-critical abilities

1

2

3

4

1

2

3

4

13.Capacity to adapt to new situations

1

2

3

4

1

2

3

4

14.Capacity for generating new ideas (creativity)

1

2

3

4

1

2

3

4

15.Problem solving

1

2

3

4

1

2

3

4

16.Decision-making

1

2

3

4

1

2

3

4

17.Teamworking

1

2

3

4

1

2

3

4

1 = none; 2 = weak; 3 = considerable; 4 = strong

EIE Surveyor Final Report

182

Tuning methodology in EIE

Skill/Competence

Importance to the work area

Level to which skill is demonstrated by recent graduates 1 2 3 4

18.Interpersonal skills

1

2

3

4

19.Leadership

1

2

3

4

1

2

3

4

20.Ability to work in an interdisciplinary team

1

2

3

4

1

2

3

4

21.Ability to communicate with non-experts (in the field)

1

2

3

4

1

2

3

4

22.Appreciation of diversity and multiculturality

1

2

3

4

1

2

3

4

23.Ability to work in an international context

1

2

3

4

1

2

3

4

24.Understanding of cultures and customs of other countries

1

2

3

4

1

2

3

4

25.Ability to work autonomously

1

2

3

4

1

2

3

4

26.Project design and management

1

2

3

4

1

2

3

4

27.Initiative and entrepreneurial spirit

1

2

3

4

1

2

3

4

28.Appreciation of ethical issues

1

2

3

4

1

2

3

4

29.Concern for quality

1

2

3

4

1

2

3

4

30.Will to succeed

1

2

3

4

1

2

3

4

31. Patents and Intellectual Property Rights

1

2

3

4

1

2

3

4

32. International Relations and Collaborations

1

2

3

4

1

2

3

4

33.

1

2

3

4

1

2

3

4

34.

1

2

3

4

1

2

3

4

Please rank below the five most important competences according to your opinion. Please write the number of the item within the box. Mark on the first box the most important, on the second box the second most important and so on. 1 2 3 4 5

EIE Surveyor Final Report

Item number Item number Item number Item number Item number

183

Tuning methodology in EIE

Ability in Languages other than Native Language

For each of the languages listed below, please estimate: —the importance of being able to communicate effectively verbally and in written form, in your opinion, for work in the work area you have chosen in your organisation; —the level to which ability has been developed as demonstrated by the graduates you have recruited over the past three years to this work area. Please use the following scale: 1 = none; 2 = weak; 3 = considerable; 4 = strong.

Importance Language Bulgarian Czech Danish Dutch English Estonian Finnish French German Greek Hungarian Icelandic Irish Italian Latvian Lithuanian Maltese Norwegian Polish Portuguese Romanian Slovak Slovene Spanish Swedish Turkish

EIE Surveyor Final Report

Written 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2

3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3

Level of development as a demonstrated by graduates Written Spoken

Spoken 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4

1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2

3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3

184

4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4

1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2

3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3

4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4

1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2

3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3

4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4

Tuning methodology in EIE

Specific Skills Question For each of the skills listed below, please estimate: —the importance of the skill or competence, in your opinion, for work in the work area you have chosen in your organisation; —the level to which each skill or competence has been developed as demonstrated by the graduates you have recruited over the past three years to this work area. The blank spaces may be used to indicate any other skills that you consider important but which do not appear in the list. Please use the following scale: 1 = none; 2 = weak; 3 = considerable; 4 = strong.

Skill/Competence

Importance to the work area

Level to which skill is demonstrated by recent graduates

Fundamentals 1. Ability to demonstrate knowledge and understanding of scientific facts, concepts, theories, principles and methods necessary to underpin the engineering discipline of the work area

1

2

3

4

1

2

3

4

2. Ability to demonstrate knowledge and understanding of mathematics principles and methods necessary to underpin the engineering discipline of the work area

1

2

3

4

1

2

3

4

3. Ability to apply and integrate knowledge and understanding of other engineering disciplines appropriate to the work area

1

2

3

4

1

2

3

4

4. Ability to demonstrate an appreciation of the wider multidisciplinary engineering context and its underlying principles

1

2

3

4

1

2

3

4

5. Ability to understand and take into account social, environmental, ethical, economic and commercial considerations affecting the exercise of engineering judgement in the work area

1

2

3

4

1

2

3

4

EIE Surveyor Final Report

185

Tuning methodology in EIE

1 = none; 2 = weak; 3 = considerable; 4 = strong Skill/Competence

Importance to the work area

Level to which skill is demonstrated by recent graduates

Engineering Analysis 6. Ability to apply appropriate quantitative mathematical, science and engineering methods and computer software to solve problems in the work area

1

2

3

4

1

2

3

4

7. Ability to identify, classify and describe the performance of systems and components through the use of analytical methods and modelling techniques in the work area

1

2

3

4

1

2

3

4

8. Ability to apply a systems approach to engineering problems in the work area

1

2

3

4

1

2

3

4

9. Ability to investigate and define a problem and identify constraints including environmental and sustainability limitations, health and safety and risk assessment issues

1

2

3

4

1

2

3

4

10. Ability to understand customer and user needs and the importance of considerations such as aesthetics in the design process

1

2

3

4

1

2

3

4

11. Ability to identify and manage cost drivers in designs and projects

1

2

3

4

1

2

3

4

12. Ability to demonstrate creative and innovative ability in the synthesis of solutions and in formulating designs

1

2

3

4

1

2

3

4

13. Ability to undertake design activities and projects to ensure fitness for purpose for all aspects of the problem including production, operation, maintenance and disposal

1

2

3

4

1

2

3

4

14. Ability to manage the design process and evaluate outcomes

1

2

3

4

1

2

3

4

Design

EIE Surveyor Final Report

186

Tuning methodology in EIE

1 = none; 2 = weak; 3 = considerable; 4 = strong Skill/Competence

Importance to the work area

Level to which skill is demonstrated by recent graduates

Economic, social and environmental context 15. Ability to demonstrate knowledge and understanding of the commercial and economic context of the work area

1

2

3

4

1

2

3

4

16. Ability to demonstrate knowledge of management techniques which may be used to achieve engineering objectives within the commercial and economic context in the work area

1

2

3

4

1

2

3

4

17. Ability to demonstrate understanding of the requirement for engineering activities to promote sustainable development

1

2

3

4

1

2

3

4

18. Ability to demonstrate awareness of the framework of relevant legal requirements governing engineering activities, including personnel, health, safety, and risk (including environmental risk) issues

1

2

3

4

1

2

3

4

19. Ability to demonstrate understanding of the need for a high level of professional and ethical conduct in engineering

1

2

3

4

1

2

3

4

20. Ability to demonstrate knowledge of characteristics of particular materials, equipment, processes, or products relevant to the work area

1

2

3

4

1

2

3

4

21. Ability to demonstrate practical engineering skills relevant to the work area.

1

2

3

4

1

2

3

4

22. Ability to demonstrate understanding of contexts in which engineering knowledge can be applied (e.g. operations and management, technology development, etc)

1

2

3

4

1

2

3

4

23. Ability to demonstrate understanding of the use of technical literature and other information sources in your work area

1

2

3

4

1

2

3

4

24. Ability to demonstrate awareness of the nature of intellectual property and contractual issues

1

2

3

4

1

2

3

4

EIE Surveyor Final Report

187

Tuning methodology in EIE

1 = none; 2 = weak; 3 = considerable; 4 = strong Skill/Competence

Importance to the work area

Level to which skill is demonstrated by recent graduates 1 2 3 4

25. Ability to demonstrate understanding of appropriate codes of practice and industry standards

1

2

3

4

26. Ability to demonstrate awareness of quality issues

1

2

3

4

1

2

3

4

27. Ability to work with technical uncertainty

1

2

3

4

1

2

3

4

28. Ability to work in a group on a major project

1

2

3

4

1

2

3

4

29.

1

2

3

4

1

2

3

4

30.

1

2

3

4

1

2

3

4

31.

1

2

3

4

1

2

3

4

32.

1

2

3

4

1

2

3

4

33.

1

2

3

4

1

2

3

4

34.

1

2

3

4

1

2

3

4

Please rank below the five most important competences according to your opinion. Please write the number of the item within the box. Mark on the first box the most important, on the second box the second most important and so on. 1 2 3 4 5

Item number Item number Item number Item number Item number

Many thanks for your co-operation

EIE Surveyor Final Report

188

Tuning methodology in EIE

-

-

Task 1.1 of the EIE-Surveyor project has been dedicated to the application of the Tuning Methodology to the Electrical and Information Engineering discipline area. This report presents the approach taken to this application and an analysis of the results obtained from a pan-European survey of students, academics, graduates and employers. In total 3,275 completed questionnaires have been received and entered into a single SPSS dataset. The responses have enabled analyses in a number of different ways to be carried out including comparisons by gender, academic study level, country and by competence both individually and in groups they form through the application of standard statistical data reduction techniques. Attention has been paid to the clarification of the scope of the EIE area as the boundaries between technical degrees and broader arts degrees are blurred in places. The project has confirmed the appropriateness of the Tuning Methodology to the discipline area and, in line with other Tuning studies, has shown that the results do differ between countries and that clustering of countries does occur in some analyses. The analysis shows that, in terms of general preparedness for employment academic typically over-rate while students generally under-rate their view on how well they are preparing students relative to employers. This perhaps reflects a general optimism of employment potential by academics and pessimism by students. In general employers and academics rate competences higher in importance than students and graduates, even allowing for the unevenness in the average responses of these different stakeholders. The most important generic competence is problem solving followed by elementary computing skills and knowledge of a second language. A number of differences between rated importance and level of development of the competences emerge providing evidence that adjustment of curricula would be beneficial. Finally the analysis shows that the English language is the only second language that is rated as anything more than weakly important. This view is shared by all stakeholder groups. The value of the Tuning Methodology and of the analyses carried out has been demonstrated by this project task and the specific findings point clearly to areas where more work can be undertaken. There are gaps in the data for some countries and for some stakeholder groups within some countries. It is recommended that attempts are

The alignment of GENERIC, SPECIFIC and LANGUAGE SKILLS within the ELECTRICAL AND INFORMATION ENGINEERING discipline

made to fill these gaps so that the analysis can be extended to be more representative of the whole of Europe. The issue of clustering needs to be examined in more detail and a focussed study in this area may reveal some interesting European country clusters or some regional differences.

For any information and documentation http://www.eie-surveyor.org [email protected]

Application of the TUNING approach

Funded by the European Union 225997-CP-1-2005-1-FR-ERASMUS-TNPP October 2005 - September 2008, ISBN: 2-9516740-2-3

Suggest Documents