RAE2001 logo


Consultation questions




Question 1: Should the funding bodies use a form of research assessment exercise similar to previous exercises to make judgements of research quality for allocating research funding? What other approach might we take which would be as robust, effective and acceptable to HEIs as a form of RAE?
Question 2: Should research assessment be concerned only with the question of research quality as opposed to, for example, its value for money or its relevance to wealth creation and the quality of life?
Question 3: Should research assessment cover all academic research, and adopt a broad and inclusive definition of research?
Question 4: Should there be a single UK-wide exercise rather than separate exercises conducted by each of the funding bodies?
Question 5: Should the method of assessment continue to be based primarily on peer review?
Question 6: Should the exercise continue to be based only on single-discipline units of assessment (UOAs)?
Question 7: Should all submissions for assessment conform to a common framework and common data definitions?
Question 8: Should the exercise continue to be a prospective one, based on past performance?
Question 9: Should ratings of research quality continue to be the only output of a future assessment exercise, or should we consider adding a greater formative element? If so, how much developmental feedback should the exercise provide at the subject level and on submissions?
Question 10: What additional financial cost would be acceptable to include a greater developmental aspect in the RAE?
Question 11: Are there activities essential to research which the present definition excludes but where there is a strong case for taking these into account in assessing the full range of a department's or unit's research ?
Question 12: What should be the interval between the 1996 RAE and the next and subsequent exercises?
Question 13: Would it be practicable in administrative and funding terms to assess only some subjects in any one year? Would this approach reduce the overall burden of research assessment on higher education institutions and researchers and be more attractive to them?
Question 14: Should we consider further an interim, opt-in exercise ? If so, what kind of exercise would be robust and equitable in principle, workable in practice and attractive to HEIs?
Question 15: Should we implement the Dearing Committee's proposal to provide an incentive not to participate in the RAE? How else could we meet the need to strike a balance between teaching and research activity?
Question 16: If peer review is retained as the primary method of assessment, should this be supplemented by quantitative methods, and if so, how?
Question 17: Should an element of self-assessment be introduced to the assessment process, and if so what should this comprise?
Question 18: How could we discourage HEIs from exaggerating their achievements?
Would publishing whole or parts of submissions bring value to the RAE?
Should we consider a deposit which would be forfeited if the actual grade fell significantly below the grade claimed?
Question 19: Would an element of visiting improve the RAE?
Question 20: Could it be achieved in a cost-effective way?
Question 21: Should we explore the possibility of conducting visits for submissions in certain categories, and if so which ones?
Question 22: Should we consider reconfiguring large units of assessment, and in particular medical subjects, into better defined units?
Question 23: Apart from medical subjects, was the number, division and coverage of the 1996 subject-based UOAs and assessment panels appropriate?

Are there instances where a strong case can be made for combining or subdividing UOAs or panel remits, on which we might further consult subject communities?

Question 24: In addition to suggestions in questions 22 and 23 above, could the use of sub-panels ensure coverage of broadly defined subjects without requiring additional panels?
Question 25: What is the desirable balance between maintaining some common criteria and working methods for different panels, and allowing panels to set criteria appropriate to the subject area?
Question 26: Should formal mechanisms be introduced to ensure greater interaction and comparability between panels? If so, how far should we strive to set limits to moderation and conformity?
Question 27: Could the measures outlined in paragraphs 48-52 above be combined with a broadly discipline-based framework to improve the assessment of interdisciplinary research? What other measures would be both feasible and effective?
Question 28: For a future exercise to assess research quality, should we continue to appoint panel members as outlined above, or should we cast the net more widely? In particular:
a.Should panel chairs be appointed by the funding bodies on the basis of nominations from outgoing chairs alone? What alternatives are possible (for example, the new chair to be elected by the outgoing panel)? b.Should we continue to seek a degree of continuity in membership of panels, and to what extent?
Question 29: How can we attract and induct appropriately qualified users and in particular people from industry into the process of academic peer review?
Question 30: If the problem is the inability of those concerned to devote the necessary time to the process, is there a way to involve them which would not require so much time?
Question 31: To what extent should we seek to appoint overseas academics to assessment panels? Would it be possible to involve overseas academics short of full membership of panels?
Question 32: Should we seek other ways of adding an international dimension to the process, for example by requiring international moderation for top grades?
Question 33: In a future exercise to assess research quality, should we adopt a rating scale that makes no reference to sub-areas of research activity?
Question 34: Should HEIs still be able to identify within submissions the sub-areas of research conducted in the unit ?
Question 35: Should decimal scores be allowed, based on averaging scores awarded by individual panel members?
Question 36: Should the present seven-point scale be retained, and, if so, should it be numbered from 1-7?
Question 37: Should the rating be expressed as the percentage of work of national excellence and the percentage of work of international excellence?
Question 38: Is there a case for panels identifying a minimum number of staff required for the attainment of the highest grade?
Question 39: Should such decisions be made through consultation with subject communities?
Question 40: Should the rating scale be modified to reflect more directly the proportion of staff submitted in highly rated departments bearing in mind the potential consequences for submission patterns and for the calculation of funding?
Question 41: Are there additional issues concerning the assessment of research which we should consider over the longer term?
Question 42: Are there other issues or concerns relevant to the assessment of research which this paper does not cover?

We received responses from the following HEIs

England A-N England O-Z, Scotland, Wales, NI
Anglia Polytechnic University
Aston University
University of Bath
Bath College of Higher Education
University of Birmingham
Birkbeck College
Bolton Institute of HE
Bournemouth University
University of Bradford
Bretton Hall
University of Brighton
University of Bristol
Brunel University
Buckinghamshire College of HE
University of Cambridge
University of Central England
University of Central Lancashire
Central School of Speech and Drama
Canterbury Christ Church College
Chester College of HE
Chichester Institute of HE
City University
Coventry University
Cranfield University
De Montfort University
University of Derby
University of Durham
University of East Anglia
University of East London
Edge Hill College of HE
Institute of Education
University of Essex
University of Exeter
Falmouth College of Arts
Goldsmiths College
University of Greenwich
The College of Guidance Studies
Harper Adams Agricultural College
University of Hertfordshire
Homerton College, Cambridge
University of Huddersfield
University of Hull
Imperial College
Keele University
University of Kent at Canterbury
Kent Institute of Art & Design
King Alfred's College, Winchester
King's College London
Kingston University
Lancaster University
University of Leeds
Leeds Metropolitan University
University of Leicester
University of Lincolnshire & Humberside
University of Liverpool
Liverpool Hope
Liverpool John Moores University
University of London - Senate
Institute of Cancer Research
Royal Free Hospital School of Medicine
United Medical and Dental Schools
London Business School
London School of Economics & Political Science
London Guildhall University
London School of Hygiene & Tropical Medicine
The London Institute
Loughborough University
Loughborough College of Art & Design
University of Luton
University of Manchester
Manchester Metropolitan University
Middlesex University
Nene College
University of Newcastle upon Tyne
Newman College
University of North London
Northern School of Contemporary Dance
University of Northumbria at Newcastle
Norwich School of Art & Design
University of Nottingham
Nottingham Trent University
Open University
School of Oriental and African Studies
University of Oxford
Oxford Brookes University
University of Plymouth
University of Portsmouth
Queen Mary and Westfield College
RCN Institute
University of Reading
Roehampton Institute
Royal Academy of Music
Royal College of Art
Royal College of Music
Royal Holloway, University of London
Royal Northern College of Music
Royal Veterinary College
St George's Hospital Medical School
College of St Mark & St John
St Martin's College
St Mary's College
University of Salford
University of Sheffield
Sheffield Hallam University
University of Southampton
Southampton Institute
South Bank University
Staffordshire University
University of Sunderland
Surrey Institute of Art and Design
University of Surrey
University of Sussex
University of Teesside
Thames Valley University
Trinity & All Saints
Trinity College of Music
University College London
UCL - Eastman Dental Institute
University of Warwick
Westhill College
University of Westminster
Westminster College, Oxford
University of West of England, Bristol
Wimbledon School of Art
University of Wolverhampton
Worcester College of HE
Wye College, University of London
University of York
University of Aberdeen
University of Abertay Dundee
University of Dundee
University of Edinburgh
Edinburgh College of Art
University of Glasgow
Glasgow Caledonian University
Glasgow School of Art
Heriot-Watt University
Moray House Institute of Education
Napier University
Northern College of Education
University of Paisley
Queen Margaret College
Robert Gordon University
University of St Andrews
St Andrew's College of Education
University of Stirling
University of Strathclyde
University of Glamorgan
North East Wales Institute of Higher Education
University of Wales, Bangor
University of Wales, Swansea
Trinity College, Carmarthen
University of Wales, Aberystwyth
University of Wales, Cardiff
University of Wales Centre for Advanced. Welsh & Celtic Studies
University of Wales Institute, Cardiff University of Wales, Lampeter
University of Wales College of Medicine
University of Wales College, Newport
The Queen's University of Belfast
University of Ulster

We received responses from the following other organisations and bodies

AIRTO - Association of Independent Research and Technology Organisations
Armagh Observatory
Association for Language Learning
Association for Management Education and Training in Scotland
Association for Scottish Literary Studies
Association of Art Historians
Association of Business Schools
Association of Graphic Design Educators
Association of Hispanists of Great Britain and Ireland
Association of Law Teachers
Association of Postgraduate Medical Schools
Association of Medical Research Charities
Association of Research Centres on the Social Sciences
Association of the British Pharmaceutical Industry
Association of University Departments of Theology and Religious Studies
Association of University Professors and Heads of French
Association of University Teachers
AURIL - The Association for University Research and Industry Links
BILETA - British and Irish Legal Education Technology Association
British Academy
British Academy of Management
British Association for American Studies
British Association of Slavonic and East European Studies
British Dental Association
British International Studies Association
British Medical Association
British Pharmacological Society
British Sociological Association
British Psychological Society
British Universities Committee on Optometry
Confederation of British Industry
Centre for Higher Education Studies, Institute of Education, University of London
Centre for Housing Management and Development
Chartered Institute of Building
Chartered Institute of Housing
Chartered Institution of Building Services Engineers
Chartered Society of Physiotherapy
Coalition of Modern Universities
Committee of Heads of Art and Design
Chemical Industries Association
The Council for Industry and Higher Education
College of Occupational Therapists CPS
College of Science and Agriculture
Committee of Heads of Accounting
Committee of Heads of University Law Schools
Committee of Professors in Operational Research, University of Strathclyde
Committee of the Heads of UK Veterinary Schools
Conference of Heads of Geography in Higher Education Institutions
Conference of Professors of Accounting and Finance
Committee of Scottish Higher Education Principals
Council for College and University English
Council for Professions Supplementary to Medicine
Council of Professors of Building Engineering and Management
Council of Heads of Medical Schools
Council of Mortgage Lenders
Council of Professors of Building Engineering and Management
Council of Science and Technology Institutes
Coventry University - School of Engineering
Conference of Professors of Heads of Computing
Department of Health
Duncan of Jordanstone College of Art
Dundee City Council
Economic & Social Research Council
Economic History Society, University of Glasgow
Engineering and Physical Sciences Research Council
Engineering Professors' Council
European Economic Development Services Ltd
Faculty of Humanities and Social Sciences - Department of Economics - De Montfort University
Faculty of Public Health Medicine
Foreign and Commonwealth Office
Forest Research
Forum of the History of Science, Technology and Medicine
Glaxo Wellcome
Heads of Departments of Sociology Council
Heads of University Centres of Biomedical Science
Health and Safety Commission
Higher Education Chemistry Conference
Highlands and Islands Enterprise
History at the Universities Defence Group
ICI Technology
Institute of Leisure and Amenity Management
Imperial College Association of University Teachers
Imperial College, Conference of Professors and Heads of Computing
Institute of Actuaries
Institute of Biology
Institute of Chartered Accountants
Institute of Food Science and Technology, UK
Institute of Measurement and Control
Institute of Personnel and Development
Institute of Physics
Institute of Physics and Engineering in Medicine
Institute of Biology, Head of Science Policy and Books
Institution of Chemical Engineers
Institution of Civil Engineers
Institution of Electrical Engineers,
Joint University Council
Joint University Council - Bob Sanders
Joseph Rowntree Foundation
Keele University, Department of Environmental Social Sciences
Landscape Institute
Lancaster University - Department of Educational Research
Leeds Metropolitan University, Northern Women's/Gender Studies
Lifespan Healthcare
London Mathematical Society
Manchester Metropolitan University - Department of Languages
Medical Research Council
Middlesex University - Philosophy
Modern Humanities Research Association
National Association of Music Staff in Higher Education
Napier University, Department of Economics
National Board for Nursing, Midwifery and Health Visiting for Scotland
National Committee for Philosophy
National Environment Research Council
National Postgraduate Committee
National Primary Care Research and Development Centre
National Society for Education in Art and Design
Office of Science and Technology - Health and Life Science Panel
Office of Science and Technology, Foresight Manufacturing, Production and Business Panel
Office of Science and Technology, Foresight Chemicals Panel
Oxford Brookes University, School of Languages
Political Studies Association
PREST University of Manchester
Professor A G Atkins and Professor Richard Chaplin - University of Reading
Professor Derek H Aldcroft - Manchester Metropolitan University
Professor Michael Batty - University College London
Professor R H Smallwood Head of Department of Medical Physics & Clinical Engineering University of Sheffield
Queen's University of Belfast - School of Biology and Biochemistry - Professor W I Montegomery
Queen's University of Belfast - School of Mathematics and Physics
Regional Studies Association
Royal Academy of Engineering
Royal Astronomical Society
Royal College of Pathologists
Royal College of Nursing
Royal College of Ophthalmologists
Royal College of Physicians
Royal College of Paediatrics and Child Health
Royal College of Speech and Language therapists
Royal Economic Society Conference of Heads of University Departments of Economics
Royal Geographical Society
Royal Historical Society
Royal Incorporation of Architects in Scotland
Royal Institute of British Architects
Royal Institute of British Architects
Royal Musical Association
Royal Pharmaceutical Society of Great Britain
Royal Scottish Geographical Society
Royal Society of Chemistry
Royal Society of Edinburgh
Royal Statistical Society
Royal Town Planning Institute
Russell Group and 94 Group of research intensive universities
Standing Committee of Heads of Landscape Architecture
Save British Science Society
Standing Conference of Principals
Scots Philosophical Club
Scottish Committee of Professors of English
Scottish Natural Heritage
Scottish Tourist Board
SmithKline Beecham
Social History Society
Social Policy Association
Society for General Microbiology
Society of Archivists
Society of Public Teachers of Law
South Bank University, School of Construction
Staff and Educational Development Association
Standing Conference for Consumer Studies
Standing Conference of Heads of European Studies
Standing Conference on Cultural, Communication and Media Studies
Tax Research Network
TCS Board Secretariat
The Chartered Institute of Building
The Historical Association
The Publisher Association Ltd
The Royal Institution of Chartered Surveyors in Scotland
The Royal Society
UCET Research and Development Committee
UCL, Faculty of Arts
UCML, University Council of Modern languages
UK Life Sciences Committee
UK National Committee for Microbiology
UMIST - Department of Textiles
UNISON, Higher Education
University and College Lecturers' Union
University College London, Head of Archive and Records Management Courses
University of Aberdeen, Centre for Advanced Studies in Nursing
University of Birmingham - Standing Conference of Arts and Social Sciences
University of Bristol - Department of French
University of Bristol - G10, Heads of Geography Departments
University of Cambridge - Department of Land Economy
University of Durham - Council of University Classical Departments
University of Exeter, Research Support Unit
University of Exeter, Department of Drama
University of Glasgow - Department of Physics and Astronomy
University of Glasgow - Nursing and Midwifery Studies
University of Glasgow - Association of Business Historians
University of Huddersfield - School of Design Technology Research Committee
University of Leeds - Society of Public Teachers of Law
University of Leicester - Archaeology Response
University of Leicester, SCUPHA
University of Liverpool - Diabetes and Endocrinology Research Group
University of Liverpool, BMJ
University of Liverpool, Centre for Archive Studies
University of London, Institute of Latin American Studies
University of Manchester - Society for Italian Studies
University of Manchester - Standing Committee of Anthropology Heads of Departments
University of Newcastle - Department of Town and Country Planning
University of Reading - Department of Construction Management -
University of Sheffield - School of Mathematics and Statistics - Pure Mathematics Section
University of Sheffield, School of Medicine
University of Southampton - School of Management
University of Southampton - UK Academy for Information Systems
University of St Andrews - Department of Social Anthropology
University of Strathclyde - Social Studies Department
University of Surrey - Department of Linguistic and International Studies
University of York - Department of Politics
University Research Ranking
Whatman plc
Women's Studies Network (UK) Association

[ Home | About the RAE2001 | Panels | Guidance for panel members | Guidance for institutions | Data collection | Publications | Contacts ]