Bibliometrics pilot exercise

During 2008-09, HEFCE conducted a pilot exercise to test and develop bibliometric indicators of research quality for use in the REF. Twenty two UK higher education institutions took part, covering 35 units of assessment from the 2008 Research Assessment Exercise.

The following reports were published:

• Report on the effect of using normalised citation scores for particular staff characteristics (HEFCE 2011/03)
• Report on the pilot exercise to develop bibliometric indicators (HEFCE 2009/39)
• Interim report on the bibliometrics pilot exercise
• Report on data collection for the bibliometrics pilot exercise
• First report on 'lessons learned' from the bibliometrics pilot exercise: data collection (A report to HEFCE by Technopolis)
• Second report on 'lessons learned' from the bibliometrics pilot exercise: outcomes (A report to HEFCE by Technopolis)

The pilot exercise concluded that citation information is not sufficiently robust to be used formulaically or as a primary indicator of quality in the REF; but there is scope for such data to inform and enhance the process of expert review.

These conclusions drew on feedback from participating institutions, Expert Advisory Groups, and consultation with the wider sector.