A couple of years ago, UCAS took a substantial step forward in opening the admissions debate by releasing the rather un-sexily titled “Undergraduate reports by sex, area background, and ethnic group”.
In my previous life as Wonkhe’s resident data-digger we managed to publish some of the most comprehensive analysis of that dataset. We were able to demonstrate the continued substantial variance in university entry by both ethnicity and social class and, more importantly, point to where the data suggested that there might be bias operating in admissions.
I say “suggested”, because the data provided by UCAS is by no means conclusive proof of bias.
The data provided by UCAS shows where different demographic groups are receiving statistically fewer offers than equivalent applicants with the same entry grades and applying for the same subjects. A full explanation of the data and what it means can be found at the foot of this article.
In the two years since that initial release, UCAS has made two further releases of the relevant data, incorporating the last two application cycles of 2016 and 2017. We now have eight years’ worth of data, from 2010 to 2017, to understand how university admissions for UK full-time, 18 year old, undergraduate entrants has changed for those of different ethnicities.
Do ethnic minority applicants get fewer offers than they should?
Analysis of the 2017 data shows 54 UK universities where applicants of either Black, Asian or Mixed ethnicity were less likely to receive offers than applicants of other ethnicities with the same grades and for same subject. This includes a wide range of universities from across different regions, mission groups, and with widely rates of racial diversity in their entrants. 15 are in the “Sutton Trust 30”, a common proxy for the most “selective” universities in the country. Oxford and Cambridge are not included in the list, though we’ll take a closer look at these two institutions down the line.
Table 1
Table of institutions with possible bias v. Asian applicants in 2017
Institution | Cycle | Equality Dimension | Average offer rate | June deadline applications | Percentage point difference between offer rate and average offer rate |
---|---|---|---|---|---|
A80 Aston University Birmingham | 2017 | Asian ethnic group | 0.795 | 3950 | -1.2 |
B20 Bath Spa University | 2017 | Asian ethnic group | 0.899 | 185 | -6 |
B32 University of Birmingham | 2017 | Asian ethnic group | 0.723 | 5525 | -1.5 |
E42 Edge Hill University | 2017 | Asian ethnic group | 0.715 | 395 | -9.2 |
K84 Kingston University | 2017 | Asian ethnic group | 0.81 | 1945 | -2.2 |
L27 Leeds Beckett University | 2017 | Asian ethnic group | 0.772 | 1640 | -3 |
L46 Liverpool Hope University | 2017 | Asian ethnic group | 0.915 | 195 | -9.1 |
N77 Northumbria University | 2017 | Asian ethnic group | 0.855 | 615 | -3.6 |
N91 Nottingham Trent University | 2017 | Asian ethnic group | 0.87 | 1990 | -2.6 |
O66 Oxford Brookes University | 2017 | Asian ethnic group | 0.774 | 900 | -2.3 |
Q75 Queens University Belfast | 2017 | Asian ethnic group | 0.784 | 255 | -5.8 |
S18 The University of Sheffield | 2017 | Asian ethnic group | 0.686 | 2115 | -2.6 |
S21 Sheffield Hallam University | 2017 | Asian ethnic group | 0.732 | 1650 | -3.2 |
S78 The University of Strathclyde | 2017 | Asian ethnic group | 0.628 | 710 | -7.3 |
W01 University of South Wales | 2017 | Asian ethnic group | 0.843 | 260 | -7.1 |
Y50 University of York | 2017 | Asian ethnic group | 0.807 | 830 | -2.3 |
Y75 York St John University | 2017 | Asian ethnic group | 0.847 | 170 | -5.8 |
Table 2
Table of institutions with possible bias v. Black applicants in 2017
Institution | Cycle | Equality dimension | Average offer rate | June deadline applications | Percentage point difference between offer rate and average offer rate |
---|---|---|---|---|---|
A60 Anglia Ruskin University | 2017 | Black ethnic group | 0.752 | 485 | -5.2 |
B16 University of Bath | 2017 | Black ethnic group | 0.69 | 365 | -6.4 |
B25 Birmingham City University | 2017 | Black ethnic group | 0.694 | 1655 | -2.2 |
B32 University of Birmingham | 2017 | Black ethnic group | 0.718 | 2280 | -3.3 |
B84 Brunel University London | 2017 | Black ethnic group | 0.766 | 1485 | -2.8 |
C15 Cardiff University | 2017 | Black ethnic group | 0.634 | 415 | -7.9 |
C30 University of Central Lancashire (UCLan) | 2017 | Black ethnic group | 0.765 | 315 | -5.2 |
C55 University of Chester | 2017 | Black ethnic group | 0.848 | 270 | -7.2 |
C85 Coventry University | 2017 | Black ethnic group | 0.81 | 2160 | -3.9 |
E14 University of East Anglia (UEA) | 2017 | Black ethnic group | 0.7 | 645 | -4.6 |
E42 Edge Hill University | 2017 | Black ethnic group | 0.738 | 185 | -16.8 |
E59 Edinburgh Napier University | 2017 | Black ethnic group | 0.689 | 70 | -13 |
E84 University of Exeter | 2017 | Black ethnic group | 0.841 | 610 | -3.4 |
H36 University of Hertfordshire | 2017 | Black ethnic group | 0.765 | 1915 | -2.2 |
K24 The University of Kent | 2017 | Black ethnic group | 0.836 | 2100 | -2.3 |
K60 Kings College London (University of London) | 2017 | Black ethnic group | 0.558 | 1210 | -3.7 |
L24 Leeds Trinity University | 2017 | Black ethnic group | 0.951 | 60 | -6.4 |
L27 Leeds Beckett University | 2017 | Black ethnic group | 0.792 | 355 | -4.8 |
L34 University of Leicester | 2017 | Black ethnic group | 0.851 | 1780 | -3 |
L39 University of Lincoln | 2017 | Black ethnic group | 0.903 | 330 | -5.4 |
L41 The University of Liverpool | 2017 | Black ethnic group | 0.83 | 755 | -4.2 |
L46 Liverpool Hope University | 2017 | Black ethnic group | 0.927 | 75 | -17.3 |
L75 London South Bank University | 2017 | Black ethnic group | 0.668 | 795 | -4 |
L79 Loughborough University | 2017 | Black ethnic group | 0.699 | 1450 | -5.9 |
M20 The University of Manchester | 2017 | Black ethnic group | 0.592 | 1470 | -3.4 |
M40 The Manchester Metropolitan University | 2017 | Black ethnic group | 0.769 | 1030 | -5.8 |
N21 Newcastle University | 2017 | Black ethnic group | 0.8 | 440 | -3.6 |
N77 Northumbria University | 2017 | Black ethnic group | 0.845 | 220 | -7.4 |
N84 The University of Nottingham | 2017 | Black ethnic group | 0.684 | 1555 | -2 |
N91 Nottingham Trent University | 2017 | Black ethnic group | 0.869 | 1475 | -3.4 |
O66 Oxford Brookes University | 2017 | Black ethnic group | 0.78 | 380 | -3.7 |
Q50 Queen Mary University of London | 2017 | Black ethnic group | 0.779 | 1110 | -2.9 |
S03 The University of Salford | 2017 | Black ethnic group | 0.771 | 495 | -3.6 |
S18 The University of Sheffield | 2017 | Black ethnic group | 0.7 | 545 | -4.2 |
S21 Sheffield Hallam University | 2017 | Black ethnic group | 0.721 | 455 | -4.3 |
S27 University of Southampton | 2017 | Black ethnic group | 0.653 | 1205 | -2.7 |
S84 University of Sunderland | 2017 | Black ethnic group | 0.905 | 55 | -6.6 |
S90 University of Sussex | 2017 | Black ethnic group | 0.883 | 790 | -2.6 |
T20 Teesside University | 2017 | Black ethnic group | 0.685 | 105 | -10 |
U80 UCL (University College London) | 2017 | Black ethnic group | 0.532 | 925 | -4 |
W01 University of South Wales | 2017 | Black ethnic group | 0.869 | 110 | -11.7 |
Table 3
Table of institutions with possible bias v. Mixed/Other applicants in 2017
Institution | Cycle | Equality Dimension | Average offer rate | June deadline applications | Percentage point difference between offer rate and average offer rate |
---|---|---|---|---|---|
B80 Bristol University of the West of England (UWE) | 2017 | Mixed ethnic group | 0.833 | 475 | -4.3 |
D39 University of Derby | 2017 | Mixed ethnic group | 0.867 | 345 | -3.1 |
E42 Edge Hill University | 2017 | Mixed ethnic group | 0.791 | 260 | -6.1 |
B25 Birmingham City University | 2017 | Other ethnic group | 0.742 | 250 | -5.6 |
E14 University of East Anglia (UEA) | 2017 | Other ethnic group | 0.725 | 150 | -10.3 |
E56 The University of Edinburgh | 2017 | Other ethnic group | 0.541 | 195 | -6.9 |
L14 Lancaster University | 2017 | Other ethnic group | 0.814 | 85 | -7.8 |
S85 University of Surrey | 2017 | Other ethnic group | 0.793 | 305 | -4.1 |
Conversely, we find that there are 15 universities where white applicants were more likely to receive offers than applicants of other ethnicities with the same grades and for same subject. Again, the range of universities here is quite broad, including four in the Russell Group.
Table 4
Table of institutions with possible bias in favour of white applicants in 2017
Institution | Cycle | Equality dimension | Average offer rate | June deadline applications | Percentage point difference between offer rate and average offer rate |
---|---|---|---|---|---|
A80 Aston University Birmingham | 2017 | White ethnic group | 0.896 | 3410 | 2 |
B32 University of Birmingham | 2017 | White ethnic group | 0.853 | 22875 | 0.8 |
C60 City University of London | 2017 | White ethnic group | 0.687 | 2140 | 2 |
C85 Coventry University | 2017 | White ethnic group | 0.839 | 7380 | 1.6 |
E14 University of East Anglia (UEA) | 2017 | White ethnic group | 0.824 | 8535 | 0.8 |
E42 Edge Hill University | 2017 | White ethnic group | 0.792 | 9025 | 1 |
H36 University of Hertfordshire | 2017 | White ethnic group | 0.789 | 5495 | 1.2 |
I50 Imperial College London | 2017 | White ethnic group | 0.472 | 3545 | 1.8 |
K60 Kings College London (University of London) | 2017 | White ethnic group | 0.753 | 5955 | 1.2 |
L34 University of Leicester | 2017 | White ethnic group | 0.917 | 7555 | 0.9 |
L75 London South Bank University | 2017 | White ethnic group | 0.808 | 2405 | 1.8 |
L79 Loughborough University | 2017 | White ethnic group | 0.791 | 15170 | 0.8 |
N91 Nottingham Trent University | 2017 | White ethnic group | 0.882 | 16800 | 0.7 |
Q50 Queen Mary University of London | 2017 | White ethnic group | 0.868 | 3985 | 1.3 |
S03 The University of Salford | 2017 | White ethnic group | 0.787 | 7905 | 0.7 |
We also find a small number of institutions with possible instances of affirmative offer-making for non-white ethnicities, or perhaps just quirks of the data. With the exceptions of Asian applicants to the University of Bath, and mixed ethnicity applicants to Durham University, all involve quite small numbers of applicants.
Table 5
Table of institutions with possible bias in favour of non-white applicants in 2017
Institution name | Cycle | Equality dimension | Average offer rate | June deadline applications | Percentage point difference between offer rate and average offer rate |
---|---|---|---|---|---|
B16 University of Bath | 2017 | Asian ethnic group | 0.803 | 1435 | 2.2 |
A66 Arts University Bournemouth | 2017 | Black ethnic group | 0.524 | 80 | 12.2 |
D65 University of Dundee | 2017 | Black ethnic group | 0.622 | 120 | 13.4 |
S75 The University of Stirling | 2017 | Black ethnic group | 0.659 | 75 | 20.4 |
U65 University of the Arts London | 2017 | Black ethnic group | 0.296 | 460 | 4.4 |
D86 Durham University | 2017 | Mixed ethnic group | 0.75 | 850 | 2.9 |
N39 Norwich University Of The Arts | 2017 | Mixed ethnic group | 0.662 | 60 | 10.8 |
S78 The University of Strathclyde | 2017 | Mixed ethnic group | 0.65 | 195 | 9.6 |
H72 The University of Hull | 2017 | Other ethnic group | 0.955 | 65 | 4.5 |
Looking further back than 2017 cycle, my analysis covering the 2013, 2014 and 2015 entry cycles shows very similar results. While many universities drift in and out of the realm of statistical significance in their differences in offer making to difference racial demographics, the aggregate number of universities suggesting possible bias in their offer making remains relatively constant.
Does this mean university admissions are racist?
It might. The data suggests that there must be other reasons why Asian, Black and mixed ethnicity applicants are not getting the same number of offers as “average” students with equivalent UCAS tariff scores and applying for the same subjects. The question the data cannot answer is whether these are factors that might reasonably affect admissions decisions, or whether it is simple unfairness.
In a well-argued response to our 2016 piece, Nottingham Trent University argued that their own analysis showed that Black and Asian applicants with sufficient overall tariff scores were less likely to receive offers because they were more likely not to hold specific A-levels as required by different courses entry criteria. NTU argued that this explained much of the gap in offer rates, and noted that they would take this into consideration in future publication of entry criteria and in providing advice to schools, colleges and applicants on level 3 qualification choices.
NTU’s explanation might apply to several of the universities listed above. If true, it suggests that Black and Asian applicants to university are at the very least at risk of being disadvantaged by their level 3 qualification choices, which may be less likely to meet universities’ requirements than their white peers. Quite why this might be the case is difficult to fathom.
Even if this doesn’t amount to “bias” in the conventional sense, it should nonetheless be of significant concern to universities, schools, colleges, and anyone else responsible for providing information, advice and guidance on higher education choices.
If the theory presented by NTU does not hold up after further analysis in other universities, then it is difficult to look past the explanation of racial bias in offer making, in spite of the caveats listed below. It is hard to deduce, at least at a superficial level, what unites the institutions presented in the lists above that might reasonable explain such differences in offer making across all of them.
To be continued
It is important once again to stress that evidence of this can be found in universities which admit huge numbers of non-white students, and not just in some universities traditionally considered “elite” or “selective”. It shouldn’t come as a surprise, but bias and unfairness appear prone to persist even in relatively diverse university environments.
In future, we’ll zoom in on the issues of fairness in admissions presented by this data to look at the Sutton Trust 30, and later Oxbridge in particular, to understand whether the arguments made both against and in defence of these universities hold up.
Method and caveats
Even with the wealth of data made available about university admissions is difficult to conclusively prove bias against any particular group. Simply looking at the offer-rate – the percentage of a group of applicants made an offer by a university – is insufficient, as it tells does not let us discern between differences in the entry grades of different groups of applicants. It also tells us nothing about the subject which applicants are applying to, as different subjects within universities tend to have very different entry criteria, patterns of offer-making, and demographics of applicants.
The key statistic provided by UCAS to help us discern possible bias in admissions is called the “percentage point difference between the [x demographic] offer rate and the average offer rate”. This statistic controls for the issues noted above – the different entry tariffs of applicants, and the subjects they are applying for – in order to tell us whether a particular group of applicants is still more or less likely to receive an offer than others.
As UCAS put it, “a difference simply means that the offer rate is higher or lower than it is for all applicants who are similar in terms of the subject applied for and a summary measure of their predicted grades”.
UCAS provides a table to identify when this figure is of sufficient statistical significance. In cases where a demographic group of applicants is very small (as is the case with the number of Black applicants to quite a few universities), this makes it difficult to ascertain for sure whether a superficially large gap in offer rates (sometimes as large as five percentage points) is statistically significant enough to be meaningful.
Furthermore, how the controlling factors are taken into account is the source of disagreement between UCAS and other researchers. There are different ways of controlling for factors such as entry grades and subjects of study, and some researchers argue that other factors should also be taken into account. UCAS claim that their way is the most “precise” available. Researchers such as Vikki Boliver at Durham University have been lobbying hard for UCAS to make more underlying data available in order for them to construct their own models which may more may not corroborate with UCAS’s own release.
When a significant difference in offer rates occurs, there is at least enough evidence to question whether it is a result of bias against ethnic minorities within universities. UCAS and universities will argue that there are any number of other factors that might be taken into account. Whether this is a fair defence will likely vary a lot between institutions.
Caution must be urged, but the sector is rapidly running out of ways to easily explain away wide differences in offer rates.
With thanks to David Kernohan for support in data preparation.
One response to “Are university admissions racially biased?”