Month: October 2021

Keep Your Virtue*…Ignore the Reputation Rankings

If Government took an “experienced, published” scholar and said they would have to spend the next 21 years working only on a vanity project, the higher education community would be outraged at the waste of time, intellect and potential.  But that’s what the THE Reputation Rankings 2021 appear to be doing by having around 11,000 such scholars submitting views on which other universities are good at research and teaching.  It’s only the beginning of the problem for another dreary day in the self-interested world of the rankers.

We are told that academics are hard-pressed and facing mental burnout but that doesn’t stop the THE taking their valuable time to seek opinions about other institutions.  If each of the 10,963 respondents spent half a working day on their submission that would be 5,481 days.  Dividing that by 260 working days a year (a five-day working week times 52 with no holidays) suggests THE may have taken more than two decades of academic time away from scholarship that could save humanity.

Twisted by Knaves to Make a Trap for Fools

Despite, or perhaps because of, all that effort it comes as a yawn inducing revelation that the top five in 2021 are exactly the same universities as the top five in both 2020 and 2019.  The procession of Cambridge, Harvard, MIT, Oxford and Stanford – placed alphabetically here because the whole notion of ranking them seems ludicrous – continues.  In a world where the purpose of higher education, its value and its relevance are all under question this parade of hierarchy seems irrelevant.  

I wonder how Harvard’s reputation really looks to people who agree with Scott Galloway that higher education is becoming “the enforcer of a caste system” where “elite institutions no longer see themselves as public servants”.  Or Michael Crow, President of Arizona State University, when he says that HE is increasingly a system “where status is derivative of exclusion”.  Or to those who have listened to Malcolm Gladwell’s forensic dissection of the US News rankings, where he notes that they are “a self-fulfilling prophecy”.

There should also be an enquiry into the fact that California Institute of Technology (CalTech) is only placed at 14 in the Reputation Rankings.  On THE Student the compilers are telling thousands of candidates that CalTech is the best university in the US,  QS rank it at 6 in the world, it’s number 9 in US News and number 2 in the THE’s own World Rankings.  There are several other examples illustrating inconsistencies which confirm that the whole exercise isn’t really about understanding or reflecting excellence.

One might guess that the opportunity to reach out and flatter 10,963 potential readers and event attendees by asking for their opinion is a primary motivator of the approach taken.  But for THE to then claim the rankings are “based on the opinions of those who truly know” seems typically hyperbolic and ill-founded.  Donald A. Norman is quoted as saying – “academics get paid for being clever, not for being right” – which is an alternative view worth considering.  

Fill the Unforgiving Minute  

The 21-year estimate of time does, of course, presume that the academics involved took the weighty task of considering the reputational implications for thousands of their colleagues at thousands of universities seriously.  Half a day hardly seems long enough to do the job properly but some cynics might suggest that it was more likely half-an-hour over a cup of coffee.  Plenty of time to see scores settled, biases reinforced and best friends rewarded. 

Even half an hour for each submission would be about two-and-a-half years of time stolen from saving the world and brings equally good questions about the value of the exercise.  Each academic submitted around 14 names on average which which, in 30 minutes, means they would take about two minutes to weigh and consider each nomination.  It’s less time and attention than most people spend on selecting their top ten favourite party records for the Christmas playlist.  

Make Allowance for their Doubting Too

The reputation rankings methodology** specifically gives “more weight to research”.  This is not because research is intrinsically more important but because “our expert advisers have suggested that there is greater confidence in respondents’ ability to make accurate judgements about research quality”.  It is interesting to read that THE’s advisers thinks academics can’t really be trusted to review the teaching quality of their peers. 

Pity the poor student who believe the Reputation Rankings have much to do with the teaching they might receive.  The methodology places a premium on the score for research reputation of 2:1 over the score for teaching reputation.  This gives some idea of the importance that THE attributes to teaching in establishing an institution’s standing and the extent to which academics are contributing to perceptions about their priorities.

One Heap of All Your Winnings

It also seems that the eventual ranking is driven as much by volume as by quality.  Respondents are asked to simply name, rather than rank, up to 15 institutions which are best at research and teaching) in their specific subject discipline.  But the number one institution “is the one selected most often” as being one of the best in its field.

It doesn’t seem to matter if the twenty most eminent researchers in each field believes your university is the best.  You will not be top if enough other “experienced, published” researchers pick the place where they are angling for a job, enjoy to visit or where the overlord of research is a personal friend.  There is no indication in the methodology that there is a weighting to account for the ability of the respondents to make or offer a well-informed judgement.

Or Being Lied About Don’t Deal In Lies

However, there are adjustments to ensure that the ranking represents the global distribution of scholars.  Participants are selected randomly from Elsevier’s SCOPUS database which can presumably create a sample in line with the global distribution of academics.  As responses do not reflect the UNESCO distribution of scholars so they have to be weighted.   

Engineering overperformed with 15.8% of respondents and had to be levelled down to a weighted 12.7% while Business and Economics and Arts and Humanities had to be levelled up from 8.2% and 7.7% of respondents to 13.1% and 12.5% respectively.  Maybe it’s just that engineers like questionnaires and giving their opinion but it would be nice to think that some scholars are too dismissive of the process to join in.

If the argument is that the Reputation Rankings are only a game and for entertainment then academics might consider how wise it is to be wasting their time on something as meaningful as voting on The X-Factor or Dancing With the Stars.  But if it is intended to inform politicians, funders, philanthropists and business about quality it carries the danger of reinforcing bias while devaluing other institutions, and their students.  Next time the email from THE pops up in the inbox it might be a good moment to press delete and get on with doing something important. 

NOTES

*Part of the title and all the sub-heading are fragments from Rudyard Kipling’s wonderful and inspirational poem ‘If’

** The page of description of the methodology is, in my view, neither clear or well written. I would be happy to clarify or correct any areas where my interpretation or understanding is incorrect on the advice of an authoritative source.

Image by Gerd Altmann from Pixabay      

It’s Only Just Out of Reach*

It’s always fun to write something that challenges current orthodoxy.  It is not about being right all the time but stimulating debate brings the potential for creative solutions and better solutions for students and society.  There is also the interesting spectacle of people defending the status quo and thinking nothing can or will ever change.

Recently, Louise Nicol and I co-authored a piece for University World News which exhorted the UK to ‘make hay’ while the sun of a benevolent international student environment shone down.  In the face of a beleaguered Australia, an overwhelmed Canada and a United States where every month brings a new twist or turn, it’s time to seize the day.  Or, as the UK Prime Minister could possibly say the UK needs to prenez le grip et donne nous the students.

The suggestion in the article was that the UK should not be thinking about being second in the world for international student recruitment but, specifically, “how and where can we be first?”.   Illustrating the potential was the Education International Cooperation Education Group survey which found, for the third consecutive year, that the UK achieved favoured status – something previously held by the United States.   It also noted that this year UG applications from India were up 30%, with the growth firming up as later data showing placed applicants up by the same percentage.

This led the authors to suggest that the UK Government target of 600,000 international students by 2030 should be revised to 750,000.   It’s a big number but UCL added over 7,000 international students in the four years to 2019/20 and there are more than 150 degree awarding institutions in the UK. A further 240 colleges in the UK provide complete courses leading to recognized UK degrees so the additional students could be spread even further.

Around the Corner

Even if it sounds a stretch target there are a range of data points to suggest what might be possible if there was the will.  If the proportion of international students studying for degrees in the UK was 33% of the total enrolled (UCL is at 53%) there would have been 844,000 of them in 2019/20.  A 44% increase on the 556,625 international students in UK universities in 2019/20 (including EU students), growth which Australia managed between 2016 and 2019, would take the number to 802,540.  All of this is without counting the 432,000 students doing UK degrees outside the country which means that nearly 1 million students around the globe are already studying for awards from UK institutions. 

It was, however, suggested by one respondent that “…the reality is the UK can never be #1. One of many reasons – institutional capacity”.  Fans of Maradona, Berra and Smith might agree more with Yoda’s wisdom that “size matters not” and I wondered what it would really take for the UK to overhaul the US as the leading international student recruiter.  There are several ways of measuring it but it’s surprising how close a race it could be.

First thing to say is that the Open Doors press release and headline figures for US international student enrollment embellishes the actuality.  You can remove 223,539 Optional Practical Training (OPT) that are included (because study is generally prohibited or incidental) and 58,201 non-degree entries from the 2019/20 total of 1,075,496.  That leaves 793,756 UG and Graduate students which is below the numbers noted in the ambitious growth UK scenario noted above.

Next point is that the US has been in a period of decline and Open Doors gives a number of 225,239 new UG and Graduate enrollments in 2019/20.  HESA indicates that the UK enrolled 319,825 first year non-UK students that year, with 255,710 being non-EU so it was ahead on new degree entry international students.  Continuing to close the gap at the rate of 30,000 a year would see the UK ahead of the US within eight years.

It seems reasonable to suggest that the engine of US growth for the past ten years has been Chinese students but that the coming ten years will bring different motivations and constraints.  A four-year undergraduate and two-year postgraduate system may be less attractive for international students who are anxious to get their degree and move on to work in the country of study.  In this respect the UK length of degree study has an advantage and its recently activated right to two years post study work is more accessible than the US options.    

India is likely to become the most important indicator as China’s demographics and attitudes change.  It’s early days but in the year to the end of June 2021 the UK issued 62,500 student visas for India – a rise of around 30 per cent on the previous year while a comparative figure for the US seems to be about 55,000.  These numbers suggest that the UK was ahead by 12.8% – a winning margin that would increase the world long jump to over 10 meters from its current standard of under 9 meters.

Maybe Just by Holding Still

It is true that the US has over 4,000 degree granting institutions so its capacity is extensive.  But it is more expensive; studying often takes longer; post study work is complex; there is a reputation in recent years for being less than welcoming and the lingering uncertainty of a different political viewpoint dominating in a few years.  The recent climate and the prospects were considered so poor that at least 18 US pathway operations closed in the past three years despite being operated by experienced companies that recruit over 15,000 international students a year in the UK. 

The scale of the decline in the US pathway operations has been brutal and is no better illustrated than INTO’s troubles at Oregon State University where an enrollment of 1,496 in Fall 2014 fell to 809 in 2019/20.  The US universities that have made significant progress in international recruitment and maintained momentum during the difficult recent years have invested over the long term to build infrastructure and expertise.  But, there seems no real evidence of a widespread, concerted attempt by the majority of US universities to do what is necessary to materially increase the number of international students they attract.

Meanwhile, the UK is rubbing its hands with glee at the recent news that the THRIVE Act could dissuade colleges from using international agents.  The Center for China and Globalization (CCG) has noted worsening China/USA relations impacting student choices and there seems little reason for agents, already under pressure from the rise of aggregators, to give preference to a country that has always been lukewarm to their role in student recruitment. The M Square Media (MSM) agent survey published in early 2021 showed the depth of the problem that has to be overcome. 

None of this is to say that the US, with its breadth and depth of quality institutions, cannot find its way back towards a position of substantial growth in the international student arena and remain number one for total volume.  But having capacity and wanting the cash from tuition fees is unlikely to be enough to compete effectively against countries that are hungry for success, offer easy routes to post-study work, make citizenship a realistic goal, and which are not likely to fundamentally alter the rules of the game with every change of Government.  Neither does it mean that the UK can’t aspire to dominate markets where its quality, variety, value, visa policies and record of engagement with local agents, schools and universities makes it a safer bet. 

NOTES

* All headings and sub-headings are derived from the song “Something’s Coming” from the irresistible West Side Story which celebrates the 60th anniversary of its release on film this year.  For my money Leonard Bernstein and Stephen Sondheim created the finest musical ever committed to film.  (Music by Leonard Bernstein, lyrics by Stephen Sondheim. © 1956, 1957 Amberson Holdings LLC and Stephen Sondheim. Copyright renewed.  Leonard Bernstein Music Publishing Company LLC, Publisher.)  

Image by Peggy und Marco Lachmann-Anke from Pixabay