FROM FUTILITY TO UTILITY

Collins Dictionary tells us that, “If you say that something is futile, you mean there is no point in doing it, usually because it has no chance of succeeding.”  It is difficult to think of a better description of a student scanning the Times Higher Education or QS World Rankings or any of the multiplicity of other rankings that have proliferated from those organizations.  They don’t really tell students anything useful about whether the institution is right for them as an individual or whether it will allow them to fulfil their life and career ambitions.

All the evidence suggests that the primary motivator for going to higher education is to enhance job prospects. Chegg’s survey across 21 countries, INTO’s research with agents and Gallup surveys are among indicators that for both home and international students a degree is largely a means to an end. That is not to say that people don’t want to study something they enjoy – just that the degree is the aim.

Most existing rankings are, however, just an attempt to monetize industry data for commercial ends and the sector collaborates, possibly because it’s the way things have always been done.  The rankings, as someone said, “Xerox privilege” by reaffirming existing hierarchies and usually allow institutions to manipulate their data, sometimes beyond the point of criminality.  For the institutions they are vanity projects which lead to dubious internal resource allocation, avoid hard questions about graduate employability and distort the decision making of Governments, funders and students.

Utility, on the other hand, is “the quality or property of being useful” and we may be beginning to see the glimmer of some media developing data to be genuinely useful to students.  It is a timely and smart move because we are nearly at the point where AI will give students the opportunity to have near total, instant and absolutely personalized university search capability at their fingertips.  That should send a shudder through ranking organizations that are wedded to a business model and presentation based on early 2000s thinking.

Money magazine’s Best Colleges 2023 may point the way.  It still has a vapid “star” system to allow colleges to be ranked but the database begins to say some useful, student oriented, things about Acceptance Rate, tuition fee (both headline price but more importantly average actual price) and graduation rate.  Imagine if that database approach married itself, in the US, to the work of a company like College Viability, LLC which gives an insight into reasons which a college “…may not be financially viable for the time required to earn a degree from that college.”  Then, add to the mix comprehensive information on the graduate outcomes and career payback from specific degrees – the Princeton Review Best Value Colleges gives a flavour but still ends up as a ranking with limited coverage.

In the UK, the growth of private universities and the significant difference in tuition fees at graduate level between public universities makes the approach equally appropriate.  Such a database would begin to answer the most pressing of student needs – will I get in and with what grades, am I likely to graduate, and what are my career and earning prospects thereafter?  There could be plenty of further nuance added, including grades required, accommodation, measures of student experience and so on.

All of this could be done without the need for a grading system.  The problem with rankings is that the company doing the ranking sets an arbitrary test which institutions do their best to pass with a high grade.  This entirely excludes the student from having any input into the criteria but the results are then presented as an aspirational or emotional nirvana for them to consider.

A smart organization would be ensuring that their data collection is driven by the real world needs and concerns of students. It’s time to remove the worthies who make up the Advisory Groups and Panels for the major ranking organizations and find ways of engaging directly with potential students. The outcome would be relevant, dynamic and have utility for millions around the globe.

It would also be a driver for universities to engage more effectively with the issue of graduate employment both through on-campus services and establishing strong data on careers and jobs. Colleagues including Louise Nicol of Asia Careers Group and Shane Dillon of CTurtle have been demonstrating for years that smart use of technology even makes it possible to leave antiquated, email driven surveys of graduates behind in collecting the data. The answers might even begin to convince Governments around the world that universities are engaging effectively and adding value to economic growth and sustainability.

McKinsey and many others have written about personalization of the customer experience in retail with much of the impetus being given by technology.  The insurance world has seen the rise and rise of aggregators and there is talk of the “personalized insurance engine” that gives a fully automated customer journey.  Potential students are hungry for better decision making option and education needs to catch up fast with the opportunities that exist.

Image by Steve Buissinne from Pixabay

THE’s Russian Ranking Reprise

Despite a year of slaughter, destruction and probable war crimes in Ukraine the Times Higher Education (THE) continues to turn its eyes away from the obvious step of excluding the names of Russian universities from its rankings.  As the drumbeat starts for the launch of the 2023 Impact Rankings at the end of May 2023, the THE has already announced that Russia will again have the most institutions taking part.  We are also told that they are “expecting data to come from a single academic year: 2021” so there would appear to be no chance of revulsion at an institution’s support for unprovoked war, deaths and a refugee crisis impacting on its ranking.

The Sustainable Development Goals are a decent and positive attempt to build a better world and universities are right to consider how they might play a part in that endeavour.  This makes it particularly unfortunate that the THE Impact Rankings have ignored the underlying principles to give continued encouragement to institutions that have backed Putin’s war.  There is even more to suggest how this distorted world view undermines the credibility of the rankings and the organization.      

Indifference and Inaction

The THE Chief Executive Office expressed “solidarity with Ukranian people” on behalf of the company in March 2022 and claimed “we will allow the rankings to do what they are designed to do, and show the world the impact of those [Russian government] decisions..”.  He conveniently forgot to mention that it would be years before the rankings reflected the impact of the war and may even have hoped, in best WW1 jingoistic fashion, that it would all be over by Christmas.  Imagine if every other business, Government and individual that has supported Ukraine through resources, funding, boycotts or direct action, had decided it would wait more than two years before doing anything.

He went on to say that “..we will of course keep the situation under constant review, and will not hesitate to take further steps if we believe it is necessary to do so.”  As far as one can see there has been no further action, no further statements and no further interest despite more than a year of bloodshed and atrocities.  In that respect, the Impact Rankings have become a monument to the indifference of the THE’s leadership.      

Lack of Transparency

Even the THE doesn’t seem able to stomach the notion of Russian universities parading their credentials on SDG 16 – Peace, Justice and Strong Social Institutions.  It is difficult to see any other reason that they would blank the scores for this SDG in the rankings of Russian institutions.  However, there is no explanation in the methodology as to whether there is still a score counting towards the overall ranking of the institution, whether it is zeroed or if there is some other fix.

When a senior data scientist at the THE was asked to explain the methodology no response was received1.  It’s not a very good look given claims about the openness and integrity of the rankings. But it should be a timely reminder to every participant that the methodology is subject to the whims of the compilers.

Allowing Brand Endorsement

Meanwhile, Russian universities remain entirely content to maximise the publicity they get from featuring in the rankings. For example, Altai State University features their ranking, complete with blanked out boxes on SDG 16, as part of their marketing.  Their corporate statement reflects glowingly on what they position as “the third nomination, in which the university was awarded, was…Goal No. 16.”

It seems beyond belief that the THE cannot see that its logo, rankings and reputation are being used as an endorsement for Russian universities.  Neither do they seem to realize that league table endorsement is exactly what the Russian government requires of the institutions. The minimal efforts made by the THE to reduce these bragging rights have manifestly failed and allows Putin’s regime to claim a semblance of normality and acceptance in the world university community.

Promoting Russia as a Study Destination

The THE continues to actively promote Russian universities, allowing easy and searchable access to university courses to 457 courses in the Russian Federation.  Courses from HSE University (shown here) are also publicized, along with many other Russian universities, by Studyportals who act as a THE partner and facilitator in exploiting student eyes on league tables.  It is difficult to see that this is not contributing to Russia’s continued success in attracting international students

Hapless, Hopeless or Worse

It seems reasonable to accept the Ukranian group Progresylni taking any opportunity to understand how they can raise the profile of Ukraine and its fight for academic survival. We should all feel humbled by their willingness to look forward while facing a devastating attack on their country. The uncomfortable truth is that the THE’s unwillingness to act means that the names of Ukranian institutions in the rankings continue to stand next to those from an invading power which continues to build a reputation for crushing academic freedom.

In the Impact Rankings Ukranian institutions are outnumbered by around three Russian universities to one Ukranian which, according to Statista, makes the ratio slightly better than the advantage that Russia has in active soldiers.  With a single decision the THE could allow Ukrainians to enjoy the rankings without the presence of the aggressors. A reformulation of a line from David Sedaris might suggest that these are circumstances where humbled can be found between hapless and hypocrisy in the dictionary. 

Keeping Bad Company

Nobody really expects the THE to give up on the money-go-round that is the university rankings and they may have already anticipated an end game in the war.  It could come down to a calculation of the odds on who prevails or who will have the most university buildings left standing in the long-term.  The needs of private investors and owners, Inflexion, may also make it seem important to keep the doors to revenue open for all possibilities.

What we do know is that the Impact Rankings are manipulable and there is an emerging consistency about those who most want to be involved.  The top three countries involved in 2023 will be Russia (92), Japan (91) and Turkey (84) with two sharing the distinction of having a so called “hard man” at the top and all three being in the bottom 40% of the Academic Freedom Index. In the 2022 Impact Rank the five countries with the most entries – Russia (94), Japan (76), Pakistan (63), India (61) and Turkey (57) – were all in the bottom 40% of the Index.  

In Turkey (which is in the bottom 10% of the Index), President Erdogan signed a decree that allowed him to appoint a president to any university in the country and did so at Bogazici University which he claimed, “failed to understand and incorporate itself to the nation’s values.”   He appointed Melih Bulu as president and while protests erupted and students were arrested “Bulu kept repeating his main promise of improving Bogazici’s international university ranking…”.  While Bulu was eventually removed2 it suggests how pernicious the rankings can be in creating a lever for politicians to ride roughshod over academic freedom.

Even in countries considered to be relatively liberal democracies the rankings have become a dumbed down touchstone for awarding visas in a way that is both vapid and discriminatory.  It is not too far-fetched to believe that rankings are already a vanity project for every wannabe dictator or authoritarian government that wants credibility on the world stage and are becoming a simplistic measure for politicians to judge value in higher education.  It is, after all, much easier to expect universities to manipulate their rankings submission, than to allow academics and students to build a liberal, challenging community where governments are critiqued and challenged. 

NOTES

  1. The individual had been openly looking at my LinkedIn profile. After the message was sent they disappeared from view on my account. Strange behaviour.
  2. Before cheering the demise of Melih Bulu it’s worth noting that Professor Mehmet Naci Inci was appointed (by Erdogan) despite the opposition of 95% of the institution’s academics. In January 2022 he removed three deans of school for their part in protests then in August 2022 he suspended 16 academics who protested “..against presidentially appointed rectors at the school..”. In February 2023 an Istanbul court sentenced 14 Boğaziçi University students each to six months in prison for staging a protest over his appointment.

Image by Andrew Martin from Pixabay