Search This Blog

Thursday, April 5, 2018

NIRF 2018

Two days ago, I learnt that JNU is a better educational institution than IIT Kanpur, and I am terribly confused since then. What does this statement mean. Does it mean they produce better economists than the quality of electrical engineers we produce. How do you really compare two fine institutions as different from each other as JNU and IITK are, with the only common agenda being excellence.

In fact, even within the same category and very similar institutions with same governance, ownership, kind of programs, shared admission process and all that, what does it mean to say one is better than the other. IIT Madras is obviously a great institution, but so is IIT Bombay. For three years in a row, some people sitting near Delhi have declared (based on some data of course) that IIT Madras is a better engineering college than IIT Bombay.

What is the implication of this. Who will use this information. If we consider the set of students who could possibly get admission to any under-graduate program in any IIT, and this set is very small (perhaps, statistically insignificant, and that is why they don't count), only about 50 students, how many of them have taken admission in IIT Madras in the last three years. Very close to zero. Is this ranking not relevant to 12th class students and their parents. Or is it that they aren't aware of the ranking. After all, releasing the ranking just days before JEE would mean that they didn't get to read about them in the newspapers.

If this information is not supposed to be used by 12th class students, who is it for. Is it for students looking for admission to MTech/PhD programs. I am not sure if many of them would seek admission based on this ranking. Is it for PhDs and post-docs seeking academic positions. Is it for companies to figure out where to recruit, or where to do collaborative projects.

Who actually makes use of this information? The answer appears to be, None. It may very subtly over a long period of time change some preferences of some people, but has no real impact on any decision making. Even NIRF website is silent about the purpose and potential use of these rankings. They justify everything they do by saying that MHRD approved it and a core committee took all the decisions, but what was the rationale of MHRD or the core committee isn't known to us.

Why should then academic institutions take these rankings seriously. Well, because, the government wants them to take it seriously. Anything that the government starts, it wants to ensure that it succeeds irrespective of any intrinsic merit of the idea. So, they have declared that rankings will be used for a variety of goodies (even though we don't understand why is JNU better than IITK). They are already using it for graded autonomy. If you are ranked higher, you will get more freedom from UGC. You become eligible to apply for Institute of Eminence status. They are also threatening to link budget to these rankings. And the last part is a huge problem.

I have already written in the previous two years about the problems with NIRF ranking. Some of the issues have been taken care of, but many of them have not been. Let me point a few issues here.

In the period 2006-2008, IIT Kanpur had the misfortune of seeing about 8 suicides. Many experts in local media told us that one of the factors for stress in the student body (even though most suicides had very little to do with academics) was that there was huge peer pressure to graduate in time (in 4 years for BTech), and those who fail even a couple of courses then get stressed merely by assuming that they may have to stay back for an extra semester. We have worked very hard to introduce a lot of flexibility in our curriculum which encourages students to stay for an extra semester or two for either an extra degree or to do double major, or just take a break and try entrepreneurship or even a job in the middle of their programs. As a result, only about 60% of the students have been choosing to graduate in 4 years, and those who are forced to spend an extra semester because of failures don't feel as if a disaster has struck them. Any academician would agree that what we have achieved in the last decade is remarkable. But unfortunately, NIRF disagrees. Since only 60% of our UG students graduate in time, we lose several points in the ranking. If we start taking admissions in different programs, including some 5-year programs and force people to remain in those programs (as we used to do earlier, and as most IITs still do), our ranking would improve.

Also, if you can fill up your seats by hook or by crook, your rankings improve. Since the graduation rates are counted not from the number of students who join a college, but the number of students who could have joined the college. So, if a college declares that they have 600 seats, and take 400 admissions. If 360 students graduate in time, the graduation rate will not be 90% (360/400) but only 60% (360/600). Now, there are two ways to fill your capacity. If you have a capacity of 400, you can based on historically joining rates, artificially declare your capacity as 600 (so you make 600 offers) and somewhere around 400 would join. And you don't admit students after the semester starts. On the other hand, if you believe that your teachers are bad, and missing classes wouldn't really impact learning, you would announce 400 seats, and will keep having waiting list and several rounds of admissions till late into the semester. The first method is far superior in that it allows people to get admission quickly, less stress, no missing of classes, and so on. But NIRF would force you to adopt the second method.

Now, if these rankings are to be used for funding decisions in near future, institutions will be forced to do things which improve their ranking. And it makes sense. If Government (and NIRF) believes that certain things are indicative of higher quality, they must allow all institutions to follow those things. So Government says that 50% women students is ideal and will give you more marks. Can IITK decide to have a 50% reservation for women. Would government handle the political pressure it will result in. Can we reserve 50% seats for out of state. (Karnataka government would hate this, as they would want a 50% reservation for locals.) So on one hand, you are arguing that certain things improve quality, and on the other hand, you don't allow me to follow them. This is so unfair.

But the good thing about people in India is that they understand that universities are complex organizations and work in multiple dimensions, and reducing all those dimensions to a linear score/rank is quite stupid, and therefore, they don't care. Each one of them have their own reasons which they think are at least more logical than NIRF ranking. As I mentioned above, almost all students will continue to favor IITB over IITM despite NIRF.

Links to other articles, addeed on 6th April, 2018:

NIRF Ranking: An Open Letter to Shri Javadekar
JNU Professor tells us why he loathes the practice of ranking universities
NIRF-2018: Urgency of a Reform in Higher Education and also NIRF
Miles to go for IISc
My blog on NIRF last year: NIRF 2017


freedom said...

NIRF left me wondering as to how an institute that fares consistently so badly in the international rankings is able to consistently garner the best rank at the national level.

Nirmalendu Kumar said...

What I feel is the worst part of this absurd ranking is that whatever data the institutions provide is excepted for ranking and there is no independent mechanism to check the authenticity of data provided by any institutions. Thus, the garbage(cooked data ) in and garbage out.

Unless the independent data collection and scrutiny is done to the data used for ranking it will never have any sense. In Engineering BITS Pilani is having lower rank than VIT vellore and IIIT Hyderabad is placed so low is beyond comprehension of any intellectual of this country.It is a shame for the government that they are officially publishing such a garbage and education mafia is so powerful that the government is helpless.

Sanjay Goel said...

It is shocking to see that a huge majority of top 100 NIRF-2018 listed institutes in all the 9 lists this year have scored less than 60 marks out of 100. Only 15 insituites/universities across all the 9 lists have scored >=75/100. Only AIIMS has scored >= 90. This ranking diverts the attention from an overall very poor state of higher education in India where most of the top 100 in all these lists don't even score 60/100 irrespective of the criteria. So instead of ranking top 100 intitutes, the NIRF should just list out those institutes/universities that score 90-100, 75-89, 60-74 as per their criteria that must continue to evolve through debates. And just leave all others from unnecessarily getting declared as a top university/institute whereas they don't actually even score 60/100.

And then every year, at the time of announcement if this ranking, the MHRD must also explain why the total number of institutes/universities in all these these categories (call it the good old first class for >60/100) have not increased. It must also announce the intiatives and reforms to help more universities/institutes to move up to these categories without diluting the criteria. This may create a better purpose, and also a better piece of information for public, policy makers and also the education managers.

And as not much has changed since 2017. My detailed analysis of NIRF 2017 is still valid and relevant.

Latesh said...

Private institutes are using hook or crook to manage NIRF data. Using fake email ids to generate false feedback to improve in perception and unnecessary wasting energy of teachers. No team verifies. We really need to look into this matter? is NIRF ranking really worth? It is only game of data.

NIRF ranking is good tool to guide parents who are seeking admission to college. But is it properly used by education system. We need to think again.

Ajit R. Jadhav said...

Dear Dheeraj,

Hope you don't get angry at me at pointing this out (and you don't have to run this comment either), but it seems to be that when you are asking a question, you still end it not via a question mark, but via a full stop.

For example:

``What gives.''

That is, not:

``What gives?''

I am sure that you have read question-marks during your own UG CS examinations at the IIT Kanpur, haven't you?

Hope you change your writing habits.



freedom said...

The panel wants to use only the NIRF rank to elevate an institute or university to the Institute of Eminence status. It appears that it doesn't want to use the global rankings because some "prominent" institutes were left out.

iitmsriram said...

A bit of a late response, but there appears to be a mismatch between the graduation rates suggested here and the data submitted to NIRF. Yes, IITK has lost points because graduation late is reported lower, but it does not appear to come from the UG program. Incidentally, NIRF considers 80% graduation rate as the target, so if 80% of sanctioned strength graduate in stipulated time, full score is given. Per IITK submitted data for 2018, just under 80% of UG class is graduating in stipulated time (though it is claimed to be about 60% in this blog). The data for the the 2017 graduating batch is about 85% finishing in stipulated time, this is not the reason IITK has lost points on this factor. The gap appears to be coming from M.Tech. program where IITK is reporting about 40% of sanctioned strength or 50% of admitted students graduating in stipulated time. Not sure if there is some problem with this data as reported to NIRF. IITK also shows MTech sanctioned intake around 1000 per year, appears a bit high, especially in view of the admissions being only around 700. IITM and IITB show lower sanctioned intake, but actual intake of about 110% of sanctioned intake.

I believe it is factors like this that may make a difference.

Dheeraj Sanghi said...

@iitmsriram, The problem with Masters program is that we do not have a deadline on the thesis defense. So a larger number of them finish their thesis just before they have to join a job, or in June/July, and more importantly, after the convocation. Internally, we feel that anyone who has finished MTech before the beginning of the next semester should be considered as having graduated in time. But apparently there is some other deadline that NIRF asks for - probably the convocation (and since our convocation is very early compared to all other IITs, this is probably where we lost out). The graduation rate of MTech would be around 40% if it is looked at in mid-June, but by end-July, it would be around 80%.