Search This Blog

Thursday, December 27, 2012

Should we admit students through a lottery

 Thanks to my good friend, Surya Mantha, I read this long article on the Christmas day, titled "The Myth of American Meritocracy," by Ron Unz on the American Conservative website. The URL of the fascinating article is:


http://www.theamericanconservative.com/articles/the-myth-of-american-meritocracy/

I will not go into the details of discrimination charges, but the solution seemed interesting, and I was wondering if the same solution would work for IITs (not that we have a problem of discrimination).

Paraphrasing his suggestion, it would mean that in an IIT, we get some top few rankers of JEE (say, up to the rank of 1000), and then we look at the next 40-50 thousand students, and select randomly amongst them through a lottery.

The advantages of this scheme would be (again, my understanding of how this scheme would work in the IIT context):

1. The goal of the students would become to get into top 50,000, since getting into top 1000 is just too difficult a goal. This is an easier goal than the current system where every single mark can change your career completely, and hence you will try to do everything to increase the chances of getting that extra mark. And if enough good students would not go through such an extreme form of competition, coaching, etc., then more students would have a normal childhood.

2. The unfair biases that any strongly competitive admission process would introduce will not be present in a lottery based system. So, for example, the admission process would not be discriminatory to women, and we would see a more gender balanced class. (The process itself is not discriminatory, but the fact that very few women are allowed to go to Kota kind of places for coaching, makes the overall system discriminatory.)

3. It will temper the arrogance found in too many of today's IIT students. Students would behave normally with each other, and greater amount of interaction amongst them will actually improve the quality of education.

4. Not getting into IITs would not be a matter of shame or stress. There is no shame in losing a lottery. So less stress in the society for everyone.

5. Since students were simply winners of the lottery, the society will treat non-IITians with much more respect that they truly deserve. A few random marks lost in a test is no way to judge and treat human beings.

The loss in this scheme, as one will surely argue, is that we are not getting the top few students, but the next best. As the article would argue, students at the very top are truly exceptional (in academic sense), and latter students are all roughly equal. (If you think 50K is too low, make it 40K.) In a sense, trying to rank students after the few truly exceptional ones, is a lottery by itself. Luck plays too big a role today. So we are just replacing one type of lottery with another form of lottery, but this new form of lottery does not induce stress, which the current form of lottery does.

Having said all this, I am not fully convinced of the lottery, and hence seek the views of my readers.

Sunday, December 23, 2012

Changes to GATE

A strategy committee for GATE has been formed. They have a problem to worry about. The number of candidates giving GATE will be 11 lakhs in 2013. The number was less than 8 lakhs in 2012. It is obvious that the current model of conducting GATE, where faculty members of IITs and IISc are present in each and every center, cannot be scaled beyond the current numbers.

But I find the initial proposal amusing. I know that it is just an initial proposal, and it may get changed during the course of further discussions. So, in a sense, this article is really to initiate the discussion on a public forum, rather than keep that discussion only restricted to the faculty members of IITs and IISc.

The proposal is to have a two tier exam, and following the example of JEE, the two exams will be named as GATE and GATE Advanced (How I wish it were Main Gate and Advanced Gate). The first tier will be during September/October, only online, on multiple days (but each student can give it only once), and conducted with the help of a partner organization with expertise in conducting online exams. The question bank for this test will still be responsibility of the GATE committee. Each exam will be of two-hour duration, and will have only Multiple Choice Questions (MCQs).

The selected candidates in the GATE will only be able to appear for GATE Advanced. It is expected that about 15 percent students will qualify for GATE Advanced. GATE Advanced will be a 3-hour exam, and will only be in the discipline of that exam. No questions on Engineering Maths, Aptitude, etc., which would have been covered in GATE. So this will allow greater coverage of the subject, since the entire 3 hours is focused on the subject.

I have a problem with this two-tier exam. If we can have the first tier for 11 lakhs (or whatever that number becomes in 2014 and beyond), then why not just use the score of the tier 1 for admission, and any other purpose that anyone may use the score for.

The strategy committee has two reasons for not using the GATE score for admission, and insisting on GATE Advanced. (They don't give these reasons in the proposal. They don't even consider the possibility of just changing the current GATE to proposed new GATE. But the proposal has something from which one can guess these two reasons.)

The first reason is that GATE Advanced will be able to cover the syllabus better, by just focusing on the subject test.

The second reason is that it avoids the comparison of multiple tests, since some inequality of the various tests will only impact selection for the GATE Advanced, and that too of the weakest candidates, and all stronger candidates will get exactly the same paper (GATE Advanced) and thus the comparison for admission will be fair.

The first reason is going against the very reason for including aptitude and engineering maths in the GATE paper. These two items were introduced by arguing that they are a good predictor of quality of preparedness of the student for higher education. But now, we are saying that anyone ranked 1 and ranked 1.6 lakh in the GATE are equal for the purpose of admission, which will only be done on the basis of GATE Advanced. This immediately means that people who perform poorly in engineering maths and aptitude portion and do well in the technical questions may get poorer marks in the GATE, but that will not affect their admission at all. And given that selection to GATE Advanced will be at very low scores (similar to GATE qualifying marks currently), these two topics are as good as useless for most students to prepare. Then we might as well make the first paper subject only, and cover the subject well in that paper.

The second reason is an admission of incompetence. We are admitting that even after having an experience of more than 50 years of conducting competitive exams, we have no clue as to how do we scientifically compare the two tests. This admission of incompetence is not a problem by itself. After all, we are primarily experts in science or engineering and not in subjects such as testing. But what is amazing to me is that while we admit our incompetence, we do not wish to seek expert help. Surely, there must be people in this country who understand these issues. And if there are no experts in testing in India, can we not seek consultancy from people elsewhere in the world. After all, everyone faces the same problem in such testing. GRE faces the same problem, just to give an example.

The simple logic would dictate that if you are having two tests than you should test different things in those two tests. And this was the problem in the JEE debate also (and the compromise that we have all accepted for JEE for 2013). If one has to do two tier tests, the first test should be just aptitude and engineering maths. Everyone should be allowed to give the second test, with the expectation that most universities and PSUs and other users of the score will require a minimum score in the aptitude and engineering maths. This would automatically reduce the number of students for the second test drastically, since everyone will first give aptitude and if get poor score will not find any good reason to waste more good money. But even if lot of students sit for the second test, it does not matter, since that too will be online and on multiple days.

Wednesday, November 21, 2012

Quality in Indian Higher Education

A lot of us keep bemoaning that the quality in Indian Higher Education scenario is largely absent but for a few institutes in each discipline. Consider engineering, for example, with a demand of more than 10 lakh seats per year, but the most liberal interpretation of quality would still not let you classify more than 50 thousand seats as having good quality of education.

Has the higher education policy of the government failed?

Of course, not. The policy has been fantastically successful. It was designed to create a situation that we see today, and it has succeeded. A higher education policy has to balance between access/equity, cost and quality. Government has always considered access/equity and cost to be more important parameters than quality. Please note that while technology and improvement in eco-system, governance, understanding of pedagogy, etc., will hopefully keep reducing the cost, we are far from a situation where cost is irrelevant and the quality education can be provided at a low cost.

If that be the case, it follows that quality education will require greater financial inputs. (By the way, it does not follow that greater financial inputs will always result in higher quality education. So one needs to be aware of all issues, and not just blindly throw money at the problem.) Where will this money come from. It can come from the government (tax payers), or from students, or in the form of philanthropy (including CSR of companies). When we talk about students, it can be their parents or through loans that they pay back later (there are more than one model for this payback, including a slightly higher income tax, for example).

But the government policies have consistently ignored this issue of funds for higher quality. It does not want to spend a much larger part of the budget on quality. So it can support only a few of its favourites for higher quality. There is a severe fee regulation and control in most states that does not allow even a better performing college to charge a significantly higher tuition. The fee that is allowed is such that it is not theoretically possible to even pay the minimum UGC salaries to all faculty members at the student-teacher ratio required by the regulator. The students and parents keep complaining that it is not easy to get student loans in a hassle free fashion.

Fee control is justified on the basis that in the absence of easy student loans and the lack of government subsidy, the higher education will become inaccessible to poor. This is a fine argument, but then this is precisely what I have pointed out in the beginning of this article that the policy is to give higher priority to access/equity and cost, and that the policy has succeeded.

A few deemed universities started claiming that as universities their tuition cannot be controlled and started charging higher tuition and started providing higher quality of education. Of course, there were some who started charging higher tuition and still provided lower quality of education. Instead of creating a distinction between the two, the government is threatening to bring tuition control to all deemed universities. Again, cost is more important than quality in our higher education policy.

One would have thought that the policy may permit a few institutions who have got a track record of doing better than average to go up the ladder in quality, either by providing direct subsidies or allowing them to charge higher tuition. But no. Government does not have funds for quality education outside its favourite institutes, and there must not be any institute in the country which is expensive.

And it is not just the government. Even the mango men (I love this phrase instead of "Aam Admi") want the same. Low cost, low quality in all institutions is better than low cost, low quality in most, and higher cost, higher quality in some. After all, this can create a class divide. Those who can afford quality education will become superior to those who can not afford quality education. So, ban higher cost institutions. The result, unfortunately, is huge competition for the few quality seats (like IITs), and a huge exodus of students for quality institutions abroad, when we could have been the education provider to the world, if we had paid some attention to the quality in our education policy.

Please note that I am not arguing for higher tuition here. I am only pointing out that low quality of higher education reflects success of higher education policy, and not its failure. Whether policy needs to change is something that more erudite people can comment on.