Friday, December 2, 2011

Some Q&As over exam paper viewings

Hi Professor,

I remember at the beginning of the course you mentioned 10 points for attendance. But I see that it’s counted as 7 points. Could you please look into it?
Thanks,
M
My response:

Hi M,

The attendance and CP together constitute 15% (refer course pack and session 1 slides).

Each session attended fully carries a 1% point credit. However, the first session is not counted (it is prior to final registration). And of the remaining 9 sessions, upto 2 sessions were given 'off' - i.e. no attendance penalty for not showing up in upto 2 lectures. Hence, effectively, the attendance component drops to 7%.

I hope that clarifies
-----------------------------------------------
Dear Prof Sudhir,

My market research experience had been really enriching especially the real life project and data analysis.

I had a separate question on one of the end-term problems. If in a multiple regression, one variable is found to be totally insignificant based on t-value and p-value, can we really take its contribution as more if it has high Beta than a variable who may have a lower beta but is a significant one.

My understanding was we can’t determine the impact solely on Beta in case the variable in not insignificant and only if a variable is significant based on t & p-values, then I can rank them on their impact based on the beta values.

I may be wrong but I wanted to know the right answer and I had given a re-eval request on this aspect too.
Thanks in advance for clarification.
H

My response:

Hi H,

I did go through quite a few re-eval apps which seem to be based on your query. There does seem to be confusion on this score.

1. If a variable isn't significant, then based on either its standardized beta and/or its significance level, it will not show up as impactful. If the standardized beta is still large, it can't be insignificant. The 2 don't go together.

2. If a variable has been used in a regression model and later found insignificant, that still doesn't mean the variable can be dropped when computing predicted values. Many folks appear to have made this mistake. This is because, the coeffs of all other variables are obtained given the presence of this variable in the regression. The alternative could be to drop the variable, re-run the regression and then use the new coeffs (betas) from the new model (which does not use the dropped variable) for prediction.

I hope that clarified. I'm glad to hear the project was found to be relevant and useful. As always, I'd appreciate candid and constructive feedback on how to improve the course for next year and beyond.

Regards,
-------------------------------------------------------------------------------
Dear Professor Voleti,

As posted on your blog: there was a typo in the binary logit question. The coeff of income^2 was shown as -.088 instead of -0.88. Hence, the predicted probabilities of channel watched for all 3 cases would now come up as 1.

I along with many other students spent a lot of time trying to solve this question but gave up after trying parts 1 and 2. The probabilities came as 1 for part 2 and by just looking at parts 3-4 we concluded that we would get the same answer and hence we left them blank.

I feel its unfair that we have been awarded 0 marks for parts 3-4 when people have been given full marks for restating the formula stated in parts 1-2.

Can this evaluation scheme be looked into again, taking into account that the data for the question was wrong and we have understood the concept since we have correctly answered parts 1 & 2?
S
My response:

Hi S,

After the typo, the answer to Q2 - (c) (ii)-(iv) comes up as Pr(channel)=1 in all three cases. Because of the typo, we realized people may get different answers etc., so we decided to award marks to all who attempted the Q.

If Pr=1 in all cases, then this should have been written down in all three cases.

If the space is left blank, then what judgment is a grader to make? Even stating that in words that the answer is coming Pr=1 in all three cases would have given us grounds to award partial if not full credit there.

But graders can't do anything when students leaving a Q blank with no justification why it was not attempted.

So I'm sorry, I cannot at this time accede to the request of changing the grading template to include non-attempts as well simply because I cannot justify doing so. The AAs have been quite liberal with awarding credit in the concerned Q due to the typo.

Hope that clarifies.
-------------------------------------------------------------
Prof Sudhir,

I just checked the answer keys of the end term paper and it appears to me that there are a couple of issues there.

In a log log regression a fixed percentage increase in the dependant variable leads to a B*the percentage increase of the dependant variable. The question asked whether 1 ounce increase in size on average will lead to a 2% increase in sale. The Size is increase is absolute and hence the statement is false and the answer key appears to be wrong to me.

Also if both adjusted R2 and R2 are both given then we should we not consider the adjusted value as a goodness of fit indicator as it takes into account the degrees of freedom and the sample size thereby explaining the variance more accurately. Additionally the question itself had a misprint 82.%% and leads to ambiguity.

I have put the paper for revaluation based on the above. Would be great if you can help me clear my doubts/errors in interpretation.

Regards
R
My response:

Hi R,
I agree with your first point. The 'sales' in the LHS are unit sales and not sales vol in ounces. The correct answer should be FALSE in Q1 - (c) -(ii). Chandana and Pankaj, We should meet to discuss this and any other corrections that would arise.

Re your second point, well Q1-(c)-(iv) asks not about assessment of model fit but only about % of variance explained by Xs in the Y. The latter is appropriately defined by the multiple R-sq while the former is better described by the adj-R-sq.

Re the typo in this part (82.%%), well the correct answer is 83.1% and hence I would have mistyped it as 83.%% instead of 82.%% if I meant the multiple R-sq. So I cannot accede to changing this part of the answer key.

Hope that clarifies.

Sudhir
-----------------------------------------------------------------

More as they come.

Sudhir




No comments:

Post a Comment

Constructive feedback appreciated. Please try to be civil, as far as feasible. Thanks.