Importance of exploratory data analysis of dummy variables, logit/probit using eviews

By IMPRI Team
IMPRI Generation Alpha Data Centre (GenAlphaDC) along with IMPRI Impact and Policy Research Institute, New Delhi conducted a Two-Week Immersive Online Hands-On Certificate Training Course on Exploratory Data Analysis with Categorical Variables Regression Models Dummy Variables and Logit/Probit using EViews, on December 10 and 17, 2022. The expert trainer for the course was Professor Nilanjan Banik, Professor at Mahindra University. He is a Visiting Consultant at IMPRI and an Academic Consultant with Geneva Network, United Kingdom, and a Senior Consultant with Hankuk University of Foreign Studies, South Korea.
The convenors for the event were Prof Vibhuti Patel, Visiting Professor at IMPRI and a Former Professor, Tata Institute of Social Sciences (TISS), Mumbai; Dr Soumyadip Chattopadhyay, Associate Professor, Economics, Visva-Bharati, Santiniketan and a Visiting Senior Fellow, IMPRI; Dr Arjun Kumar, Director, IMPRI. The training course had participants from the field of data and policy– including students, professionals, researchers, and many others.

Day 1 | December 10, 2022

The session began by going through the basics of Regression. The first question he pondered upon is what the meaning of a “dummy” is. He stated that in essence, it means a replica. Here, in a regression model, if X is a dummy variable, it means that it is a qualitative variable. He began by laying down some assumptions about the dependent and the independent variables. First, X and the Error Term (e) are not related, if related, there will be a problem of endogeneity. X is not quantitative if it is a dummy variable. He explained how we can constitute various qualitative traits in a dummy variable such as gender, and ethnicity among others in a regression model. It tries to capture the impact of any variable that is qualitative in nature.
Second, he mentioned that a dummy variable can capture any break or shift in data. He used the example of the Indian economic reforms of 1991, which was a breakpoint in terms of per capita GDP levels. After 1991 there was a big jump in GDP growth. In other words, there was a structural break. Dummy variables can capture such structural breaks. Thirdly, he mentioned that dummy variables can also be used to de-seasonalize the data. Using Excel, he showed how to incorporate dummy variables in a regression model and how dropping a dummy variable is important in order to avoid a Dummy Trap. He also showed how to de-seasonalize the data, using Excel. After de-seasonalizing the graph turned out to be more stable than before.
After explaining over Excel, he showcased the same data set on EViews. He selected the variables such as sales figures, trends, etc. He then created the dummy variables out of the four quarters. He ran the regression without the dummy first. Then he showcased a data set where he introduced a dummy and ran the regression. The data set used was US Trends in Gross Personal Income and Gross Personal Savings from 1959 to 2007. The dummy variables reflected the recession points from 1981 to 1984. The regression diagram consequently showed the breaking point due to the recession of 1981. The session ended for the day with this, after which, Professor Banik went on to take questions and clear doubts of the trainees. The next class was saved to learn Logit and Probit Models.

Day 2 | December 17, 2022

The second day of the session conducted by Professor Nilanjan Banik, titled, “Exploratory Data Analysis with Categorical Variables Regression Models: Dummy Variables and Logit/Probit using EViews” was devoted to the concepts of Logit and Probit. Professor Banik started by explaining the basic equation of a regression model, and the components within it. Here, the motive was to explain the concept of dummy variables, and the Probit/Logit model, when the variables X and Y are qualitative respectively. Then with an example of hourly wage rates, he showed how to interpret dummy variables for various categorical variables.
After explaining dummy variables, he followed it up by talking about Logit functions. He mentioned that in Logit functions, the dependent variable, Y, takes values of 1 or 0. The Logit or Probit model describes the odds of an individual meeting the outcome variable, given a certain trait or characteristic. He mentioned the importance of LR tests in Probit models. The Logit/Probit models primarily deal with the dependent variable (Y). He showed that the Y variable takes values between negative infinity to positive infinity. He proved this by showing the method to derive the value of Y using Probability. Since the P value will be between the value of 0 and 1, the Y value will take the value of negative Infinity to positive infinity.
After delving into theory, he started a practical lesson on the above discussions with the help of a data set on EViews. First, he showed how to introduce dummy variables on a set of observations. Then, Professor Banik went on to show how to interpret Logit functions on EViews. For this, he again used the previous US data on Savings and Income to show the recession point. Using other data he showed how smoking is affected by age, income, and education. He explained what the P value shows using the formula for the same. He also showed it practically based on the regression model and the results generated from it. Then he took questions from the trainees which he promptly clarified. With this, the two-day training course ended.

---
Acknowledgement: Aaswash Mahanta is a research intern at IMPRI

Comments

Beyond his riding skill, Karl Umrigar was admired for his radiance, sportsmanship, and affability

By Harsh Thakor* Karl Umrigar's name remains etched in the annals of Indian horse racing, a testament to a talent tragically cut short. An accident on the racetrack at the tender age of nineteen robbed India of a rider on the cusp of greatness. Had he survived, there's little doubt he would have ascended to international stature, possibly becoming the greatest Indian jockey ever. Even 46 years after his death, his name shines brightly, reminiscent of an inextinguishable star. His cousin, Pesi Shroff, himself blossomed into one of the most celebrated jockeys in Indian horse racing.

Aurangzeb’s last will recorded by his Maulvi: Allah shouldn't make anyone emperor

By Mohan Guruswamy Aurangzeb’s grave is a simple slab open to the sky lying along the roadside at Khuldabad near Aurangabad. I once stopped by to marvel at the tomb of an Emperor of India whose empire was as large as Ashoka the Great's. It was only post 1857 when Victoria's domain exceeded this. The epitaph reads: "Az tila o nuqreh gar saazand gumbad aghniyaa! Bar mazaar e ghareebaan gumbad e gardun bas ast." (The rich may well construct domes of gold and silver on their graves. For the poor folks like me, the sky is enough to shelter my grave) The modest tomb of Aurangzeb is perhaps the least recognised legacies of the Mughal Emperor who ruled the land for fifty eventful years. He was not a builder having expended his long tenure in war and conquest. Towards the end of his reign and life, he realised the futility of it all. He wrote: "Allah should not make anyone an emperor. The most unfortunate person is he who becomes one." Aurangzeb’s last will was re...

PUCL files complaint with SC against Gujarat police, municipal authorities for 'unlawful' demolitions, custodial 'violence'

By A Representative The People's Union for Civil Liberties (PUCL) has lodged a formal complaint with the Chief Justice of India, urging the Supreme Court to initiate suo-moto contempt proceedings against the police and municipal authorities in Ahmedabad, Gujarat. The complaint alleges that these officials have engaged in unlawful demolitions and custodial violence, in direct violation of a Supreme Court order issued in November 2024.

How the slogan Jai Bhim gained momentum as movement of popularity and revolution

By Dr Kapilendra Das* India is an incomprehensible plural country loaded with diversities of religions, castes, cultures, languages, dialects, tribes, societies, costumes, etc. The Indians have good manners/etiquette (decent social conduct, gesture, courtesy, politeness) that build healthy relationships and take them ahead to life. In many parts of India, in many situations, and on formal occasions, it is common for people of India to express and exchange respect, greetings, and salutation for which we people usually use words and phrases like- Namaskar, Namaste, Pranam, Ram Ram, Jai Ram ji, Jai Sriram, Good morning, shubha sakal, Radhe Radhe, Jai Bajarangabali, Jai Gopal, Jai Jai, Supravat, Good night, Shuvaratri, Jai Bhole, Salaam walekam, Walekam salaam, Radhaswami, Namo Buddhaya, Jai Bhim, Hello, and so on. A soft attitude always creates strong relationships. A relationship should not depend only on spoken words. They should rely on understanding the unspoken feeling too. So w...

राजस्थान, मध्यप्रदेश, पश्चिम बंगाल, झारखंड और केरल फिसड्डी: जल जीवन मिशन के लक्ष्य को पाने समन्वित प्रयास जरूरी

- राज कुमार सिन्हा* जल संसाधन से जुड़ी स्थायी समिति ने वर्तमान लोकसभा सत्र में पेश रिपोर्ट में बताया है कि "नल से जल" मिशन में राजस्थान, मध्यप्रदेश, पश्चिम बंगाल, झारखंड और केरल फिसड्डी साबित हुए हैं। जबकि देश के 11 राज्यों में शत-प्रतिशत ग्रामीणों को नल से जल आपूर्ति शुरू कर दी गई है। रिपोर्ट में समिति ने केंद्र सरकार को सिफारिश की है कि मिशन पुरा करने में राज्य सरकारों की समस्याओं पर गौर किया जाए।

State Human Rights Commission directs authorities to uphold environmental rights in Vadodara's Vishwamitri River Project

By A Representative The Gujarat State Human Rights Commission (GSHRC) has ordered state and Vadodara municipal authorities to strictly comply with environmental and human rights safeguards during the Vishwamitri River Rejuvenation Project, stressing that the river’s degradation disproportionately affects marginalized communities and violates citizens’ rights to a healthy environment. The Commission mandated an immediate halt to ecologically destructive practices, rehabilitation of affected communities, transparent adherence to National Green Tribunal (NGT) orders, and public consultations with experts and residents. The order follows the Concerned Citizens of Vadodara coalition—environmentalists, ecologists, and urban planners—submitting a detailed letter to authorities, amplifying calls for accountability. The group warned that current plans to “re-section” and “desilt” the river contradict the NGT’s 2021 Vishwamitri River Action Plan, which prioritizes floodpla...

CPM’s evaluation of BJP reflects its political character and its reluctance to take on battle against neo-fascism

By Harsh Thakor* A controversial debate has emerged in the revolutionary camp regarding the Communist Party of India (Marxist)'s categorization of the Bharatiya Janata Party. Many Communists criticize the CPM’s reluctance to label the BJP as a fascist party and India as a fascist state. Various factors must be considered to arrive at an accurate assessment. Understanding the original meaning and historical development of fascism is essential, as well as analyzing how it manifests in the present global and national context.

Haven't done a good deed, inner soul is cursing me as sinner: Aurangzeb's last 'will'

Counterview Desk The Tomb of Aurangzeb, the last of the strong Mughal emperors, located in Khuldabad, Aurangabad district, Maharashtra, has this epitaph inscribed on it: "Az tila o nuqreh gar saazand gumbad aghniyaa! Bar mazaar e maa ghareebaan gumbad e gardun bas ast" (the rich may well construct domes of gold and silver on their graves. For the poor folks like me, the sky is enough to shelter my grave).

How polarization between different ideological trends within the communist movement sharpened in India

By Harsh Thakor* This article is a rejoinder to A Note on Slogans of “Left Unity,” “Unity of the Communist Revolutionaries” and “Mass Line” by Umair Ahmed, published on the Nazariya blog .

Implications of deaths of Maoist leaders G. Renuka and Ankeshwarapu Sarayya in Chhattisgarh

By Harsh Thakor* In the wake of recent security operations in southern Chhattisgarh, two senior Maoist leaders, G. Renuka and Ankeshwarapu Sarayya, were killed. These operations, which took place amidst a historically significant Maoist presence, resulted in the deaths of 31 individuals on March 20th and 16 more three days prior.

Search This Blog