Importance of exploratory data analysis of dummy variables, logit/probit using eviews

By IMPRI Team
IMPRI Generation Alpha Data Centre (GenAlphaDC) along with IMPRI Impact and Policy Research Institute, New Delhi conducted a Two-Week Immersive Online Hands-On Certificate Training Course on Exploratory Data Analysis with Categorical Variables Regression Models Dummy Variables and Logit/Probit using EViews, on December 10 and 17, 2022. The expert trainer for the course was Professor Nilanjan Banik, Professor at Mahindra University. He is a Visiting Consultant at IMPRI and an Academic Consultant with Geneva Network, United Kingdom, and a Senior Consultant with Hankuk University of Foreign Studies, South Korea.
The convenors for the event were Prof Vibhuti Patel, Visiting Professor at IMPRI and a Former Professor, Tata Institute of Social Sciences (TISS), Mumbai; Dr Soumyadip Chattopadhyay, Associate Professor, Economics, Visva-Bharati, Santiniketan and a Visiting Senior Fellow, IMPRI; Dr Arjun Kumar, Director, IMPRI. The training course had participants from the field of data and policy– including students, professionals, researchers, and many others.

Day 1 | December 10, 2022

The session began by going through the basics of Regression. The first question he pondered upon is what the meaning of a “dummy” is. He stated that in essence, it means a replica. Here, in a regression model, if X is a dummy variable, it means that it is a qualitative variable. He began by laying down some assumptions about the dependent and the independent variables. First, X and the Error Term (e) are not related, if related, there will be a problem of endogeneity. X is not quantitative if it is a dummy variable. He explained how we can constitute various qualitative traits in a dummy variable such as gender, and ethnicity among others in a regression model. It tries to capture the impact of any variable that is qualitative in nature.
Second, he mentioned that a dummy variable can capture any break or shift in data. He used the example of the Indian economic reforms of 1991, which was a breakpoint in terms of per capita GDP levels. After 1991 there was a big jump in GDP growth. In other words, there was a structural break. Dummy variables can capture such structural breaks. Thirdly, he mentioned that dummy variables can also be used to de-seasonalize the data. Using Excel, he showed how to incorporate dummy variables in a regression model and how dropping a dummy variable is important in order to avoid a Dummy Trap. He also showed how to de-seasonalize the data, using Excel. After de-seasonalizing the graph turned out to be more stable than before.
After explaining over Excel, he showcased the same data set on EViews. He selected the variables such as sales figures, trends, etc. He then created the dummy variables out of the four quarters. He ran the regression without the dummy first. Then he showcased a data set where he introduced a dummy and ran the regression. The data set used was US Trends in Gross Personal Income and Gross Personal Savings from 1959 to 2007. The dummy variables reflected the recession points from 1981 to 1984. The regression diagram consequently showed the breaking point due to the recession of 1981. The session ended for the day with this, after which, Professor Banik went on to take questions and clear doubts of the trainees. The next class was saved to learn Logit and Probit Models.

Day 2 | December 17, 2022

The second day of the session conducted by Professor Nilanjan Banik, titled, “Exploratory Data Analysis with Categorical Variables Regression Models: Dummy Variables and Logit/Probit using EViews” was devoted to the concepts of Logit and Probit. Professor Banik started by explaining the basic equation of a regression model, and the components within it. Here, the motive was to explain the concept of dummy variables, and the Probit/Logit model, when the variables X and Y are qualitative respectively. Then with an example of hourly wage rates, he showed how to interpret dummy variables for various categorical variables.
After explaining dummy variables, he followed it up by talking about Logit functions. He mentioned that in Logit functions, the dependent variable, Y, takes values of 1 or 0. The Logit or Probit model describes the odds of an individual meeting the outcome variable, given a certain trait or characteristic. He mentioned the importance of LR tests in Probit models. The Logit/Probit models primarily deal with the dependent variable (Y). He showed that the Y variable takes values between negative infinity to positive infinity. He proved this by showing the method to derive the value of Y using Probability. Since the P value will be between the value of 0 and 1, the Y value will take the value of negative Infinity to positive infinity.
After delving into theory, he started a practical lesson on the above discussions with the help of a data set on EViews. First, he showed how to introduce dummy variables on a set of observations. Then, Professor Banik went on to show how to interpret Logit functions on EViews. For this, he again used the previous US data on Savings and Income to show the recession point. Using other data he showed how smoking is affected by age, income, and education. He explained what the P value shows using the formula for the same. He also showed it practically based on the regression model and the results generated from it. Then he took questions from the trainees which he promptly clarified. With this, the two-day training course ended.

---
Acknowledgement: Aaswash Mahanta is a research intern at IMPRI

Comments

70,000 migrants, sold on Canadian dream, face uncertain future: Canada reinvents the xenophobic wheel

By Saurav Sarkar* Bikram Singh is running out of time on his post-study work visa in Canada. Singh is one of about 70,000 migrants who were sold on the Canadian dream of eventually making the country their home but now face an uncertain future with their work permits set to expire by December 2024. They came from places like India, China, and the Philippines, and sold their land and belongings in their home countries, took out loans, or made other enormous commitments to get themselves to Canada.

Kerala government data implicates the Covid vaccines for excess deaths

By Bhaskaran Raman* On 03 Dec 2024, Mr Unnikrishnan of the Indian Express had written an article titled: “Kerala govt data busts vaccine death myth; no rise in mortality post-Covid”. It claims “no significant change in the death rate in the 35-44 age group between 2019 and 2023”. However, the claim is obviously wrong, even to a casual observer, as per the same data which the article presents, as explained below.

PM-JUGA: Support to states and gram sabhas for the FRA implementation and preparation and execution of CFR management plan

By Dr. Manohar Chauhan* (Over the period, under 275(1), Ministry of Tribal Affairs has provided fund to the states for FRA implementation. Besides, some states like Odisha, Chhattisgarh and Maharashtra allocated special fund for FRA implementation. Now PM-JUDA under “Dharti Aaba Janjatiya Gram Utkarsh Abhiyan(DAJGUA) lunched by Prime Minister on 2nd October 2024 will not only be the major source of funding from MoTA to the States/UTs, but also will be the major support to the Gram sabha for the preparation and execution of CFR management Plan).

Defeat of martial law: Has the decisive moment for change come in South Korea?

By Steven Lee Late at night on December 3, soldiers stormed into South Korea’s National Assembly in armored vehicles and combat helicopters. Assembly staff desperately blocked their assault with fire extinguishers and barricades. South Korea’s President Yoon Suk Yeol had just declared martial law to “ eliminate ‘anti-state’ forces .”

Operation Kagar represents Indian state's intensified attempt to extinguish Maoism: Resistance continues

By Harsh Thakor Operation Kagar represents the Indian state's intensified attempt to extinguish Maoism, which claims to embody the struggles and aspirations of Adivasis. Criminalized by the state, the Maoists have been portrayed as a threat, with Operation Kagar deploying strategies that jeopardize their activities. This operation weaves together economic, cultural, and political motives, allegedly with drone attacks on Adivasi homes.

How Amit Shah's statement on Ambedkar reflects frustration of those uncomfortable with Dalit assertion, empowerment

By Vidya Bhushan Rawat* Dr. B.R. Ambedkar remains the liberator and emancipator of India’s oppressed communities. However, attempts to box him between two Brahmanical political parties betray a superficial and self-serving understanding of his legacy. The statement by Union Home Minister Amit Shah in the Rajya Sabha was highly objectionable, reflecting the frustration of those uncomfortable with Dalit assertion and empowerment.

Balod tech fest tests students’ interest in innovative ideas in the fields of science, engineering, start-ups

By Our Representative A techno fest scheduled on December 20 and 21 in Balod district of Chhattisgarh will test the innovative ideas of school students in the fields of science, engineering and start-ups. For this two-day fest organised at Maheswari Bhawan of the district, a total of 824 models made by students were initially registered. Out of those, a selection committee chose 200 models from several schools spread over five blocks of Balod. These will be on display on these two days from 10am to 4.30pm. Out of many ideas, one of the most interesting models is a smart glove which can be used by children with impairments and disabilities. For those who cannot speak at all or have speech difficulty, they can ask for help from caregivers by pressing their fingers on the glove after wearing it. This will attract attention.

Local businessman subjected to physical assault, verbal abuse: Demand for accountability, justice

By Kirity Roy* On October 9, 2024, a disturbing incident of harassment and abuse took place in the Swarupnagar Block of North 24 Parganas district, involving a local businessman, Hasanur Gazi, who was subjected to physical assault, verbal abuse, and religious discrimination by a Border Security Force (BSF) constable. The incident, which occurred at the Hakimpur Checkpost, has raised serious concerns about the safety and dignity of citizens living in border areas, especially those belonging to religious minorities.

Affable but arrogant, embodying contradictions, Raj Kapoor's legacy will endure as long as Bollywood exists

By Harsh Thakor* December 14 marks the birth centenary of Raj Kapoor, a filmmaker and visionary who revolutionized Bollywood, elevating it to new heights by exploring uncharted emotional and social territories. Kapoor wasn’t just a filmmaker; he was a storyteller who touched the souls of the masses and reflected the pulse of post-partition India with unparalleled depth. His films acted as a unifying force in a divided nation, transcending social and cultural boundaries.

Suspicious death of Dalit laborer in BSF custody: A call for justice

By Kirity Roy* The tragic and suspicious death of Mr. Babai Barui, a Dalit daily wage laborer from North 24 Parganas, West Bengal, has raised serious concerns regarding custodial violence and the violation of fundamental rights. Mr. Barui, son of Sukharanjan Barui, resided in Pallishree Sangsad, Bongaon, and was arrested by the Border Security Force (BSF) on November 9, 2024, near the Angrail border on allegations of smuggling. The very next day, he was found dead under mysterious circumstances, with visible injuries that point toward possible custodial violence.

Search This Blog