Importance of exploratory data analysis of dummy variables, logit/probit using eviews

By IMPRI Team
IMPRI Generation Alpha Data Centre (GenAlphaDC) along with IMPRI Impact and Policy Research Institute, New Delhi conducted a Two-Week Immersive Online Hands-On Certificate Training Course on Exploratory Data Analysis with Categorical Variables Regression Models Dummy Variables and Logit/Probit using EViews, on December 10 and 17, 2022. The expert trainer for the course was Professor Nilanjan Banik, Professor at Mahindra University. He is a Visiting Consultant at IMPRI and an Academic Consultant with Geneva Network, United Kingdom, and a Senior Consultant with Hankuk University of Foreign Studies, South Korea.
The convenors for the event were Prof Vibhuti Patel, Visiting Professor at IMPRI and a Former Professor, Tata Institute of Social Sciences (TISS), Mumbai; Dr Soumyadip Chattopadhyay, Associate Professor, Economics, Visva-Bharati, Santiniketan and a Visiting Senior Fellow, IMPRI; Dr Arjun Kumar, Director, IMPRI. The training course had participants from the field of data and policy– including students, professionals, researchers, and many others.

Day 1 | December 10, 2022

The session began by going through the basics of Regression. The first question he pondered upon is what the meaning of a “dummy” is. He stated that in essence, it means a replica. Here, in a regression model, if X is a dummy variable, it means that it is a qualitative variable. He began by laying down some assumptions about the dependent and the independent variables. First, X and the Error Term (e) are not related, if related, there will be a problem of endogeneity. X is not quantitative if it is a dummy variable. He explained how we can constitute various qualitative traits in a dummy variable such as gender, and ethnicity among others in a regression model. It tries to capture the impact of any variable that is qualitative in nature.
Second, he mentioned that a dummy variable can capture any break or shift in data. He used the example of the Indian economic reforms of 1991, which was a breakpoint in terms of per capita GDP levels. After 1991 there was a big jump in GDP growth. In other words, there was a structural break. Dummy variables can capture such structural breaks. Thirdly, he mentioned that dummy variables can also be used to de-seasonalize the data. Using Excel, he showed how to incorporate dummy variables in a regression model and how dropping a dummy variable is important in order to avoid a Dummy Trap. He also showed how to de-seasonalize the data, using Excel. After de-seasonalizing the graph turned out to be more stable than before.
After explaining over Excel, he showcased the same data set on EViews. He selected the variables such as sales figures, trends, etc. He then created the dummy variables out of the four quarters. He ran the regression without the dummy first. Then he showcased a data set where he introduced a dummy and ran the regression. The data set used was US Trends in Gross Personal Income and Gross Personal Savings from 1959 to 2007. The dummy variables reflected the recession points from 1981 to 1984. The regression diagram consequently showed the breaking point due to the recession of 1981. The session ended for the day with this, after which, Professor Banik went on to take questions and clear doubts of the trainees. The next class was saved to learn Logit and Probit Models.

Day 2 | December 17, 2022

The second day of the session conducted by Professor Nilanjan Banik, titled, “Exploratory Data Analysis with Categorical Variables Regression Models: Dummy Variables and Logit/Probit using EViews” was devoted to the concepts of Logit and Probit. Professor Banik started by explaining the basic equation of a regression model, and the components within it. Here, the motive was to explain the concept of dummy variables, and the Probit/Logit model, when the variables X and Y are qualitative respectively. Then with an example of hourly wage rates, he showed how to interpret dummy variables for various categorical variables.
After explaining dummy variables, he followed it up by talking about Logit functions. He mentioned that in Logit functions, the dependent variable, Y, takes values of 1 or 0. The Logit or Probit model describes the odds of an individual meeting the outcome variable, given a certain trait or characteristic. He mentioned the importance of LR tests in Probit models. The Logit/Probit models primarily deal with the dependent variable (Y). He showed that the Y variable takes values between negative infinity to positive infinity. He proved this by showing the method to derive the value of Y using Probability. Since the P value will be between the value of 0 and 1, the Y value will take the value of negative Infinity to positive infinity.
After delving into theory, he started a practical lesson on the above discussions with the help of a data set on EViews. First, he showed how to introduce dummy variables on a set of observations. Then, Professor Banik went on to show how to interpret Logit functions on EViews. For this, he again used the previous US data on Savings and Income to show the recession point. Using other data he showed how smoking is affected by age, income, and education. He explained what the P value shows using the formula for the same. He also showed it practically based on the regression model and the results generated from it. Then he took questions from the trainees which he promptly clarified. With this, the two-day training course ended.

---
Acknowledgement: Aaswash Mahanta is a research intern at IMPRI

Comments

Loktantra Bachao Abhiyan raises concerns over Jharkhand Adivasis' plight in Assam, BJP policies

By Our Representative The Loktantra Bachao Abhiyan (Save Democracy Campaign) has issued a pressing call to protect Adivasi rights in Jharkhand, highlighting serious concerns over the treatment of Jharkhandi Adivasis in Assam. During a press conference in Ranchi on November 9, representatives from Assam, Chhattisgarh, and Madhya Pradesh criticized the current approach of BJP-led governments in these states, arguing it has exacerbated Adivasi struggles for rights, land, and cultural preservation.

Promoting love or instilling hate and fear: Why is RSS seeking a meeting with Rahul Gandhi?

By Ram Puniyani* India's anti-colonial struggle was marked by a diverse range of social movements, one of the most significant being Hindu-Muslim unity and the emergence of a unified Indian identity among people of all religions. The nationalist, anti-colonial movement championed this unity, best embodied by Mahatma Gandhi, who ultimately gave his life for this cause. Gandhi once wrote, “The union that we want is not a patched-up thing but a union of hearts... Swaraj (self-rule) for India must be an impossible dream without an indissoluble union between the Hindus and Muslims of India. It must not be a mere truce... It must be a partnership between equals, each respecting the religion of the other.”

Right-arm fast bowler who helped West Indies shape arguably greatest Test team in cricket history

By Harsh Thakor* Malcolm Marshall redefined what it meant to be a right-arm fast bowler, challenging the traditional laws of biomechanics with his unique skill. As we remember his 25th death anniversary on November 4th, we reflect on the legacy he left behind after his untimely death from colon cancer. For a significant part of his career, Marshall was considered one of the fastest and most formidable bowlers in the world, helping to shape the West Indies into arguably the greatest Test team in cricket history.

Swami Vivekananda's views on caste and sexuality were 'painfully' regressive

By Bhaskar Sur* Swami Vivekananda now belongs more to the modern Hindu mythology than reality. It makes a daunting job to discover the real human being who knew unemployment, humiliation of losing a teaching job for 'incompetence', longed in vain for the bliss of a happy conjugal life only to suffer the consequent frustration.

A Hindu alternative to Valentine's Day? 'Shiv-Parvati was first love marriage in Universe'

By Rajiv Shah The other day, I was searching on Google a quote on Maha Shivratri which I wanted to send to someone, a confirmed Shiv Bhakt, quite close to me -- with an underlying message to act positively instead of being negative. On top of the search, I chanced upon an article in, imagine!, a Nashik Corporation site which offered me something very unusual.

Andhra team joins Gandhians to protest against 'bulldozer action' in Varanasi

By Rosamma Thomas* November 1 marked the 52nd day of the 100-day relay fast at the satyagraha site of Rajghat in Varanasi, seeking the restoration of the 12 acres of land to the Sarva Seva Sangh, the Gandhian organization that was evicted from the banks of the river. Twelve buildings were demolished as the site was abruptly taken over by the government after “bulldozer” action in August 2023, even as the matter was pending in court.

Will Bangladesh go Egypt way, where military ruler is in power for a decade?

By Vijay Prashad* The day after former Bangladeshi Prime Minister Sheikh Hasina left Dhaka, I was on the phone with a friend who had spent some time on the streets that day. He told me about the atmosphere in Dhaka, how people with little previous political experience had joined in the large protests alongside the students—who seemed to be leading the agitation. I asked him about the political infrastructure of the students and about their political orientation. He said that the protests seemed well-organized and that the students had escalated their demands from an end to certain quotas for government jobs to an end to the government of Sheikh Hasina. Even hours before she left the country, it did not seem that this would be the outcome.

Will Left victory in Sri Lanka deliver economic sovereignty plan, go beyond 'tired' IMF agenda?

By Atul Chandra, Vijay Prashad* On September 22, 2024, the Sri Lankan election authority announced that Anura Kumara Dissanayake of the Janatha Vimukthi Peramuna (JVP)-led National People’s Power (NPP) alliance won the presidential election. Dissanayake, who has been the leader of the left-wing JVP since 2014, defeated 37 other candidates, including the incumbent president Ranil Wickremesinghe of the United National Party (UNP) and his closest challenger Sajith Premadasa of the Samagi Jana Balawegaya.

Green Revolution’s reliance on chemical fertilizers, pesticides contributing to Punjab's health crisis

By Bharat Dogra, Jagmohan Singh* Punjab was once synonymous with robust health, particularly in its rural areas, where farmers were known for their strength and vitality. However, in recent years, reports from these villages tell a different story, with rising cases of serious health issues, including cancer. What led to this decline? The answer lies largely in the erosion of good nutrition, once a hallmark of Punjabi village life. The health of a population is closely tied to its nutrition, and Punjab's reputation as a provider of high-quality nutrition has suffered greatly. The loss of biodiversity in agriculture has led to a decrease in the variety and quality of crops, resulting in poorer nutrition. Pulses, a key source of protein, have seen a steep decline in cultivation due to the disruption of traditional farming practices by the Green Revolution. This has had a detrimental effect on both soil and human health. Although pulses are still available in the market, they are exp

Tributes paid to pioneer of Naxalism in Punjab, who 'dodged' police for 60 yrs

By Harsh Thakor* Jagjit Singh Sohal, known as Comrade Sharma, a pioneer of Naxalism in Punjab, passed away on October 20 at the age of 96. Committed to the Naxalite cause and a prominent Maoist leader, Sohal, who succeeded Charu Majumdar, played hide and seek with the police for almost six decades. He was cremated in Patiala.

Search This Blog