Importance of exploratory data analysis of dummy variables, logit/probit using eviews

By IMPRI Team
IMPRI Generation Alpha Data Centre (GenAlphaDC) along with IMPRI Impact and Policy Research Institute, New Delhi conducted a Two-Week Immersive Online Hands-On Certificate Training Course on Exploratory Data Analysis with Categorical Variables Regression Models Dummy Variables and Logit/Probit using EViews, on December 10 and 17, 2022. The expert trainer for the course was Professor Nilanjan Banik, Professor at Mahindra University. He is a Visiting Consultant at IMPRI and an Academic Consultant with Geneva Network, United Kingdom, and a Senior Consultant with Hankuk University of Foreign Studies, South Korea.
The convenors for the event were Prof Vibhuti Patel, Visiting Professor at IMPRI and a Former Professor, Tata Institute of Social Sciences (TISS), Mumbai; Dr Soumyadip Chattopadhyay, Associate Professor, Economics, Visva-Bharati, Santiniketan and a Visiting Senior Fellow, IMPRI; Dr Arjun Kumar, Director, IMPRI. The training course had participants from the field of data and policy– including students, professionals, researchers, and many others.

Day 1 | December 10, 2022

The session began by going through the basics of Regression. The first question he pondered upon is what the meaning of a “dummy” is. He stated that in essence, it means a replica. Here, in a regression model, if X is a dummy variable, it means that it is a qualitative variable. He began by laying down some assumptions about the dependent and the independent variables. First, X and the Error Term (e) are not related, if related, there will be a problem of endogeneity. X is not quantitative if it is a dummy variable. He explained how we can constitute various qualitative traits in a dummy variable such as gender, and ethnicity among others in a regression model. It tries to capture the impact of any variable that is qualitative in nature.
Second, he mentioned that a dummy variable can capture any break or shift in data. He used the example of the Indian economic reforms of 1991, which was a breakpoint in terms of per capita GDP levels. After 1991 there was a big jump in GDP growth. In other words, there was a structural break. Dummy variables can capture such structural breaks. Thirdly, he mentioned that dummy variables can also be used to de-seasonalize the data. Using Excel, he showed how to incorporate dummy variables in a regression model and how dropping a dummy variable is important in order to avoid a Dummy Trap. He also showed how to de-seasonalize the data, using Excel. After de-seasonalizing the graph turned out to be more stable than before.
After explaining over Excel, he showcased the same data set on EViews. He selected the variables such as sales figures, trends, etc. He then created the dummy variables out of the four quarters. He ran the regression without the dummy first. Then he showcased a data set where he introduced a dummy and ran the regression. The data set used was US Trends in Gross Personal Income and Gross Personal Savings from 1959 to 2007. The dummy variables reflected the recession points from 1981 to 1984. The regression diagram consequently showed the breaking point due to the recession of 1981. The session ended for the day with this, after which, Professor Banik went on to take questions and clear doubts of the trainees. The next class was saved to learn Logit and Probit Models.

Day 2 | December 17, 2022

The second day of the session conducted by Professor Nilanjan Banik, titled, “Exploratory Data Analysis with Categorical Variables Regression Models: Dummy Variables and Logit/Probit using EViews” was devoted to the concepts of Logit and Probit. Professor Banik started by explaining the basic equation of a regression model, and the components within it. Here, the motive was to explain the concept of dummy variables, and the Probit/Logit model, when the variables X and Y are qualitative respectively. Then with an example of hourly wage rates, he showed how to interpret dummy variables for various categorical variables.
After explaining dummy variables, he followed it up by talking about Logit functions. He mentioned that in Logit functions, the dependent variable, Y, takes values of 1 or 0. The Logit or Probit model describes the odds of an individual meeting the outcome variable, given a certain trait or characteristic. He mentioned the importance of LR tests in Probit models. The Logit/Probit models primarily deal with the dependent variable (Y). He showed that the Y variable takes values between negative infinity to positive infinity. He proved this by showing the method to derive the value of Y using Probability. Since the P value will be between the value of 0 and 1, the Y value will take the value of negative Infinity to positive infinity.
After delving into theory, he started a practical lesson on the above discussions with the help of a data set on EViews. First, he showed how to introduce dummy variables on a set of observations. Then, Professor Banik went on to show how to interpret Logit functions on EViews. For this, he again used the previous US data on Savings and Income to show the recession point. Using other data he showed how smoking is affected by age, income, and education. He explained what the P value shows using the formula for the same. He also showed it practically based on the regression model and the results generated from it. Then he took questions from the trainees which he promptly clarified. With this, the two-day training course ended.

---
Acknowledgement: Aaswash Mahanta is a research intern at IMPRI

Comments

Eight years of empowering tribal communities through water initiatives in Chhattisgarh

By Gazala Paul* In the heart of Chhattisgarh, amidst the echoes of tribal life, a transformative journey has unfolded over the past eight years. The Samerth organization has diligently worked to elevate the lives of indigenous communities in the Kawardha district through the project, "Enabling Baiga Community to access safe drinking water."

Martin Crowe played instrumental role in making New Zealand a force in world cricket

By Harsh Thakor* Late Martin Crowe was the perfect manifestation of how mere figures could not convey or do justice to the true merit of a batsman. Crowe was arguably the most complete or majestic batsmen of his era or the ultimate embodiment of batting perfection, or the classical batsmen. He perished 7 years ago, due to a rare and aggressive form of cancer, follicular lymphoma, which originated in 2012. In September, we celebrated his 60th birthday but sadly he left for his heavenly abode.

Regretful: Kapil Dev retired not leaving Indian cricket with integrity he upheld

By Harsh Thakor Kapil Dev scaled heights as an entertainer and a player upholding the spirit of the game almost unparalleled in his era. In his time he was cricket’s ultimate mascot of sportsmanship On his day Kapil could dazzle in all departments to turn the tempo of game in the manner of a Tsunami breaking in. He radiated r energy, at a level rarely scaled in his era on a cricket field. Few ever blended aggression with artistry so comprehenisively. Although fast medium, he could be as daunting with the ball as the very best, with his crafty outswinger, offcutter, slower ball and ball that kicked from a good length. Inspite of bowling on docile tracks on the subcontinent, Kapil had 434 scalps, with virtually no assistance. I can never forget how he obtained pace and movement on flat pancakes, trapping the great Vivian Richards in Front or getting Geoff Boycott or Zaheer Abbas caught behind. No paceman carried the workload of his team’s bowling attack on his shoulders in his eras muc

How the slogan Jai Bhim gained momentum as movement of popularity and revolution

By Dr Kapilendra Das* India is an incomprehensible plural country loaded with diversities of religions, castes, cultures, languages, dialects, tribes, societies, costumes, etc. The Indians have good manners/etiquette (decent social conduct, gesture, courtesy, politeness) that build healthy relationships and take them ahead to life. In many parts of India, in many situations, and on formal occasions, it is common for people of India to express and exchange respect, greetings, and salutation for which we people usually use words and phrases like- Namaskar, Namaste, Pranam, Ram Ram, Jai Ram ji, Jai Sriram, Good morning, shubha sakal, Radhe Radhe, Jai Bajarangabali, Jai Gopal, Jai Jai, Supravat, Good night, Shuvaratri, Jai Bhole, Salaam walekam, Walekam salaam, Radhaswami, Namo Buddhaya, Jai Bhim, Hello, and so on.

Towards 2024: Time for ‘We the People of India’ to wake up before it is too late

By Fr Cedric Prakash SJ* It is Constitution Day once again! We, the people of India, gratefully remember 26 November 1949 when the Constitution of India was passed and adopted by the Constituent Assembly. The Constituent Assembly comprised women and men of distinction, who were able to represent the heart and soul of the people of India without fear or favour. They gave of their best, so that we may a visionary Constitution, which would be the mainstay for and of democracy in India!

Ceasefire a tactical victory for Palestinian resistance, protests intensify across globe

By Harsh Thakor* The Zionist leadership and Netanyahu’s government were compelled to concede the defeat of their first attempt after almost 50 days of daily fighting in the Gaza Strip. Netanyahu was forced to concede that he was unsuccessful in suppressing the Palestinian Resistance; and that the release of the prisoners was only plausible because they accepted Hamas’ terms.

Odisha leadership crisis deepens: CM engages retired babus to oversee depts' work

By Sudhansu R Das Over decades, Odisha has lost much of its crop diversity, fertile agriculture land, water bodies, employment potential, handicraft and handloom skills etc. The state has failed to strike a balance between the urban and rural sector growth; this leads to the migration of villagers to the urban areas leading to collapse of the urban infrastructures and an acute labor shortage in rural areas. A large number of educated, skilled and unskilled Odia people have migrated to other states for higher education, quality jobs and for earning livelihood which plummet the efficiency level of government departments. Utmost transparency in the recruitment and promotion in the state government departments will improve governance mechanisms in the state. "No near and dear one approach" in governance mechanisms can only achieve inclusive growth for the state on payment basis. This is a moral hazard. When so many educated young people seek employment outside the

1982-83 Bombay textile strike played major role in shaping working class movement

By Harsh Thakor On January 18th, 1982 the working class movement commemorated the 40th anniversary of the Textile Workers Strike that lasted for 18 months, till July 1983. It was landmark event that played a major role in shaping the working class movement. With more than 2.5 lakh workers from 65 textile mills joining in this strike for almost two years, this strike became one of the most significant strikes in terms of scale and duration All democrats should applaud the mill workers’ united battle, and their unflinching resilience an death defying courage continues to serve as a model for contemporary working-class movements. Many middle class persons harboured opinions that the Textile workers were pampered or were a labour aristocracy, ignorant of how they were denied wages to provide for basic necessities. The Great Bombay Textile Strike is notably one of the most defining movements in the working class struggles in Post-independent India. Bombay’s textile industry flourished in

Massive tropical deforestation: Big finance's $307 billion go to forest-risk commodities

A note on report by Forests & Finance coalition -- Rainforest Action Network, TuK Indonesia, Profundo, Amazon Watch, Repórter Brasil, BankTrack, Sahabat Alam Malaysia and Friends of the Earth US: *** A new report released on ‘Finance Day’ at COP28 by the Forests & Finance Coalition , provides a comprehensive look into the role big finance plays in driving deforestation, biodiversity loss, climate change and human rights abuses in tropical forest regions. The report reveals that since the Paris Agreement, banks have pumped over $307 billion into high risk forestry and agriculture companies linked to tropical deforestation, proving that the policies of major global banks and investors are failing to prevent continued widespread forest and biodiversity loss.

20% of Indian businesses have no emission plan in place despite climate emergency: Report

By Jag Jivan New research underlines urgent need for strategies and transition plans to combat climate change, remain successful and meet stakeholder expectations.

Search This Blog