Skip to main content

Data analytics: How scientific enquiry process impacts quality of policy research

By IMPRI Team 

Given the multidimensionality of policy and impact research, tech-driven policy prescriptions are playing a dominant role in the 21st century. As such, data analytics have become integral in this space. IMPRI Generation Alpha Data Centre (GenAlphaDC), IMPRI Impact and Policy Research Institute New Delhi has successfully conducted a #WebPolicyTalk 6-Week Immersive Online Hands-on Certificate Training Course on Data Analytics for Policy Research, spanning over 6-consecutive Saturdays from October 15th to November 19th, 2022. Along with this, datasets for hands-on learning were also provided for data analysis and learning.
Participants were required to make a submission for evaluation at the end of the course, to obtain the certificate. This course comprised hands-on data learning sessions and various expert sessions on data discourses. The course especially catered to data and policy enthusiasts – including students, professionals, researchers, and other individuals looking for a comprehensive foundation for data-based policy research. The training programme was conducted by an expert group of academicians which included Prof Nilanjan Banik, Professor and Program Director (BA, Economics and Finance) at Mahindra University, Hyderabad; Prof Utpal K. De, Professor, Department of Economics at North-Eastern Hill University (NEHU), Shillong and a Visiting Professor at IMPRI.
Others included Prof Vibhuti Patel, Visiting Professor, IMPRI and a Former Professor, Tata Institute of Social Sciences (TISS), Mumbai; Dr Soumyadip Chattopadhyay, Associate Professor, Economics at Visva-Bharati, Santiniketan and a Visiting Senior Fellow, IMPRI; Prof Nalin Bharti, Professor, Department of Humanities and Social Sciences, Indian Institute of Technology (IIT), Patna and a Visiting Senior Fellow, IMPRI; Prof Gummadi Sridevi, Professor, School of Economics, University of Hyderabad and Visiting Senior Fellow at IMPRI; Dr Amar Jesani, Independent Researcher and Teacher (Bioethics and Public Health) and Editor of Indian Journal of Medical Ethics; Dr Ismail Haque, Fellow, Indian Council for Research on International Economic Relations (ICRIER) and a Visiting Fellow at IMPRI; Dr Arjun Kumar Director, IMPRI.

Day 1 | October 15, 2022

The first day started with a brief introduction of the panellists. Post the introduction, Prof Nilanjan Banik took over and commenced the training programme. He started by introducing concepts of Distribution Functions, and Normal Distributions, with explanations about how to interpret normal distribution tables. He explained the underlying concepts of class intervals and population density functions among others. Prof Banik used a data set of property prices in order to provide a more hands-on example. This hands-on session was followed by an insightful session on “Research Ethics in Primary Data Collection and Analysis”.
The speaker for the session was Dr Amar Jesani, who delved into the importance of ethics in research, including the protection of participants, the relevance of Research Ethics Frameworks and Research Integrity (prevention of misconduct in research). He mentioned 8 critical benchmarks of ethical research: 1.) Social Value; 2.) Scientific Validity; 3.) Favourable Risk Benefit Ratio; 4.) Fair Selection of Study Population; 5.) Informed Consent; 6.) Redirect for Participants and Communities; 7.) Independent Review; 8.) Collaborative Partnerships. He then went on to individually explain these benchmarks.

Day 2 | October 22, 2022

The second day began with an introduction to Sampling and Analysis by Prof Utpal De. In order to understand these concepts better, he talked about the various steps required in conducting a sample survey. He also discussed the various types of sampling methods: Simple random sampling, Systematic Sampling, Stratified Random Sampling, Two-Stage Sampling, Cluster Sampling, Multi-Stage Sampling and the like. This was followed by a discussion on the Statistical Systems in India and an Introduction to Various Official and Other Databases, India’s Macroeconomic and Financial Data by Dr Arjun Kumar and Ms Anshula Mehta, Senior Assistant Director at IMPRI. They talked about various sources of official data and what sources one can use for research work. These included the Government System of Scrutiny, Annual Report of Ministry, Program data and dashboard, Press Information Bureau (PIB), Comptroller and Auditor General (CAG) Report, Parliamentary Committee Report and NITI Aayog. The issues and challenges with respect to the official data available were also discussed.
Problems of credibility, reliability and timeliness were discussed. Discrepancies in macroeconomic data, with respect to Gross Domestic Product (GDP), Banking and National Accounts pose another such challenge. As for Unemployment, Poverty and Inequality, methodological and estimation issues have been observed. Additionally, problems with the public availability of data have also been seen. This enriching discussion was followed by a session on Introduction to Geographic Information System (GIS) mapping and Visualisation of Geocoded data by Dr Ismail Haque. A GIS is a system designed to capture, store, manipulate, analyse, manage and present all types of geographically referenced or spatial data. It helps in mapping quantities, densities and trajectories. He explained the various types of GIS Data, predominantly the Vector Data Model and Raster Data Model. Dr Haque gave the participants a walkthrough of the QGIS software interface. He explained how to show the rental housing distribution on a map of Bangalore using various features of the software.

Day 3 | October 29, 2022

The third day started with Prof Banik delving into concepts of the standard normal distribution (Z Distribution), the T-tests, and the differences between these, again, with the use of data sets. He showed how to find out variance, mean, the P value, the test statistic and explained what the different components of the test statistic meant, such as the degrees of freedom, 2-tail and 1-tail tests, among others. After a comprehensive analysis of the data set, he moved on to provide some homework to the trainees. This was followed by an explanation of the concept of hypothesis testing which is an integral part of data analysis, and how the null hypothesis and alternate hypothesis will be different for two-tailed tests and one-tailed tests respectively. The P value, he explained, shows the probability that the null hypothesis is true. After explaining every new concept, Prof Banik ensured that the session was open for questions in order to clear doubts.
His session was followed by another session titled ‘Time Series Analysis: A Primer’, conducted by Prof Soumyadip Chattopadhyay, who tried to showcase how to run a regression analysis using time series data using a particular data set. Here he focused mainly on univariate time series models. He briefly explained the concept of regression analysis and then moved on to explain the stationarity of a time series model. Both theoretically and practically, he showed how stationarity influences a regression analysis, the concepts of weak stationary and non-stationary processes. After this, he explained the different tests for stationarity: the graphical approach, the Autocorrelation Function and Correlogram, the Unit Root Test and the Dickey-Fuller Test. He then explained what a Spurious Regression Problem is (when there is a high R2 value greater than the Durbin Watson D Statistic), and how such a regression problem does not have practical policy relevance. He showed the different ways to prevent the Spurious Regression Problem, such as Cointegration and the Engle-Granger Theorem. Using EViews, Prof Chattopadhyay then showed the trainees how to run the above-mentioned regression tests, explaining the various components present in them.

Day 4 | November 5, 2022

The fourth day commenced with Prof Banik discussing the homework given to the trainees the previous day. He then discussed how to frame the objectives and the claims before testing a hypothesis and the two ways to capture causality. He explained what it meant to standardise the data and how to do it using Excel. Carefully explaining the differences between correlation and regression, he noted the importance of distinguishing between the two during data analysis. The major difference, he showed, is in the concept of linearity. Using the data analysis tools in Excel, he individually explained the various concepts of the ANOVA table, Residual Output and the R square among others, based on a data set of property prices. The objective was to check if the various variables such as “Square Feet”, “Year Built”, “Lot Size” etc, influence the prices of the properties, that is, which variables are statistically significant. Following Prof Banik, a new session commenced under Prof Vibhuti Patel, titled “Feminist Principles in Scientific Inquiry”.
The session primarily catered to the need for being gender-responsive while conducting a scientific enquiry since the process itself impacts the result of the research. She started by outlining the broader question of feminist principles in research: the need to reduce interviewer bias, increase the response rate, create more interactive and empowering experiences, facilitate trust while conducting interviews on sensitive issues such as domestic violence, caste-based exclusion, discrimination, among others and the need of ensuring complete knowledge. Feminist perspectives have immense transformative potential in terms of driving social change, she mentioned. It can validate the experiences of women by mainstreaming the gender perspective. However, she mentioned how there needs to be the use of “conscious subjectivity”, that inherently takes into consideration the privileged ideal position of the researcher. As such, there needs to be a sense of solidarity towards the subject, reducing the distance between the researcher and the researched. She then talked about the relevance of the Feminist Standpoint Theory in scientific Inquiry: that one’s social location limits their base of knowledge.
Knowledge generated about women by “experts” cannot be in isolation, that is, without the active participation of women themselves. Such complete research reports include the Sharmashakti Report, Time Use Survey among others, she noted. The next part of her presentation was about power relations: how dominant ideology subjugates the knowledge of the marginalised. She noted that one of the leading concerns of feminist perspectives is to bring about knowledge of the marginalised ideology, which often gets encapsulated within the elitist androcentric intellectual legacy. Hence within feminist perspectives, there is a need to challenge existing power structures in order to empower the subaltern. Traditional Research Methods of the 1950s till the 1970s were gender-blind, and were guided by the Role Conflict Theory, often giving into patriarchal explanations. She traced back the roots of feminist perspectives in economic research and surveys in India, elaborating on how various paid and unpaid work came to be recognised over the years.
She reiterates the famous 1984 quote, “Women constitute ½ of the world’s population, do ⅔ of the world’s work and get 1/10 of the world’s income and own 1/100 of the world’s wealth.” Prof Patel emphasised the importance of qualitative techniques while encountering gender issues. Lastly, she explained the Grounded Theory, which refers to systematic inductive methods that use particular facts to form general rules and principles. These principles are used to conduct qualitative research that develops theory and explains the studied empirical phenomena. The Grounded Theory has become a game changer in conducting feminist surveys in India. She concluded by briefly summing up the significance of feminist principles and perspectives in research and scientific inquiry and noted that we still have a long way to go in this regard. With this, the sessions for day 4 ended.

Day 5 | November 12, 2022

The fifth day was proceeded by Prof Nilanjan Banik, who tried to emancipate the gathered audience over the materials to be discussed. He continued where he left off in the previous session. He explained the concept of errors and how it is very necessary to minimize errors when estimating values based on some variables. The errors from various deviations such as moments and skewness can be calculated by various methods. He then proceeded to explain an error from a linear regression function, by explaining various factors involved such as stochastic variables. The methodology used in the calculation was explained and how the interplay of various factors like beta and collinearity are relevant. In order to verify certain conditions, the Jarque Bera Statistics was briefly explained along with the general techniques that are used. Skewness was explained next with a few examples. A data set was taken to practically explain the whole process using variables that consisted of family income and family consumption.
The conditional mean was calculated using the data set, plotted on axes. It is very important to minimize the sum of squares of errors which can be calculated with the help of some formulas. Although these are mathematical, the results are calculated based on certain assumptions which were discussed. The various interpretation of different results was also discussed ahead. Next up, the data set shared previously is used to calculate the various results that have been discussed theoretically so far, such as t-test, error from the regression equation, ESS, RSS, TSS, and so on, over an excel sheet for practical understanding. These results were interpreted by Prof. Nilanjan for a better understanding of their significance. Next, the next session was preceded by Dr Vibhuti Patel, wherein the floor was made open for questions on the session which talked about Feminism in Data Analytics. She started off talking briefly about the ShramShakti Report. She then discussed the time-use survey introduced by the Government of India and the NSSO.
She further emphasized the involvement of feminist ideology in various fields such as sociology, psychology, and the very power structure in general. The predetermined bias and background can be influential in various decision-making scenarios. Various institutions should consider these aspects when looking into data structures. She further talked about her experience in the field of feminism and data analytics, participating and researching in various events and organizations. The session was then taken over by Dr Soumyadip Chattopadhyay. He began by explaining the concept of forecasting as a continuation of time series analysis, the method used in the process which is ARIMA. The AR model, its properties, and the result derived were explained using various assumptions and formulations for the calculation of ARIMA. Similarly, the MA model, its properties, and the result derived were explained keeping in mind the various assumptions and using specific formulations.
Further, the process and result of the ARMA model were explained. The PACF used in the AR and MA process was discussed along with the factors that lead to its requirement. He then emphasized the fact that it is very important to identify the type of regression function to select any particular method for forecasting, based on various characteristics. Next, the Box Jenkins method for forecasting was explained, which uses various models in its process. This was followed by the evaluation of forecasts, explaining the assumptions before calculations, and the conditions for selecting a particular model. Finally, the practicality of the theory being discussed was dealt with, with the help of EViews and importing the data set from excel.

Day 6 | November 19, 2022

Day 6 began with the session headed by Prof Nilanjan Banik. He started briefly explaining the materials of the previous session. He continued with the assumptions that are taken into account while finding errors. He proceeded with the data set that he left in the previous session, starting with the F-test and continuing further on the theories and deriving the results that were discussed in the previous sessions with the help of Excel. He then worked on a new data set to calculate multicollinearity with the help of EViews using regression and other statistical functions. He then proceeded with the calculation and explanation of Auto Correlation taking into account a data set. Continuing with the data set he then explained the concept of heteroskedasticity.
The session was then proceeded by Prof. Nalin Bharti. He began with the concept of different types of Tariff data. To ease the explanation, he took certain data sets from the Government of India websites on trade and statistics, comparing different commodities exported and imported. This was continued forward to the concept of Data Analysis of Import Export using SMART Model. It started with the explanation of WITTS Global Tariff Cuts and Trade Simulator and the modules under it, along with explaining the modules individually to show their applicability with examples for ease of understanding. The tariffs were also explained with the help of an interactive video which was a simulation tutorial, the data set from the simulation was imported into Excel for further analysis.
The session was then taken over by Prof. Gummadi Sridevi who presented on the topic, Ethics in Research. She started by emphasizing the fact that ethics in data collection is important to mitigate any bias that may arise, and be inclusive to all the groups concerned over the field of research. Primary data is more of an observatory phenomenon rather than being entirely subjective, showing the importance of being careful while collecting data to remove any sort of unwanted and unethical process. She then discussed the various field research methods. She proceeded to talk about the development of the topic of ethics in data and research, the involvement of various institutes and organizations, and her personal experiences in the particular field, combined with examples for better understanding.
Various experiments related to the study of ethics in the research were also taken into the discussion to portray results and impute their significance in modern research and data collection, focussing on proper information dispatch. The importance of the context of research is also a grey area when we talk about ethics, defining the roles of concerned parties, and the purpose to remove any sort of discrepancy and bias. There should be significant clarity of the personnel and institution involved in the field of particular research, the responsibilities of a researcher, and the proof of data sets. A suitable example to explain the concept of ethics was explained, taking into account a study conducted in a distant village in the country.
---
Acknowledgement: Aaswash Mahanta, Soham Biswas and Tripta Behara, research interns at IMPRI

Comments

TRENDING

देशव्यापी ग्रामीण भारत बंध में उतरे मध्य प्रदेश के आदिवासी, किया केंद्र सरकार का विरोध

- हरसिंग जमरे, भिखला सोलंकी, रतन अलावे*  15 और 16 फरवरी को निमाड के बड़वानी, खरगोन और बुरहानपुर में जागृत आदिवासी दलित संगठन के नेतृत्व में आदिवासी महिला-पुरुषों ग्रामीण भारत बंद में रैली एवं विरोध प्रदर्शन किया । प्रधान मंत्री द्वारा 2014 में फसलों की लागत का डेढ़ गुना भाव देने का वादा किया गया था, 2016 में किसानों की आय दुगना करने का वादा किया गया था । आज, फसलों का दाम नहीं बढ़ रहा है, लेकिन खेती में खर्च बढ़ता जा रहा है! खाद, बीज और दवाइयों का दाम, तीन-चार गुना बढ़ चुका है! किसानों को लागत का डेढ़ गुना भाव देने के बजाए, खेती को कंपनियों के हवाले करने के लिए 3 काले कृषि कानून लाए गए । 3 काले कानून वापस लेते समय प्रधान मंत्री ने फिर वादा किया था कि फसलों की लागत का डेढ़ गुना भाव की कानूनी गारंटी के लिए कानून बनाएँगे, लेकिन वो भी झूठ निकला! आज जब देश के किसान दिल्ली में आपको अपना वादा याद दिलाने आए है, तब आप उनका रास्ता रोक रहें है, उनके साथ मारपीट कर उन पर आँसू गैस फेंक रहें हैं, उन पर छर्रों से फायरिंग कर रहें है! देश को खिलाने वाला किसान खुद भूखा रहे, क्या यही विकास है?

नफरती बातें: मुसलमानों में असुरक्षा का भाव बढ़ रहा है, वे अपने मोहल्लों में सिमट रहे हैं

- राम पुनियानी*  भारत पर पिछले 10 सालों से हिन्दू राष्ट्रवादी भारतीय जनता पार्टी (भाजपा) राज कर रही है. भाजपा आरएसएस परिवार की सदस्य है और आरएसएस का लक्ष्य है हिन्दू राष्ट्र का निर्माण. आरएसएस से जुड़ी सैंकड़ों संस्थाएँ हैं. उसके लाखों, बल्कि शायद, करोड़ों स्वयंसेवक हैं. इसके अलावा कई हजार वरिष्ठ कार्यकर्ता हैं जिन्हें प्रचारक कहा जाता है. भाजपा के सत्ता में आने के बाद से आरएसएस दुगनी गति से हिन्दू राष्ट्र के निर्माण के अपने एजेण्डे को पूरा करने में जुट गया है. यदि भाजपा को चुनावों में लगातार सफलता हासिल हो रही है तो उसका कारण है देश में साम्प्रदायिकता और साम्प्रदायिक मुद्दों का बढ़ता बोलबाला. इनमें से कुछ हैं राम मंदिर, गौमांस और गोवध एवं लव जिहाद. 

Only 15% businesses provide employees real-time sustainability dashboards: Study

Kyndryl in collaboration with Microsoft has released the findings of The Global Sustainability Barometer study. The study, conducted by Ecosystm, finds that while 85% of organizations place a high strategic level of importance on achieving their sustainability goals, only 16% have integrated sustainability into their strategies and data. A Kyndryl note: *** Kyndryl (NYSE: KD), the world’s largest IT infrastructure services provider, in collaboration with Microsoft , today released the findings of The Global Sustainability Barometer study. The study, conducted by Ecosystm , finds that while 85% of organizations place a high strategic level of importance on achieving their sustainability goals, only 16% have integrated sustainability into their strategies and data.

How the slogan Jai Bhim gained momentum as movement of popularity and revolution

By Dr Kapilendra Das*  India is an incomprehensible plural country loaded with diversities of religions, castes, cultures, languages, dialects, tribes, societies, costumes, etc. The Indians have good manners/etiquette (decent social conduct, gesture, courtesy, politeness) that build healthy relationships and take them ahead to life. In many parts of India, in many situations, and on formal occasions, it is common for people of India to express and exchange respect, greetings, and salutation for which we people usually use words and phrases like- Namaskar, Namaste, Pranam, Ram Ram, Jai Ram ji, Jai Sriram, Good morning, shubha sakal, Radhe Radhe, Jai Bajarangabali, Jai Gopal, Jai Jai, Supravat, Good night, Shuvaratri, Jai Bhole, Salaam walekam, Walekam salaam, Radhaswami, Namo Buddhaya, Jai Bhim, Hello, and so on.

Laxmanpur Bathe massacre: Perfect example of proto-fascist Brahmanical social order

By Harsh Thakor  The massacre at Laxmanpur-Bathe of Jehanabad in Bihar on the night of 1 December in 1997 was a landmark event with distinguishing features .The genocide rightly shook the conscience of the nation in the 50th year of Indian independence. The scale of the carnage was unparalleled in any caste massacre. It was a perfect manifestation of how in essence the so called neo-liberal state was in essence most autocratic. 

અત્યારસુધી પ્રિન્ટ કરાયેલા ચુંટણી બૉન્ડ નો પ્રિન્ટિંગ ખર્ચ રૂ 1,90,01,380 કેન્દ્ર સરકારે ભોગવ્યો

- પંક્તિ જોગ  ચુંટણી બૉન્ડ ના કુલ 30 તબક્કામાં SBI  જુદાજુદા 19 રાજ્યો માં અધિકૃત કરેલા SBI મુખ્ય શાખાઓ માંથી જે બોન્ડ વેંચવામાં આવ્યા તેના કમિશન પેટે SBI કેન્દ્ર સરકાર (નાણાં મંત્રાલય) પાસે રૂ 12,4,59,043/-  માંગ્યા. 

Tamil Nadu brahmins are at cross roads, their future scenario remains uncertain

By NS Venkataraman*  For over 70 years now, brahmin community in Tamil Nadu have been abused, insulted and even physically attacked on some occasions by those who claimed that they were part of the so called dravidian movement. However, brahmin community silently and helplessly ducked under pressure and showed no signs of resistance or fight back.

गुजरात विश्वविद्यालय कुलपति महोदया का बयान उल्टा चोर कोतवाल को डांटे समान है

गुजरात विश्व विद्यालय परिसर में विदेशी छात्रों को सांस्कृतिक संवेदनशीलता का पाठ देने की ख़बर के संबंध में विश्व विद्यालय को खुला पत्र: --- प्रति श्री, कुलपति महोदय गुजरात विश्वविद्यालय अहमदाबाद विषय- गुजरात विश्व विद्यालय परिसर में विदेशी छात्रों को सांस्कृतिक संवेदनशीलता का पाठ देने की ख़बर के संबंध में। महोदया,

અંકલેશ્વર/પાનોલી માં વાંરવાર અકસ્માત ના બનાવો બને છે એ એક ચિંતન નો વિષય છે

- સલીમ પટેલ*  પાનોલી જીઆઇડીસીમાં ઓદ્યોગિક ઘન/પ્રવાહી કચરાનું રીસાયલીંગ કરતી RSPL નામની કમ્પની આવેલ છે. જે અન્ય ઓદ્યોગિક એકમોના રાસાયણિક કચરાને રીસાયલીંગ કરવાનું કામ કરે છે જેમાં અનેક અને દુર –દુર ના એકમોનો રાસાયણિક કચરાને અહિયાં પ્રોસેસ માટે લાવવામાં આવે છે. આ દરમ્યાન 23.03.24 નાં રોજ મોડી સાંજે કોઈ કારણોસર રાસાયણિક કચરામાં આગ લાગતા હોળી પેહલા જ વેસ્ટ કેમિકલ હોળી દહન ના દ્ર્શ્યો સર્જાયા હતા અને તેમાં સોલ્વન્ટ સહીત ના ઝેરી તત્વો શામેલ હોવાના લીધે વાતાવરણ પ્રદુષિત બનતા આસપાસના લોકોમાં ભય ફેલાયો હતો. આ અગાઉ પણ ગત વર્ષે પણ પાનોલી જી આઈ ડી સી માં આગ અકસ્માત નો બનાવ બનતા કેટલાક ગામો ને ખાલી કરવાની ફરજ પડી હતી જે ઘટના ને યાદ કરી પ્રજા માં ભય નું વાતાવરણ સર્જાયું હતું.

Holi, also known as Eid-e-Gulabi, is a shared colourful heritage of Hindus, Muslims

By Firoz Bakht Ahmed* Though I never see people as Hindus and Muslims as the famous poet saint Kabir had said that he doesn’t see a Hindu and and Muslim in the eyes of a person but a human! Interestingly yet I would like to share that Tilak Raj Rustagi, a Hindu friend and colleague of mine, has since 1983 been coming to my place on Holi to smear the red gulal on my forehead as a mark of the festival’s inter-faith harmonious spirit. Once a relative of mine, on seeing the colour smeared on my forehead, remarked, “It is irreligious and un-Islamic to play Holi.” I told him that such things only reiterate my faith in my religion, as friendly acts like putting gulal or lighting a candle on Diwali cannot take away my religion. In the same tone and tenure, Atyab Siddiqui, a senior Delhi High Court lawyer, while celebrating the hues of Holi with his wife Umema, son Mizan and Sumaiyya, states this lovely couplet about Urdu, “”Munh par naqab-e-zard har ik zulf par gulal/ Holi ki shaam hi to sahar