Assessment of the reliability of sociological research on the Internet
https://doi.org/10.21869/2223-1536-2024-14-3-170-182
Abstract
The purpose of research. The main goal of assessing reliability is to quantitatively substantiate the measure of confidence in a particular process. The article discusses the methodological and practical aspects of assessing the reliability of sociological research conducted on the Internet. Emphasis is placed on analyzing the specific problems encountered when using online surveys and other digital data collection methods. Issues of sample representativeness and a number of other quantitative indicators that affect the reliability of the assessment of sociological research are discussed.
Methods. The article is devoted to methodological and practical aspects of assessing the reliability of sociological research conducted on the Internet. Issues of sample representativeness, weighting coefficients, data analysis, testing for systematic errors, and calculation of Cronbach’s alpha coefficient are discussed.
Results. The main steps for calculating the reliability of sociological research conducted on the Internet are presented. Key steps include proper sample selection and adjustment, use of weights, performing statistical analysis, and estimating confidence intervals. These methods help minimize errors and increase the reliability of the data obtained.
Conclusion. The proposed methods for assessing the reliability of the Internet will help improve the quality of data and the reliability of the results, namely, Online surveys can be subject to various types of biases, including self-selection of participants, when only certain groups of people decide to participate in the survey. Credibility assessment will promote fair and transparent research, which strengthens the trust of respondents and the public in research projects.
About the Authors
S. A. NesterovichRussian Federation
Sergey A. Nesterovich, Candidate of Sciences (Engineering), Associate Professor, Associate Professor of the Department of Information Technology, Artificial Intelligence and Socio-Social Technologies of the Digital Society
4/1 Wilhelm Peak Str., Moscow 129226
A. N. Brezhneva
Russian Federation
Aleksandra N. Brezhneva, Candidate of Sciences (Engineering), Associate Professor of the Department of Informatics
36 Stremyanny side-street, Moscow 117997
References
1. Demidova M.S., Fedotova O.V. The use of digital technologies in sociological research Sovremennaya nauka: aktual’nye problemy teorii i praktiki = Modern Science: Current Problems of Theory and Practice. 2015;(4):45–50. (In Russ.)
2. Borisova I.V., Tikhomirova O.S. Application of information technologies in sociological research. Voprosy statistiki = Questions of Statistics. 2015;(6):87–92. (In Russ.)
3. Pankratova E.V. Methods for analyzing data from Internet surveys in sociology. Voprosy statistiki = Questions of Statistics. 2015;(2):128–134. (In Russ.)
4. Malyshev V.V. Internet and sociological research: new prospects and challenges. Vestnik Moskovskogo gosudarstvennogo universiteta kul’tury i iskusstv = Bulletin of the Moscow State University of Culture and Arts. 2015;(3):95–99. (In Russ.)
5. Zinoviev A.N. Modern approaches to the analysis of Internet survey data. Voprosy statistiki = Questions of Statistics. 2015;(3):135–141. (In Russ.)
6. Vorontsov V.N., Kostina A.S. Sociological research in the context of digitalization // Vestnik Moskovskogo gosudarstvennogo universiteta kul’tury i iskusstv = Bulletin of the Moscow State University of Culture and Arts. 2015;(1):115–120. (In Russ.)
7. Нестерович С. А., Брежнева А. Н. Оценка достоверности социологических исследований…
8.
9. Golubev P.V. Methodology and practice of analyzing social network data. Voprosy statistiki = Questions of Statistics. 2015;(4):123–129. (In Russ.)
10. Trofimov V.N., Ivanova A.S. Reliability of data in Internet research. Vestnik SanktPeterburgskogo universiteta. Sotsiologiya = Bulletin of St. Petersburg State University.
11. ;5(1):120–128. (In Russ.)
12. Polushin I.K., Maslyaev A.V., Glisin A.F. Assessing the representativeness of the comparative approach when evaluating companies. Alleya nauki = Alley of Science. 2018;4(6):474–477. (In Russ.) EDN UVDQVZ
13. Egorov A.V., Ivashkova L.A. Internet surveys: methodological and practical aspects Sotsiologiya: teoriya, metody, marketing = Sociology: Theory, Methods, Marketing. 2015;(1):103–111. (In Russ.)
14. Kravchenko S.A., Maslova I.A. Social networks as an object of sociological analysis Sotsiologicheskii zhurnal = Sociological Journal. 2015;(2):78–85. (In Russ.)
15. Smirnova A.V. Methods for processing social network data in sociology. Vestnik Sankt-Peterburgskogo universiteta. Sotsiologiya = Bulletin of St. Petersburg State University.
16. Sociology. 2015;6(2):77–83. (In Russ.)
17. Kozlov V.A., Bochkarev N.S. Analysis of Internet survey data: methodological approaches. Voprosy statistiki = Questions of Statistics. 2015;(8):117–122. (In Russ.)
18. Frolova E.V. Sociological research on the Internet: problems and solutions. Vestnik Sankt-Peterburgskogo universiteta. Sotsiologiya = Bulletin of St. Petersburg State University. 2015:7(3):84–91. (In Russ.)
19. Smirnov A.V. Social network analysis: theory and practice. Moscow: Institut sotsiologii RAN; 2015. 250 p. (In Russ.)
20. Konovalov N.N. Sociological research in digital society: new opportunities and challenges. Vestnik Permskogo universiteta. Sotsiologiya = Bulletin of Perm University. Sociology. 2015:(2):45–54. (In Russ.)
21. Martynova O.V., Lebedev I.V. Methods for analyzing Internet surveys in sociology. Vestnik Moskovskogo gosudarstvennogo universiteta kul’tury i iskusstv = Bulletin of the Moscow State University of Culture and Arts. 2015;(5):78–83. (In Russ.)
22. Melnikov I.N., Sokolova T.A. Social media and sociological research: new opportunities. Vestnik Moskovskogo gosudarstvennogo universiteta kul’tury i iskusstv = Bulletin of the Moscow State University of Culture and Arts. 2015;(2):93–98. (In Russ.)
23. Kuznetsov A.V., Ivanov D.S. Internet research in sociology: problems and prospects Sotsiologicheskie issledovaniya = Sociological Research. 2015;(10):39–44. (In Russ.)
24. Vartanyan K.A., Abakumov R.G. The use of probabilistic and statistical methods in assessing the degree of reliability of the results of assessing the market value of real estate. Innovatsionnaya ekonomika: perspektivy razvitiya i sovershenstvovaniya = Innovative Economics: Prospects for Development and Improvement. 2019;(2):175–181. (In Russ.) EDN
25. WCFXPB
26. Korepanova A.A. Assessment of the reliability of information in social networks in the context of assessing the personal characteristics of the user. In: Informatsionnaya bezopasnost’ regionov Rossii (IBRR – 2021) = Information security of the regions of Russia (IBRD – 2021): Proceedings of the conference. St. Petersburg: Sankt-Peterburgskoe obshchestvo informatiki, vychislitel’noi tekhniki, sistem svyazi i upravleniya; 2021. P. 332–334.
27. (In Russ.) EDN HOJPSS
28. Vinnichenko A.V., Istomina Yu. P. Kronbach’s alpha for reliability analysis in predicting machine learning models. In: Volnovaya elektronika i infokommunikatsionnye: sbornik statei XXVI Mezhduna-rodnaya nauchnaya konferentsiya = Wave electronics and information and communication: Collection of articles XXVI International Scientific Conference. Pt. 3. St. Petersburg: Sankt-Peterburgskii gosudarstvennyi universitet aerokosmicheskogo priborostroeniya; 2023. P. 151–155. (In Russ.) EDN CUCXMU
29. Descriptive analysis of factors: questionnaire questions, reliability coefficients (Cronbach’s alpha) and factor loads. In: Transformation of industry in the conditions of the fourth industrial Revolution. Moscow: Real’naya ekonomika; 2018. P. 144–147. (In Russ.)
30. EDN YPDYNV
Review
For citations:
Nesterovich S.A., Brezhneva A.N. Assessment of the reliability of sociological research on the Internet. Proceedings of the Southwest State University. Series: IT Management, Computer Science, Computer Engineering. Medical Equipment Engineering. 2024;14(3):170-182. (In Russ.) https://doi.org/10.21869/2223-1536-2024-14-3-170-182