+7 495 989 9610, 9am6pm (GMT+3), Monday – Friday
ИД «Финансы и кредит»






Economic Analysis: Theory and Practice

Evaluating the effectiveness of research organizations: The CEMI RAS case study

Vol. 20, Iss. 10, OCTOBER 2021

Received: 20 September 2021

Received in revised form: 29 September 2021

Accepted: 7 October 2021

Available online: 29 October 2021


JEL Classification: O15, O32, О38

Pages: 1874–1896


Ekaterina V. AKINFEEVA Central Economics and Mathematics Institute of Russian Academy of Sciences (CEMI RAS), Moscow, Russian Federation


Mariya A. NIKONOVA Central Economics and Mathematics Institute of Russian Academy of Sciences (CEMI RAS), Moscow, Russian Federation


Subject. The article investigates the effectiveness of scientific activities of the Central Economics and Mathematics Institute of the Russian Academy of Sciences (CEMI RAS).
Objectives. Our aim is to evaluate the effectiveness of scientific activity of the CEMI RAS on the basis of publication activities for 2010–2019.
Methods. We employ general scientific research methods. The data on the number of publications by the Institute's staff in journals included in Web of Science (WoS), Scopus, the Russian Science Citation Index (RSCI) databases, and the data of the CEMI RAS, serve as information base of the study.
Results. The paper presents a brief overview of scientometric indicators used to assess the effectiveness of scientific organizations. We evaluated the effectiveness on the basis of statistical data of the CEMI RAS, considered various methods of evaluating the effectiveness of scientific activities of universities and research institutes. To improve the effectiveness of scientific activities of the CEMI RAS, we developed a methodology for calculating the standard of publications and scores by department. The offered methodology is designed to encourage staff to improve scientific activities, thereby increasing both their individual effectiveness and the effectiveness of the scientific organization as a whole.
Conclusions. The analysis shows that during the period under review, the enhanced effectiveness of the CEMI RAS is confirmed by an increase in the number of articles, published by the Institute's staff in journals, included in the WoS, Scopus and RSCI databases, both overall and among individual researchers.

Keywords: scientometrics, scientific activity, publication activity, statistics, calculation methodology


  1. Kulagin A.S. [Assessment and self-assessment of a scientific organization]. Innovatsii = Innovations, 2011, no. 10, pp. 20–30. URL: Link (In Russ.)
  2. Orlov A.I. [The number of citations as a key indicator of the scientific activity effectiveness]. Rossiya: tendentsii i perspektivy razvitiya = Russia: Trends and Development Prospects, 2016, no. 11-3, pp. 708–713. URL: Link (In Russ.)
  3. Osipov G.V., Klimovitskii S.V. [Towards the development of qualitative methods for assessing the results of scientific activity]. Sotsial'no-gumanitarnye znaniya, 2017, no. 5, pp. 76–87. URL: Link (In Russ.)
  4. Pronichkin S.V. [Assessing the efficacy of scientific activities]. Natsional'nye interesy: prioritety i bezopasnost' = National Interests: Priorities and Security, 2019, vol. 15, iss. 2, pp. 258–272. (In Russ.) URL: Link
  5. Osipov G.V., Klimovitskii S.V. [Evaluation of the social efficiency of fundamental scientific research]. Sotsial'no-gumanitarnye znaniya, 2014, no. 5, pp. 54–62. URL: Link (In Russ.)
  6. Granovskii Yu.V. [Scientometrics in Moscow university]. Upravlenie bol'shimi sistemami, 2013, no. 44. (In Russ.) URL: Link
  7. Beklaryan L.A., Davydov D.V., Dement'ev V.E. et al. [Scientometrics and its impact on the development of modern science]. Voprosy innovatsionnoi ekonomiki = Russian Journal of Innovation Economics, 2019, vol. 9, no. 1, pp. 11–36. URL: Link (In Russ.)
  8. Litvinova L.V. [Measurement and factors of academic productivity]. Universitetskoe upravlenie: praktika i analiz = University Management: Practice and Analysis, 2018, vol. 22, no. 1, pp. 61–75. URL: Link (In Russ.)
  9. Pislyakov V., Dyachenko E. Citation expectations: Are they realized? Study of the Matthew index for Russian papers published abroad. Scientometrics, 2010, vol. 83, iss. 3, pp. 739–749. URL: Link
  10. Sharabchiev Yu.T. [Why are scientific publications not quoted and how to increase the citation level]. Meditsinskie novosti = Medical News, 2014, no. 2, pp. 6–13. URL: Link (In Russ.)
  11. Varshavskii A.E. [The main problems of assessing the resultativeness and effectiveness of scientific organizations]. Kontseptsii = Concepts, 2015, no. 1, pp. 3–8. URL: Link (In Russ.)
  12. Gordukalova G.F. [Bibliometrics, scientometrics and webometrics – from the number of rows in the works of Aristotle]. Nauchnaya periodika: problemy i resheniya = Scientific Periodicals: Problems and Solutions, 2014, no. 2, pp. 40–46. URL: Link (In Russ.)
  13. Dadalko V.A., Dadalko S.V. [Metric studies as a form of analysis of scientific productivity]. Znanie. Ponimanie. Umenie = Knowledge. Understanding. Skill, 2019, no. 2, pp. 125–136. URL: Link (In Russ.)
  14. Marshakova I.V. [A system of links between documents built on the basis of links: according to the Science Citation Index]. Nauchno-tekhnicheskaya informatsiya. Seriya 2. Informatsionnye protsessy i sistemy = Scientific and Technical Information. Series 2. Information Processes and Systems, 1973, no. 6, pp. 3–8. URL: Link (In Russ.)
  15. Small H. Co-citation in the scientific literature: A new measure of the relationship between two documents. Journal of the American Society for Information Science, 1973, vol. 24, iss. 4, pp. 265–269. URL: Link
  16. Shabalin Yu.E., Shalygin I.V. [How can Russian scientists increase the indicators of importance of a scientific article]. Sovet rektorov = Council of Rectors, 2021, no. 4, pp. 53–58. (In Russ.)
  17. Aksent'eva M.S., Kirillova O.V., Moskaleva O.V. [On Paper Citation by Web of Science and Scopus from Translated Russian Journals]. Nauchnaya periodika: problemy i resheniya = Scientific Periodicals: Problems and Solutions, 2013, no. 4, pp. 4–18. URL: Link (In Russ.)
  18. Tarasenko G.V., Dorogin R.V. [Assessing efficiency of scientific institutions]. Vestnik Saratovskogo gosudarstvennogo sotsial'no-ekonomicheskogo universiteta = Vestnik of Saratov State Socio-Economic University, 2018, no. 4, pp. 118–121. URL: Link (In Russ.)
  19. Kazarina M.V., Vladimirova O.N. [Review of analytical support for the assessment of scientific organizations resources]. Voprosy innovatsionnoi ekonomiki = Russian Journal of Innovation Economics, 2018, vol. 8, no. 1, pp. 69–78. URL: Link (In Russ.)
  20. Glagolev M.V., Lapshina E.D. [The methodology for estimation of scientific activity in UNESCO department of Yugra State University]. Dinamika okruzhayushchei sredy i global'nye izmeneniya klimata = Environmental Dynamics and Global Climate Change, 2012, vol. 3, no. 2. URL: Link (In Russ.)

View all articles of issue


ISSN 2311-8725 (Online)
ISSN 2073-039X (Print)

Journal current issue

Vol. 20, Iss. 11
November 2021