Sh Should ld We e Seek Seek f for or Educational Impact of of - PowerPoint PPT Presentation

Sh Should ld We e Seek Seek f for or Educational Impact of of Research ch Articl cles s in Social M Media Metrics? Ashraf Maleki Graduate at Scientometrics University of Tehran (Iran) @ashrafmaleki malekiashraf68@gmail.com

Diverse vs. dominant Impact Measures • Scholarly impact (formal citations) • Educational impact Definition: Mentions of syllabi and course descriptions to journal articles (vs. books) Also it could be mentions of Presentation files to journal articles • Kousha, K., & Thelwall, M. (2008). Assessing the Impact of Disciplinary Research on Teaching: An Automatic Analysis of Online Syllabuses. Journal of the American Society for Information Science and Technology, 59(13), 2060-2069. • Thelwall, M., & Kousha, K. (2008). Online presentations as a source of scientific impact? An analysis of PowerPoint files citing academic journals. Journal of the American Society for Information Science and Technology, 59(5), 805-815. • Thelwall, M., & Kousha, K. (2017). SlideShare presentations, citations, users, and trends: A professional site with academic 2 and educational uses. Journal of the Association for Information Science and Technology, 68(8), 1989-2003.

Impact Attributes of Social Media Metrics Scholarly impact All - weak correlation with citations (Thelwall, et al, 2013) Educational impact Wikipedia - high books citation coverage and correlations (Kousha & Thelwall, 2017) Weblogs – potential relevance (Kirkup, 2010) Weblogs Public impact Weblogs – potential relevance (Kirkup, 2010) Tweets – not clear • Kirkup, G. (2010). Academic blogging: academic practice and academic identity. London Review of Education , 8(1), 75- 84. • Kousha, K., & Thelwall, M. (2017). Are Wikipedia citations important evidence of the impact of scholarly articles and books? Journal of the American Society for Information Science , 68(3), 762-779. • Thelwall, M., Haustein, S., Larivière, V., & Sugimoto, C. R. (2013). Do Altmetrics Work? Twitter and Ten Other Social Web Services. PloS one , 8(5). 3

Using Social Media in Education? • Education “is a social, not an individual process” (Hrastinski & Aghaee, 2010) • Students use social media to share and discuss about their education (Veletsianos, 2012) • evidence suggests their limited participation in networking and sharing in educational courses that involve use of social media (Veletsianos & Navarrete, 2012) • there is far less evidence on extent of students use of social media for sharing scholarly articles which are part of course reading lists. 4

Research Goal • To speculate whether or not we can attribute educational impact to social media metrics 5

Research Questions 1. Which fields have the highest uptake in syllabi? 2. To what extent of journal articles in each field in Scopus are mentioned in syllabi? (uptake of journal in a field) 3. To what extent of titles in a Scopus journal are mentioned in syllabi, blogs, Wikipedia and Twitter? 4. How correlated are Syllabus mentions and social 6 media metrics?

Dataset & Method: Main Collection Methods to extract Syllabi mentions to journal articles: • Searching online Syllabi and course reading lists in University websites using Bing search engine (Kousha & Thelwall, 2008) Open Syllabus Project (OSP) • Former URL: explorer.opensyllabusproject.org • Current URL: https://opensyllabus.org 7

Dataset & Method: Sample • Coverage of top 5000 journals in OSP in terms of Number of Journals from each Subject and Number of Titles • Only 14 top journals in terms of number of articles in syllabi in 2018 August • Citations and DOIs of 164,464 articles (1880-2019) from Scopus. • Tweet counts, Wikipedia and Blog citations are collected from Altmetric.com via DOIs

9

To what extent of journal articles in each field in Scopus are mentioned in syllabi?

How much users tweeting the articles are in each other’s network? 3487 936 991 574 724 693 411 705 479 298 1052 415 770 573

Median metrics

Correlations with Syllabus Mentions

Discussion • Correlation were insignificant or week • Mainly because journal articles are used less in syllabi in line with (Kousha & Thelwall, 2017) but not that of journals articles (5%) • People generally do not trust social media as a source of educational content (debate of authenticity of Wikipedia citations) • Books vs. journal articles in syllabi and Wikipedia • Blog are an emerging academic practice • Education takes place locally 14

Conclusions • Educational impact interferes with uptake of research for social reasons • educational impact of academic articles might be closely related to social, cultural or historical aspects of research • Educational impact difficult to harness in the face of larger uptake of research for reasons 15

Acknowledgement goes to Altmetric.com for supporting access to data. 16

Questions? Ashraf Maleki Master Graduate at Scientom etrics U niversity of T ehran (I ran) @ashrafmaleki malekiashraf68@gmail.com