Recognition of the 2019 Comprehensive Scientific Research Performance Evaluation System for Community Health Centers and the Results：a Survey

doi:10.12114/j.issn.1007-9572.2019.00.504

Abstract

Abstract: Background　The comprehensive scientific research performance evaluation system for community health centers（CHCs） initially developed in 2017 and the scientific research performance ranking of CHCs launched in the same year，have been verified and improved in practice.However，there is no large-scale survey on whether the evaluation system and results have gained subjective recognition from general medicine experts and the evaluated CHCs.Objective　To explore the subjective recognition for the 2019 Comprehensive Scientific Research Performance Evaluation System for CHCs and the evaluation results among general medicine experts from CHCs，offering a reference for further optimization and dynamic adjustment of the system.Methods　From March to May，2019，a questionnaire survey was conducted among general medicine experts and scholars from representative CHCs participating in the comprehensive scientific research performance evaluation for CHCs.Their subjective recognition for the 2019 evaluation system and subjective ranking of the CHCs were collected.Kappa test was carried out to assess the agreement between the objective ranking results and expert ranking results.Results　 The survey showed that 71.4% of the respondents gave their approval for the evaluation system.In terms of the ranking of CHCs，high-level consistency of agreement was found between the objective ranking and the subjective ranking by experts from Beijing and Shanghai （Kappa=0.600，Kappa=0.400），while low-level consistency of agreement was identified between the objective ranking and the subjective ranking by experts from Jiangsu and Zhejiang provinces，and the Pearl River Delta （Kappa=0.317，Kappa=0.200）．Conclusion　The 2019 evaluation system has gained recognition from general medicine experts and scholars from CHCs to a certain extent.The objective ranking results have obtained wide recognition in some regions，indicating that the evaluation system is practical and feasible，in part，and the evaluation results can be used for reference.

Key words: Community health centers, Scientific performance ranking, Evaluation results, Evaluation system, Evaluation results, Kappa consistency test

摘要： 背景　社区卫生服务中心科研能力综合评价体系和社区卫生服务中心科研能力评价结果自2017年构建以来，在实践中被不断论证与完善，但尚未进行过大规模调查全科领域专家及被评价的各个社区卫生服务中心在主观上是否认同该评价体系及评价结果。目的　本研究调查了社区卫生服务中心专家对社区卫生服务中心科研能力综合评价体系及评价结果评价的认同度，从而为评价体系的进一步优化及动态调整提供参考。方法　2019年3—5月，对曾参与过社区卫生服务中心科研能力综合评价的代表性社区卫生服务中心及专家和学者进行问卷调查，收集专家对评价体系的认同度及对社区评价结果的主观评价，并对已有评价结果与专家评价结果进行Kappa一致性检验分析。结果　本次调查结果显示，71.4%的调查对象对评价体系表示了认同。关于社区科研能力评价结果，北京、上海地区的专家评分结果与已有评价结果匹配度较高（Kappa=0.600，Kappa=0.400），江浙、珠三角地区的匹配度较低（Kappa=0.317，Kappa=0.200）。结论　本评价体系在一定程度上得到了社区卫生服务中心的全科专家和学者的认可。已有的评价结果在部分地区的匹配度较好，说明本评价体系具备一定的实践性和可行性，评价结果具有一定的参考价值。

关键词: 社区卫生服务中心, 科研能力, 评价结果, 评价体系, 评价结果, Kappa一致性检验

LIU Qian,LIU Rui,HUANG Jiaoling, et al. Recognition of the 2019 Comprehensive Scientific Research Performance Evaluation System for Community Health Centers and the Results：a Survey　[J]. Chinese General Practice, 2019, 22(28): 3411-3414. DOI: 10.12114/j.issn.1007-9572.2019.00.504.
刘茜,刘蕊,黄蛟灵等. 2019年社区卫生服务中心科研能力综合评价体系及评价结果的认同度调查研究[J]. 中国全科医学, 2019, 22(28): 3411-3414. DOI: 10.12114/j.issn.1007-9572.2019.00.504.

References

［1］薄小杰，陆媛，刘蕊，等．2018年社区卫生服务中心科研能力排行榜及展望［J］．中国全科医学，2018，21（17）：2038-2042．DOI：10.12114/j.issn.1007-9572.2018.00.005.
BO X J，LU Y，LIU R，et al．Scientific research performance ranking for community health centers in China （2018） and the prospect development［J］．Chin Gen Pract，2018，21（17）：2038-2042．DOI：10.12114/j.issn.1007-9572.2018.00.005.
［2］COHEN J.A coefficient of agreement for nominal scales［J］．Psychological Bulletin，1960，20（1）：37-46．DOI：10.1177/001316446002000104.
［3］俞立平，潘云涛，武夷山.科技教育评价中主客观赋权方法比较研究［J］．科研管理，2009，30（4）：154-161．DOI：10.19571/j.cnki.1000-2995.2009.04.020.
YU L P，PAN Y T，WU Y S.Comparing objective weighting with subjective weighting in Sci-tech education institute assessment［J］．Sci Res Manag，2009，30（4）：154-161．DOI：10.19571/j.cnki.1000-2995.2009.04.020.
［4］陈懋.医院科研绩效评估指标体系的构建与应用设想［J］．管理观察，2019（8）：178-179.
［5］金光辉，赵亚利，邵爽，等．全科医生科研培训需求调查［J］．继续医学教育，2017，31（7）：3-4．DOI：10.3969/j.issn.1004-6763.2017.07.002.
［6］郝立晓，王婷，陈丽芬，等．全科医学学科知识和技能体系研究［J］．中国全科医学，2018，21（19）：2269-2276．DOI：10.12114/j.issn.1007-9572.2018.19.001.
HAO L X，WANG T，CHEN L F，et al．The knowledge and skills system in general practice［J］．Chin Gen Pract，2018，21（19）：2269-2276．DOI：10.12114/j.issn.1007-9572.2018.19.001.
［7］李遥，陈晔，廖勇，等．一种多属性主客观对比评价模型及应用［J］．南京航空航天大学学报，2015，47（1）：104-112．DOI：10.16356/j.1005-2615.2015.01.015.
LI Y，CHEN Y，LIAO Y，et al．Multiple-criteria-based subjective-objective evaluation result comparison model and its application［J］．J Nanjing Univ Aeronaut Astronaut，2015，47（1）：104-112．DOI：10.16356/j.1005-2615.2015.01.015.

[1]	ZHANG Lifeng, ZHANG Ningning, QIN Xiuqun, YANG Yi, ZHONG Dongmei, LIU Shaofei, DAI Yushen, WANG Xiaodan, WANG Mingfei. Healthcare-seeking Behavior and Influencing Factors of Children with Upper Respiratory Tract Infection in the Context of Hierarchical Medical System [J]. Chinese General Practice, 2023, 26(26): 3269-3275.
[2]	ZI Jing, DU Xueping. Exploratory Research on Models of Operating Elderly Care Facilities by Community Health Institutions from Integrated Medical and Elderly Care Perspective: a Case Study of Yinling Elderly Nursing Home Held by Beijing Xicheng District Yuetan Community Health Center [J]. Chinese General Practice, 2023, 26(19): 2434-2438.
[3]	GUO Daiyao, PU Chuan, PENG Yang, QIU Lan, HU Xinyu. Utilization of Traditional Chinese Medicine Community Services and Influencing Factors by Residents in the Main Urban Areas of Chongqing [J]. Chinese General Practice, 2023, 26(19): 2369-2375.
[4]	SHEN Fei, JIANG Weiping, MEI Xiaobin, HAN Yiping, ZHAO Jiayi, FAN Jian, GU Juan, SHEN Yanhong, XU Hongmei, ZHANG Dan, MEN Ying, DING Haiguang, CHEN Caiping, HAN Junhua. Influence of Microbiota-modulating Agents on Gut Flora in Community Patients with Diabetic Nephropathy [J]. Chinese General Practice, 2023, 26(09): 1112-1117.
[5]	Min ZHANG, Shibin SONG, Shujun LI, Jinjia ZHANG, Weiguo QIAN, Zhishan ZHOU, Rongying WANG. Assistant General Practitioner Training Bases in Hebei Province: the Assessment and Recommendations for Improvement [J]. Chinese General Practice, 2022, 25(28): 3544-3549.
[6]	Delu YIN, Xi WANG, Tao YIN. Common Diseases of Children in Urban Community Health Service Institutions [J]. Chinese General Practice, 2022, 25(22): 2753-2757.
[7]	Chunguo XING, Yingqiu XIA, Danyun WU, Yunxia LIAO, Ning ZHAO. The Informatization Construction and Use of Primary Health Institutions in Jiangsu Province [J]. Chinese General Practice, 2022, 25(16): 2008-2013.
[8]	MA Cong, WANG Wei, YUAN Ying, SUN Yanchun, XU Fang, YAN Fei. Perceptions of Hierarchical Medical System and Associated Factors in Key Primary Care Practitioners [J]. Chinese General Practice, 2022, 25(07): 822-828.
[9]	LIU Qing，CHEN Yahong，WANG Zhong，YU Jing，WU Yonghao. Analysis of the Status Quo and Influencing Factors of Beijing Community General Practitioners on Chronic Obstructive Pulmonary Disease　 [J]. Chinese General Practice, 2021, 24(8): 982-988.
[10]	JI Yan，SUN Yange，YAN Chunze，DING Lan，DING Jing. Further Clinical Training for In-service Medical Workers in a Community Health Center of Beijing　 [J]. Chinese General Practice, 2021, 24(4): 490-495.
[11]	LIU Runyou，YANG Changhong，LI Ling，PENG Yanqiu，LYU Qiang. Public Health Informatization in Primary Care in Sichuan Province: an Investigation　 [J]. Chinese General Practice, 2021, 24(28): 3584-3589.
[12]	LIU Meixing, DING Jing, JI Yan, CHEN Xue. Burnout Prevalence and Associated Factors among Family Doctors in Xicheng District of Beijing　 [J]. Chinese General Practice, 2021, 24(13): 1656-1664.
[13]	SHI Xiaoxiao，SONG Huijiang，GE Xuhua，JIN hua，WANG Zhaoxin，YANG Sen，SONG Yang,HE Juanmei，ZHU Minjie，YU Dehua. Bi-directional Referrals in Urban and Suburban Community Health Centers：a Comparative Study　 [J]. Chinese General Practice, 2021, 24(1): 30-35.
[14]	YANG Rong，LIU Changming，LIAO Xiaoyang，WANG Lei. Refection on the Collaborative and Integrated Management Pathway for Atrial Fibrillation by a Large Tertiary General Hospital and a Community Hospital　 [J]. Chinese General Practice, 2021, 24(1): 36-39.
[15]	RU Xueying，PAN Zhigang，WANG Tianhao，GAO Junling. Number and Disease Profile of Patients Discharged from Community Health Centers in Shanghai's Rural-urban Fringe　 [J]. Chinese General Practice, 2020, 23(7): 803-807.