Although general practice teacher training has been implemented in China for over a decade, a unified and effective tool for evaluating its outcomes is still lacking, which hampers the improvement of training quality.

Grounded in the Kirkpatrick model, we developed and validated a comprehensive evaluation scale for assessing the effectiveness of general practice teacher training, thereby providing a scientifically rigorous tool for monitoring training quality.

From January 8 to May 8, 2021, the initial scale was developed through a combination of literature review, expert interviews, and group discussions. During this process, four dimensions were determined: reaction, learning, behavior, and results, with each dimension comprising five items. From June to July 2021, a convenience sample of general practice (GP) residency training instructors from Jincheng and Yangquan in Shanxi Province, who were participating in the provincial GP faculty training program, were selected for two rounds of pilot testing (pre-survey and formal survey). Exploratory factor analysis was conducted on the pre-survey data (n=201), and confirmatory factor analysis was performed on the formal survey data (n=286). The reliability and validity of the scale were evaluated using Cronbach's αcoefficient, composite reliability, content validity, and other indices.

During the pilot testing phase, a total of 209 pre-test questionnaires were distributed, with an effective response rate of 96.2% (201/209). In the formal testing phase, 292 questionnaires were distributed, achieving an effective response rate of 97.9% (286/292). The final scale demonstrated a Cronbach's α coefficient of 0.967. The Cronbach's α coefficients for the four dimensions were 0.92, 0.83, 0.81, and 0.89, respectively. The composite reliability (CR) ranged from 0.82 to 0.92. The comparative fit index (CFI) was 0.858, the normed fit index (NFI) was 0.829, and the incremental fit index (IFI) was 0.859. The model fit index χ²/df was 4.804. The square roots of the average variance extracted (AVE) were all greater than the inter-factor correlation coefficients, indicating that all model fit indices performed well. Ultimately, a general practice faculty training effectiveness evaluation scale comprising four dimensions and 17 items was constructed.

The General Practice Teacher Training Effectiveness Scale demonstrates strong reliability and validity, serving as an effective tool for assessing training outcomes and for ongoing quality monitoring and continuous improvement.