Brain Korea 21 phase II : a new evaluation model /
Saved in:
| Imprint: | Santa Monica, CA : RAND, 2008. |
|---|---|
| Description: | 248 p. : ill. ; 23 cm. |
| Language: | English |
| Subject: | |
| Format: | Print Book |
| URL for this record: | http://pi.lib.uchicago.edu/1001/cat/bib/6742805 |
Table of Contents:
- Preface
- Figures
- Tables
- Summary
- Acknowledgments
- Abbreviations
- Chapter 1. Introduction
- Background
- BK21 Program Structure
- Phase I and Phase II Comparison
- Significance of the Program
- Objective of the Study
- Approach
- Outline of the Monograph
- Chapter 2. Implications of Phase I Program Evaluations for Phase II Evaluations
- Previous Performance Evaluations of BK21 Phase I
- Annual and Interim Evaluations
- Program-Level Evaluations
- Findings from Previous Evaluations
- Changes Resulting from BK21 Phase I
- Suggestions for Improving the Evaluation System
- Limitations of Previous Evaluations
- Implications for Designing the Phase II Evaluation Model
- Chapter 3. A Logic Model for Evaluating BK21
- Literature Review and Focus Group Interviews
- Developing the Logic Model
- Identifying the Goals and Missions
- Goals
- Missions
- Performance Milestones
- Goals and Missions Identified for the Logic Model
- Program Inputs
- BK21 Funding
- Strategy
- Unit of Support
- Recipient Selection Criteria
- Performance Evaluation Criteria
- Other Operational Mechanisms
- Summary
- Incentives, Activities, Outputs, and Outcomes of the Program
- Incentives
- Activities
- Outputs
- Outcomes
- Other Observations
- Summary
- Chapter 4. Quantitative Model to Assess BK21 Program Outcomes
- Introduction
- Summary of Phase I Statistics
- Potential Approaches
- Unadjusted Comparisons of BK21 Winners and Losers
- Ordinary Least Squares, Matching, and Propensity Score
- Fixed-Effects and Difference-in-Differences Models
- Regression Discontinuity
- Other Strategies
- Quantitative Model
- Heterogeneous Funding
- The Power to Identify Impacts
- Data for Use in Validating the Model
- ISI Data
- Ministry of Education Data
- Validation of the Model
- Pre-Treatment Trends
- Another Possible Comparison Group: Nonapplicants
- Validation
- Variations on the Specification
- Quality
- Social Science and Humanities
- Other Aspects of the Logic Model
- Simultaneous Equations Methods
- International Competitiveness
- Simulation: Ability to Precisely Estimate Effects at Phase II Funding Levels
- Simulation: Outside Funding
- Implications for Data Collection
- Summary
- Chapter 5. Metrics and Measurement for Program Evaluation
- General Issues of Measurement
- Reliability
- Validity
- Direct and Indirect Measures
- Cost Versus Benefit
- Strategy for Framing Evaluation Measures
- Matching Measures to Goals
- Selecting Among Candidate Measures
- Adding to Korea's Research Manpower Pool
- Highly Educated Workforce Employment
- High-Quality Globally Competitive Research
- Measuring Quality of Research Output
- Consistent Measures of Quality Within Fields
- Measures of Quality Across All Fields
- Relative Research Quality Measures
- Changes to University/Department Infrastructure
- Fostering a Competitive Environment Within Korea
- Other Measures of Prestigious and Competitive Graduate Research
- Measuring Enhanced University-Industry Collaboration
- Measuring Enhanced Regional University Standing and Industry Linkage
- Industrial Research Quantity, Quality, and National Labor Productivity
- Chapter 6. Database Design to Support BK21 Program Evaluation and Measurement
- Priority Among Proposed Measures
- Database Design and Content
- Format of Database Design Entries
- Chapter 7. Future Development of BK21 and University Research in Korea
- A Good Model for an Allocation System
- Applying the Model to Korea
- Research Project Funding
- Portable Student Fellowships
- Facilities and Infrastructure Funding
- Promotion of Specific Regions or Fields
- BK21 Program Management
- Requirements for University and Department Governance
- Changing the Korean System
- Appropriate Scale and Number of Research Universities
- Analogy to the U.S. System
- Applying the Proposed Measurement Tools
- Summary
- Chapter 8. Conclusions
- Directions for a Phase II Evaluation System
- Phase II Program Goals and Characteristics Identified by the Logic Model
- Quantitative Model and Data Requirements
- Metrics, Measures, and Database to Assess Program Effects and to Monitor Progress
- Assessing the Quality of Program Outputs and Outcomes
- Quality of Research
- Quality of the Highly Educated Workforce
- Concentration Strategy and Competition Rule
- Suggestions for Long-Term Changes in the Korean Scientific Research and Education System
- Balancing Competition and Stability in Funding
- Portable Student Fellowships
- Infrastructure Funding
- Improving University and Department Governance
- Preconditions for the Proposed Changes
- Enhancing Program Evaluation and Management Capabilities
- Appendix
- A. Performance Evaluation Metrics Used in Previous Evaluations of Phase I
- B. Interview Guides for Representatives of Participants, Policymakers, and Users Related to the University Research and Education System
- C. Selection Criteria for Applied Science Research Groups: Phase II
- D. Table with Lagged Outcomes
- E. Research Data Series
- F. Education Data Series
- G. Industry Data Series
- H. General Data Series
- Bibliography