News
Programs get high marks in NRC rankings
The National Research Council (NRC) of the National Academy of Sciences has released its long-awaited assessment of research-doctoral programs in U.S. universities, and several UB programs have received high marks in the rankings.
The assessment, released on Tuesday, is the first review by the NRC since 1993 and applies an entirely new methodology that avoids comparison with earlier rankings. The current ratings are based on a complex formula that incorporates data in 19-to-20 parameters, depending on the discipline, that participating universities assembled during late fall 2006 through spring 2007.
In a departure from past practice, the NRC did not publish single definitive rankings for each program, stating that the committee felt strongly that assigning a single number to each program and ranking them in that order would misrepresent the varieties of ways that programs achieve quality, as well as the varieties of attributes that potential students seek in a doctoral program.
Instead, the assessment offers a range of potential rankings, using two different systems for weighting the parameters, called “S” and “R.”
The “S,” or survey-based, rankings are based on a survey that asked faculty to rate the importance of the different program characteristics in determining the quality of a program. The “R,” or regression-based, rankings are based on an indirect way of determining the importance that faculty attach to various characteristics.
Thirty-four UB doctoral programs were evaluated, with eight given ranges that fell into the top quartile of the “R” system: pharmacology, chemical engineering, civil engineering, American studies, comparative literature, computer science and engineering, communication and geography.
Six programs—pharmaceutical sciences, pharmacology, chemical engineering, industrial engineering, computer science and engineering, and American studies—were given ranges that placed them in the top quartile in the “S” system.
A total of 28 UB programs received ranges that extended into the top 50 percentile in the “R” ranking system, while 21 programs received ranges that extended into the top 50 percentile in the “S” system.
The complete assessment report is available online.
John Ho, vice provost for graduate education, dean of the Graduate School and leader of UB’s assessment team, said he appreciated this thorough review by the NRC.
“This is a valuable working document, one of many ways we can gain insight into our academic quality,” Ho said. “Program chairs, faculty and deans can do their own analyses of the data, looking at how their programs compare on selected variables of interest with our peer institutions.
“We will draw on this information to help us understand where to build on strength and where to improve,” he said, noting that many changes already have been made in the four years since the data was compiled.
Provost Satish K. Tripathi said he was pleased with UB’s overall performance in the NRC report. He thanked UB’s assessment team for its hard work in assembling the data, which he says will be useful for years to come.
“UB has many excellent doctoral programs, a testimony to the hard work of our faculty,” Tripathi said. “Assembling this data has been a useful exercise in examining our doctoral program as a whole, and can be used as a road map in the future to enhance our entire repertoire of academic programs.”
To be included in the study, a field or discipline had to have produced at least 500 PhDs in the five years prior to 2004-05, and had to be offered in at least 25 universities. An individual program had to have produced at least five PhDs in the five years prior to 2005-06 to be included in the assessment.
The assessment covers more than 5,000 doctoral programs at 212 institutions in 62 fields within the physical sciences and mathematics, agricultural and life sciences, health sciences, engineering, social sciences, and arts and humanities.
The final report is based on data collected through five questionnaires:
- An institutional questionnaire on institution-wide practices and a list of doctoral programs.
- A program questionnaire on students, faculty, characteristics of the program, a list of doctoral faculty and names of their advanced doctoral students in five fields.
- A faculty questionnaire that covered educational and work history, grants, publications, characteristics important to the quality of a doctoral program, and whether respondents would be willing to answer a survey rating programs in their field.
- A student questionnaire that gathered information from advanced students in English, chemical engineering, economics, physics and neuroscience about their educational background, research experiences while in the program, program practices and post-graduation plans.
- A questionnaire that was sent to a stratified sample of faculty members who had indicated they were willing to rate other programs in their field as part of the “R” ranking methodology.
In addition to the overall measure provided by the assessment for each program at each institution, dimensional measures were constructed in three areas: research activity of program faculty, student treatment and outcomes, and diversity of the academic environment.
The authors of the NRC report note that the study and its methodology are meant to set into motion a dynamic process that leads to further discussion and insights, and are not to be considered a “final verdict” on the quality of doctoral programs as they existed in 2006.
The data is expected to be of interest to policymakers, researchers, university administrators and faculty, as well as students who are considering doctoral study.
Reader Comments