loading page

Evaluation of model refinement in CASP14
  • +2
  • Adam Simpkin,
  • Filomeno Rodriguez,
  • Shahram Mesdaghi,
  • Andriy Kryshtafovych,
  • Daniel Rigden
Adam Simpkin
University of Liverpool

Corresponding Author:[email protected]

Author Profile
Filomeno Rodriguez
University of Liverpool
Author Profile
Shahram Mesdaghi
University of Liverpool
Author Profile
Andriy Kryshtafovych
University of California, Davis
Author Profile
Daniel Rigden
University of Liverpool
Author Profile


We report here an assessment of the model refinement category of the 14th round of Critical Assessment of Structure Prediction (CASP14). As before, predictors submitted up to five ranked refinements, along with associated residue-level error estimates, for targets that had a wide range of starting quality. The ability of groups to accurately rank their submissions and to predict coordinate error varied widely. Overall only four groups out-performed a “naïve predictor” corresponding to resubmission of the starting model. Among the top groups there are interesting differences of approach and in the spread of improvements seen: some methods are more conservative, others more adventurous. Some targets were “double-barrelled” for which predictors were offered a high-quality AlphaFold 2 (AF2)-derived prediction alongside another of lower quality. The AF2-derived models were largely unimprovable, their apparent errors being found to reside very largely at domain and, especially, crystal lattice contacts. Refinement is shown to have a mixed impact overall on structure-based function annotation methods to predict nucleic acid binding, spot catalytic sites and dock protein structures.
30 Apr 2021Submitted to PROTEINS: Structure, Function, and Bioinformatics
03 May 2021Submission Checks Completed
03 May 2021Assigned to Editor
04 May 2021Reviewer(s) Assigned
28 May 2021Review(s) Completed, Editorial Evaluation Pending
02 Jun 2021Editorial Decision: Revise Minor
14 Jun 20211st Revision Received
20 Jun 2021Submission Checks Completed
20 Jun 2021Assigned to Editor
24 Jun 2021Reviewer(s) Assigned
30 Jun 2021Review(s) Completed, Editorial Evaluation Pending
11 Jul 2021Editorial Decision: Accept
Dec 2021Published in Proteins: Structure, Function, and Bioinformatics volume 89 issue 12 on pages 1852-1869. 10.1002/prot.26185