Model selection
For model selection we used both global structure scores and interaction
interface scores. This approach was described
previously15, 17 and implemented in the VoroMQA web
server33, but for CASP14 we introduced some
modifications. These included VoroMQA-dark, a new method for global
structure evaluation (see below), and an improved tournament-based
ranking algorithm (see Supplementary information for details). When
ranking models based on their pairwise comparisons, the algorithm puts
more emphasis on the interaction interface pseudo-energy and less
emphasis on the global structure score. This is achieved by using a
tolerance value when comparing global VoroMQA-dark scores. If the
difference between global scores is small, the interface scoring becomes
the only decisive factor.
In addition to fully automated scoring methods, models were also
evaluated according to constraints obtained from the literature or from
the CASP contact prediction servers, if such data were available. All
models were visually inspected before submission and manual ranking
adjustments were introduced, if necessary.