Loop modeling

The goal of loop modeling is to predict the native conformation of an internal stretch of protein backbone. This is an important problem in areas such as homology modeling, protein design, and structure determination. This benchmark comprises a standard set of well-curated loops for the purpose of comparing different loop modeling algorithms. Each algorithm predicts hundreds of structures for each loop and is judged based on the backbone RMSD between those predictions and the known structure.

Downloading the benchmark

The benchmark is hosted on GitHub. The most recent version can be checked out using the git command-line tool:

git clone https://github.com/Kortemme-Lab/loop_modeling.git

Running the benchmark

The benchmark is only designed to run without modification on the QB3 cluster at UCSF. On that cluster, the commands to run the benchmark will look something like the examples below. More information on what these commands do and how they can be configured is given in the README.rst files in their respective directories:

cd hpc/ucsf/rosetta
./run_benchmark.py B1 benchmarks/kic.xml input/full.pdbs

cd ../../../analysis
./make_report B1

Table of Contents

This archive contains the following directories:


Contains common code used by all the scripts comprising the benchmark.


Contains the input files for the benchmark.


These directories are empty by default. This is the default output location for protocols if they are run on the local machine.


Contains sample output data that can be used to test the analysis script.


Contains the analysis script used to analyze the output of a prediction run. All protocols are expected to produce output in a format compatible with the analysis script.


Contains the scripts needed to run a prediction for each protocol.


Contains scripts that can be used to run the entire benchmark using specific cluster architectures. For practical reasons, a limited number of cluster systems are supported. Please feel free to provide scripts which run the benchmark for your particular cluster system.


This repository contains third party libraries and materials which are distributed under their own terms (see LICENSE-3RD-PARTY). The novel content in this repository is licensed according to LICENSE.


The latest release of this repository: releasedoi