name: inverse layout: true class: center, middle, inverse
---
# Deeper look into Genome Assembly algorithms
Anthony Bretaudeau
Simon Gladman
Anton Nekrutenko
Delphine Lariviere
last_modification
Updated:
purl
PURL
:
gxy.io/GTN:S00029
text-document
Plain-text slides
|
Tip:
press
P
to view the presenter notes |
arrow-keys
Use arrow keys to move between slides
??? Presenter notes contain extra information which might be useful if you intend to use these slides for teaching. Press `P` again to switch presenter notes off Press `C` to create a new window where the same presentation will be displayed. This window is linked to the main window. Changing slides on one will cause the slide to change on the other. Useful when presenting. --- ## Requirements Before diving into this slide deck, we recommend you to have a look at: - [Introduction to Galaxy Analyses](/training-material/topics/introduction) - [Sequence analysis](/training-material/topics/sequence-analysis) - Quality Control: [
slides
slides](/training-material/topics/sequence-analysis/tutorials/quality-control/slides.html) - [
tutorial
hands-on](/training-material/topics/sequence-analysis/tutorials/quality-control/tutorial.html) --- ### <i class="far fa-question-circle" aria-hidden="true"></i><span class="visually-hidden">question</span> Questions - What are the main types of assembly algorithms? - How do they perform with short and long reads? - How to improve assemblies using other technologies? --- # Different types of input data * Short reads (Illumina): numerous 👍, high quality 👍, cheap 👍, short 👎 * Long reads (PacBio, Nanopore): longer 👍, fewer 👎, (many) more errors 👎 Genome Assembly can be done with: * only short reads * only long reads * both (hybrid assembly) Specific algorithms for each --- # Genome Assembly algorithms Detect overlaps between reads to build the longest possible sequences Algorithms use graphs to represent overlapping reads/words Two steps: * Build a (huge) graph while reading the input data * Try to find the longest paths traversing the graph Two main types of algorithms: * Short reads: de Bruijn Graphs * Long reads: OLC (Overlap Layout Consensus) --- # OLC (Overlap Layout Consensus) The older, first used for Sanger sequencing Compare all reads, look for read overlaps If a *suffix* of one read is similar to a *prefix* of another read... ``` TCTATATCTCGGCTCTAGG <- read 1 ||||||| ||||||| TATCTCGACTCTAGGCC <- read 2 ``` ...then they may overlap within the genome. --- ## Directed graphs We build a *directed graph* where directed *edges* connect *nodes* representing overlapping reads: ![Image showing example reads represented as nodes, and an overlap between two reads as an edge](../../images/dag.png) >**Directed graph** representing overlapping reads. (Image from [Ben Langmead](http://www.cs.jhu.edu/~langmea/resources/lecture_notes/assembly_scs.pdf)). --- ## Directed graphs For example, consider these 15 three letter reads: TAA AAT ATG TGC GCC CCA CAT ATG TGG GGG GGA GAT ATG TGT GTT We're lucky, we know the corresponding genome sequence is TAATGCCATGGGATGTT So the 15 reads can be represented as the following directed graph: ![A graph representing the 15 overlapping example reads](../../images/4.6.png) --- **However**, in real life we do not know the actual genome! All we have is a collection of reads. Let's first build an overlap graph by connecting two 3-mers if suffix of one is equal to the prefix of the other: >![All possible overlap connections for our 3-mer collection](../../images/4.7.png) > >**Overlap graph**. All possible overlap connections for our 3-mer collection. (Fig. 4.7 from [CP](http://bioinformaticsalgorithms.com/)) So to determine the sequence of the underlying genome we are looking for a path in this graph that visits every node (3-mer) once. Such path is called [Hamiltonian path](https://en.wikipedia.org/wiki/Hamiltonian_path) and it may not be unique. --- For example for our 3-mer collection there are two possible Hamiltonian paths: ![First possible Hamiltonian path](../../images/4.9a.png) ![Second possible Hamiltonian path](../../images/4.9b.png) **Two Hamiltonian paths for the 15 3-mers**. Edges spelling "genomes" <code>TAATGCCATGGGATGTT</code> and <code>TAATGGGATGCCATGTT</code> are highlighted in black. (Fig. 4.9. from [[CP](http://bioinformaticsalgorithms.com/)](http://bioinformaticsalgorithms.com/)). --- The reason for this "duality" is the fact that we have a *repeat*: 3-mer <code>ATG</code> is present three times in our data (<font color="green">green</font>, <font color="red">red</font>, and <font color="blue">blue</font>). Repeats cause a lot of trouble in genome assembly. --- # Limits of OLC * Computationally intensive * Doesn't perform well with Illumina (massive amount of short reads) => deBruijn Graphs --- # **de Bruijn Graphs** Based on a counter-intuitive idea * Hash all reads in overlapping fixed-length words * Words = k-mers of size k * Build a directed graph where nodes are k-mers and edges represent overlaps between k-mers --- # **What are K-mers?** ![K-mers are subwords of length k of a string](../../images/kmers01.png) --- # **K-mers de Bruijn graph** ![Example with 4 english words](../../images/ex1-1.png) --- # **K-mers de Bruijn graph** ![Example with 4 english words](../../images/ex1-2.png) --- # **K-mers de Bruijn graph** ![Example with 4 english words](../../images/ex1-3.png) --- # **K-mers de Bruijn graph** ![Example with 4 english words](../../images/ex1-4.png) --- # **The problem of repeats** ![Example with a word containing repeats: Mississippi](../../images/ex2-1.png) --- # **The problem of repeats** ![Example with a word containing repeats: Mississippi](../../images/ex2-2.png) --- # **The problem of repeats** ![Example with a word containing repeats: Mississippi](../../images/ex2-3.png) --- # **The problem of repeats** ![Example with a word containing repeats: Mississippi](../../images/ex2-4.png) --- # **Different k** ![Effect of the size of k](../../images/ex2a-1.png) --- # **Different k** ![Effect of the size of k](../../images/ex2a-2.png) --- # **Different k** ![Effect of the size of k](../../images/ex2a-3.png) --- # **Different k** ![Effect of the size of k](../../images/ex2a-4.png) --- # **Choose k wisely** * Lower k * More connections * Less chance of resolving small repeats * Higher k-mer coverage * Higher k * Less connections * More chance of resolving small repeats * Lower k-mer coverage ***Optimum value for k will balance these effects.*** --- # **Read errors** .image-75[![Example of english words with errors](../../images/ex3-head.png)] ![Example of english words with errors](../../images/blank.png) --- # **Read errors** .image-75[![Example of english words with errors](../../images/ex3-head.png)] ![Example of english words with errors](../../images/ex3-2.png) --- # **Read errors** .image-75[![Example of english words with errors](../../images/ex3-head.png)] ![Example of english words with errors](../../images/ex3-3.png) --- # **Read errors** .image-75[![Example of english words with errors](../../images/ex3-head.png)] ![Example of english words with errors](../../images/ex3-4.png) --- # Coverage (or sequencing depth) The number of unique reads that contain a given nucleotide in the reconstructed sequence. ![Aligned reads showing the notion of coverage](../../images/coverage.png) Source: [Wikimedia](https://commons.wikimedia.org/wiki/File:Read,_read_length_and_read_depth_to_achieve_a_read_depth) **Estimated coverage** **(number of reads x read length)** / **estimated size of the genome** 1,000,000 reads x 150bp / 10Mb = **15X** --- # **More coverage** * Errors won't be duplicated in every read * Most reads will be error free * We can count the frequency of each k-mer * Annotate the graph with the frequencies * Use the frequency data to clean the de Bruijn graph ***More coverage depth will help overcome errors!*** --- # **Read errors revisited** ![Graph annotated with coverage](../../images/ex3a.png) --- # **de Bruijn graph assembly process** 1. Select a value for k 2. "Hash" the reads (make the kmers) 3. Count the kmers 4. Make the de Bruijn graph 5. Perform graph simplification steps 6. Read off contigs from simplified graph --- # **Make contigs** * Find an unbalanced node in the graph * Follow the chain of nodes and "read off" the bases to produce the contigs * Where there is an ambiguous divergence/convergence, stop the current contig and start a new one. * Re-trace the reads through the contigs to help with repeat resolution --- # Assembly in real life In this topic we've learned about two ways of representing the relationship between reads derived from a genome we are trying to assemble: 1. **Overlap graphs** - nodes are reads, edges are overlaps between reads. 2. **De Bruijn graphs** - nodes are overlaps, edges are reads. --- # Overlap graph ![An example overlap graph](../../images/4.7.png) --- # de Bruijn Graph - same data ![An example de Bruijn graph](../../images/4.13f.png) --- Whatever the representation will be it will be messy: ![An example of a real-life, noisy graph](../../images/t12_mess.png) A fragment of a very large De Bruijn graph (Image from [BL](https://github.com/BenLangmead/ads1-slides/blob/master/0580_asm__practice.pdf)). --- There are multiple reasons for such messiness: **Sequence errors** Sequencing machines do not give perfect data. This results in spurious deviations on the graph. Some sequencing technologies such as Oxford Nanopore have very high error rate of ~15%. >![Zoom on graph region containing sequencing errors](../../images/t12_errors.png) > >Graph components resulting from sequencing errors (Image from [BL](https://github.com/BenLangmead/ads1-slides/blob/master/0580_asm__practice.pdf)). --- **Ploidy** As we discussed earlier humans are diploid and there are multiple differences between maternal and paternal genomes. This creates "bubbles" on assembly graphs: >![Impact of diploid genome sequencing on graphs](../../images/t12_bubble.png) > >Bubbles due to a heterozygous site (Image from [BL](https://github.com/BenLangmead/ads1-slides/blob/master/0580_asm__practice.pdf)). --- **Repeats** As we've seen the third law of assembly is unbeatable. As a result some regions of the genome simply cannot be resolved and are reported in segments called *contigs*: >![Impact of repeats on graphs](../../images/t12_contigs.png) > >The following "genomic" segment will be reported in three pieces corresponding to regions flanking the repeat and repeat itself (Image from [BL](https://github.com/BenLangmead/ads1-slides/blob/master/0580_asm__practice.pdf)). --- # What to do with my reads? * Short reads => DBG assemblers (e.g. Spades, ABySS, DISCOVAR, Velvet, ...) * Long reads => OLC assemblers (e.g Canu, Falcon, Hgap4, ...) * Short + Long reads => hybrid assemblers (e.g. Unicycler, ...) Hybrid assembly: long reads to resolve repeats, short reads to correct errors Other data and tools for polishing (scaffolding, gap filling, ...) --- # Other data: Optical maps ![Optical mapping workflow](../../images/Optical_mapping.jpg) (Source: [Wikimedia](https://en.wikipedia.org/wiki/Optical_mapping#/media/File:Optical_mapping.jpg)) Use for scaffolding by comparing the restriction map with the predicted restriction sites in the contig sequences --- # Other data: Hi-C ![Hi-C sequencing workflow](../../images/hic.jpg) (Source: Dovetail genomics) Sequence chunks of genome colocalized --- # Other data: Linked-Reads ![Linked-Reads workflow](../../images/linked_reads.png) (Source: 10X) Reads grouped by physical regions on the genome thanks to barcodes 10X Genomics (discontinued in 2020) --- ## Thank You! This material is the result of a collaborative work. Thanks to the [Galaxy Training Network](https://training.galaxyproject.org) and all the contributors!
Authors:
Anthony Bretaudeau
Simon Gladman
Anton Nekrutenko
Delphine Lariviere
Tutorial Content is licensed under
Creative Commons Attribution 4.0 International License
.