UseGalaxy.eu has developed Training Infrastructure as a Service (TIaaS for short) which allows you to use Galaxy with a private queue for your training event. Your trainees’ jobs won’t wait in the main queue, and can be processed much more quickly than they might be otherwise. This can provide the experience of a local, private Galaxy combined with a public Galaxy that you are not responsible for maintaining. Additionally if something goes wrong, you can conveniently blame the Galaxy admins, rather than feeling the stress of debugging and fixing your private Galaxy.

UseGalaxy.eu has developed Training Infrastructure as a Service (TIaaS for short) which allows you to use Galaxy with a private queue for your training event. Your trainees’ jobs won’t wait in the main queue, and can be processed much more quickly than they might be otherwise. This can provide the experience of a local, private Galaxy combined with a public Galaxy that you are not responsible for maintaining. Additionally if something goes wrong, you can conveniently blame the Galaxy admins, rather than feeling the stress of debugging and fixing your private Galaxy.

Agenda

In this tutorial, we will see:

1. Where are you
2. Identify if TIaaS is Appropriate For Your Training
3. How TIaaS Works
4. The Application Process
5. The Student’s Process
6. The Status Dashboard
7. Before Your Training
8. During Your Training

Where are you

Hands-on: Choose Your Own Tutorial

This is a "Choose Your Own Tutorial" section, where you can select between multiple paths. Click one of the buttons below to select how you want to follow the tutorial

Galaxy has servers across the world, but it's best to choose one close to you. Here we customise this tutorial based on where you are, so, pick the location closest to where you'll be running your training.

Europe, the Middle East, and Africa (EMEA) Asia/Pacific (APAC) the Americas (AMER)

Identify if TIaaS is Appropriate For Your Training

First consider the requirements for your training to see if TIaaS is a good fit for you:

• Do you need really special tools that are not already available on UseGalaxy.euUseGalaxy.org.auUseGalaxy.org?
  • The UseGalaxy.* servers support most training workflows.
  • But we only install publicly available and open tools: EU Tool RepositoryAustralian Tool RepositoryAmerican Tool Repository
• Do you need extra guarantees that the server will be online?
  • The big UseGalaxy.* servers have good uptime, for services run by academic groups, but it cannot make promises regarding availability.
  • Additionally this server can experience occasional slow downs due to usage by other groups and users. If you need more guarantees, please find an alternative.

How TIaaS Works

We have several groups of virtual machines (VMs) attached to UseGalaxy.eu that run user jobs. For trainings we attach a new group of VMs that is specially labelled for that training. When normal users run tools on our server, these jobs are instructed to avoid the training pools by default.

We have a pool of virtual machines (VMs) dedicated to training, that run training specific jobs only.

Jobs submitted while in a TIaaS group have an artificially capped memory limited, and walltime. By lowering these parameters we can be sure the jobs will execute more quickly, but this only works for training data. If you run a training with "real data" it may require too much memory or computation time, and those jobs will be killed.

When your users join a training, using a special URL provided to you, they then are placed in a special training group. Their jobs will then preferentially run on a training machine, and, in the event there is no more capacity, they will run on the main queue. If a spot on a training VM opens up first, they will run there rather than continuing to wait in the main queue.

The Application Process

Hands-on: Apply for TIaaS Training

1. Fill out the formFill out the formFill out the form

2. The admin team will review the request and get in touch with you as needed to identify the compute resources you need for your training

3. The admin team will inform you of the URL you should provide to your participants during the training. They can open this URL and they will be added to the special training group

The Student’s Process

We have a “test” TIaaS training setup on UseGalaxy.eu, which will never have compute resources associated with it, but you can use it to test the process of signing up, if you wish:

Hands-on: Join a TIaaS Training

1. Click on this link: https://usegalaxy.eu/join-training/test

2. In the background you are added to a group in Galaxy. If you were to run jobs they would be tagged with this special queue.

That’s it, you’re now in the “test” TIaaS group. It’s really that easy for students.

The Status Dashboard

Once your students are registered, and you’re running your training, a common question instructors ask are “Are you all done?” and students are often not as vocal or repsonsive as we would like. So the TIaaS service now has a dashboard you can view which shows you the queue status for everyone in your training group. This works by finding all of the members of that training group, and checking all jobs that were created in the last 3 hours. For all of those jobs, this is displayed as a simple dashboard with the status of these jobs:

It shows:

• Overview of queue (how many are in state new/queued/ok/error)
• Overview split by tools (how many people are done running Fastqc?)
• A full listing of the queue

Open image in new tab

Hands-on: View the dashboard

1. The status dashboard is just the same URL as to join the group, with /status at the end: https://usegalaxy.eu/join-training/test/status

Before Your Training

At least 2 weeks before your training:

1. Run through your planned trainings on the UseGalaxy.eu server to ensure everything is available including data libraries and tools.
2. If anything is missing, contact the admins and they will work to resolve the missing training material resources.
3. Follow the rest of the training material’s guide to preparing a workshop

During Your Training

1. Check out your status dashboard
2. Watch for problems and contact the admins if
   • Jobs are spending abnormally long in the queue
   • Jobs are failing unexpectedly
3. Remind your participants to submit bug reports if they experience any tool errors
4. Follow the rest of the training material’s guide to running a workshop

You've Finished the Tutorial

Please also consider filling out the Feedback Form as well!

Key points

• Infrastructure is available for running Galaxy trainings for free from UseGalaxy.*

• This can be easier than setting up a local Galaxy and may have more resources available

• But have a backup plan

Frequently Asked Questions

Feedback

Did you use this material as an instructor? Feel free to give us feedback on how it went.
Did you use this material as a learner or student? Click the form below to leave feedback.

Citing this Tutorial

1. Helena Rasche, Training Infrastructure as a Service (Galaxy Training Materials). https://training.galaxyproject.org/training-material/topics/teaching/tutorials/setup-tiaas-for-training/tutorial.html Online; accessed TODAY
2. Hiltemann, Saskia, Rasche, Helena et al., 2023 Galaxy Training: A Powerful Framework for Teaching! PLOS Computational Biology 10.1371/journal.pcbi.1010752
3. Batut et al., 2018 Community-Driven Data Analysis Training for Biology Cell Systems 10.1016/j.cels.2018.05.012

BibTeX

@misc{teaching-setup-tiaas-for-training,
author = "Helena Rasche",
	title = "Training Infrastructure as a Service (Galaxy Training Materials)",
	year = "",
	month = "",
	day = ""
	url = "\url{https://training.galaxyproject.org/training-material/topics/teaching/tutorials/setup-tiaas-for-training/tutorial.html}",
	note = "[Online; accessed TODAY]"
}
@article{Hiltemann_2023,
	doi = {10.1371/journal.pcbi.1010752},
	url = {https://doi.org/10.1371%2Fjournal.pcbi.1010752},
	year = 2023,
	month = {jan},
	publisher = {Public Library of Science ({PLoS})},
	volume = {19},
	number = {1},
	pages = {e1010752},
	author = {Saskia Hiltemann and Helena Rasche and Simon Gladman and Hans-Rudolf Hotz and Delphine Larivi{\`{e}}re and Daniel Blankenberg and Pratik D. Jagtap and Thomas Wollmann and Anthony Bretaudeau and Nadia Gou{\'{e}} and Timothy J. Griffin and Coline Royaux and Yvan Le Bras and Subina Mehta and Anna Syme and Frederik Coppens and Bert Droesbeke and Nicola Soranzo and Wendi Bacon and Fotis Psomopoulos and Crist{\'{o}}bal Gallardo-Alba and John Davis and Melanie Christine Föll and Matthias Fahrner and Maria A. Doyle and Beatriz Serrano-Solano and Anne Claire Fouilloux and Peter van Heusden and Wolfgang Maier and Dave Clements and Florian Heyl and Björn Grüning and B{\'{e}}r{\'{e}}nice Batut and},
	editor = {Francis Ouellette},
	title = {Galaxy Training: A powerful framework for teaching!},
	journal = {PLoS Comput Biol} Computational Biology}
}

                   

Galaxy Administrators: Install the missing tools

You can use Ephemeris's shed-tools install command to install the tools used in this tutorial.

shed-tools install [-g GALAXY] [-a API_KEY] -t <(curl https://training.galaxyproject.org/training-material/api/topics/teaching/tutorials/setup-tiaas-for-training/tutorial.json | jq .admin_install_yaml -r)

Alternatively you can copy and paste the following YAML

---
install_tool_dependencies: true
install_repository_dependencies: true
install_resolver_dependencies: true
tools: []

Feedback

No feedback has been recieved yet for this training. Be the first one by filling in the feedback form from above.