AWS HPC Blog
Tag: AWS Batch
Run simulations using multiple containers in a single AWS Batch job
Run simulations using multiple containers in a single AWS Batch job Matthew Hansen, Principal Solutions Architect, AWS Advanced Computing & Simulation Recently, AWS Batch launched a new feature that makes it possible to run multiple containers within a single job. This enables new scenarios customers have asked about like simulations for autonomous vehicles, multi-robot collaboration, […]
Linter rules for Nextflow to improve the detection of errors before runtime
Check out this post to learn how linter rules for Nextflow’s DSL can help you catch errors in your workflows before runtime, which means greater developer productivity, which leads directly to a faster time to science.
Using a digital twin for sensitivity analysis to determine sensor placement in a roll-to-roll manufacturing web-line
What’s the best way to select sensors to capture key data for your digital twin without overspending? Check out our latest blog post on using ML and sensitivity studies to optimize sensor selection.
Choosing the right compute orchestration tool for your research workload
Running big research jobs on AWS but not sure where to start? We break down options like Batch, ECS, EKS, and others to pick the right tool for your needs. Lots of examples for genomics, ML, engineering, and more!
Introducing new alerts to help users detect and react to blocked job queues in AWS Batch
Heads up AWS Batch users! Learn how to get notifications when your job queue gets blocked so you can quickly troubleshoot and keep your workflows moving. Details in our blog.
Improve the speed and cost of HPC deployment with Mountpoint for Amazon S3
Don’t sacrifice performance OR ease of use with your HPC storage. Learn how Mountpoint for Amazon S3 combines high throughput and low latency with the simplicity of S3.
Accelerating agent-based simulation for autonomous driving
AWS is powering the future of self-driving cars. Check out this post to see how high performance computing is transforming agent-based models for the CARLA RAI Challenge.
How agent-based models powered by HPC are enabling large scale economic simulations
See how agent-based models, driven to scale by HPC in the cloud, are shedding new light on macroprudential policies with this post from Oxford’s Institute for New Economic Thinking.
Leveraging Seqera Platform on AWS Batch for machine learning workflows – Part 2 of 2
In this second part of using Nextflow for machine learning for life science workloads, we provide a step-by-step guide, explaining how you can easily deploy a Seqera environment on AWS to run ML and other pipelines.
Leveraging Seqera Platform on AWS Batch for machine learning workflows – Part 1 of 2
Nextflow is popular workflow framework for genomics pipelines, but did you know you can also use it for machine-learning? ML is already being used for medical imaging, protein folding, drug discovery, and gene editing. In this post, we explain how to build an example Nextflow pipeline that performs ML model-training and inference for image analysis.