This page shows all available recipes. They are organized by theme (e.g. Database management
and Networking
). Each recipe also has tags that indicate the key technologies (i.e. parallelcluster
and rds
) it references.
You can use an HPC Recipe for AWS in several ways:
- Learn from it. Read the README file and inspect its
assets
directory to understand how it works. - Launch resources with it. Navigate to its README page and follow the instructions. There is often a quick-launch link to the AWS CloudFormation console.
- Incorporate it. Recipe assets are permissively licensed so you can use them in your own builds. You can also bring assets in by URL
There are currently no recipes in this namespace.
- About: Whisper audio transcription powered by AWS Batch and AWS Inferentia
- Usage: README.md
- About: Set up a replicated Amazon Aurora database that can support Slurm accounting.
- Usage: README.md
- About: Stand up a basic AWS Managed Microsoft AD for use with AWS ParallelCluster.
- Usage: README.md
- About: Simple OpenLDAP service running on ECS
- Usage: README.md
- About: Install and configure Spack + Spack configs on shared storage
- Usage: README.md
There are currently no recipes in this namespace.
There are currently no recipes in this namespace.
- About: Networking configuration for HPC on AWS. Can use an existing VPC or create a new one.
- Usage: README.md
- About: Networking configuration for large-scale HPC on AWS. Creates a new VPC.
- Usage: README.md
- About: Demonstrate decoupled shared storage using Amazon EFS.
- Usage: README.md
- About: Provides templates to configure AWS ParallelCluster for isolated environments/those with no Internet access.
- Usage: README.md
- About: Quick demo of the latest ParallelCluster release
- Usage: README.md
- About: Demonstrates the new Login Nodes feature in ParallelCluster 3.7.2
- Usage: README.md
- About: Create an AMI of a ParallelCluster LoginNode compatible with Research and Engineering Studio
- Usage: README.md
- About: Create a cluster that can launch instances in multiple Availability Zones
- Usage: README.md
- About: Creates a multi-user instance of AWS ParallelCluster using AWS Managed AD as the directory service.
- Usage: README.md
- About: Create an AWS ParallelCluster with ParallelClusterUI to manage it.
- Usage: README.md
- About: Create an instance of AWS ParallelCluster with Slurm accounting enabled, using Amazon RDS as the DBMS.
- Usage: README.md
- About: Create an instance of AWS ParallelCluster with Slurm accounting enabled and e-mail notifications using Slurm-Mail, using Amazon RDS as the DBMS.
- Usage: README.md
- About: Includes files to accelerate STIG compliance for Parallelcluster images as well as scripts to verify OSCAP results
- Usage: README.md
- About: Create a ParallelCluster system to try out Hpc6a instances.
- Usage: README.md
- About: Create a ParallelCluster system to try out Hpc6id instances.
- Usage: README.md
- About: Create a ParallelCluster system to try out Hpc7a instances.
- Usage: README.md
- About: Create a ParallelCluster system to try out Hpc7g instances.
- Usage: README.md
- About: Create a ParallelCluster system to try out Trn1 instances.
- Usage: README.md
- About: Connect standalone access nodes to AWS PCS
- Usage: README.md
- About: Run OpenFOAM on PCS
- Usage: README.md
- About: Enable CloudWatch Logs on PCS instances
- Usage: README.md
- About: Use EFA with AWS PCS compute node groups
- Usage: README.md
- About: Supports "Getting Started with AWS PCS" in AWS PCS user guide.
- Usage: README.md
- About: Example for configuration for multi-user AWS PCS using LDAPS
- Usage: README.md
- About: Install Spack on AWS PCS
- Usage: README.md
- About: Set up Entra ID with RES
- Usage: README.md
- About: Research and Engineering Studio (RES) on AWS demo environment
- Usage: README.md
- About: Certificate creation for public domain. Creates secrets for pem/key files for a public cert for a Route53 owned domain.
- Usage: README.md
There are currently no recipes in this namespace.
- About: Create an Amazon EFS filesystem and mount targets in three Availability Zones.
- Usage: README.md
- About: Creates either a scratch or persistent FSxL filesystem and a security group for accessing the filesystem.
- Usage: README.md
- About: Demonstrates an FSx for Lustre filesystem with an S3 data repository association
- Usage: README.md
- About: Provision an FSx for OpenZFS filesystem and a security groups for accessing the filesystem
- Usage: README.md
- About: Configure AWS ParallelCluster to mount S3 buckets to directories using mountpoint-s3
- Usage: README.md
- About: Create an Amazon S3 bucket using CloudFormation.
- Usage: README.md
- About: Cluster example using manual configuration.
- Usage: README.md
- About: Cluster example using CloudFormation imports.
- Usage: README.md
- About: Cluster example using nested CloudFormation stacks.
- Usage: README.md
You can access recipe assets using HTTPS or S3 protocols. They are mirrored to an S3 bucket so they can used with AWS CloudFormation.
Here are example URLs for the CloudFormation launch template for the "latest" ParallelCluster recipe (recipes/pcluster/latest):
- HTTPS Template: https://aws-hpc-recipes.s3.us-east-1.amazonaws.com/main/recipes/pcluster/latest/assets/launch.yaml
- S3 Template: s3://aws-hpc-recipes/main/recipes/pcluster/latest/assets/launch.yaml
In both URLs, /main/
is the HPC Recipes on AWS version. At present, the only supported version is main.
You can use the HTTPS link in a couple of contexts.
- You can download the file it references
curl -O HTTPS_URL
- If it's a Cloudformation template, you can import it into the CloudFormation console when creating a stack
- You can embed it in a CloudFormation quick-launch link.
- Template:
https://console.aws.amazon.com/cloudformation/home?region=REGION#/stacks/create/review?templateURL=HTTPS_URL
- Template:
The S3 URL is useful anywhere you want to use native S3 commands for data access.
- Template:
aws s3 cp s3://aws-hpc-recipes/main/recipes/NAMESPACE/RECIPE/assets/FILE.yaml .