AWS Host Groups
To create an AWS Host Group, you must first setup an AWS Cloud Provider.
Nirmata directly integrates with Amazon Web Services (AWS) and offers several ways to provision and manage AWS hosts. For each AWS Host Group you can use any of the following options to launch AWS cloud instances:
- Using Amazon Machine Images (AMIs).
- Using Auto Scaling Groups (ASGs).
- Using Spot Fleet Requests.
- Using Launch Configurations.
Using Amazon Machine Images (AMIs)
You can create your own AMI with Docker running on it. The AMI has the following requirements:
- Can be any Linux flavor that can run Docker
- Requires Docker 1.10+ (download)
You will need to setup the Nirmata agent container on that instance by running the command:
sudo curl -sSL https://www.nirmata.io/nirmata-host-agent/setup-nirmata-agent.sh | sudo sh -s -- --cloud aws
Once the instance is setup, create an AMI via the AWS console. This AMI can be used with your Auto Scaling Group or Spot Fleet instances.
Using Auto Scaling Groups (ASGs)
Detailed information on creating and managing Auto Scaling groups can be found here:
AWS Documentation: Auto Scaling Groups
The Launch Configuration of the ASG must use the AMI created earlier or you can use a standard Linux AMI and use cloud-init to install Docker and Nirmata agent.
This will ensure that Docker and Nirmata Host Agent are pre installed.
Using Spot Fleet Requests
You can use AWS Spot Fleet Requests with Nirmata to take advantage of discounted spot instance pricing. To use Spot Fleet Requests, you need to first create the Spot Fleet Requests using AWS console. Detailed information on creating and managing Spot Fleet Requests can be found here:
AWS Documentation: Spot FleetRequests
The Spot Fleet Request can use the AMI created earlier or you can use a standard Linux AMI and use cloud-init to install Docker and Nirmata agent.
Using Launch Configurations
AWS Launch Configurations can be used with Nirmata in order to provision/deprovision EC2 instances from Nirmata. Detailed information on creating a Launch Configuration can be found here:
AWS Documentation: Launch Configurations
The Launch Configurations must use the AMI created earlier or you can use a standard Linux AMI and use cloud-init to install Docker and Nirmata agent.
Creating an AWS Host Group
To create an AWS Host Group, you must first setup a AWS Provider.
Create a Host Group by specifying the Host Group Name and selecting the Cloud Provider. Then you need to select the host instance type (AMI, ASG, Spot Fleet Request or Launch Configuration).
Troubleshooting AWS Host Creation
In some cases, host creation on AWS may fail due to various reasons. Here are a few things to check when the host creation fails:
- Check if Docker Engine and Nirmata agent were successfully installed and started on the instances provisioned on AWS. To check if Nirmata agent is running, ssh to your AWS instance and use command: sudo docker ps. This command will list all the running containers. Verify that the nirmata-agent container is running
- If Nirmata agent is running on your AWS instance but the state
displaying on the Nirmata console is ‘Pending Connect’ or ‘Not
Connected’, the Nirmata agent might be unable to connect back to
Nirmata server. Verify that AWS security groups for your instance
allow outbound HTTPS traffic. You can check be accessing a website
e.g. www.google.com using curl or wget (e.g.
curl -XGET http://www.google.com)
- When creating AWS instances using Launch Configuration mode, ensure that the network selected in Nirmata is the same as the network of security group configured for the launch configuration. If this is not the case, instance creation will fail.