Introduction to S3 and EC2 file copy

In this article, we are going to see how to copy files from ec2 instance to S3 bucket and vice versa, with the assist of IAM roles and without having to use the AWS access key and secrets in the server.

copy file from EC2 to S3

In AWS technical terms.

Copying files from EC2 to S3 is called Upload ing the file

Copying files from S3 to EC2 is chosen Download ing the files

The starting time iii steps are the same for both upload and download and should exist performed just once when y'all are setting up a new EC2 instance or an S3 bucket. the last and the quaternary stride is same except the change of source and destination.

Promise the following image helps you lot empathize the difference and between upload and download.

EC2 to S3

Let see how to get both of this washed.

Steps to re-create files from EC2 instance to S3 bucket (Upload)

  1. Create an IAM function with S3 write access or admin access
  2. Map the IAM part to an EC2 instance
  3. Install AWS CLI in EC2 case
  4. Run the AWS s3 cp control to copy the files to the S3 bucket

1. Create an IAM role with S3 write admission or admin access

Login to your AWS Management Console and go to IAM.

Create a new IAM office with S3 Admin Access which can be lateral mapped to the EC2 case for easy S3 and EC2 integration.

Refer the post-obit GIF to know how to create a new IAM role for S3 admission

2. Map the IAM role to an EC2 instance

Choose the EC2 instance you want to assign this IAM role to.

Click on Deportment > Security> Modify IAM Role

Search for the IAM Role we take created in the previous step and select it and hit Salvage.

EC2 to S3

three. Install AWS CLI in EC2 instance

Login to your EC2 instance and follow the instructions respective to your Operating System and install the AWS CLI

  • Installing AWS CLI version ii on Linux or Unix
  • Installing AWS CLI version 2 on Windows

Refer the following GIF to know how to install AWS CLI in Linux machine

to know more about AWS CLI commands and how to use them refer this article

4. Run the AWS s3 cp command to copy the files to the S3 bucket

At present equally we accept installed the aws command line you tin simply utilise the following commands to copy the files to S3 Bucket from EC2.

# To List the S3 Bucket  aws s3 ls s3://<S3bucketName>  # To copy the files from EC2 to S3 aws s3 cp <Fully Qualified Local filename> s3://<S3BucketName>

Refer the following GIF to know how it works in real-fourth dimension.

Hope this quick article helps you to re-create files from S3 to EC2 instance straight without any programmatic access and Keys

Steps to copy files from S3 bucket to EC2 instance (Download)

To copy the files from S3 bucket to EC2 instance, you have to follow the aforementioned steps except changing the source and destination on the Fourth Step

  1. Create an IAM role with S3 write access or admin admission
  2. Map the IAM role to an EC2 case
  3. Install AWS CLI in EC2 instance
  4. Run the AWS s3 cp control to copy the files from S3 to EC2

To copy the files from S3 to EC2, Proceed the source as the saucepan URL and the destination to your local directory or filename

# To copy the files from S3 to EC2 aws s3 cp s3://<S3BucketName> <Fully Qualified Local filename/Directory>

In the previous command, you can see the difference. Here the source is S3 Bucket URL and the destination is a local file name or directory proper noun.

If you are interested to use S3 with ansible. refer this commodity.

How to use ansible with S3 – Ansible aws_s3 examples | Devops Junction

Promise information technology helps

What you think well-nigh this article ?. allow me know in comments

Cheers
Sarav AK

Buy Me a Coffee at ko-fi.com

Follow the states onFacebook orTwitter
For more than practical videos and tutorials. Subscribe to our channel
Find me on Linkedin My Profile
For any Consultation or to hire us [email protected]
If you lot similar this article. Testify your Support! Buy me a Coffee.

Signup for Sectional "Subscriber-only" Content