Questions tagged [amazon-web-services]
Amazon Web Services (AWS) is a collection of commercial services centered around virtualized, commodity and clustered computing, networking, database and storage, as well as supporting tools that are offered through infrastructure as a service.
18
questions with no upvoted or accepted answers
4
votes
0
answers
4k
views
Copying multiple S3 files in parallel using aws shell command
Any improvements to this welcome, I have got it working and I'm happy with it. I'm not really all that proficient with bash shell scripts though.
Problem:
AWS can copy multiple files pretty much as ...
4
votes
0
answers
2k
views
AWS EC2 metadata fetcher in Python
Update
https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ec2-instance-metadata.html
This seems to be the schema for the instance metadata, though the way they describe it isn't really handy for ...
4
votes
0
answers
353
views
Test cases for Ansible lambda module for deployment of AWS Lambdas
I have written a set of test cases which cover the ansible lambda module. The entire source is available on GitHub, forked from ansible/ansible
The original file is visible on github as is the ...
4
votes
0
answers
599
views
Deploy a Python script as an AWS Lambda micro web service
I'm still new to python, but my history is in the C/C++ world with plenty of Makefiles, though I've rarely written from scratch such elaborate ones as this. The Hitchhiker's Guide to Python gave me ...
3
votes
0
answers
91
views
Bash script for rebalancing weighted round robin
I have written a tool that is used to rebalance weights in a weighted round robin in AWS. I am quite happy with it whereas I would welcome feedback from any Bash programmers.
...
3
votes
0
answers
130
views
SageMakerTrainingOperator in Airflow
I have made an operator (surrounded by others operators) for training a model in sagemaker in airflow and I have doubts how would it be more readable or more pythonic. First I did this:
...
3
votes
0
answers
298
views
User registration in Actix w/ DynamoDB
I am trying to puzzle out api based user registration for a service I am building, but I have a strong feeling that my code is not optimal.
It feels like passing "state" in the way I did prevents the ...
3
votes
0
answers
100
views
Validating Amazon CloudFormation templates using Rspec
I have created an open source project that uses Rspec to validate the formatting of AWS::CloudFormation::Init YAML blocks in CloudFormation templates.1
My project is here.
Some general concerns:
Is ...
3
votes
0
answers
1k
views
AWS Lambda Function to Register in Cognito
This is the entire code for a Lambda function that registers a new user in Amazon Cognito.
The email, username, and password are passed to the Lambda function. The client ID is stored in an ...
3
votes
0
answers
179
views
Concurrent AWS S3 copying of images listed in MySQL
I created the following one off script and it did the task quite well (1000s of requests / second with low CPU usage - outperformed the previous python script in every aspect). But I am wondering if ...
3
votes
0
answers
175
views
ECMAScript 6 amazon lambda image processing
I use this script in amazon lambda for image processing. Script should do:
download image and watermark from amazon S3
resize image to two sizes
put watermark on it and annotate with text
put resized ...
2
votes
0
answers
36
views
Code and Inputs on to use AWS temporary Credentials
I am adding below code for review as i am bit new to boto3. This Script adds tags (key and value) to All Volumes of EC2 listed in Excel. Is there any more effective way i could have written this? Also ...
2
votes
0
answers
119
views
S3 Tools in Bash
This is a follow on to a previous question:
Part 1: Signature
All the code I am submitting here is available in github
The reason to write these tools is so I can prototype and quickly verify ...
1
vote
0
answers
379
views
Golang DB connection with AWS SSM Parameters and context
I'm working on setting up an app backend that's deployed automatically using infrastructure-as-code and a ci/cd pipeline. As a result of that I need the app server to gather DB credentials ...
1
vote
0
answers
105
views
AWS plugin to create a CloudFormation stack if it doesn't exist
The following Python class is what I am trying to refactor in the case where I have to add validation of the existence of an AWS cloudformation stack before creating it in the method create_cfn_stack :...
1
vote
0
answers
72
views
AWS Lambda stack definition YAML
Design
My desired outcome is as follows:
S3 event triggers Lambda Function startTextractStateMachine
Lambda Function ...
1
vote
0
answers
430
views
Go program to generate S3 presigned PUT URL
I'm have a made a simple Go program to generate a s3 presigned put url:
...
1
vote
0
answers
2k
views
Unit tests for a Redshift wrapper class
I'm somewhat new to TDD and unit testing, but I've written a suite of unit tests to check my functionality. The basic classes automate simple load and unload operations from s3 and redshift, and ...