Amazon Web Services : Fault tolerant solution

Posted by Algorist on Stack Overflow See other posts from Stack Overflow or by Algorist
Published on 2010-05-03T10:02:50Z Indexed on 2010/05/03 10:08 UTC
Read the original article Hit count: 430

Filed under:

aws

|

amazon-ec2

|

amazon-web-services

|

amazon

|

Cloud

Hi,

I am using Boto library to write scripts for automating our jobs on AWS. My script actually starts a hadoop cluster using cloudera scripts and then does some customization. I am having a problem with retries. Seems like very command in my script fails once couple of days. I started adding retry to all the commands, but then the code is very clumsy and difficult to maintain. what do people do in general.

Thank you
Bala

© Stack Overflow or respective owner

Related posts about aws

How do you transfer AWS RDS snap shot to a different AWS account

as seen on Server Fault - Search for 'Server Fault'
Hi I have an RDS database that I need to transfer a snapshot of to another AWS account. I understand there are issues being able to do this between availability zones so I'm really unsure if this is possible. The RDS instance is mySql. If it's not possible to transfer the snapshot please could… >>> More
How do I use XML prefixes in C#?

as seen on Stack Overflow - Search for 'Stack Overflow'
EDIT: I have now published my app: http://pastebin.com/PYAxaTHU I was trying to make console-based application that returns my temperature. using System; using System.Xml; namespace GetTemp { class Program { static void Main(string[] args) { XmlDocument doc… >>> More
need help with automating a CMD java tool whcih qurries alexa AWS using batch

as seen on Server Fault - Search for 'Server Fault'
Hi everyone, I need to get all available info on 600 URLs from "Alexa Web Information Service", I downloaded the java tool and I'm able to run a single query each time with a single switch/Response Group. I would like to ask how to write a batch file that would automate the process ? the java tool… >>> More
need help with automating a CMD java tool which queries alexa AWS using batch

as seen on Server Fault - Search for 'Server Fault'
Hi everyone, I need to get all available info on 600 URLs from "Alexa Web Information Service", I downloaded the java tool and I'm able to run a single query each time with a single switch/Response Group. I would like to ask how to write a batch file that would automate the process? The java tool… >>> More
Amazon AWS EC2 + Puppet, get Puppet to know AWS instance tags

as seen on Server Fault - Search for 'Server Fault'
I am having a problem with my AWS deployment, fairly new to AWS and Puppet. So coming to my question - can you distinguish puppet nodes with AWS machine tags or CNAME domains? A little background about the plan: have multiple clusters of machines, one php cluster, one legacy php cluster, one… >>> More

Related posts about amazon-ec2

Amazon EC2 spot instances - is there a catch ?

as seen on Server Fault - Search for 'Server Fault'
I needed to start a new EC2 instance today and decided to try out the new spot instances, where you can reduce your instance cost by bidding on the maximum per-hour price you're prepared to pay. Since today's spot price was only 35c / hour, compared with 85c / hour for an on-demand instance, I was… >>> More
Amazon EC2 spot instances - is there a catch ?

as seen on Server Fault - Search for 'Server Fault'
I needed to start a new EC2 instance today and decided to try out the new spot instances, where you can reduce your instance cost by bidding on the maximum per-hour price you're prepared to pay. Since today's spot price was only 3.5c / hour, compared with 8.5c / hour for an on-demand instance, I… >>> More
Amazon EC2 master node hanging

as seen on Server Fault - Search for 'Server Fault'
Hi, I am using cloudera setup to launch a cluster with hadoop on Amazon. Sometimes, the master hadoop node hangs and we have to restart the job from the job. Did anyone face similar problem and resolve the issue. Thank you. >>> More
Can't Connect to IIS Ftp Site under Amazon EC2

as seen on Server Fault - Search for 'Server Fault'
IIS 7.5: Ftp Firewall Suport: Data Ranges 49152-65535 using external Ip of Amazon EC2 static IP Ftp IPv4 Restriction: allow: Amazon EC2 static IP Ftp Authentication: Anonymous: Enabled, Basic: Disabled, IISMgr: Enabled Ftp Authorization: Allow All Users: Read/Write Windows Firewall (Inbound): Open… >>> More
Amazon EC2 EBS volume scheduled backup/snapshots using puppet

as seen on Server Fault - Search for 'Server Fault'
I am not a Linux admin, although I wish I was, and I have seen these questions Amazon EC2 Backup Strategy Amazon EC2 + EBS:: Regular backup plan? Simple Backup Strategy for Amazon EC2 instances / volumes? And this suggestion http://alestic.com/2009/09/ec2-consistent-snapshot I tried using… >>> More