Tag Archives: Cloud

Run your Hadoop MapReduce job on Amazon EMR

I have posted a while ago how to setup an EMR cluster by using CLI. In this post I will show how to setup the cluster by using the Java SDK for AWS. The best way to show how to … Continue reading

Posted in AWS, cloud, Hadoop | Tagged , , ,

Running Hive jobs on AWS EMR

In a previous post I showed how to run a simple job using AWS Elastic MapReduce (EMR). In this example we continue to make use of EMR but now to run a Hive job. Hive is a data warehouse system … Continue reading

Posted in AWS, cloud | Tagged , , , ,

Archiving data to AWS Glacier

For archiving your data at AWS you can use AWS Glacier. This service offers cheaper storage than the S3 service but the downside is that your data won’t be accessible right away as it is with S3. It may take … Continue reading

Posted in AWS, cloud | Tagged , , | 2 Comments

Using AWS ElasticMapReduce with the Command Line Interface

In this post I am going to use the AWS MapReduce service (called ElasticMapReduce) by making use of the CLI for EMR. The process of using EMR can be divided in three steps on a high level: set up and … Continue reading

Posted in AWS, cloud | Tagged , , , | 2 Comments

Using s3cmd for working with AWS s3 buckets

When you make use of (some of the) Amazon services there is a big chance S3 is one of them for the storage of files, be it temporary or more permanent. When you are using this service of AWS and … Continue reading

Posted in AWS, cloud | Tagged , , | 1 Comment

AWS Summit London 2013

Last week I attended to the AWS Summit in London. Together with a few colleagues from 4Synergy we saw a lot of interesting stuff. I attended to the Data & Analytics Track and saw (again) the potential of what AWS … Continue reading

Posted in AWS, cloud | Tagged ,

Using CloudCheckr for AWS monitoring

About a month ago I posted about the tool CloudCheckr for the first time. Since then I have had a look at it every now and then and I must say I really love it. Although my Amazon AWS environment … Continue reading

Posted in cloud | Tagged ,

Keeping track of your Amazon AWS Products

I guess you have noticed that the whole field of IT infrastructure has changed and is still changing significantly with the opportunities that the cloud is offering. Especially Amazon with its AWS is acting as a frontrunner in this (new) … Continue reading

Posted in AWS, cloud | Tagged , , | 1 Comment

Amazon ELB and multiple Availability Zones

I was recently playing with the AWS ELB and AWS AutoScaling which I described here. What I wanted to do was to setup some stress test and have the Autoscaling kick in by instantiating extra instances because of the heavy … Continue reading

Posted in AWS, cloud | Tagged , ,

Set up AWS Autoscaling

In this post I will setup autoscaling for the EC2 WordPress server I created previously. With autoscaling you can tell Amazon to launch or terminate instances based on a set of rules/ conditions. For example if a server has a … Continue reading

Posted in AWS, cloud | Tagged , | 3 Comments