Tag Archives: Cloud

Run your Hadoop MapReduce job on Amazon EMR

Posted on 03/09/2013 by Pascal Alma

I have posted a while ago how to setup an EMR cluster by using CLI. In this post I will show how to setup the cluster by using the Java SDK for AWS. The best way to show how to … Continue reading →

Posted in AWS, cloud, Hadoop | Tagged , , , | Comments Off on Run your Hadoop MapReduce job on Amazon EMR

Running Hive jobs on AWS EMR

Posted on 10/06/2013 by Pascal Alma

In a previous post I showed how to run a simple job using AWS Elastic MapReduce (EMR). In this example we continue to make use of EMR but now to run a Hive job. Hive is a data warehouse system … Continue reading →

Posted in AWS, cloud | Tagged , , , , | Comments Off on Running Hive jobs on AWS EMR

Archiving data to AWS Glacier

Posted on 28/05/2013 by Pascal Alma

For archiving your data at AWS you can use AWS Glacier. This service offers cheaper storage than the S3 service but the downside is that your data won’t be accessible right away as it is with S3. It may take … Continue reading →

Posted in AWS, cloud | Tagged , , | 2 Comments

Using AWS ElasticMapReduce with the Command Line Interface

Posted on 07/05/2013 by Pascal Alma

In this post I am going to use the AWS MapReduce service (called ElasticMapReduce) by making use of the CLI for EMR. The process of using EMR can be divided in three steps on a high level: set up and … Continue reading →

Posted in AWS, cloud | Tagged , , , | 2 Comments

Using s3cmd for working with AWS s3 buckets

Posted on 01/05/2013 by Pascal Alma

When you make use of (some of the) Amazon services there is a big chance S3 is one of them for the storage of files, be it temporary or more permanent. When you are using this service of AWS and … Continue reading →

Posted in AWS, cloud | Tagged , , | 1 Comment

AWS Summit London 2013

Posted on 27/04/2013 by Pascal Alma

Last week I attended to the AWS Summit in London. Together with a few colleagues from 4Synergy we saw a lot of interesting stuff. I attended to the Data & Analytics Track and saw (again) the potential of what AWS … Continue reading →

Posted in AWS, cloud | Tagged , | Comments Off on AWS Summit London 2013

Using CloudCheckr for AWS monitoring

Posted on 06/04/2013 by Pascal Alma

About a month ago I posted about the tool CloudCheckr for the first time. Since then I have had a look at it every now and then and I must say I really love it. Although my Amazon AWS environment … Continue reading →

Posted in cloud | Tagged , | Comments Off on Using CloudCheckr for AWS monitoring

Keeping track of your Amazon AWS Products

Posted on 05/03/2013 by Pascal Alma

I guess you have noticed that the whole field of IT infrastructure has changed and is still changing significantly with the opportunities that the cloud is offering. Especially Amazon with its AWS is acting as a frontrunner in this (new) … Continue reading →

Posted in AWS, cloud | Tagged , , | 1 Comment

Amazon ELB and multiple Availability Zones

Posted on 02/02/2013 by Pascal Alma

I was recently playing with the AWS ELB and AWS AutoScaling which I described here. What I wanted to do was to setup some stress test and have the Autoscaling kick in by instantiating extra instances because of the heavy … Continue reading →

Posted in AWS, cloud | Tagged , , | Comments Off on Amazon ELB and multiple Availability Zones

Set up AWS Autoscaling

Posted on 18/01/2013 by Pascal Alma

In this post I will setup autoscaling for the EC2 WordPress server I created previously. With autoscaling you can tell Amazon to launch or terminate instances based on a set of rules/ conditions. For example if a server has a … Continue reading →

Posted in AWS, cloud | Tagged , | 3 Comments