#AWS LINUX INSTALL APACHE SPARK CODE#
#AWS LINUX INSTALL APACHE SPARK DOWNLOAD#

EC2 lets you remotely access a server that's maintained by amazon. Then, head over to Amazon Web Services to create an account to use Amazon Web Services, an umbrella for many nifty services, the most popular being its Elastic Compute (generation 2) cloud. If you've previously installed Cygwin just open the installer to add OpenSSH. Since OpenSSH is not installed by default, use the search box to search for it in the packages and deselect 'skip'. Cygwin is a simple linux emulator for windows- it isn't necessary for using AWS and Spark, but it's handy and has an easy secure shell, OpenSSH for connecting to your AWS instance.

#AWS LINUX INSTALL APACHE SPARK DOWNLOAD#

Initial setupįirst download Cygwin () if you don't already have it. This site gives a very informative overview of getting set up on EC2.

Create AWS account and connect to the serverĬlick here to jump to quick instructions for accessing the instance after the first-time setup.

* Will replace low resolution images- there was a disconnect with an editor preview and actual publishing This one focuses on creating and connecting to an AWS instance. Since there are different routes you can go from each step, I've decided to break it into parts. This tutorial is designed to hold your hand through the process so you (hopefully) don't have to Google every step. But you're on Windows, you don't have a lot of time, and despite being fairly tech capable, after a few environment path changes it isn't quite working and you're frustrated. 'I can do easy.' But wait, what you really need to try is AWS, it's /the/ cloud to put your data on.

Oh, and Spark! Spark lets you analyze data fast and easily! 'Ok!' You say.

#AWS LINUX INSTALL APACHE SPARK CODE#

On windows!Įverybody's talking about Jupyter, some sort of 'notebook' thing that let's you see your code and graphs in one neat little page. The goal of this multi-part guide is to walk the reader through setting up distributed data analysis on a remote server (AWS) with Apache Spark, simply using Cygwin and Jupyter, in your browser.

Aws linux install apache spark