vida amorosa

Welcome to the second part of the blog where we would learn how to run a simple pig program. This blog has been written to complete an assignment on big data with the praxis business school. The sample exercise has been taken from the following link  "http://hortonworks.com/hadoop-tutorial/how-to-process-data-with-apache-pig/" . About Pig: Pig is a high level scripting language that i used with Apache hadoop. Pig excels at describing data analysis problems as data flows. Pig is complete in that you can do all the required data manipulations in Apache Hadoop with Pig. In addition through the User Defined Functios(UDF) facility in Pig you can have Pig invoke code in many languages like Jruby, Jython and Java Pig Scripts are translated into a series of Mapreduce jobs that run on the Apache Hadoop Cluster. As part of the translation the Pig interpreter does perform optimizations to speed execution on Apache Hadoop.  Lets solve a simple exercise on how ...

Big Data has attracted the attention of lots of corporates, individuals, big  honchos in the field of analytics.  Big data is a buzzword, or catch-phrase, used to describe a massive volume of both structured and unstructured data that is so large it is difficult to process using traditional database and software techniques.  A small baby elephant comes to the rescue by the name of hadoop. Hadoop is a tool that helps solving the problem of processing large amount of data (Terabytes) by the combination  of number of computers.  Before I proceed ahead with the objective in mind regarding this blog. We must understand  two principles concepts of Hadoop: a) HDFS: Hadoop Distributed File System distributes large files across multiple machines in a way that is invisible to the user b) Map Reduce Concept: This is the crux of the hadoop. It can be broken down into two independent tasks map an...

SAS is a very powerful tool to build the graphs. Our main focus is to build the SAS/Graph like Bar Graphs, Scatter Plots etc.Let us look on some of the questions and try to understand the code and the output. The appearance of the output from various SAS/GRAPH procedures can be influenced by additional statements such as SYMBOL (for example, defines plotting symbols and line styles), PATTERN (defines styles for bar graphs), and AXIS (defines horizontal and vertical axes) Q1) Code: let us understand step wise what is happening 1) Title statement describes the title to be printed. It is a global statement. 2) Ron Cody has specified:    A PATTERN statement requests that the bars in your vertical bar chart consist of an outline only (the default is to fill in the bar).  The VBAR statement requests a vertical bar  Alternatives to VBAR are as follows: HBAR Horizontal bar chart VBAR3D Three-dimensional vertical bar chart H...

In this blog we would look at some programmes on how to do subsetting of the data  and how to combine the data from several to single datasets. Subsetting a SAS datastep involves selecting observations from one data set by defining the selection criteria either where , if/else , select  among many others. Lets look at the questions to get better understanding  Q Code: Code: 1) We are creating a new dataset A35_a in library A15035 2) We are reading the observations from blood dataset in library A15035. 3) We are partitioning the data based on the condition using the where keyword when gender equals female and bloodtype is AB. 4) We are creating the new variable combined computing the value based on the condition specified. 5) Then we are using the proc print to print the observations from the dataset A35_a 6) In the next part we are creating a new dataset A35_b in library A15035 7) We are reading the observations from blood datas...