edu.yale.cs.hadoopdb.benchmark
Class JoinTaskHDFS

java.lang.Object
  org.apache.hadoop.conf.Configured
      edu.yale.cs.hadoopdb.exec.HDFSJobBase
          edu.yale.cs.hadoopdb.benchmark.JoinTaskHDFS

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

public class JoinTaskHDFS
extends HDFSJobBase

Adapted from Andy Pavlo's code http://database.cs.brown.edu/projects/mapreduce-vs-dbms/

Nested Class Summary

(package private) class	JoinTaskHDFS.Phase1Map
(package private) class	JoinTaskHDFS.Phase1Reduce
(package private) class	JoinTaskHDFS.Phase2Reduce
(package private) class	JoinTaskHDFS.Phase3Reduce

Field Summary

static java.lang.String	DATE_FROM_PARAM
static java.lang.String	DATE_TO_PARAM
static java.text.DateFormat	dateParser
static int	RANKINGS_FIELD_NUMBER
static int	USER_VISITS_FIELD_NUMBER

Constructor Summary

JoinTaskHDFS()

Method Summary

protected org.apache.hadoop.mapred.JobConf	configureJob(java.lang.String... args) Override this method to set job-specific options
static void	main(java.lang.String[] args)
protected int	printUsage() Provide job-specific command-line help
int	run(java.lang.String[] args)

Methods inherited from class edu.yale.cs.hadoopdb.exec.HDFSJobBase

printHDFSUsage

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Field Detail

DATE_FROM_PARAM

public static final java.lang.String DATE_FROM_PARAM

See Also:

Constant Field Values

DATE_TO_PARAM

public static final java.lang.String DATE_TO_PARAM

See Also:

Constant Field Values

dateParser

public static final java.text.DateFormat dateParser

RANKINGS_FIELD_NUMBER

public static final int RANKINGS_FIELD_NUMBER

See Also:

Constant Field Values

USER_VISITS_FIELD_NUMBER

public static final int USER_VISITS_FIELD_NUMBER

See Also:

Constant Field Values

Constructor Detail

JoinTaskHDFS

public JoinTaskHDFS()

Method Detail

configureJob

protected org.apache.hadoop.mapred.JobConf configureJob(java.lang.String... args)
                                                 throws java.io.IOException

Description copied from class: HDFSJobBase

Override this method to set job-specific options

Specified by:

configureJob in class HDFSJobBase

Throws:

java.io.IOException

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception

Throws:

java.lang.Exception

printUsage

protected int printUsage()

Description copied from class: HDFSJobBase

Provide job-specific command-line help

Specified by:

printUsage in class HDFSJobBase

run

public int run(java.lang.String[] args)
        throws java.lang.Exception

Specified by:

run in interface org.apache.hadoop.util.Tool

Overrides:

run in class HDFSJobBase

Throws:

java.lang.Exception