org.hedera.util

Class VectorizeAnchorMap

java.lang.Object

org.apache.hadoop.conf.Configured

tuan.hadoop.conf.JobConfig

org.hedera.util.VectorizeAnchorMap

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

public class VectorizeAnchorMap
extends tuan.hadoop.conf.JobConfig
implements org.apache.hadoop.util.Tool

This tool reads the mapping of Wikipedia entity ID - anchor mapping output from Cloud9, checks the continuous entity IDs and IDs of anchor texts, and repacks everything into continuous id ranges

Nested Class Summary

Nested classes/interfaces inherited from class tuan.hadoop.conf.JobConfig

tuan.hadoop.conf.JobConfig.Version

Field Summary

Fields

Modifier and Type	Field and Description
static String	DICTIONARY_OPTION
static String	INPUT_OPTION
static String	OUTPUT_OPTION
static String	PREPROCESSING

Constructor Summary

Constructors

Constructor and Description
VectorizeAnchorMap()

Method Summary

Methods

Modifier and Type	Method and Description
static void	main(String[] args)
int	run(String[] args)
static void	toIntArrayWritable(tuan.hadoop.io.IntArrayListWritable ints, int[] termids, int length)

Methods inherited from class tuan.hadoop.conf.JobConfig

create, getVersion, markOutputForDeletion, setCompress, setCompressOption, setMapperSize, setup, setup, setup, setVersion

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Field Detail

DICTIONARY_OPTION

public static final String DICTIONARY_OPTION

See Also:

Constant Field Values

PREPROCESSING

public static final String PREPROCESSING

See Also:

Constant Field Values

INPUT_OPTION

public static final String INPUT_OPTION

See Also:

Constant Field Values

OUTPUT_OPTION

public static final String OUTPUT_OPTION

See Also:

Constant Field Values

Constructor Detail

VectorizeAnchorMap

public VectorizeAnchorMap()

Method Detail

toIntArrayWritable

public static void toIntArrayWritable(tuan.hadoop.io.IntArrayListWritable ints,
                      int[] termids,
                      int length)

run

public int run(String[] args)
        throws Exception

Specified by:

run in interface org.apache.hadoop.util.Tool

Throws:

Exception

main

public static void main(String[] args)