Uses of Interface
org.apache.pig.data.DataBag

Packages that use DataBag

org.apache.hadoop.zebra.types	Data types being shared between the io and mapred packages.
org.apache.pig	Public interfaces and classes for Pig.
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer
org.apache.pig.backend.hadoop.executionengine.physicalLayer	Implementation of physical operators that use hadoop as the execution engine and data storage.
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators
org.apache.pig.backend.hadoop.hbase
org.apache.pig.builtin	This package contains builtin Pig UDFs.
org.apache.pig.data	This package contains implementations of Pig specific data types as well as support functions for reading, writing, and using all Pig data types.
org.apache.pig.impl.builtin
org.apache.pig.impl.io
org.apache.pig.impl.util
org.apache.pig.pen
org.apache.pig.pen.util
org.apache.pig.piggybank.evaluation.stats
org.apache.pig.piggybank.evaluation.util

Uses of DataBag in org.apache.hadoop.zebra.types

Methods in org.apache.hadoop.zebra.types that return DataBag

static DataBag	TypesUtils.createBag() Create a PIG Bag object.
static DataBag	TypesUtils.createBag(Schema schema)

Uses of DataBag in org.apache.pig

Methods in org.apache.pig that return DataBag

DataBag

LoadCaster.bytesToBag(byte[] b, ResourceSchema.ResourceFieldSchema fieldSchema) Cast data from bytearray to bag value.

Methods in org.apache.pig that return types with arguments of type DataBag

Map<Operator,DataBag>

PigServer.getExamples(String alias)

Methods in org.apache.pig with parameters of type DataBag

byte[]

StoreCaster.toBytes(DataBag bag)

Uses of DataBag in org.apache.pig.backend.hadoop.executionengine.mapReduceLayer

Methods in org.apache.pig.backend.hadoop.executionengine.mapReduceLayer with parameters of type DataBag

abstract org.apache.hadoop.mapreduce.Mapper.Context

PigGenericMapBase.getIllustratorContext(org.apache.hadoop.conf.Configuration conf, DataBag input, List<Pair<PigNullableWritable,org.apache.hadoop.io.Writable>> output, org.apache.hadoop.mapreduce.InputSplit split)

Uses of DataBag in org.apache.pig.backend.hadoop.executionengine.physicalLayer

Fields in org.apache.pig.backend.hadoop.executionengine.physicalLayer declared as DataBag

protected static DataBag

PhysicalOperator.dummyBag

Methods in org.apache.pig.backend.hadoop.executionengine.physicalLayer with parameters of type DataBag

Result

PhysicalOperator.getNext(DataBag db)

Uses of DataBag in org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators

Methods in org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators with parameters of type DataBag

protected Result	ExpressionOperator.accumChild(List<ExpressionOperator> child, DataBag db) Drive all the UDFs in accumulative mode
Result	POUserFunc.getNext(DataBag db)
Result	POUserComparisonFunc.getNext(DataBag db)
Result	PORelationToExprProject.getNext(DataBag db)
Result	POProject.getNext(DataBag db)
Result	POMapLookUp.getNext(DataBag db)
Result	POCast.getNext(DataBag bag)
Result	POBinCond.getNext(DataBag db)
Result	ExpressionOperator.getNext(DataBag db)
Result	ConstantExpression.getNext(DataBag db)
Result	ComparisonOperator.getNext(DataBag db)

Uses of DataBag in org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators

Methods in org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators that return DataBag

protected DataBag

POPartitionRearrange.constructPROutput(List<Result> resLst, Tuple value)

Uses of DataBag in org.apache.pig.backend.hadoop.hbase

Methods in org.apache.pig.backend.hadoop.hbase that return DataBag

DataBag

HBaseBinaryConverter.bytesToBag(byte[] b, ResourceSchema.ResourceFieldSchema fieldSchema) NOT IMPLEMENTED

Methods in org.apache.pig.backend.hadoop.hbase with parameters of type DataBag

byte[]

HBaseBinaryConverter.toBytes(DataBag bag) NOT IMPLEMENTED

Uses of DataBag in org.apache.pig.builtin

Methods in org.apache.pig.builtin that return DataBag

DataBag	Utf8StorageConverter.bytesToBag(byte[] b, ResourceSchema.ResourceFieldSchema schema)
DataBag	TextLoader.bytesToBag(byte[] b, ResourceSchema.ResourceFieldSchema schema) TextLoader does not support conversion to Bag
DataBag	TOP.exec(Tuple tuple)
DataBag	TOP.Final.exec(Tuple tuple)
DataBag	TOKENIZE.exec(Tuple input)
DataBag	TOBAG.exec(Tuple input)
DataBag	Distinct.exec(Tuple input)
DataBag	Distinct.Final.exec(Tuple input)
DataBag	DIFF.exec(Tuple input) Compares a tuple with two fields.
DataBag	COV.exec(Tuple input) Function to compute covariance between data sets.
DataBag	COV.Final.exec(Tuple input)
DataBag	COR.exec(Tuple input) Function to compute correlation between data sets.
DataBag	COR.Final.exec(Tuple input)
protected DataBag	Distinct.getDistinct(Tuple input)

Methods in org.apache.pig.builtin with parameters of type DataBag

protected static Tuple	LongAvg.combine(DataBag values)
protected static Tuple	IntAvg.combine(DataBag values)
protected static Tuple	FloatAvg.combine(DataBag values)
protected static Tuple	DoubleAvg.combine(DataBag values)
protected static Tuple	COV.combine(DataBag values) combine results of different data chunk
protected static Tuple	COR.combine(DataBag values) combine results of different data chunk
protected static Tuple	AVG.combine(DataBag values)
protected static Tuple	COV.computeAll(DataBag first, DataBag second) compute sum(XY), sum(X), sum(Y) from given data sets
protected static Tuple	COR.computeAll(DataBag first, DataBag second) compute sum(XY), sum(X), sum(Y), sum(XX), sum(YY) from given data sets
byte[]	Utf8StorageConverter.toBytes(DataBag bag)
byte[]	TextLoader.toBytes(DataBag bag)
byte[]	BinStorage.toBytes(DataBag bag)
protected static void	TOP.updateTop(PriorityQueue<Tuple> store, int limit, DataBag inputBag)

Uses of DataBag in org.apache.pig.data

Classes in org.apache.pig.data that implement DataBag

class	AccumulativeBag
class	DefaultAbstractBag Default implementation of DataBag.
class	DefaultDataBag An unordered collection of Tuples (possibly) with multiples.
class	DistinctDataBag An unordered collection of Tuples with no multiples.
class	InternalCachedBag
class	InternalDistinctBag An unordered collection of Tuples with no multiples.
class	InternalSortedBag An ordered collection of Tuples (possibly) with multiples.
class	NonSpillableDataBag An unordered collection of Tuples (possibly) with multiples.
class	ReadOnceBag This bag is specifically created for use by POPackageLite.
class	SingleTupleBag A simple performant implementation of the DataBag interface which only holds a single tuple.
class	SortedDataBag An ordered collection of Tuples (possibly) with multiples.
class	SortedSpillBag Common functionality for proactively spilling bags that need to keep the data sorted.

Methods in org.apache.pig.data that return DataBag

static DataBag	DataReaderWriter.bytesToBag(DataInput in)
DataBag	DefaultBagFactory.newDefaultBag() Get a default (unordered, not distinct) data bag.
abstract DataBag	BagFactory.newDefaultBag() Get a default (unordered, not distinct) data bag.
DataBag	DefaultBagFactory.newDefaultBag(List<Tuple> listOfTuples) Get a default (unordered, not distinct) data bag from an existing list of tuples.
abstract DataBag	BagFactory.newDefaultBag(List<Tuple> listOfTuples) Get a default (unordered, not distinct) data bag with an existing list of tuples inserted into the bag.
DataBag	DefaultBagFactory.newDistinctBag() Get a distinct data bag.
abstract DataBag	BagFactory.newDistinctBag() Get a distinct data bag.
DataBag	DefaultBagFactory.newSortedBag(Comparator<Tuple> comp) Get a sorted data bag.
abstract DataBag	BagFactory.newSortedBag(Comparator<Tuple> comp) Get a sorted data bag.
static DataBag	DataType.toBag(Object o) If this object is a bag, return it as a bag.

Methods in org.apache.pig.data with parameters of type DataBag

void	SingleTupleBag.addAll(DataBag b)
void	ReadOnceBag.addAll(DataBag b)
void	NonSpillableDataBag.addAll(DataBag b)
void	InternalSortedBag.addAll(DataBag b)
void	InternalDistinctBag.addAll(DataBag b)
void	InternalCachedBag.addAll(DataBag b)
void	DistinctDataBag.addAll(DataBag b)
void	DefaultAbstractBag.addAll(DataBag b) Add contents of a bag to the bag.
void	DataBag.addAll(DataBag b) Add contents of a bag to the bag.
void	AccumulativeBag.addAll(DataBag b)
protected void	BagFactory.registerBag(DataBag b) Register a bag with the SpillableMemoryManager.

Uses of DataBag in org.apache.pig.impl.builtin

Methods in org.apache.pig.impl.builtin that return DataBag

DataBag	GFReplicate.exec(Tuple input)
DataBag	GFCross.exec(Tuple input)

Method parameters in org.apache.pig.impl.builtin with type arguments of type DataBag

void	ReadScalars.setOutputBuffer(Map<String,DataBag> inputBuffer)

Uses of DataBag in org.apache.pig.impl.io

Methods in org.apache.pig.impl.io that return DataBag

DataBag

PigFile.load(LoadFunc lfunc, PigContext pigContext)

Methods in org.apache.pig.impl.io with parameters of type DataBag

void	PigFile.store(DataBag data, FuncSpec storeFuncSpec, PigContext pigContext)

Constructors in org.apache.pig.impl.io with parameters of type DataBag

NullableBag(DataBag b)

Uses of DataBag in org.apache.pig.impl.util

Methods in org.apache.pig.impl.util with parameters of type DataBag

static String

BagFormat.format(DataBag bag)

Uses of DataBag in org.apache.pig.pen

Methods in org.apache.pig.pen that return DataBag

DataBag

Illustrator.getData()

Methods in org.apache.pig.pen that return types with arguments of type DataBag

Map<Operator,DataBag>	ExampleGenerator.getData()
Map<Operator,DataBag>	ExampleGenerator.getData(Map<LOLoad,DataBag> newBaseData)
Map<PhysicalOperator,DataBag>	IllustratorAttacher.getDataMap()
Map<Operator,DataBag>	ExampleGenerator.getExamples()
Map<LOLoad,DataBag>	AugmentBaseDataVisitor.getNewBaseData()

Method parameters in org.apache.pig.pen with type arguments of type DataBag

Map<Operator,DataBag>	ExampleGenerator.getData(Map<LOLoad,DataBag> newBaseData)
static Map<LogicalRelationalOperator,Collection<IdentityHashSet<Tuple>>>	EquivalenceClasses.getLoToEqClassMap(PhysicalPlan plan, LogicalPlan lp, Map<Operator,PhysicalOperator> logToPhyMap, Map<Operator,DataBag> logToDataMap, Map<LOForEach,Map<LogicalRelationalOperator,PhysicalOperator>> forEachInnerLogToPhyMap, HashMap<PhysicalOperator,Collection<IdentityHashSet<Tuple>>> poToEqclassesMap)
void	LocalMapReduceSimulator.launchPig(PhysicalPlan php, Map<LOLoad,DataBag> baseData, LineageTracer lineage, IllustratorAttacher attacher, ExampleGenerator eg, PigContext pc)

Constructor parameters in org.apache.pig.pen with type arguments of type DataBag

AugmentBaseDataVisitor(OperatorPlan plan, Map<Operator,PhysicalOperator> logToPhysMap, Map<LOLoad,DataBag> baseData, Map<Operator,DataBag> derivedData)

AugmentBaseDataVisitor(OperatorPlan plan, Map<Operator,PhysicalOperator> logToPhysMap, Map<LOLoad,DataBag> baseData, Map<Operator,DataBag> derivedData)

LineageTrimmingVisitor(LogicalPlan plan, Map<LOLoad,DataBag> baseData, ExampleGenerator eg, Map<Operator,PhysicalOperator> LogToPhyMap, PhysicalPlan physPlan, PigContext pc)

Uses of DataBag in org.apache.pig.pen.util

Method parameters in org.apache.pig.pen.util with type arguments of type DataBag

static float	MetricEvaluation.getCompleteness(Operator op, Map<Operator,DataBag> exampleData, Map<LogicalRelationalOperator,Collection<IdentityHashSet<Tuple>>> OperatorToEqClasses, boolean overallCompleteness)
static float	MetricEvaluation.getConciseness(Operator op, Map<Operator,DataBag> exampleData, Map<LogicalRelationalOperator,Collection<IdentityHashSet<Tuple>>> OperatorToEqClasses, boolean overallConciseness)
static float	MetricEvaluation.getRealness(Operator op, Map<Operator,DataBag> exampleData, boolean overallRealness)
static void	DisplayExamples.printSimple(Operator op, LogicalPlan lp, Map<Operator,DataBag> exampleData)
static String	DisplayExamples.printTabular(LogicalPlan lp, Map<Operator,DataBag> exampleData, Map<LOForEach,Map<LogicalRelationalOperator,DataBag>> forEachInnerLogToDataMap)
static String	DisplayExamples.printTabular(LogicalPlan lp, Map<Operator,DataBag> exampleData, Map<LOForEach,Map<LogicalRelationalOperator,DataBag>> forEachInnerLogToDataMap)

Uses of DataBag in org.apache.pig.piggybank.evaluation.stats

Methods in org.apache.pig.piggybank.evaluation.stats that return DataBag

DataBag	COV.exec(Tuple input) Deprecated. Function to compute covariance between data sets.
DataBag	COV.Final.exec(Tuple input)
DataBag	COR.exec(Tuple input) Deprecated. Function to compute correlation between data sets.
DataBag	COR.Final.exec(Tuple input)

Methods in org.apache.pig.piggybank.evaluation.stats with parameters of type DataBag

protected static Tuple	COV.combine(DataBag values) Deprecated. combine results of different data chunk
protected static Tuple	COR.combine(DataBag values) Deprecated. combine results of different data chunk
protected static Tuple	COV.computeAll(DataBag first, DataBag second) Deprecated. compute sum(XY), sum(X), sum(Y) from given data sets
protected static Tuple	COR.computeAll(DataBag first, DataBag second) Deprecated. compute sum(XY), sum(X), sum(Y), sum(XX), sum(YY) from given data sets

Uses of DataBag in org.apache.pig.piggybank.evaluation.util

Methods in org.apache.pig.piggybank.evaluation.util that return DataBag

DataBag	Top.exec(Tuple tuple) Deprecated.
DataBag	Top.Final.exec(Tuple tuple)
DataBag	ToBag.exec(Tuple input) Deprecated.

Methods in org.apache.pig.piggybank.evaluation.util with parameters of type DataBag

protected static void

Top.updateTop(PriorityQueue<Tuple> store, int limit, DataBag inputBag) Deprecated.