Uses of Interface
org.apache.pig.LoadPushDown

Packages that use LoadPushDown
org.apache.hadoop.zebra.pig Implementation of PIG Storer/Loader Interfaces 
org.apache.pig.backend.hadoop.hbase   
org.apache.pig.builtin This package contains builtin Pig UDFs. 
org.apache.pig.piggybank.storage   
 

Uses of LoadPushDown in org.apache.hadoop.zebra.pig
 

Classes in org.apache.hadoop.zebra.pig that implement LoadPushDown
 class TableLoader
          Pig IndexableLoadFunc and Slicer for Zebra Table
 

Uses of LoadPushDown in org.apache.pig.backend.hadoop.hbase
 

Classes in org.apache.pig.backend.hadoop.hbase that implement LoadPushDown
 class HBaseStorage
          A HBase implementation of LoadFunc and StoreFunc.
 

Uses of LoadPushDown in org.apache.pig.builtin
 

Classes in org.apache.pig.builtin that implement LoadPushDown
 class PigStorage
          A load function that parses a line of input into fields using a delimiter to set the fields.
 

Uses of LoadPushDown in org.apache.pig.piggybank.storage
 

Classes in org.apache.pig.piggybank.storage that implement LoadPushDown
 class AllLoader
          The AllLoader provides the ability to point pig at a folder that contains files in multiple formats e.g.
 class CSVExcelStorage
          CSV loading and storing with support for multi-line fields, and escaping of delimiters and double quotes within fields; uses CSV conventions of Excel 2007.
 class CSVLoader
          A load function based on PigStorage that implements part of the CSV "standard" This loader properly supports double-quoted fields that contain commas and other double-quotes escaped with backslashes.
 class HiveColumnarLoader
          Loader for Hive RC Columnar files.
Supports the following types:
* Hive Type Pig Type from DataType string CHARARRAY int INTEGER bigint or long LONG float float double DOUBLE boolean BOOLEAN byte BYTE array TUPLE map MAP

Partitions
The input paths are scanned by the loader for [partition name]=[value] patterns in the subdirectories.
If detected these partitions are appended to the table schema.
For example if you have the directory structure:

 class PigStorageSchema
          This Load/Store Func reads/writes metafiles that allow the schema and aliases to be determined at load time, saving one from having to manually enter schemas for pig-generated datasets.
 



Copyright © 2012 The Apache Software Foundation