Sqoop – Installation

We can directly install sqoop from apache official website. Similar to pig or hive we can untar the sqoop file, afterwards we get sqoop home directory like /home/username/sqoop-a.b.c/. We can go to that directory and give /bin/sqoop for sqoop command line interface to start. When we type above command we get sqoop shell as,

% sqoop

Try sqoop help for usage.

We can use,

% sqoop help

usage: sqoop COMMAND [ARGS]

Available commands:

codegen        Generate code to interact with database records

create-hive-table    Import a table definition into Hive

eval                Evaluate a SQL statement and display the results

export            Export an HDFS directory to a database table

help                List available commands

import           Import a table from a database to HDFS

import-all-tables Import tables from a database to HDFS

job                  Work with saved jobs

list-databases List available databases on a server

list-tables      List available tables in a database

merge            Merge results of incremental imports

metastore     Run a standalone Sqoop metastore

version          Display version information

See 'sqoop help COMMAND' for information on a specific command.



% sqoop help import

usage: sqoop import [GENERIC-ARGS] [TOOL-ARGS]

Common arguments:

--connect <jdbc-uri> Specify JDBC connect string

--driver <class-name> Manually specify JDBC driver class to use

--hadoop-home <dir> Override $HADOOP_HOME

--help Print usage instructions

-P Read password from console

--password <password> Set authentication password

--username <username> Set authentication username

--verbose Print more information while working…

Import control arguments:

   --append                                                   Imports data

                                                              in append

                                                              mode

   --as-avrodatafile                                          Imports data

                                                              to Avro data

                                                              files

   --as-parquetfile                                           Imports data

                                                              to Parquet

                                                              files

   --as-sequencefile                                          Imports data

                                                              to

                                                              SequenceFile

                                                              

   --as-textfile                                              Imports data

                                                              as plain

                                                              text

                                                              (default) ……..