一 SQOOP2的实验

数据库基本操作命令

1 选择数据库命令

  • Mysql:

现在我用一个例子讲解sqoop2的具体使用方法,数据准备,有一个mysql的表叫worker，里面有三条数据，我们要将其导入hadoop,这是建表语句

  1. 登录方式:
  2. #直接本地登录 root:123456
  3. #mysql -u root -p 
  5. mysql> show databases;
  6. +--------------------+
  7. | Database           |
  8. +--------------------+
  9. | information_schema |
  10. | hive               |
  11. | mysql              |
  12. | performance_schema |
  13. +--------------------+
  14. 4 rows in set (0.02 sec)
  16. mysql> create database chu888chu888;
  17. Query OK, 1 row affected (0.00 sec)
  19. mysql> use chu888chu888;
  20. Database changed
  21. mysql> CREATE TABLE `workers` (
  22.     ->   `id` int(11) NOT NULL AUTO_INCREMENT,
  23.     ->   `name` varchar(20) NOT NULL,
  24.     ->   PRIMARY KEY (`id`)
  25.     -> ) ENGINE=MyISAM  DEFAULT CHARSET=utf8;
  26. Query OK, 0 rows affected (0.00 sec)
  28. mysql> insert into workers (name) values ('jack');
  29. Query OK, 1 row affected (0.00 sec)
  31. mysql> insert into workers (name) values ('vicky');
  32. Query OK, 1 row affected (0.00 sec)
  34. mysql> insert into workers (name) values ('martin');
  35. Query OK, 1 row affected (0.00 sec)

2. 导入数据

  1. $sqoop2-shell
  2. sqoop:000> show connector
  3. 16/08/09 13:35:05 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  4. +------------------------+---------+------------------------------------------------------------+----------------------+
  5. |          Name          | Version |                           Class                            | Supported Directions |
  6. +------------------------+---------+------------------------------------------------------------+----------------------+
  7. | oracle-jdbc-connector  | 1.99.7  | org.apache.sqoop.connector.jdbc.oracle.OracleJdbcConnector | FROM/TO              |
  8. | sftp-connector         | 1.99.7  | org.apache.sqoop.connector.sftp.SftpConnector              | TO                   |
  9. | kafka-connector        | 1.99.7  | org.apache.sqoop.connector.kafka.KafkaConnector            | TO                   |
  10. | kite-connector         | 1.99.7  | org.apache.sqoop.connector.kite.KiteConnector              | FROM/TO              |
  11. | ftp-connector          | 1.99.7  | org.apache.sqoop.connector.ftp.FtpConnector                | TO                   |
  12. | hdfs-connector         | 1.99.7  | org.apache.sqoop.connector.hdfs.HdfsConnector              | FROM/TO              |
  13. | generic-jdbc-connector | 1.99.7  | org.apache.sqoop.connector.jdbc.GenericJdbcConnector       | FROM/TO              |
  14. +------------------------+---------+------------------------------------------------------------+----------------------+