几点说明:(mysql初始化)

a. canal的原理是基于mysql binlog技术,所以这里一定需要开启mysql的binlog写入功能,建议配置binlog模式为row.
针对阿里云RDS账号默认已经有binlog dump权限,不需要任何权限或者binlog设置,可以直接跳过这一步

  1. [mysqld]
  2. log-bin=mysql-bin #添加这一行就ok
  3. binlog-format=ROW #选择row模式
  4. server_id=1 #配置mysql replaction需要定义,不能和canal的slaveId重复
b. canal的原理是模拟自己为mysql slave,所以这里一定需要做为mysql slave的相关权限.
  1. CREATE USER canal IDENTIFIED BY 'canal';
  2. GRANT SELECT, REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO 'canal'@'%';
  3. -- GRANT ALL PRIVILEGES ON *.* TO 'canal'@'%' ;
  4. FLUSH PRIVILEGES;

针对已有的账户可直接通过grant

其他场景的使用

  1. 下载canal

直接下载
访问:https://github.com/alibaba/canal/releases ,会列出所有历史的发布版本包下载方式,比如以1.0.17版本为例子:

  1. wget https://github.com/alibaba/canal/releases/download/canal-1.0.17/canal.deployer-1.0.17.tar.gz

or

自己编译

  1. git clone git@github.com:alibaba/canal.git
  2. cd canal;
  3. mvn clean install -Dmaven.test.skip -Denv=release

编译完成后,会在根目录下产生target/canal.deployer-$version.tar.gz

  1. 解压缩
  1. mkdir /tmp/canal
  2. tar zxvf canal.deployer-$version.tar.gz -C /tmp/canal

解压完成后,进入/tmp/canal目录,可以看到如下结构:

  1. drwxr-xr-x 2 jianghang jianghang 136 2013-02-05 21:51 bin
  2. drwxr-xr-x 4 jianghang jianghang 160 2013-02-05 21:51 conf
  3. drwxr-xr-x 2 jianghang jianghang 1.3K 2013-02-05 21:51 lib
  4. drwxr-xr-x 2 jianghang jianghang 48 2013-02-05 21:29 logs
  1. 配置修改

应用参数:

  1. vi conf/example/instance.properties
  1. #################################################
  2. ## mysql serverId
  3. canal.instance.mysql.slaveId = 1234
  4.  
  5. #position info,需要改成自己的数据库信息
  6. canal.instance.master.address = 127.0.0.1:3306
  7. canal.instance.master.journal.name =
  8. canal.instance.master.position =
  9. canal.instance.master.timestamp =
  10.  
  11.  
  12. #canal.instance.standby.address =
  13. #canal.instance.standby.journal.name =
  14. #canal.instance.standby.position =
  15. #canal.instance.standby.timestamp =
  16.  
  17.  
  18. #username/password,需要改成自己的数据库信息
  19. canal.instance.dbUsername = canal
  20. canal.instance.dbPassword = canal
  21. canal.instance.defaultDatabaseName =
  22. canal.instance.connectionCharset = UTF-8
  23.  
  24.  
  25. #table regex
  26. canal.instance.filter.regex = ._\.._
  27.  
  28.  
  29. #################################################
  30.  

说明:

  • canal.instance.connectionCharset 代表数据库的编码方式对应到java中的编码类型,比如UTF-8,GBK , ISO-8859-1
  1. 准备启动
  1. sh bin/startup.sh
  1. 查看日志
  1. vi logs/canal/canal.log
  1. 2013-02-05 22:45:27.967 [main] INFO com.alibaba.otter.canal.deployer.CanalLauncher - ## start the canal server.
  2. 2013-02-05 22:45:28.113 [main] INFO com.alibaba.otter.canal.deployer.CanalController - ## start the canal server[10.1.29.120:11111]
  3. 2013-02-05 22:45:28.210 [main] INFO com.alibaba.otter.canal.deployer.CanalLauncher - ## the canal server is running now ......

具体instance的日志:

  1. vi logs/example/example.log
  1. 2013-02-05 22:50:45.636 [main] INFO c.a.o.c.i.spring.support.PropertyPlaceholderConfigurer - Loading properties file from class path resource [canal.properties]
  2. 2013-02-05 22:50:45.641 [main] INFO c.a.o.c.i.spring.support.PropertyPlaceholderConfigurer - Loading properties file from class path resource [example/instance.properties]
  3. 2013-02-05 22:50:45.803 [main] INFO c.a.otter.canal.instance.spring.CanalInstanceWithSpring - start CannalInstance for 1-example
  4. 2013-02-05 22:50:45.810 [main] INFO c.a.otter.canal.instance.spring.CanalInstanceWithSpring - start successful....
  1. 关闭
  1. sh bin/stop.sh

it's over.

原文: https://github.com/alibaba/canal/wiki/QuickStart