mac搭建hadoop、hive、spark、flink环境

1 mysql

启动mysql

brew services start mysql

abc.ABC.123

2 集群搭建

1. mac osx 搭建hadoop开发环境
2. spark on yarn
3. hive环境搭建

按照上面文章的方式搭建，启动hdfs、yarn

必须使用这个命令

## 启动yarn
hadoop/sbin/./yarn-daemon.sh start resourcemanager
hadoop/sbin./yarn-daemon.sh start nodemanager
## 启动hdfs
hadoop/sbin/start-hdfs.sh

hdfs-web
yarn-web

2.1 hive

create user ‘hadoop‘@’%’ identified by ‘hadoop%HADOOP%123’;

grant all privileges on . to ‘hadoop‘@’%’ with grant option;

flush privileges;

2.2 flink on yarn

flink on yarn部署

在flink lib下增加flink-hadoop兼容包Pre-bundled Hadoop 2.7.5

# 启动
bin/start-cluster.sh

2.3 搭建AthenaX

Building AthenaX and Flink