抱歉,您的浏览器无法访问本站

本页面需要浏览器支持(启用)JavaScript


了解详情 >

What’s your daily personal growth secret?

1. IDEA-2021.3.2

2. jdk-8u201-macosx-x64

~/.zprofile
1
2
3
4
5
6
7
MS=/usr/local/xsoft

JAVA_HOME=$MS/jdk/Contents/Home
JAVA_BIN=$JAVA_HOME/bin
PATH=$JAVA_HOME/bin:$PATH
CLASSPATH=.:$JAVA_HOME/jre/lib/rt.jar:$JAVA_HOME/jre/lib/dt.jar:$JAVA_HOME/jre/lib/tools.jar
export JAVA_HOME JAVA_BIN PATH CLASSPATH
1
2
3
4
➜ java -version
java version "1.8.0_144"
Java(TM) SE Runtime Environment (build 1.8.0_144-b01)
Java HotSpot(TM) 64-Bit Server VM (build 25.144-b01, mixed mode)

3. apache-maven

apache-maven-3.8.4-bin.tar.gz

1
2
3
4
5
6
7
8
9
10
11
12
cd /usr/local/xsoft                   
tar -zxvf apache-maven-3.8.4-bin.tar.gz
ln -s /usr/local/xsoft/software/apache-maven-3.8.5 maven

vim ~/.zprofile

M2_HOME=/usr/local/xsoft/maven
MAVEN_HOME=$M2_HOME
M3_HOME=$M2_HOME
PATH=$M3_HOME/bin:$PATH
#MAVEN_OPTS="-Xms128m -Xmx512m"
export MAVEN_HOME M2_HOME PATH
1
2
3
4
5
6
mvn -version
Apache Maven 3.8.4 (9b656c72d54e5bacbed989b64718c159fe39b537)
Maven home: /XXX/soft/maven
Java version: 1.8.0_201, vendor: Oracle Corporation, runtime: /Library/Internet Plug-Ins/JavaAppletPlugin.plugin/Contents/Home
Default locale: zh_CN, platform encoding: UTF-8
OS name: "mac os x", version: "10.16", arch: "x86_64", family: "mac"

4. spark src-code import

https://github.com/apache/spark

5. antlr,scala plugin install

装完后重启生效

。。。

10. source-code compile

在spark源码包下:

1
mvn clean package  -Phive -Phive-thriftserver -Pyarn -DskipTests