当前位置:首页 > 技术 > 正文内容

DataSphere Studio AppConn 部署指南

访客 技术 2026年7月11日 3

一、Exchangis AppConn 部署

参考官方文档:Exchangis AppConn 部署说明Exchangis 服务部署文档

1. 安装 ZooKeeper(单机模式)

tar xf zookeeper-3.5.7.tar.gz -C /mnt/datasphere/
cd /mnt/datasphere/
ln -sv zookeeper-3.5.7/ zookeeper
cd zookeeper/conf
mv zoo_sample.cfg zoo.cfg

vim /etc/profile.d/zookeeper.sh
export ZOOKEEPER_HOME=/mnt/datasphere/zookeeper
export ZOOCFGDIR=/mnt/datasphere/zookeeper/conf
export PATH=$PATH:${ZOOKEEPER_HOME}/bin

. /etc/profile.d/zookeeper.sh
zkServer.sh start
zkServer.sh status
netstat -tnlp | grep 2181

2. 安装 Sqoop

tar xf sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz -C /mnt/datasphere/
mv mysql-connector-java-5.1.27-bin.jar /mnt/datasphere/sqoop/lib/
cd /mnt/datasphere/
ln -sv sqoop-1.4.6.bin__hadoop-2.0.4-alpha/ sqoop

vim /etc/profile.d/sqoop.sh
export PATH=${PATH}:/mnt/datasphere/sqoop/bin/
export SQOOP_HOME=/mnt/datasphere/sqoop

. /etc/profile.d/sqoop.sh

sqoop list-databases --connect jdbc:mysql://192.168.1.134:3306/ --username root -P

3. 部署 Exchangis Server

wget https://osp-1257653870.cos.ap-guangzhou.myqcloud.com/WeDatasphere/Exchangis/exchangis1.0.0/wedatasphere-exchangis-1.0.0.tar.gz
wget https://osp-1257653870.cos.ap-guangzhou.myqcloud.com/WeDatasphere/Exchangis/exchangis1.0.0/exchangis-appconn.zip
wget https://osp-1257653870.cos.ap-guangzhou.myqcloud.com/WeDatasphere/Exchangis/exchangis1.0.0/dist.zip

# 添加认证 token
INSERT INTO `linkis_mg_gateway_auth_token` (
    `token_name`, `legal_users`, `legal_hosts`, `business_owner`,
    `create_time`, `update_time`, `elapse_day`, `update_by`
) VALUES (
    'EXCHANGIS-AUTH', '*', '*', 'BDP',
    curdate(), curdate(), -1, 'LINKIS'
);

# 添加 Hive 数据源配置(替换为实际 IP)
INSERT INTO `linkis_ps_dm_datasource_env` (
    `env_name`, `env_desc`, `datasource_type_id`, `parameter`,
    `create_time`, `create_user`, `modify_time`, `modify_user`
) VALUES (
    '开发环境SIT', '开发环境SIT', 4,
    '{"uris":"thrift://192.168.1.134:3306", "hadoopConf":{"hive.metastore.execute.setugi":"true"}}',
    now(), NULL, now(), NULL
);

INSERT INTO `linkis_ps_dm_datasource_env` (
    `env_name`, `env_desc`, `datasource_type_id`, `parameter`,
    `create_time`, `create_user`, `modify_time`, `modify_user`
) VALUES (
    '开发环境UAT', '开发环境UAT', 4,
    '{"uris":"thrift://192.168.1.134:3306", "hadoopConf":{"hive.metastore.execute.setugi":"true"}}',
    now(), NULL, now(), NULL
);

# 解压并配置
mkdir -p /mnt/datasphere/exchangis-server/
mv wedatasphere-exchangis-1.0.0.tar.gz /mnt/datasphere/exchangis-server/
cd /mnt/datasphere/exchangis-server/
tar xf wedatasphere-exchangis-1.0.0.tar.gz

vim config/config.sh
LINKIS_GATEWAY_HOST=192.168.1.134
LINKIS_GATEWAY_PORT=9001
EXCHANGIS_PORT=9080
EUREKA_URL=http://192.168.1.134:9600/eureka/

vim config/db.sh
MYSQL_HOST=192.168.1.134
MYSQL_PORT=3306
MYSQL_USERNAME=root
MYSQL_PASSWORD=Qwer@123
DATABASE=exchangis

sbin/install.sh
Do you want to initialize database with sql? (Y/N) y

4. 启动服务

sbin/daemon.sh start server

确认服务注册成功,可通过 Eureka 界面验证。

5. 前端部署(Nginx 配置)

vim /etc/nginx/conf.d/exchangis.conf
server {
    listen       10001;
    server_name  localhost;
    location / {
        root   /appcom/Install/exchangis;
        autoindex on;
    }
    location /api {
        proxy_pass http://192.168.1.134:9001;
        proxy_set_header Host $host;
        proxy_set_header X-Real-IP $remote_addr;
        proxy_set_header x_real_ipP $remote_addr;
        proxy_set_header remote_addr $remote_addr;
        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        proxy_http_version 1.1;
        proxy_connect_timeout 4s;
        proxy_read_timeout 600s;
        proxy_send_timeout 12s;
        proxy_set_header Upgrade $http_upgrade;
        proxy_set_header Connection upgrade;
    }
    error_page 500 502 503 504 /50x.html;
    location = /50x.html {
        root /usr/share/nginx/html;
    }
}

nginx -t
nginx -s reload

mkdir -p /appcom/Install/exchangis
unzip dist.zip
mv dist/* /appcom/Install/exchangis

访问地址: http://192.168.1.134:10001/#/projectManage

6. 安装 AppConn

mv exchangis-appconn.zip /mnt/datasphere/dss_linkis_one-click_install_20221201/dss/dss-appconns/
cd /mnt/datasphere/dss_linkis_one-click_install_20221201/dss/dss-appconns/
unzip exchangis-appconn.zip
cd ../bin/
./appconn-install.sh

# 输入:
# 名称:exchangis
# 服务地址:192.168.1.134
# 端口:10001(前端端口)

cd ../sbin/
sh dss-stop-all.sh
sh dss-start-all.sh

7. 验证

  • 创建新项目 test2
  • 刷新 Exchangis 前端页面,确认项目已同步

二、Visualis AppConn 部署

参考文档:Visualis 部署指南AppConn 安装说明

1. 安装 Maven

tar xf apache-maven-3.6.3-bin.tar.gz -C /mnt/datasphere/
ln -sv apache-maven-3.6.3 maven
vim /etc/profile.d/maven.sh
export MAVEN_HOME=/mnt/datasphere/maven
export PATH=$PATH:$MAVEN_HOME/bin
. /etc/profile.d/maven.sh
mvn -v

2. 安装 Node.js & npm

wget --no-check-certificate https://npm.taobao.org/mirrors/node/v16.13.0/node-v16.13.0-linux-x64.tar.gz
tar xf node-v16.13.0-linux-x64.tar.gz -C /mnt/datasphere/
rm -f /usr/local/bin/node /usr/local/bin/npm
ln -sv /mnt/datasphere/node-v16.13.0-linux-x64/bin/node /usr/local/bin/node
ln -sv /mnt/datasphere/node-v16.13.0-linux-x64/bin/npm /usr/local/bin/npm
node -v
npm -v

3. 编译后端

git clone https://github.com/WeBankFinTech/Visualis.git
cd Visualis
git checkout 1.0.0
mvn clean package -DskipTests=true
mv assembly/target/visualis-server.zip /mnt/datasphere/

4. 编译前端

cd webapp
vim package-lock.json-bak
g/"resolved".*/d  # 删除 resolved 行

npm i --registry https://registry.npm.taobao.org
npm run build --registry https://registry.npm.taobao.org
# 卡住后无报错则中断,build 目录即为前端资源
mkdir -p /appcom/Install/visualis/dss/visualis
mv build/* /appcom/Install/visualis/dss/visualis

5. 编译组件包

cd visualis-appconn
mvn clean package -DskipTests=true
mv visualis-appconn/target/visualis.zip /mnt/datasphere/dss_linkis_one-click_install_20221201/dss/dss-appconns/

6. 初始化数据库

mysql -uroot -h 192.168.1.134 -p
CREATE DATABASE visualis DEFAULT CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci;
USE visualis;
SOURCE /home/hadoop/Visualis/db/davinci.sql;
SOURCE /home/hadoop/Visualis/db/ddl.sql;

7. 安装字体库

sudo yum -y install fontconfig-devel
sudo mkdir -p /usr/share/fonts/visualis
sudo mv /home/hadoop/Visualis/ext/pf.ttf /usr/share/fonts/visualis

8. Nginx 前端配置

vim /etc/nginx/conf.d/dss.conf
location /dss/visualis {
    root /appcom/Install/visualis;
    autoindex on;
}
nginx -t
nginx -s reload

9. 后端配置与启动

cd /mnt/datasphere/
unzip visualis-server.zip
cd visualis-server/conf

vim application.yml
server:
  address: 192.168.1.134
  port: 9018
  url: http://192.168.1.134:8085/dss/visualis

eureka:
  defaultZone: http://192.168.1.134:9600/eureka/

spring:
  datasource:
    url: jdbc:mysql://192.168.1.134:3306/visualis?characterEncoding=UTF-8&allowMultiQueries=true
    username: root
    password: Qwer@123

vim linkis.properties
wds.linkis.gateway.url=http://192.168.1.134:9001

cd ../bin/
sh start-visualis-server.sh
less logs/linkis.out

10. 安装 AppConn

cd /mnt/datasphere/dss_linkis_one-click_install_20221201/dss/dss-appconns/
unzip visualis.zip
cd ../bin/
sh appconn-install.sh

# 输入:
# 名称:visualis
# 前端地址:192.168.1.134
# 前端端口:8085

sh dss-stop-all.sh
sh dss-start-all.sh

11. 注意事项

在 Visualis 未部署前创建的项目中拖拽节点会提示"project is not found"。建议在部署完成后新建项目。

三、Streamis AppConn 部署

依赖参考:Linkis 编译文档

1. 安装 Scala

wget https://downloads.lightbend.com/scala/2.11.2/scala-2.11.2.tgz
tar xf scala-2.11.2.tgz -C /mnt/datasphere/
ln -sv scala-2.11.12 scala

vim /etc/profile.d/scala.sh
export SCALA_HOME=/mnt/datasphere/scala
export PATH=$PATH:$SCALA_HOME/bin
. /etc/profile.d/scala.sh

2. 安装 Flink

wget https://archive.apache.org/dist/flink/flink-1.12.2/flink-1.12.2-bin-scala_2.12.tgz
tar xf flink-1.12.2-bin-scala_2.12.tgz -C /mnt/datasphere/
ln -sv flink-1.12.2 flink

vim /etc/profile.d/flink.sh
export FLINK_HOME=/mnt/datasphere/flink
export FLINK_CONF_DIR=${FLINK_HOME}/conf/
export PATH=$PATH:${FLINK_HOME}/bin
. /etc/profile.d/flink.sh

3. 编译 Flink 引擎插件

git clone https://github.com/apache/linkis.git
cd linkis
git checkout release-1.1.1
vim pom.xml
# 注释 <scope>test</scope>

mvn -N install
mvn clean install -DskipTests
cd linkis-engineconn-plugins/engineconn-plugins/flink
mvn clean install
cp -r target/out/flink /mnt/datasphere/dss_linkis_one-click_install_20221201/linkis/lib/linkis-engineconn-plugins
chown -R hadoop:hadoop /mnt/datasphere

4. 添加引擎标签

mysql -uroot -D dss -p
SET @FLINK_LABEL="flink-1.12.2";
SET @FLINK_ALL=CONCAT('*-*,', @FLINK_LABEL);
SET @FLINK_IDE=CONCAT('*-IDE,', @FLINK_LABEL);

INSERT INTO `linkis_cg_manager_label` (`label_key`, `label_value`, `label_feature`, `label_value_size`, `update_time`, `create_time`)
VALUES ('combined_userCreator_engineType', @FLINK_ALL, 'OPTIONAL', 2, NOW(), NOW());

INSERT INTO `linkis_cg_manager_label` (`label_key`, `label_value`, `label_feature`, `label_value_size`, `update_time`, `create_time`)
VALUES ('combined_userCreator_engineType', @FLINK_IDE, 'OPTIONAL', 2, NOW(), NOW());

SELECT @label_id := id FROM linkis_cg_manager_label WHERE label_value = @FLINK_IDE;
INSERT INTO linkis_ps_configuration_category (label_id, level) VALUES (@label_id, 2);

INSERT INTO `linkis_ps_configuration_config_key` (`key`, `description`, `name`, `default_value`, `validate_type`, `validate_range`, `engine_conn_type`, `is_hidden`, `is_advanced`, `level`, `treeName`)
VALUES ('linkis.flink.url', '例如: http://127.0.0.1:8080', '连接地址', 'http://127.0.0.1:8080', 'Regex', '^\\s*http://([^:]+)(:\\d+)(/[^\\?]+)?(\\?\\S*)?$', 'flink', 0, 0, 1, '数据源配置');

INSERT INTO `linkis_ps_configuration_config_key` (`key`, `description`, `name`, `default_value`, `validate_type`, `validate_range`, `engine_conn_type`, `is_hidden`, `is_advanced`, `level`, `treeName`)
VALUES ('linkis.flink.catalog', 'catalog', 'catalog', 'system', 'None', '', 'flink', 0, 0, 1, '数据源配置');

INSERT INTO `linkis_ps_configuration_config_key` (`key`, `description`, `name`, `default_value`, `validate_type`, `validate_range`, `engine_conn_type`, `is_hidden`, `is_advanced`, `level`, `treeName`)
VALUES ('linkis.flink.source', 'source', 'source', 'global', 'None', '', 'flink', 0, 0, 1, '数据源配置');

INSERT INTO `linkis_ps_configuration_key_engine_relation` (`config_key_id`, `engine_type_label_id`)
SELECT c.id AS config_key_id, l.id AS engine_type_label_id
FROM linkis_ps_configuration_config_key c
JOIN linkis_cg_manager_label l ON c.engine_conn_type = 'flink' AND l.label_value = @FLINK_ALL;

INSERT INTO `linkis_ps_configuration_config_value` (`config_key_id`, `config_value`, `config_label_id`)
SELECT r.config_key_id, '', r.engine_type_label_id
FROM linkis_ps_configuration_key_engine_relation r
JOIN linkis_cg_manager_label l ON r.engine_type_label_id = l.id AND l.label_value = @FLINK_ALL;

exit

5. 刷新引擎目录

su - hadoop
cd /mnt/datasphere/dss_linkis_one-click_install_20221201/linkis/sbin/
sh linkis-daemon.sh restart cg-engineplugin

mysql -uroot -D dss -p
SELECT * FROM linkis_cg_engine_conn_plugin_bml_resources; -- 检查是否加载成功

6. Streamis 后端部署

mysql -uroot -p
CREATE DATABASE streamis DEFAULT CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci;

wget https://osp-1257653870.cos.ap-guangzhou.myqcloud.com/WeDatasphere/Streamis/0.2.0/wedatasphere-streamis-0.2.0-dist.tar.gz
mkdir /mnt/datasphere/streamis
mv wedatasphere-streamis-0.2.0-dist.tar.gz /mnt/datasphere/streamis/
cd /mnt/datasphere/streamis/
tar xf wedatasphere-streamis-0.2.0-dist.tar.gz

vim conf/db.sh
MYSQL_HOST=192.168.1.134
MYSQL_PORT=3306
MYSQL_DB=streamis
MYSQL_USER=root
MYSQL_PASSWORD=Qwer@123

vim conf/config.sh
STREAMIS_PORT=9400
STREAMIS_INSTALL_HOME=/mnt/datasphere/streamis
EUREKA_INSTALL_IP=192.168.1.134
GATEWAY_INSTALL_IP=192.168.1.134
STREAMIS_SERVER_INSTALL_IP=192.168.1.134
STREAMIS_SERVER_INSTALL_PORT=9400

sh bin/install.sh
sh bin/start.sh
netstat -tnlp | grep 9400

7. 前端部署

wget https://osp-1257653870.cos.ap-guangzhou.myqcloud.com/WeDatasphere/Streamis/0.2.0/streamis-0.2.0-dist.zip
unzip -q streamis-0.2.0-dist.zip
mkdir /appcom/Install/streamis
mv dist/* /appcom/Install/streamis

vim /etc/nginx/conf.d/dss.conf
location / {
    root /appcom/Install/streamis;
    index index.html;
}
location /api {
    proxy_pass http://192.168.1.134:9001;
    proxy_set_header Host $host;
    proxy_set_header X-Real-IP $remote_addr;
    proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
    proxy_http_version 1.1;
    proxy_connect_timeout 4s;
    proxy_read_timeout 600s;
    proxy_send_timeout 12s;
    proxy_set_header Upgrade $http_upgrade;
    proxy_set_header Connection upgrade;
}

nginx -t
nginx -s reload

8. 修改 MySQL SQL Mode

vim /etc/my.cnf
sql_mode=STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION

systemctl restart mysqld

9. 安装 AppConn 插件

wget https://github.com/WeBankFinTech/Streamis/archive/refs/tags/0.2.0.tar.gz
tar xf 0.2.0.tar.gz
cd Streamis-0.2.0
cd streamis-appconn
mvn clean install
cp target/streamis.zip /mnt/datasphere/dss_linkis_one-click_install_20221201/dss/dss-appconns/
cd /mnt/datasphere/dss_linkis_one-click_install_20221201/dss/dss-appconns/
unzip streamis.zip

cd ../bin/
sh appconn-install.sh

# 输入:
# name: streamis
# host: 192.168.1.134
# port: 10002(前端端口)

cd ../sbin/
sh dss-stop-all.sh
sh dss-start-all.sh

10. 验证

  • 在控制台创建项目
  • 查询是否同步生成: SELECT * FROM linkis_stream_project WHERE name = '项目名称';

四、DolphinScheduler AppConn 部署

参考文档:Standalone 部署指南DSS 插件安装文档

1. 安装依赖

yum install psmisc -y

2. 创建数据库

mysql -uroot -p
CREATE DATABASE dolphinscheduler DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;

3. 下载 JDBC 驱动

Maven Central 下载,版本不低于 5.1.47。

4. 下载并解压 DolphinScheduler

wget https://archive.apache.org/dist/dolphinscheduler/1.3.9/apache-dolphinscheduler-1.3.9-bin.tar.gz
tar xf apache-dolphinscheduler-1.3.9-bin.tar.gz
mv mysql-connector-java-5.1.47.jar apache-dolphinscheduler-1.3.9-bin/lib/
cd apache-dolphinscheduler-1.3.9-bin

5. 配置文件修改

vi conf/datasource.properties
spring.datasource.driver-class-name=com.mysql.jdbc.Driver
spring.datasource.url=jdbc:mysql://192.168.1.134:3306/dolphinscheduler?useUnicode=true&characterEncoding=UTF-8
spring.datasource.username=root
spring.datasource.password=Qwer@123

sh script/create-dolphinscheduler.sh

vim conf/env/dolphinscheduler_env.sh
export JAVA_HOME=/usr/local/java
export HADOOP_HOME=/mnt/datasphere/hadoop
export SPARK_HOME=/mnt/datasphere/spark
export HIVE_HOME=/mnt/datasphere/hive
export FLINK_HOME=/mnt/datasphere/flink
export PATH=$HADOOP_HOME/bin:$SPARK_HOME/bin:$PYTHON_HOME/bin:$JAVA_HOME/bin:$HIVE_HOME/bin:$FLINK_HOME/bin:$PATH

sudo ln -sv /usr/local/java/bin/java /usr/bin/java

vim conf/config/install_config.conf
dbtype="mysql"
dbhost="192.168.1.134:3306"
username="root"
dbname="dolphinscheduler"
password="Qwer@123"
zkQuorum="192.168.1.134:2181"
installPath="/mnt/datasphere/dolphinscheduler"
deployUser="hadoop"
mailServerHost="smtp.exmail.qq.com"
mailServerPort="25"
mailSender="xxxxxxxxxx"
mailUser="xxxxxxxxxx"
mailPassword="xxxxxxxxxx"
starttlsEnable="true"
sslEnable="false"
sslTrust="smtp.exmail.qq.com"
dataBasedirPath="/tmp/dolphinscheduler"
resourceStorageType="HDFS"
resourceUploadPath="/data/dolphinscheduler"
defaultFS="file:///data/dolphinscheduler"
resourceManagerHttpAddressPort="8088"
singleYarnIp="192.168.1.134"
hdfsRootUser="hadoop"
kerberosStartUp="false"
krb5ConfPath="$installPath/conf/krb5.conf"
keytabUserName="hdfs-mycluster@ESZ.COM"
keytabPath="$installPath/conf/hdfs.headless.keytab"
kerberosExpireTime="2"
apiServerPort="12345"
ips="localhost"
sshPort="22"
masters="localhost"
workers="localhost::default"
alertServer="localhost"
apiServers="localhost"

sudo mkdir -p /data/dolphinscheduler
sudo chown -R hadoop:hadoop /data/dolphinscheduler

6. 启动服务

sh install.sh
jps | egrep 'MasterServer|WorkerServer|LoggerServer|ApiApplicationServer|AlertServer'
ll /mnt/datasphere/dolphinscheduler/logs/

访问地址:http://192.168.1.134:12345,默认账号:admin / dolphinscheduler123

7. 安装 AppConn

wget https://osp-1257653870.cos.ap-guangzhou.myqcloud.com/WeDatasphere/DolphinScheduler/DSS1.1.1_dolphinscheduler/dolphinscheduler-appconn.zip
mv dolphinscheduler-appconn.zip /mnt/datasphere/dss_linkis_one-click_install_20221201/dss/dss-appconns/
cd /mnt/datasphere/dss_linkis_one-click_install_20221201/dss/dss-appconns/
unzip dolphinscheduler-appconn.zip

vim dolphinscheduler/appconn.properties
wds.dss.appconn.ds.admin.user=admin
wds.dss.appconn.ds.admin.token=b245a4931ccbf58850f67ed202fc6eb7
wds.dss.appconn.ds.version=1.3.9
wds.dss.appconn.ds.client.home=/mnt/datasphere/dolphinscheduler-client

cd ../bin/
sh install-appconn.sh

# 输入:
# name: dolphinscheduler
# host: 192.168.1.134
# port: 8085(Nginx 端口)

8. 替换 JAR 包

wget https://osp-1257653870.cos.ap-guangzhou.myqcloud.com/WeDatasphere/DolphinScheduler/DSS1.1.1_dolphinscheduler/dss-dolphinscheduler-token-1.1.1.jar
mv dss-dolphinscheduler-token-1.1.1.jar /mnt/datasphere/dss_linkis_one-click_install_20221201/dss/lib/dss-framework/dss-framework-project-server/
sh sbin/dss-daemon.sh restart project-server

wget https://osp-1257653870.cos.ap-guangzhou.myqcloud.com/WeDatasphere/DolphinScheduler/DSS1.1.1_dolphinscheduler/dolphinscheduler-prod-metrics-1.1.1-jar-with-dependencies.jar
mv dolphinscheduler-prod-metrics-1.1.1-jar-with-dependencies.jar /mnt/datasphere/dolphinscheduler/lib/
cd /mnt/datasphere/dolphinscheduler/
sh bin/stop-all.sh
sh bin/start-all.sh

9. Nginx 转发配置

vim /etc/nginx/conf.d/dss.conf
location /dolphinscheduler {
    proxy_pass http://192.168.1.134:12345;
    proxy_http_version 1.1;
    proxy_set_header Upgrade $http_upgrade;
    proxy_set_header Connection upgrade;
}

nginx -t
nginx -s reload

10. 设置调度中心 URL

vim /mnt/datasphere/dss_linkis_one-click_install_20221201/dss/conf/dss-workflow-server.properties
wds.dss.workflow.schedulerCenter.url=http://192.168.1.134:8085/dolphinscheduler

sh sbin/dss-daemon.sh restart workflow-server

11. 部署客户端

wget https://osp-1257653870.cos.ap-guangzhou.myqcloud.com/WeDatasphere/DolphinScheduler/DSS1.1.1_dolphinscheduler/dss-dolphinscheduler-client.zip
unzip dss-dolphinscheduler-client.zip
mv dss-dolphinscheduler-client /mnt/datasphere/dolphinscheduler-client

cd /mnt/datasphere/dolphinscheduler-client
vim conf/linkis.properties
wds.linkis.gateway.url=192.168.1.134:9001

12. 验证

  • 创建新工作空间(旧空间不可见)
  • 测试免密登录(需在 DolphinScheduler 中登录过)

五、Qualitis AppConn 部署

1. 编译 Qualitis

cd /mnt/datasphere/
wget https://services.gradle.org/distributions/gradle-4.6-bin.zip
unzip -q gradle-4.6-bin.zip
ln -sv gradle-4.6 gradle
vim ~/.bashrc
export PATH="/mnt/datasphere/gradle/bin/:$PATH"
. ~/.bashrc
gradle -v

wget https://github.com/WeBankFinTech/Qualitis/archive/refs/tags/release-0.9.2.zip
wget https://github.com/WeBankFinTech/Qualitis/releases/download/release-0.9.1/forgerock.zip
unzip -q forgerock.zip
mv forgerock ~/.m2/repository/org/
unzip -q release-0.9.2.zip
cd Qualitis-release-0.9.2
gradle clean distZip

2. 初始化数据库

cd build/distributions
unzip -q qualitis-0.9.2.zip
cd qualitis-0.9.2

mysql -uroot -h 192.168.1.134 -p --default-character-set=utf8
CREATE DATABASE qualitis DEFAULT CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci;
USE qualitis;
SOURCE conf/database/init.sql;
EXIT;

3. 配置服务

vim conf/application-dev.yml
server:
  port: 8100
spring:
  datasource:
    url: jdbc:mysql://192.168.1.134:3306/qualitis?createDatabaseIfNotExist=true&useUnicode=true&characterEncoding=utf-8
    username: root
    password: Qwer@123

task:
  persistent:
    type: jdbc
    address: jdbc:mysql://192.168.1.134:3306/qualitis?createDatabaseIfNotExist=true&useUnicode=true&characterEncoding=utf-8
    username: root
    password: Qwer@123

zk:
  address: 192.168.1.134:2181

front_end:
  home_page: http://192.168.1.134:8100/#/dashboard
  domain_name: http://192.168.1.134:8100

cp mysql-connector-java-5.1.27-bin.jar /mnt/datasphere/spark/jars/

4. 启动服务

dos2unix bin/*
sh bin/start.sh

访问:http://192.168.1.134:8100/#/home,账号:admin,密码:admin

5. 系统配置

填写系统参数,包括邮箱、权限等。

6. 安装 AppConn

git clone https://github.com/WeBankFinTech/Qualitis.git
cd Qualitis/appconn
mvn clean install
mv target/out/qualitis /mnt/datasphere/dss_linkis_one-click_install_20221201/dss/dss-appconns/
cd /mnt/datasphere/dss_linkis_one-click_install_20221201/dss/dss-appconns/
chmod -R 777 qualitis/
cd ../bin/
sh appconn-install.sh

# 输入:
# name: qualitis
# host: 192.168.1.134
# port: 8100

cd ../sbin/
sh dss-stop-all.sh
sh dss-start-all.sh

7. 验证

  • 创建工作空间
  • 测试自动跳转与免密登录

相关文章

Linux crontab 详解

1) crontab 是什么cron 是 Linux 的定时任务守护进程;crontab 是用来编辑/查看“按时间周期执行命令”的表(cron table)。常见两类:用户 crontab:每个用户一份(crontab -e 编辑)系统级 crontab / cron.d:可指定执行用户(/etc/crontab、/etc/cron.d/*)2) crontab 时间...

Mac 安装 Node.js 指南

方法一:通过官网安装包(最简单,适合初学者)如果你只是想快速安装并开始使用,这是最直接的方法。访问 Node.js 官网。页面会显示两个版本:LTS (Recommended For Most Users):长期支持版,最稳定。建议选这个。Current:最新特性版,包含最新功能但可能不够稳定。下载 .pkg 安装包并运行。按照安装向导点击“下一步”即可完成。方法二:使用 Homebrew 安装(...

Dom\HTML_NO_DEFAULT_NS 的副作用:自动加闭合标签

在使用Dom\HTMLDocument时,Dom\HTML_NO_DEFAULT_NS 将禁止在解析过程中设置元素的命名空间, 此设置是为了与DOMDocument向后兼容而存在的。当使用它时,已知的一个副作用就是:自动加闭合标签例如 </img> 为什么会这样?当你使用:Dom\HTML_NO_DEFAULT_NS文档会变成 无命名空间模式,此时内部更接近 XML...

Laravel 事件和监听器创建

在 Laravel 中,使用 Artisan 命令创建 Events(事件) 和 Listeners(监听器) 是非常高效的。你可以通过以下几种方式来实现:1. 手动创建单个 Event如果你只想创建一个事件类,可以使用 make:event 命令:Bashphp artisan make:event UserRegistered执行后,文件将生成在 app/Even...

自定义域名解析神器 dnsmasq

什么是 dnsmasq?dnsmasq 是一个轻量级、功能强大的网络服务工具,专为小型和中等规模网络设计。它是一个综合的网络基础设施解决方案[1]。dnsmasq 能做什么?功能说明应用场景DNS 转发与缓存将 DNS 查询转发到上游服务器(ISP、Google DNS 等),并在本地缓存结果加快 DNS 查询速度,减少外部 DNS 流量本地 DNS解析本地网络设备的主机名,无需编辑&n...

linux screen 用法详情 (nohup 的替代方案)

一、screen 是什么?能干嘛?screen 是一个终端复用器,可以:在一个 SSH 会话中开多个“虚拟终端”SSH 断线后,程序仍然在后台运行随时重新连接到原来的会话特别适合:nohup 的替代方案跑脚本 / 爬虫 / 训练模型运维、远程开发二、安装 screen# CentOS / Rocky / Almayum install -y screen# Debian / Ubuntuapt i...

发表评论

访客

◎欢迎参与讨论,请在这里发表您的看法和观点。