Skip to content
项目
群组
代码片段
帮助
当前项目
正在载入...
登录 / 注册
切换导航面板
S
seatunnel-web
项目
项目
详情
活动
周期分析
仓库
仓库
文件
提交
分支
标签
贡献者
图表
比较
统计图
议题
0
议题
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
CI / CD
CI / CD
流水线
作业
日程
统计图
Wiki
Wiki
代码片段
代码片段
成员
成员
折叠边栏
关闭边栏
活动
图像
聊天
创建新问题
作业
提交
问题看板
Open sidebar
宋勇
seatunnel-web
Commits
da025db5
提交
da025db5
authored
12月 07, 2023
作者:
李纤
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
修改minio连接
上级
c7a8f3b2
隐藏空白字符变更
内嵌
并排
正在显示
8 个修改的文件
包含
39 行增加
和
51 行删除
+39
-51
InitCallback.java
...apache/seatunnel/datasource/plugin/mqtt/InitCallback.java
+1
-2
MqttClientService.java
...e/seatunnel/datasource/plugin/mqtt/MqttClientService.java
+8
-3
MqttDataSourceChannel.java
...atunnel/datasource/plugin/mqtt/MqttDataSourceChannel.java
+12
-9
MqttDataSourceFactory.java
...atunnel/datasource/plugin/mqtt/MqttDataSourceFactory.java
+2
-3
HadoopS3AConfiguration.java
...eatunnel/datasource/plugin/s3/HadoopS3AConfiguration.java
+2
-4
S3ClientService.java
...pache/seatunnel/datasource/plugin/s3/S3ClientService.java
+11
-18
S3DataSourceFactory.java
...e/seatunnel/datasource/plugin/s3/S3DataSourceFactory.java
+2
-3
S3DatasourceChannel.java
...e/seatunnel/datasource/plugin/s3/S3DatasourceChannel.java
+1
-9
没有找到文件。
seatunnel-datasource/seatunnel-datasource-plugins/datasource-mqtt/src/main/java/org/apache/seatunnel/datasource/plugin/mqtt/InitCallback.java
浏览文件 @
da025db5
package
org
.
apache
.
seatunnel
.
datasource
.
plugin
.
mqtt
;
import
lombok.extern.slf4j.Slf4j
;
import
org.eclipse.paho.client.mqttv3.IMqttDeliveryToken
;
import
org.eclipse.paho.client.mqttv3.MqttCallback
;
import
org.eclipse.paho.client.mqttv3.MqttMessage
;
import
lombok.extern.slf4j.Slf4j
;
import
java.util.ArrayList
;
import
java.util.List
;
...
...
seatunnel-datasource/seatunnel-datasource-plugins/datasource-mqtt/src/main/java/org/apache/seatunnel/datasource/plugin/mqtt/MqttClientService.java
浏览文件 @
da025db5
package
org
.
apache
.
seatunnel
.
datasource
.
plugin
.
mqtt
;
import
org.eclipse.paho.client.mqttv3.*
;
import
org.eclipse.paho.client.mqttv3.persist.MemoryPersistence
;
import
lombok.Data
;
import
org.eclipse.paho.client.mqttv3.MqttCallback
;
import
org.eclipse.paho.client.mqttv3.MqttClient
;
import
org.eclipse.paho.client.mqttv3.MqttConnectOptions
;
import
org.eclipse.paho.client.mqttv3.MqttDeliveryToken
;
import
org.eclipse.paho.client.mqttv3.MqttException
;
import
org.eclipse.paho.client.mqttv3.MqttMessage
;
import
org.eclipse.paho.client.mqttv3.MqttTopic
;
import
org.eclipse.paho.client.mqttv3.persist.MemoryPersistence
;
/** @Author Heartsuit @Date 2022-12-11 */
@Data
...
...
seatunnel-datasource/seatunnel-datasource-plugins/datasource-mqtt/src/main/java/org/apache/seatunnel/datasource/plugin/mqtt/MqttDataSourceChannel.java
浏览文件 @
da025db5
...
...
@@ -17,23 +17,26 @@
package
org
.
apache
.
seatunnel
.
datasource
.
plugin
.
mqtt
;
import
com.alibaba.fastjson2.JSONObject
;
import
lombok.NonNull
;
import
lombok.extern.slf4j.Slf4j
;
import
org.apache.commons.collections4.CollectionUtils
;
import
org.apache.commons.lang3.StringUtils
;
import
org.apache.seatunnel.api.configuration.util.OptionRule
;
import
org.apache.seatunnel.common.utils.SeaTunnelException
;
import
org.apache.seatunnel.datasource.plugin.api.DataSourceChannel
;
import
org.apache.seatunnel.datasource.plugin.api.DataSourcePluginException
;
import
org.apache.seatunnel.datasource.plugin.api.model.TableField
;
import
org.apache.commons.collections4.CollectionUtils
;
import
org.apache.commons.lang3.StringUtils
;
import
org.eclipse.paho.client.mqttv3.MqttClient
;
import
org.eclipse.paho.client.mqttv3.MqttMessage
;
import
com.alibaba.fastjson2.JSONObject
;
import
lombok.NonNull
;
import
lombok.extern.slf4j.Slf4j
;
import
java.util.*
;
import
java.util.ArrayList
;
import
java.util.Arrays
;
import
java.util.Collections
;
import
java.util.HashMap
;
import
java.util.Iterator
;
import
java.util.List
;
import
java.util.Map
;
@Slf4j
public
class
MqttDataSourceChannel
implements
DataSourceChannel
{
...
...
seatunnel-datasource/seatunnel-datasource-plugins/datasource-mqtt/src/main/java/org/apache/seatunnel/datasource/plugin/mqtt/MqttDataSourceFactory.java
浏览文件 @
da025db5
...
...
@@ -17,14 +17,13 @@
package
org
.
apache
.
seatunnel
.
datasource
.
plugin
.
mqtt
;
import
com.google.auto.service.AutoService
;
import
com.google.common.collect.Sets
;
import
org.apache.seatunnel.datasource.plugin.api.DataSourceChannel
;
import
org.apache.seatunnel.datasource.plugin.api.DataSourceFactory
;
import
org.apache.seatunnel.datasource.plugin.api.DataSourcePluginInfo
;
import
org.apache.seatunnel.datasource.plugin.api.DatasourcePluginTypeEnum
;
import
com.google.auto.service.AutoService
;
import
com.google.common.collect.Sets
;
import
java.util.Set
;
@AutoService
(
DataSourceFactory
.
class
)
...
...
seatunnel-datasource/seatunnel-datasource-plugins/datasource-s3/src/main/java/org/apache/seatunnel/datasource/plugin/s3/HadoopS3AConfiguration.java
浏览文件 @
da025db5
...
...
@@ -17,13 +17,11 @@
package
org
.
apache
.
seatunnel
.
datasource
.
plugin
.
s3
;
import
lombok.extern.slf4j.Slf4j
;
import
org.apache.hadoop.conf.Configuration
;
import
org.apache.seatunnel.shade.com.typesafe.config.Config
;
import
org.apache.seatunnel.shade.com.typesafe.config.ConfigFactory
;
import
org.apache.hadoop.conf.Configuration
;
import
lombok.extern.slf4j.Slf4j
;
import
java.util.Map
;
@Slf4j
...
...
seatunnel-datasource/seatunnel-datasource-plugins/datasource-s3/src/main/java/org/apache/seatunnel/datasource/plugin/s3/S3ClientService.java
浏览文件 @
da025db5
package
org
.
apache
.
seatunnel
.
datasource
.
plugin
.
s3
;
import
com.amazonaws.services.dynamodbv2.xspec.S
;
import
io.minio.MinioClient
;
import
io.minio.errors.MinioException
;
...
...
@@ -12,12 +11,10 @@ public class S3ClientService {
private
String
BUCKET
;
private
Integer
PORT
;
private
final
String
clientId
=
"Client"
+
(
int
)
(
Math
.
random
()
*
100000000
);
private
MinioClient
minioClient
;
private
String
TOPIC
;
public
S3ClientService
(
String
endpoint
,
String
provider
,
...
...
@@ -34,11 +31,16 @@ public class S3ClientService {
setMinioClient
(
endpoint
,
provider
,
username
,
password
,
bucket
,
port
);
}
public
MinioClient
getMinioClient
()
{
return
minioClient
;
}
/**
*
* @param endpoint
* @param provider
* @param username
* @param password
* @param bucket
* @param port
* @throws MinioException
*/
public
void
setMinioClient
(
String
endpoint
,
String
provider
,
...
...
@@ -50,13 +52,4 @@ public class S3ClientService {
.
build
();
}
//
// /** 关闭MQTT连接 */
// public void close() throws MqttException {
// mqttClient.close();
// mqttClient.disconnect();
// }
}
seatunnel-datasource/seatunnel-datasource-plugins/datasource-s3/src/main/java/org/apache/seatunnel/datasource/plugin/s3/S3DataSourceFactory.java
浏览文件 @
da025db5
...
...
@@ -17,14 +17,13 @@
package
org
.
apache
.
seatunnel
.
datasource
.
plugin
.
s3
;
import
com.google.auto.service.AutoService
;
import
com.google.common.collect.Sets
;
import
org.apache.seatunnel.datasource.plugin.api.DataSourceChannel
;
import
org.apache.seatunnel.datasource.plugin.api.DataSourceFactory
;
import
org.apache.seatunnel.datasource.plugin.api.DataSourcePluginInfo
;
import
org.apache.seatunnel.datasource.plugin.api.DatasourcePluginTypeEnum
;
import
com.google.auto.service.AutoService
;
import
com.google.common.collect.Sets
;
import
java.util.Set
;
@AutoService
(
DataSourceFactory
.
class
)
...
...
seatunnel-datasource/seatunnel-datasource-plugins/datasource-s3/src/main/java/org/apache/seatunnel/datasource/plugin/s3/S3DatasourceChannel.java
浏览文件 @
da025db5
...
...
@@ -17,21 +17,13 @@
package
org
.
apache
.
seatunnel
.
datasource
.
plugin
.
s3
;
import
io.minio.MinioClient
;
import
org.apache.commons.lang3.StringUtils
;
import
lombok.NonNull
;
import
org.apache.seatunnel.api.configuration.util.OptionRule
;
import
org.apache.seatunnel.common.utils.SeaTunnelException
;
import
org.apache.seatunnel.datasource.plugin.api.DataSourceChannel
;
import
org.apache.seatunnel.datasource.plugin.api.DataSourcePluginException
;
import
org.apache.seatunnel.datasource.plugin.api.model.TableField
;
import
org.apache.hadoop.conf.Configuration
;
import
org.apache.hadoop.fs.FileSystem
;
import
org.apache.hadoop.fs.Path
;
import
lombok.NonNull
;
import
java.io.IOException
;
import
java.util.List
;
import
java.util.Map
;
...
...
编写
预览
Markdown
格式
0%
重试
或
添加新文件
添加附件
取消
您添加了
0
人
到此讨论。请谨慎行事。
请先完成此评论的编辑!
取消
请
注册
或者
登录
后发表评论