young-datafan-ooooo1 / data-integration Goto Github PK

将地址改为 http://127.0.0.1:10200/api/dataintegration-common-sso-provider/oauth/token 报错如下

项目管理-上线-提交上线显示系统繁忙，后台报404

1. Go to '管理'
2. Click on '上线'
3. Scroll down to '提交上线界面'
4. 界面报“系统繁忙”，后台报not found 404 异常

报错url路径：
http://127.0.0.1:10200/api/dp-schedule-online-audit-provider/dpPortalFrequency?frequencyName=

大佬们好，可以提供下社区交流区的二维码吗，有问题想请教

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.
如题 该项目支持MongoDB吗

请问下 现在的1.0版本支持odbc方式连接数据库吗

Error starting ApplicationContext. To display the conditions report re-run your application with 'debug' enabled.
2022-11-03 22:28:36.814 [traceCode:] [main] ERROR o.s.boot.SpringApplication - Application run failed
org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'dpFileRegularCleanController' defined in file [G:\Program\DataIntegration\dataintegration-file-management\dataintegration-file-management-provider\target\classes\com\youngdatafan\dataintegration\file\management\controller\DpFileRegularCleanController.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'dpFileRegularCleanServiceImpl': Unsatisfied dependency expressed through field 'dpPortalFileManagerService'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'dpPortalFileManagerServiceImpl': Injection of resource dependencies failed; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'minIoFileSystemManagerServiceImpl': Invocation of init method failed; nested exception is com.youngdatafan.dataintegration.core.exception.DpException: 初始化minIo配置异常
at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:800)

运行环境在windows中
1.openoffice中dockerfile copy的jdk需要放到openoffice文件夹中
2.openoffice中dockerfile 中yum install 指定了/zh-CN/，但其实没有这个路径，且openoffice4.1.11-redhat-menus-4.1.11-9808这个版本没有提交，现在是4.1.1-9775
3.脚本中没有对ui进行编译与打包
4.文档中修改ip地址哪里，没有对redis的地址和端口号进行修改

按步骤来，在本机上部署，可以运行，但是这样式不知道什么问题显示不出来，查了好久还是弄不出来

后续会考虑增加JSON输入、Streaming中的JMS、MQTT生产者和消费者以及作业的功能吗，还有其它的数据治理的模者和消费者以及作业的功能吗，还有其它的数据治理的模块后续会开源吗？

点击新建文件夹，接口返回文件可用，但是前台提示文件名称已经存在是否覆盖，点击确定后失败，后台报错
2022-04-13 11:45:43.629 ERROR 7 --- [ XNIO-1 task-1] io.undertow.request : UT005023: Exception handling request to /fileOperation/selectFileById org.springframework.web.util.NestedServletException: Request processing failed; nested exception is java.lang.IllegalArgumentException: Source must not be null at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1014) ~[spring-webmvc-5.3.2.jar!/:5.3.2] at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898) ~[spring-webmvc-5.3.2.jar!/:5.3.2] at javax.servlet.http.HttpServlet.service(HttpServlet.java:497) ~[jakarta.servlet-api-4.0.4.jar!/:4.0.4] at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) ~[spring-webmvc-5.3.2.jar!/:5.3.2] at javax.servlet.http.HttpServlet.service(HttpServlet.java:584) ~[jakarta.servlet-api-4.0.4.jar!/:4.0.4] at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:74) ~[undertow-servlet-2.2.3.Final.jar!/:2.2.3.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:129) ~[undertow-servlet-2.2.3.Final.jar!/:2.2.3.Final] at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) ~[spring-web-5.3.2.jar!/:5.3.2] at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) ~[spring-web-5.3.2.jar!/:5.3.2] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) ~[undertow-servlet-2.2.3.Final.jar!/:2.2.3.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.2.3.Final.jar!/:2.2.3.Final] at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) ~[spring-web-5.3.2.jar!/:5.3.2] at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) ~[spring-web-5.3.2.jar!/:5.3.2] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) ~[undertow-servlet-2.2.3.Final.jar!/:2.2.3.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.2.3.Final.jar!/:2.2.3.Final] at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:93) ~[spring-boot-actuator-2.4.1.jar!/:2.4.1] at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) ~[spring-web-5.3.2.jar!/:5.3.2] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) ~[undertow-servlet-2.2.3.Final.jar!/:2.2.3.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.2.3.Final.jar!/:2.2.3.Final] at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) ~[spring-web-5.3.2.jar!/:5.3.2] at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) ~[spring-web-5.3.2.jar!/:5.3.2]

谢谢

前端项目启动后无法登录 需要访问 oauth2 获取token, 一直99999 导致卡在登录页面

登录响应403 Forbidden
我尝试更改配置去解决这个问题，但是最后没能解决，请问老哥可以发下交流群吗 谢谢谢谢

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

txt.html.zip
方便更新下群二维码

如果支持的话 需要怎样集成呢

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

二维码失效了，能否提供新的二维码

登录报错 “系统繁忙” 不知道是什么意思

哪位大佬可以提供微信群或者QQ群，非常感谢

没有数据库文件

如题，多谢回答

代码学习，请问将作业和转换 在web上展示出来相关代码在哪一部分， 找了半天没找到。

我现在本地代码已经部署完了，但是还是报错，咱们有没有一个本地部署测试的说明，能不能麻烦发一下，谢谢了

选择minio文件报错，debug发现这里还没有minio的处理方法

最近在看这个项目，求一个交流群，有一些项目上的问题想咨询一下

新建数据连接时存在异常 数据库名称带有 ‘-’ 保存时忽略后面参数导致无法连接数据库。另外创建项目时怎么关联两个步骤？是功能缺失了么

部署过程中没有报错，部署完成后，访问UI登录页面，按照官网说明输入默认的用户名和密码登录不上去！ 默认的用户是admin，默认的密码是Prime@2020。很急！我们想全面了解一下这个产品，希望看到后尽快回复，谢谢

[SQL] Query dataintegration start
[ERR] 2006 - MySQL server has gone away
[ERR]
INSERT INTO dp_portal_project_file VALUES ('011928eb42c3449bb73677892421b26c','{"transformation":{"info":{"name":"输入输出插件测试","description":"","extended_description":"","trans_version":"","trans_type":"Normal","directory":"/home/admin","parameters":"","log":"","maxdate":{"connection":"","table":"","field":"","offset":0,"maxdiff":0},"size_rowset":10000,"sleep_time_empty":50,"sleep_time_full":50,"unique_connections":"N","feedback_shown":"Y","feedback_size":50000,"using_thread_priorities":"Y","shared_objects_file":"","capture_step_performance":"N","step_performance_capturing_delay":1000,"step_performance_capturing_size_limit":100,"dependencies":"","partitionschemas":"","slaveservers":"","clusterschemas":"","created_user":"14bf35b8-d342-4663-9550-5466f0b454d0","created_date":"2020/08/05 17:33:50","modified_user":"admin","modified_date":"2020/02/19 17:08:25.150","key_for_session_key":"","is_key_private":"N"},"notepads":"","connection":[{"name":"d618f2e8-dd1f-4254-b9ad-776a96a1f365","server":"","type":"POSTGRESQL","access":"Native","database":"","port":0,"username":"postgres","password":"Encrypted 2be98afc86aa78296a214ab508cc2fd8a","servername":"","data_tablespace":"","index_tablespace":"","attributes":{"attribute":[{"code":"PORT_NUMBER","attribute":0},{"code":"CUSTOM_DRIVER_CLASS","attribute":"org.postgresql.Driver"},{"code":"CUSTOM_URL","attribute":"jdbc:postgresql://192.168.124.177:5432/postgres"}]},"dataSourceName":"","dsName":"all_type_pg","dataSourceId":"d618f2e8-dd1f-4254-b9ad-776a96a1f365"}],"order":{"hop":[{"sourceUUId":"bcCsvInputdadfbsource","targetUUId":"CsvFileOutput61aa9","fromId":"bcCsvInputdadfb","toId":"CsvFileOutput61aa9","from":"csv文件输入","to":"输出到csv","enabled":"Y"},{"sourceUUId":"bcExcelInput01cd2source","targetUUId":"ExcelFileOutput99d1d","fromId":"bcExcelInput01cd2","toId":"ExcelFileOutput99d1d","from":"excel文件输入","to":"输出到excel","enabled":"Y"},{"sourceUUId":"bcTxtInputb645asource","targetUUId":"bcFileOutput96741","fromId":"bcTxtInputb645a","toId":"bcFileOutput96741","from":"txt文件输入","to":"输出到文件","enabled":"Y"}]},"step":[{"file_server_type":"s3","showFileName":"data.xls","filePath":"s3://192.168.124.166:19000/dp-s3/14bf35b8-d342-4663-9550-5466f0b454d0/0684a105ddc6489eb84dec67ee05ef88/0373b970c125436a84d42882d837ff10.xls","fsuserName":"prime","fspassWord":"IYrEJt2R4oMID0nRnavE2A==","tableName":"bcExcelInput01cd2","name":"excel文件输入","fileId":"0373b970c125436a84d42882d837ff10","stepType":"excel文件输入","describe":"","initFlag":true,"type":"bcExcelInput","modelName":"","description":"","distribute":"Y","custom_distribution":"Y","copies":1,"partitioning":{"method":"none","schema_name":""},"header":"Y","noempty":"Y","stoponempty":"Y","filefield":["",""],"sheetfield":["",""],"sheetrownumfield":"","rownumfield":"","limit":0,"encoding":"UTF-8","add_to_result_filenames":"Y","accept_filenames":"N","accept_field":"","accept_stepname":"","file":{"name":"s3://192.168.124.166:19000/dp-s3/14bf35b8-d342-4663-9550-5466f0b454d0/0684a105ddc6489eb84dec67ee05ef88/0373b970c125436a84d42882d837ff10.xls","filemask":"a","exclude_filemask":"","file_required":"N","include_subfolders":"N"},"fields":{"field":[{"name":"a","nameCn":"a","type":"Number","length":-1,"precision":-1,"trim_type":0,"repeat":"N","format":"","currency":null,"decimal":".","group":","},{"name":"b","nameCn":"b","type":"Number","length":-1,"precision":-1,"trim_type":0,"repeat":"N","format":"","currency":null,"decimal":".","group":","},{"name":"c","nameCn":"c","type":"Number","length":-1,"precision":-1,"trim_type":0,"repeat":
[SQL] Finished with error

没有sql server 驱动 无法链接数据库

token报错 请问还有没有群 想详细了解下这个项目

1.docker部署文档中执行命令是sh install/install.sh 127.0.0.1，但是必须cd到install执行sh install.sh 127.0.0.1
2.mysql、redis、minio、consul因为挂载磁盘会有权限问题，我是增加了privileged: true
3.默认生成的msyql用户密码与项目中有区别，需要手动创建账号密码并授权
4.数据集成里面其他菜单里面的功能是还没实现么，点开内容都是空的

在制作流程时能直接打开kjb和ktr进行编辑就更好了，加油

寻求支持，付费服务，联系617822576 QQ

例如各个工程启动顺序，以及需要修改的配置文件，帮助想加入的人员快速掌握整个工程

Describe the bug
项目上线功能不可用

To Reproduce

1. 点击管理
2. 选择项目管理
3. 点击某个项目的“上线”操作按钮

Expected behavior
显示系统繁忙

Version
2022.04.24 从仓库中拉取的版本

请问是功能还在开发中么，谢谢