tianmiantech / wefe Goto Github PK

WeFe ( WeLab Federated Learning ) 是 Welab 汇立集团子公司[天冕科技](https://www.tianmiantech.com )发起的开源项目，为联邦学习生态系统提供了一套好用的可靠的企业级联邦学习平台。

License: Apache License 2.0

Java 45.20% JavaScript 1.74% Shell 0.48% HTML 0.04% Vue 13.90% SCSS 3.58% Python 28.37% Makefile 0.03% C++ 3.49% Cuda 2.11% C 0.05% CMake 0.31% Go 0.10% Dockerfile 0.01% Solidity 0.58%

wefe's People

Contributors

Stargazers

Watchers

wefe's Issues

board-service module build failed, because com.cloudera:ImpalaJDBC41:jar:2.6.4.1005 not found

mvn build board-service module, com.cloudera:ImpalaJDBC41:jar:2.6.4.1005 not found.

MAVEN LOGS:

[ERROR] Failed to execute goal on project board-service: Could not resolve dependencies for project com.welab.wefe:board-service:jar:1.0.0: Failed to collect dependencies at com.cloudera:ImpalaJDBC41:jar:2.6.4.1005: Failed to read artifact descriptor for com.cloudera:ImpalaJDBC41:jar:2.6.4.1005: Could not transfer artifact com.cloudera:ImpalaJDBC41:pom:2.6.4.1005 from/to mvnrepository (http://www.mvnrepository.com/): Authorization failed for http://www.mvnrepository.com/com/cloudera/ImpalaJDBC41/2.6.4.1005/ImpalaJDBC41-2.6.4.1005.pom 403 Forbidden -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException

I also found com.cloudera:ImpalaJDBC41:jar:2.6.4.1005 in https://mvnrepository.com/artifact/com.cloudera/ImpalaJDBC41, but not found.

meanwhile, I think the parent pom repository(id=mvnrepository) is not needed, should use https://repo1.maven.org/maven2/ instead.

自建union服务出现Invalid member_id

使用wefe 最新版本，部署union service，并使用deployCns 部署智能合约，成员加入过程出现：

`--2022-08-29 18:52:01.041 - INFO [1661770321038] [nio-8080-exec-5] com.welab.wefe.common.web.ApiExecutor [ApiExecutor.java:109] : response(member/query_all):{"code":10031,"message":"Invalid member_id: 7032101aa19747be934de9ed53629803","spend":3}

请问该如何解决？

standalone模式下，get方法中判断tag是否重复的逻辑有误

在下面的代码处，_get_tag_histories作为判断tag是否重复的set，未有任何add的操作

WeFe/common/python/p_federation/impl/federation_standalone.py

Line 123 in 5d0aa0d

if (name, tag, party) in _get_tag_histories:

java: 读取.m2/repository/org/bouncycastle/bcprov-jdk15on/1.60/bcprov-jdk15on-1.60.jar时出错; zip file is empty

mvn clean install -Dmaven.test.skip=true -am -pl board/board-service 打包失败

[INFO] Scanning for projects...
[ERROR] [ERROR] Some problems were encountered while processing the POMs:
[FATAL] Non-parseable POM D:\m2\repository\org\springframework\boot\spring-boot-starter-parent\2.1.10.RELEASE\spring-boot-starter-parent-2.1.10.RELEASE.pom: Expected root element 'project' but found 'html'
(position: START_TAG seen ... @1:6) @ D:\m2\repository\org\springframework\boot\spring-boot-starter-parent\2.1.10.RELEASE\spring-boot-starter-parent-2.1.10.RELEASE.pom, line 1, column 6
@
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]
[ERROR] The project com.welab.wefe:wefe:1.0.0 (D:\ideaProject\wefe\WeFe-main\pom.xml) has 1 error
[ERROR] Non-parseable POM D:\m2\repository\org\springframework\boot\spring-boot-starter-parent\2.1.10.RELEASE\spring-boot-starter-parent-2.1.10.RELEASE.pom: Expected root element 'project' but found 'ht
ml' (position: START_TAG seen ... @1:6) @ D:\m2\repository\org\springframework\boot\spring-boot-starter-parent\2.1.10.RELEASE\spring-boot-starter-parent-2.1.10.RELEASE.pom, line 1, column 6 -> [Help
2]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
[ERROR] [Help 2] http://cwiki.apache.org/confluence/display/MAVEN/ModelParseException

怎样在GPU上跑pallier同台加密

配置nginx访问board-website访问不通

服务器中通过docker部署联邦学习平台，现在通过部署nginx进行访问board-website，发现访问不到board-website系统

union中数据集的操作接口缺失权限校验

union中的数据集删除接口没有做身份验证，即成员可以任意删除他人的数据。

联邦成员的公钥有注册到union中，可以考虑按照如下方案鉴权：

B想要伪造A的身份向union删除a。于是可以带着A的id向union发起删除a的请求。
union拥有A的公钥，因此可以向B要求身份证明。
B无法完成身份证明，union拒绝删除。

serve打包部署到服务器，日志管理中调用统计报错

Dependency com.alibaba:fastjson, leading to CVE problem

Hi, In /connectors/rocketmq-connect-mongo，there is a dependency com.alibaba:fastjson:1.2.68 that calls the risk method.

CVE-2022-25845

The scope of this CVE affected version is ** [,1.2.83)**

After further analysis, in this project, the main Api called is com.alibaba.fastjson.parser.ParserConfig: checkAutoType(java.lang.String,java.lang.Class,int)Ljava.lang.Class;

Risk method repair link : GitHub

CVE Bug Invocation Path--

Path Length : 5

CVE Bug Invocation Path : 
com.welab.wefe.serving.sdk.algorithm.AbstractAlgorithm: execute(com.welab.wefe.serving.sdk.model.BaseModel,com.welab.wefe.serving.sdk.dto.FederatedParams,com.welab.wefe.serving.sdk.dto.PredictParams,com.alibaba.fastjson.JSONObject)Lcom.welab.wefe.serving.sdk.dto.PredictResult; .m2/repository/org/springframework/boot/spring-boot-starter-logging/2.1.10.RELEASE/spring-boot-starter-logging-2.1.10.RELEASE.jar
com.alibaba.fastjson.JSONObject: toJavaObject(java.lang.Class)Ljava.lang.Object; .m2/repository/org/springframework/boot/spring-boot-starter-logging/2.1.10.RELEASE/spring-boot-starter-logging-2.1.10.RELEASE.jar
com.alibaba.fastjson.util.TypeUtils: castToJavaBean(java.util.Map,java.lang.Class,com.alibaba.fastjson.parser.ParserConfig)Ljava.lang.Object; .m2/repository/org/springframework/boot/spring-boot-starter-logging/2.1.10.RELEASE/spring-boot-starter-logging-2.1.10.RELEASE.jar
com.alibaba.fastjson.parser.ParserConfig: checkAutoType(java.lang.String,java.lang.Class)Ljava.lang.Class; .m2/repository/org/springframework/boot/spring-boot-starter-logging/2.1.10.RELEASE/spring-boot-starter-logging-2.1.10.RELEASE.jar
com.alibaba.fastjson.parser.ParserConfig: checkAutoType(java.lang.String,java.lang.Class,int)Ljava.lang.Class;

Dependency tree--

[INFO] com.welab.wefe:serving-sdk-java:jar:1.0.0
[INFO] +- com.welab.wefe:common-lang:jar:1.0.0:compile
[INFO] |  +- org.apache.httpcomponents:httpclient:jar:4.5.10:compile
[INFO] |  |  +- org.apache.httpcomponents:httpcore:jar:4.4.12:compile
[INFO] |  |  \- commons-codec:commons-codec:jar:1.11:compile
[INFO] |  +- org.apache.httpcomponents:httpmime:jar:4.5.10:compile
[INFO] |  +- commons-configuration:commons-configuration:jar:1.10:compile
[INFO] |  |  \- commons-lang:commons-lang:jar:2.6:compile
[INFO] |  +- org.mapstruct:mapstruct:jar:1.3.1.Final:compile
[INFO] |  +- org.mapstruct:mapstruct-processor:jar:1.3.1.Final:compile
[INFO] |  +- io.github.classgraph:classgraph:jar:4.8.78:compile
[INFO] |  +- org.apache.poi:poi:jar:4.1.2:compile
[INFO] |  |  +- org.apache.commons:commons-math3:jar:3.6.1:compile
[INFO] |  |  \- com.zaxxer:SparseBitSet:jar:1.2:compile
[INFO] |  +- org.apache.poi:poi-ooxml:jar:4.1.2:compile
[INFO] |  |  +- org.apache.poi:poi-ooxml-schemas:jar:4.1.2:compile
[INFO] |  |  |  \- org.apache.xmlbeans:xmlbeans:jar:3.1.0:compile
[INFO] |  |  +- org.apache.commons:commons-compress:jar:1.19:compile
[INFO] |  |  \- com.github.virtuald:curvesapi:jar:1.06:compile
[INFO] |  +- de.siegmar:fastcsv:jar:1.0.1:compile
[INFO] |  +- com.github.whvcse:easy-captcha:jar:1.6.2:compile
[INFO] |  +- net.jodah:expiringmap:jar:0.5.10:compile
[INFO] |  +- net.coobird:thumbnailator:jar:0.4.8:compile
[INFO] |  \- org.springframework:spring-core:jar:5.1.11.RELEASE:compile
[INFO] |     \- org.springframework:spring-jcl:jar:5.1.11.RELEASE:compile
[INFO] +- com.welab.wefe:common-web:jar:1.0.0:compile
[INFO] |  +- org.springframework.boot:spring-boot-starter-web:jar:2.1.10.RELEASE:compile
[INFO] |  |  +- org.springframework.boot:spring-boot-starter:jar:2.1.10.RELEASE:compile
[INFO] |  |  |  +- org.springframework.boot:spring-boot:jar:2.1.10.RELEASE:compile
[INFO] |  |  |  +- org.springframework.boot:spring-boot-autoconfigure:jar:2.1.10.RELEASE:compile
[INFO] |  |  |  +- org.springframework.boot:spring-boot-starter-logging:jar:2.1.10.RELEASE:compile
[INFO] |  |  |  |  +- ch.qos.logback:logback-classic:jar:1.2.3:compile
[INFO] |  |  |  |  |  \- ch.qos.logback:logback-core:jar:1.2.3:compile
[INFO] |  |  |  |  +- org.apache.logging.log4j:log4j-to-slf4j:jar:2.11.2:compile
[INFO] |  |  |  |  |  \- org.apache.logging.log4j:log4j-api:jar:2.11.2:compile
[INFO] |  |  |  |  \- org.slf4j:jul-to-slf4j:jar:1.7.15:compile
[INFO] |  |  |  +- javax.annotation:javax.annotation-api:jar:1.3.2:compile
[INFO] |  |  |  \- org.yaml:snakeyaml:jar:1.23:runtime
[INFO] |  |  +- org.springframework.boot:spring-boot-starter-json:jar:2.1.10.RELEASE:compile
[INFO] |  |  |  +- com.fasterxml.jackson.core:jackson-databind:jar:2.9.10.1:compile
[INFO] |  |  |  |  +- com.fasterxml.jackson.core:jackson-annotations:jar:2.9.10:compile
[INFO] |  |  |  |  \- com.fasterxml.jackson.core:jackson-core:jar:2.9.10:compile
[INFO] |  |  |  +- com.fasterxml.jackson.datatype:jackson-datatype-jdk8:jar:2.9.10:compile
[INFO] |  |  |  +- com.fasterxml.jackson.datatype:jackson-datatype-jsr310:jar:2.9.10:compile
[INFO] |  |  |  \- com.fasterxml.jackson.module:jackson-module-parameter-names:jar:2.9.10:compile
[INFO] |  |  +- org.springframework.boot:spring-boot-starter-tomcat:jar:2.1.10.RELEASE:compile
[INFO] |  |  |  +- org.apache.tomcat.embed:tomcat-embed-core:jar:9.0.27:compile
[INFO] |  |  |  +- org.apache.tomcat.embed:tomcat-embed-el:jar:9.0.27:compile
[INFO] |  |  |  \- org.apache.tomcat.embed:tomcat-embed-websocket:jar:9.0.27:compile
[INFO] |  |  +- org.hibernate.validator:hibernate-validator:jar:6.0.18.Final:compile
[INFO] |  |  |  +- javax.validation:validation-api:jar:2.0.1.Final:compile
[INFO] |  |  |  +- org.jboss.logging:jboss-logging:jar:3.3.3.Final:compile
[INFO] |  |  |  \- com.fasterxml:classmate:jar:1.4.0:compile
[INFO] |  |  +- org.springframework:spring-web:jar:5.1.11.RELEASE:compile
[INFO] |  |  |  \- org.springframework:spring-beans:jar:5.1.11.RELEASE:compile
[INFO] |  |  \- org.springframework:spring-webmvc:jar:5.1.11.RELEASE:compile
[INFO] |  |     +- org.springframework:spring-aop:jar:5.1.11.RELEASE:compile
[INFO] |  |     +- org.springframework:spring-context:jar:5.1.11.RELEASE:compile
[INFO] |  |     \- org.springframework:spring-expression:jar:5.1.11.RELEASE:compile
[INFO] |  +- com.welab.wefe:common-data-mysql:jar:1.0.0:compile
[INFO] |  |  +- org.springframework.boot:spring-boot-starter-data-jpa:jar:2.1.10.RELEASE:compile
[INFO] |  |  |  +- org.springframework.boot:spring-boot-starter-aop:jar:2.1.10.RELEASE:compile
[INFO] |  |  |  |  \- org.aspectj:aspectjweaver:jar:1.9.4:compile
[INFO] |  |  |  +- javax.transaction:javax.transaction-api:jar:1.3:compile
[INFO] |  |  |  +- javax.xml.bind:jaxb-api:jar:2.3.1:compile
[INFO] |  |  |  |  \- javax.activation:javax.activation-api:jar:1.2.0:compile
[INFO] |  |  |  +- org.hibernate:hibernate-core:jar:5.3.13.Final:compile
[INFO] |  |  |  |  +- javax.persistence:javax.persistence-api:jar:2.2:compile
[INFO] |  |  |  |  +- org.javassist:javassist:jar:3.23.2-GA:compile
[INFO] |  |  |  |  +- net.bytebuddy:byte-buddy:jar:1.9.16:compile
[INFO] |  |  |  |  +- antlr:antlr:jar:2.7.7:compile
[INFO] |  |  |  |  +- org.jboss:jandex:jar:2.0.5.Final:compile
[INFO] |  |  |  |  +- org.dom4j:dom4j:jar:2.1.1:compile
[INFO] |  |  |  |  +- org.hibernate.common:hibernate-commons-annotations:jar:5.0.4.Final:compile
[INFO] |  |  |  |  \- org.glassfish.jaxb:jaxb-runtime:jar:2.3.1:compile
[INFO] |  |  |  |     +- org.glassfish.jaxb:txw2:jar:2.3.1:compile
[INFO] |  |  |  |     +- com.sun.istack:istack-commons-runtime:jar:3.0.7:compile
[INFO] |  |  |  |     +- org.jvnet.staxex:stax-ex:jar:1.8:compile
[INFO] |  |  |  |     \- com.sun.xml.fastinfoset:FastInfoset:jar:1.2.15:compile
[INFO] |  |  |  +- org.springframework.data:spring-data-jpa:jar:2.1.12.RELEASE:compile
[INFO] |  |  |  |  +- org.springframework.data:spring-data-commons:jar:2.1.12.RELEASE:compile
[INFO] |  |  |  |  +- org.springframework:spring-orm:jar:5.1.11.RELEASE:compile
[INFO] |  |  |  |  \- org.springframework:spring-tx:jar:5.1.11.RELEASE:compile
[INFO] |  |  |  \- org.springframework:spring-aspects:jar:5.1.11.RELEASE:compile
[INFO] |  |  +- mysql:mysql-connector-java:jar:8.0.18:compile
[INFO] |  |  +- org.springframework.boot:spring-boot-starter-jdbc:jar:2.1.10.RELEASE:compile
[INFO] |  |  |  +- com.zaxxer:HikariCP:jar:3.2.0:compile
[INFO] |  |  |  \- org.springframework:spring-jdbc:jar:5.1.11.RELEASE:compile
[INFO] |  |  \- com.alibaba:druid-spring-boot-starter:jar:1.1.22:compile
[INFO] |  |     \- com.alibaba:druid:jar:1.1.22:compile
[INFO] |  \- org.modelmapper:modelmapper:jar:2.3.5:compile
[INFO] +- org.slf4j:slf4j-log4j12:jar:1.7.15:compile
[INFO] |  +- org.slf4j:slf4j-api:jar:1.7.15:compile
[INFO] |  \- log4j:log4j:jar:1.2.17:compile
[INFO] +- org.apache.commons:commons-lang3:jar:3.10:compile
[INFO] +- org.apache.commons:commons-collections4:jar:4.4:compile
[INFO] \- com.alibaba:fastjson:jar:1.2.68:compile

Suggested solutions:

Update dependency version

Thank you very much.

error: /etc/nginx/conf.d/default.conf differs from the packaged version

部署完成后，页面网络请求502

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.