Comments (9)
wu1405
commented on May 22, 2024
same problem.
piece range:1090519040-1104150527 error,realMd5:70461da8b94c6ca5d2fda3260c5a8c3b,expectedMd5:a65b502d3a94f3da0d2144cd59e0f626,dstIp:
from dragonfly.
lowzj
commented on May 22, 2024
@wu1405 Could you paste some logs about your problem?
from dragonfly.
zhhsng
commented on May 22, 2024
Same problem. My realMd5 is 70461da8b94c6ca5d2fda3260c5a8c3b too!!! NOT coincidence.
I debugged dfget, and found that in core/fetch.py:PowerClient.run() the piece content is:
piece_cont
(Pdb) ['<html>\r\n<head><title>404 Not Found</title></head>\r\n<body bgcolor="white">\r\n<center><h1>404 Not Found</h1></center>\r\n<hr><center>nginx</center>\r\n</body>\r\n</html>\r\n']
from dragonfly.
zhhsng
commented on May 22, 2024
I deployed the supernode as docker. And the docker instance has about 3G disk space as the working directory. When the space is insufficent, the space gc will delete the files in qtdown/.
I mounted a bigger volume to the docker and the problem is solved.
from dragonfly.
nonly
commented on May 22, 2024
@lowzj same problem, i deploy more than 10 supernode in VM, disk space is enough; only one supernode has the problem;
when peer download files from the problematic supernode , dead loop will be caused;
i suppose dfget can migrate to next node or download whole files from source when md5 is not matched;
do you have any suggestion ?
from dragonfly.
xq2248
commented on May 22, 2024
@lowzj same problem,too
I deploy df in three centos7.3 physical machines, the first download file failed
from dragonfly.
xq2248
commented on May 22, 2024
@lowzj the logs:
[2017-09-07 15:28:20,135] INFO sign:98825-1504769300.121 lineno:140 : task url:http://www.taobao.com
[2017-09-07 15:28:20,135] ERROR sign:98825-1504769300.121 lineno:48 : read meta file fail for tag:checkService
Traceback (most recent call last):
File "/root/df-client/component/metafile.py", line 35, in load
assert len(data_sign) == 40, "data_sign length not equal 40"
AssertionError: data_sign length not equal 40
[2017-09-07 15:28:20,149] INFO sign:98825-1504769300.121 lineno:60 : local http result:[email protected] for path:/check/
and cost:0.004
[2017-09-07 15:28:20,150] INFO sign:98825-1504769300.121 lineno:64 : do register to 192.168.1.150,remainder:['192.168.1.150']
[2017-09-07 15:28:20,754] INFO sign:98825-1504769300.121 lineno:93 : do register result:{u'code': 200, u'data': {u'pieceSize': 4194304, u'fil
eLength': -1, u'taskId': u'5806501cbcc3bb92f0b645918c5a4b15495a63259e3e0363008f97e186509e9f'}} and cost 0.604
[2017-09-07 15:28:20,768] INFO sign:98825-1504769300.121 lineno:110 : pull piece task result:{u'msg': u'client sucCount:0,cdn status:RUNNING,
cdn sucCount:0', u'code': 602} and sleep 1.098 ...
[2017-09-07 15:28:21,923] INFO sign:98825-1504769300.121 lineno:60 : local http result:20971520 for path:/rate/ and cost:0.002
[2017-09-07 15:28:21,940] ERROR sign:98825-1504769300.121 lineno:332 : piece range:0-4194303 error,realMd5:64e2a12134ffafcf72bf8719ed58c59d,e
xpectedMd5:14b2bd47fa82d1f517621d25e3743f3f,dstIp:192.168.1.150,total:169
[2017-09-07 15:28:21,992] ERROR sign:98825-1504769300.121 lineno:332 : piece range:0-4194303 error,realMd5:64e2a12134ffafcf72bf8719ed58c59d,e
xpectedMd5:14b2bd47fa82d1f517621d25e3743f3f,dstIp:192.168.1.150,total:169
[2017-09-07 15:28:22,039] ERROR sign:98825-1504769300.121 lineno:332 : piece range:0-4194303 error,realMd5:64e2a12134ffafcf72bf8719ed58c59d,e
xpectedMd5:14b2bd47fa82d1f517621d25e3743f3f,dstIp:192.168.1.150,total:169
from dragonfly.
xq2248
commented on May 22, 2024
I find the problem.
According to the official docs, you may not change the nginx user, so all request to supernode will be 403 error. Simplely change the nginx user to root in nginx.conf, or change the rights of the work directory
from dragonfly.
xq2248
commented on May 22, 2024
some kuy have the 404 problem, check your work directory of nginx 8001 port and the supernode work path
from dragonfly.
Related Issues (20)
- dfget server endpoint does not support TLS
- It can be installed to kubernetes through helm？
- level=error msg="unknown shorthand flag: 's' in -supernode.advertiseIp=127.0.0.1" HOT 4
- Test failed: http_util_test.go:95: HTTPUtilTestSuite.TestGet
- 关于Dragonfly缓存没有生效的问题 HOT 1
- Does Dragonfly support DADI?
- Replace the Qr code of DingTalk Group
- Change README link font size.
- HTTPUtilTestSuite.TestGet HOT 1
- Unit tests failed: HTTPSuite.SetUpTest
- dfget may leak credentials (via --header flag) when called by dfdaemon
- Even with cdnPattern: source, dfget connects to the downloadPort
- supernode writes debug logs even if configured with debug: false
- Upgrading to golang 1.16.1+
- Harbor配置P2P预热失败
- OOM in containerized dfget in Kubernetes
- dfget变僵尸进程
- knative pull image by Dragonfly is error
- daemon support identifier
- ipv6 support HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dragonfly.