eeertekin / bbcp Goto Github PK

When authentication fails as provided identity file doesn't exists, bbcp shows error message

bbcp: Accept timed out on port 5031
bbcp: Unable to allocate more than 0 of 4 data streams.

which has no clue about the actual error.

using -D shows the underlying issue

Warning: Identity file netbot-nrm-mvp.pem not accessible: No such file or directory.
Permission denied (publickey).

bbcp should show This error.

I'm trying to compile bbcp but I'm running into issue:

make[1]: Entering directory /media/bigone/work/application/bbcp-master/src' make[2]: Entering directory/media/bigone/work/application/bbcp-master/src'
make[2]: *** No rule to make target makeLinuxunknown'. Stop. make[2]: Leaving directory/media/bigone/work/application/bbcp-master/src'
make[1]: *** [Linux] Error 2
make[1]: Leaving directory `/media/bigone/work/application/bbcp-master/src'
make: *** [all] Error 2

I tried to compile as normal user or root, got same results.
I guess the code trying to detect my linux version is failing.

Do you have some tips ?

In case of incremental snapshot using io,
if i put @ in the second parameter, show the bug:

NOT WORK:
root@srvps1:~/Dev-Repliche# bbcp -N io 'zfs send -v -R -I Srv1Snap_20190412154051 Srv1@Snap_20190412154132' [email protected]:"zfs recv -du STORAGE/"
bbcp: Missing host name for user zfs send -v -R -I Srv1Snap_20190412154051 Srv1
Usage: bbcp [Options] [Inspec] Outspec

WORK:
root@srvps1:~/Dev-Repliche# bbcp -N io 'zfs send -v -R -I Srv1Snap_20190412154051 Snap_20190412154132' [email protected]:"zfs recv -du STORAGE/"
cannot receive: specified fs (STORAGE/) does not exist
Error: Unsupported flag with filesystem or bookmark.
bbcp: Broken pipe closing zfs

I am trying to install it on a raspberry pi device and there I am getting below error-

pi@pibox:~/bbcp/src $ make
make[1]: Entering directory '/home/pi/bbcp/src'
make[2]: Entering directory '/home/pi/bbcp/src'
make[2]: *** No rule to make target 'makeLinuxarmv7l'. Stop.
make[2]: Leaving directory '/home/pi/bbcp/src'
Makefile:192: recipe for target 'Linux' failed
make[1]: *** [Linux] Error 2
make[1]: Leaving directory '/home/pi/bbcp/src'
Makefile:155: recipe for target 'all' failed
make: *** [all] Error 2

could you please guide me in resolving this.

Is there any possible to replace zlib with lz4?
cuz the lz4 is better than zlib in performance

Hello,
i'm tryng bbcp to peed-up zfs send but after 1000 try i still have this error:

bbcp -4 c -N io "zfs send -v -R -I STORAGE@Srv1Snap_20190412135955 STORAGE@Srv1Snap_20190412140025" [email protected]:"zfs recv -du STORAGE/BK_SRV1/STORAGE"
bbcp: Missing host name for user zfs send -v -R -I STORAGE

Thanks for your help!

You can use same instructions from this fork but git clone from http://www.slac.stanford.edu/~abh/bbcp/bbcp.git :

apt-get update
apt-get install libssl-dev build-essential zlib1g-dev git
git clone http://www.slac.stanford.edu/~abh/bbcp/bbcp.git
cd bbcp/src
(to compile into Debian modify Makefile file and change the line that contains "uname -i" by "uname -m")
make
cp ../bin/amd64_linux/bbcp /bin/bbcp
bbcp --version

You need "bbcp" program in client and server hosts.

when I build bbcp in arm-platform，I can not support arm-aarch64, the error is as follows:

[root@localhost src]# make
make[1]: Entering directory '//bbcp/bbcp/src'
make[2]: Entering directory '//bbcp/bbcp/src'
make[2]: *** No rule to make target 'makeLinuxaarch64'. Stop.

any good ideas? thanks

it's not secure copy, only ssh authentication is secure.
But transfer is insecure.

You have to encrypt before transfer.

Hi there and then you for bbcp first of all. Saves us a great hasle bybusing bbcp over hi latency wan connections. We have an interesting issue. Aparently ownership is not preserved by bbcp. we are using bbcp with -p and compres flags. Is there a something else that we are missing?

Thanks!

Hi,

we have the same problem as described in #3. bbcp is a very useful tool for us but ownership is not preserved. The UID on the source does not have a name assigned on the target but I would expect the owner to be just set to the UID of the user when copying at root.

Am I missing something here?

Thanks!

I have used bbcp a few times and absolutely love this tool every time I use it.

I am using the -I option to specify a list of input files, but I receive the following error for each file listed:

bbcp: No such file or directory processing

I have tried to supply relative and absolute paths to no avail. Of note, the same file listing works using rsync with the --files-from option:

rsync --files-from=list.txt . TARGET

Is there a specific spec for the format of fname for --infiles?