The support forum

Speed seems Slow

niemeyer :

Mar 15, 2020

I am testing a couple of different  Applications to copy only changed blocks "Delta" to a server in a different datacenter and I am comparing to the total amount copied and times against RoboCopy.

The version I am testing Bvckup 2 Pro for Windows Server Release 80.11.
I am running Windows Server 2012 Standard

Robocopy says that it would copy 32.8gig which would take about 11 hours.
Bvckup  test was; Read 90.32, wrote 13.59 GB, throughput 1.13MBps / 1188549bps.  Completed in 23 h 23 min with 84 errors.

So even though it is copying less it is taking twice as long.
The data being copy is a lot of folders and small files with some files up to 2 gig in size.

Because of the abundance of  small files I can make RoboCopy more efficient by running multiple threads.  I don't see the ethernet speed drop off when using multiple threads.

I have seen an option on your website that seems to allow this in Bvckup2, but the option is not in the version I am running.

Is there anyway to speed Bvckup 2 up or am I doing something wrong?

Alex Pankratov :

Mar 15, 2020

When copying lots of small(er) files over the network, an option of running several copies in parallel with each other is a must. Current production release (R80) doesn't do that. However it is *the* main new feature of the next release (R81).

R81 is few weeks away from a formal release, but there are stable preview builds that you can use to evaluate the speed. See here for details -
https://bvckup2.com/support/preview/topic/1264

For how to get a preview build see here - https://bvckup2.com/support/preview/topic/1263

Sample benchmark of R80 vs R81 - https://bvckup2.com/wip/03102019
The UI config of parallel processing - https://bvckup2.com/wip/02032020

niemeyer :

Mar 18, 2020

Unfortunately I am not able to get the preview through the application.

Alex Pankratov :

Mar 19, 2020

Can you explain which way it fails exactly?

Here's a screencap of how to do it. Just don't forget to hold Ctrl down when selecting Help menu for the first time - https://bvckup2.com/support/data/switching-to-preview-builds.gif

niemeyer :

Mar 19, 2020

It says checking and then it says ;

Regrettably, the check has failed.

It's possible it could be a proxy / firewall issue.  You shouldn't expect software to be able to get out to the internet.  Some networks are secured or sites not allowed for security reasons.

Alex Pankratov :

Mar 19, 2020

There are no expectations of this sort for the mainstream releases, but for the "preview" builds being able to check for updates is generally a good thing to have. It's not required however. Here's a direct download link for the latest one -

    https://bvckup2.com/files/bvckup2-setup-1.80.99.13.exe

niemeyer :

Mar 20, 2020

Thank you Sir!  Testing this version now.

loyukfai :

Apr 19, 2020

R81 is few weeks away from a formal release...


Is this schedule still on track?

Cheers.

Alex Pankratov :

Apr 19, 2020

Yes, it is. We are now at preview 14 and it's the last of the preview builds. The next up is the actual release 81.

niemeyer :

Apr 25, 2020

Still testing this version and I don't understand how the delta copying thing works in Bvckup.  I have a 600m file.  I make a small change near the beginning of the file and it copies almost the entire file; Read 598.48MB  wrote 561.92MB.  If I make the same change at the end of the file; Read 598.46MB wrote 26.84KB.

Alex Pankratov :

Apr 25, 2020

This is how delta copying works, in detail - https://bvckup2.com/kb/delta-copying.

If you are seeing the file getting recopied nearly in full, it means that there _were_ in fact that many block-wise changes.

Keep in mind if you are to _insert_ something at the beginning of the file, it will shift all the data in the file and all subsequent blocks _will_ change. While it is possible to detect this sort of change and handle it incrementally, this is a change pattern that is rarely used in practice due to its sheer inefficiency.

niemeyer :

Apr 28, 2020

Thanks for the link, but I am not seeing what is described in the link.  I have tested other competing products and don't see the same results based on your comment of inserting something near the beginning of the file.  I performed another test where I didn't insert anything I changed one character  from a 4 to a 5 and the whole file copied from the point of the changed.  The demo that is shown in the link shows parts of a file being updated which is what I thought would have happened.

I did a test using DeltaCopy which uses Rsync where I inserted the same text as I did in my Bvcup2 tests and it only copied the change not the entire file from the change.  So I am not sure why the difference but there is a client and server piece.  I know you are asking then why don't I just use deltacopy, well because it screws up permissions on any file that gets updated so that won't work for me.

Alex Pankratov :

Apr 28, 2020

I can't comment on specifics of what you are seeing without knowing _exact_ details of your tests and seeing relevant log extracts. But if you are to touch just a single byte in a source file and nothing else, then only the block hosting that byte will be copied.

Alex Pankratov :

Apr 28, 2020

I should add that rsync DOES detect blocks of data being moved, so if you are seeing rsync-based solution picking up a discrete block change and bvckup2 not recognizing it, chances are that your test change IS shifting the data.

New topic

Create
Made by IO Bureau in Switzerland
Support

Updates Newsletter
Blog & RSS
Follow Twitter
Reddit
Miscellanea Press kit
Testimonials
Company Imprint

Legal Terms
Privacy