Backblaze Slow

Posted : admin On 1/2/2022
Backblaze Slow
  1. Backblaze Slow
  2. Backblaze Slow Upload Speeds
  3. Backblaze Slowing Down Computer
  4. Backblaze Slow Upload
  1. Cloud sync, jail external storage

    Hey everyone, just enabled cloud sync to a new backblaze b2 subscription. I noticed that after a couple days the 'bucket' on backblaze was much larger than the parent dataset that it was supposed to backup. I discovered that this is due to my iocage Plex jail's external storage of ~3TB of...
    • Thread
    • Replies: 9
    • Forum: General Questions and Help
  2. S

    Backblaze B2 Back up - very slow. just 1.6MB/s

    Hey All,I need to back up my 6tb NAS to backblaze and got it all working, but its been 3 days and only 400gb done. Its averaging about 1.6MB/sIs there any way to speed it up? I am using latest freenas and cloud sync.Backblaze support mentioned multi threading, but cant see that option in...
  3. OneDrive token too long (characters) for rclone

    I am trying to configure my OneDrive to my FreeNas. I went through the instructions (https://rclone.org/onedrive/), but at the point where you paste the token given, it does not fit in the Shell. It has around 2900 characters, and the limit is at 1920 characters.I have tried multiple times...
    • Thread
    • Replies: 3
    • Forum: General Questions and Help
  4. SOLVEDCloud sync with Backblaze B2 limit upload speed

    Following the mindset better save than sorry I maintain a local onsite backup of my files on a different server and thanks to FreeNAS 11.2 an encrypted offsite cloud backup. Done that for some years with Backblaze and never had a problem. There are lots of howtos on how to achieve this with...
  5. Cloud Sync - Backblaze B2 - Class C Transactions Cap Reached 100%

    Would appreciate a bit of help here please.Have set up a daily task to sync 19,000 files with Backblaze B2 across a couple of buckets. Unfortunately, I'm getting a 'Class C Transactions Cap Reached 100%' error message emailed to me from Backblaze every day 8mins after the task kicks off...
    • Thread
    • Replies: 4
    • Forum: General Questions and Help
  6. T

    Restoring from Backblaze B2

    I am totally new to freenas (and non-windows operating systems) so please be patient with my ignorance and mistakes. I recently built a freenas server to host all my families data (movies, pictures, general files, etc).I have 1 pool with about 8 datasets that are shared across my network as...
    • Thread
    • Replies: 5
    • Forum: General Questions and Help
  7. C

    Cloud sync task overlap behavior?

    I didn't really find anything in the documentation or other research, but what's the behavior if a cloud sync task overlaps itself? Say I have a task that runs weekly (starts midnight Sunday). If the cloud sync task runs long enough that the next week arrives, will the task start another sync or...
    • Thread
    • Replies: 4
    • Forum: General Questions and Help
  8. M

    Dropbox cloud sync doesn't remove files & folders

    I'm very happy cloud sync was included in 11.2 so I can easily keep a copy of my Dropbox on my home Freenas. After getting my 'cloud credentials' and 'cloud sync' task setup, everything downloaded as expected. I have begun to organize my Dropbox moving files and folders (using another computer...
  9. R

    Cloud Sync Feature Using Significant Amounts of RAM

    Hello, I have been trying to get the Cloud Sync feature setup on 11.2-RC1, but whenever I start a task to backup encrypted to Backblaze B2, I get emails regarding high RAM usage and SWAP usage. It seems that the cloud sync feature is using all 16GB of available RAM.Has anyone else seen this...
    • Thread
    • Replies: 2
    • Forum: General Questions and Help
  10. J

    S3 Error 22 (AuthorizationHeaderMalformed)

    Hi All,Having a weird issue trying to 'Add Cloud Sync' I get:Error 22An error occurred (AuthorizationHeaderMalformed) when calling the ListBuckets operation: The authorization header is malformed; the region 'us-east-1' is wrong; expecting 'eu-west-1'Has anybody else encountered this...
    • Thread
    • Replies: 2
    • Forum: General Questions and Help
  11. S

    FreeNAS 11.2 Cloud Sync Erro 'Increase chunk-size'

    Hello,I just moved over to 11.2 to test out encryption with the cloud sync feature for B2. I am trying to backup almost the entire data set and receive the below error message. Where do I go about increasing the chunk-size?Failed to sync: 'XXXXX.bin' too big (4399120252960 bytes) makes too...
    • Thread
    • Replies: 4
    • Forum: General Questions and Help
  12. L

    Cloud Credentials/Cloud Sync - Google Drive

    Hey all,I was wondering if we could get more information on how to configure Cloud Credentials for Google Drive? I know it's new functionality so the documentation is sparse. I'm sure I'm missing something really silly or making everything overly complicated but I've tried the following to get...
    • Thread
    • Replies: 23
    • Forum: General Questions and Help
  13. B

    Cloud sync - rclone aux parameters?

    I want to setup cloud sync on my freenas to a Backblaze B2. I've done some tests and everything works fine from the sync perspective however things fall apart with regard to my internet connection. Either my router or my modem simply locks down if the uplink is saturated for long enough time...
    • Thread
    • Replies: 3
    • Forum: General Questions and Help
  14. M

    Cloud Sync email notification

    Hi,Can i configure email notification of Cloud Sync status? Regards
    • Thread
    • Replies: 10
    • Forum: General Questions and Help
  15. S

    Cloud Sync

    General question regarding Cloud Sync ...Let's say you have the following scenario: (a) Push Sync with a source dataset of several hundred GBs or even TBs, (b) Provider = Google Drive (unlimited), (c) max upload bandwidth = 70 mbpsIf the sync task is interrupted for some reason (whether it...
    • Thread
    • Replies: 4
    • Forum: General Questions and Help
  16. Cloud sync enable/disable

    So, playing with 11.2beta-1, and set up a cloud sync to Backblaze. Didn't really think much of it, and left it at defaults, meaning a continuous sync - which then ended up using up all my Class C requests. My thought was to go in and disable cloud sync temporarily, reset the run times, and...
    • Thread
    • Replies: 4
    • Forum: General Questions and Help
  17. D

    Can 'Cloud Sync' sync compressed data?

    I'd like to sync data with a cloud provider, but I'd like to keep it's compression from the dataset that's syncing. For instance, I have a db backup that's ~400GB, that compresses down to 60GB, I'd like to sync that 60GB of compressed data, not the 400GB of uncompressed data.Can cloud sync do...
    • Thread
    • Replies: 1
    • Forum: General Questions and Help
  18. Logs for Cloud Sync?

    Does anyone know where logs are kept for Cloud Sync? And, hopefully, how I can tweak the verbosity of those logs?The reason I ask is my Cloud Sync tasks seem to be moving a LOT more data then I'd expect. I'd like to see what it's really doing.Thanks!
    • Thread
    • Replies: 4
    • Forum: General Questions and Help
  19. Cloud Sync with Hubic

    Hello, I'm running FreeNAS 11-STABLE and I'd like to sync my data on my HUBIC cloud storage. In order to use Cloud Sync, I understood I must first create a 'Cloud provider' in the system/cloud credentials section. Hubic is not available in the provider list (only amazon s3, azure, backblaze...
    • Thread
    • Replies: 1
    • Forum: General Questions and Help
  20. J

    FreeNAS 11.1 cloud sync

    I created a cloud sync task using my Backblaze B2 service without a problem. The service correctly uploaded my dataset to the cloud. As it was only a test I then deleted the cloud sync task.I discovered some time later that FreeNAS continued to upload the dataset to the Backblaze.Rebooting...
    • Thread
    • Replies: 1
    • Forum: Bug Reporting Discussion
  21. N

    Cloud Sync status is 'Running' then 'Waiting' but is not complete

    I just updated to FreeNAS-11.1-RELEASE from 11.0-U4 and set up 2 new Cloud Sync tasks to Backblaze B2 buckets.The syncs appeared to be running and were showing a status of 'RUNNING' and included the current upload speeds for the tasks but now have both changed to a status of 'WAITING.' I did...
    • Thread
    • Replies: 4
    • Forum: General Questions and Help

What is the problem you are having with rclone?

Maybe this is not a problem but instead a SOLUTION to a problem: I was plagued by extremely low upload speeds (around 100 KB/s) for several years when syncing borgbackup repositories to Backblaze B2. My problems were previously described in the (now locked) forum thread here. The underlying cause was found to be lots of 503 errors being throws by Backblaze while Backblaze support assured me that everything is OK at their end. None of the proposed solutions (e.g. increasing the --transfers value) worked.

If you join the backblaze reddit forum where some actual backblaze employees work, if you criticise or say something doesn't work, they try to delete/bury your comment with downvotes. It's slow, the software is rubbish and the company doesn't realise that other countries exist (they also want to be paid in dollars which is a disadvantage to. Backblaze does not detect that the external drive has been unplugged and won’t start the 30-day countdown. You can then leave your computer off and unplug your external drive for six months, and Backblaze will still keep all your files backed up including those on your external drive. Not only is Backblaze easy, I've also found it to be very fast. Backing up online can be slow, especially that initial chunk of data, but I was able to upload almost 300 GB in just three days, a feat that I haven't been able to duplicate with any other online backup service. Follow Backblaze can backup as fast as your Internet connection allows. By default, Backblaze Personal backup will automatically test your connection to our data centers, then use performance settings to maximize your backup speed while avoiding major impacts to your regular computer usage. Backblaze makes a copy of the large files on this temporary data drive and then reads them from that to transmit them, so if that is a slow drive you will see 'notches' in performance where no transmission occurs between large files for a few seconds.

Recently I have found that simply adding the '--fast-list' option to rclone command increased my upload speeds from around 100 KB/s to at least 2 MB/s (sometimes up to 5 MB/s). That's at least 20x speed increase ant it's absolutely consistent (tried 5 times without the --fast-list option and 5 times with it). I don't know if this is a bug in rclone or at Backblaze's end but this info might help other afflicted users.

Backblaze Slow

N.B: My borgbackup repositories consist of multiple long files (up to 500MB) and many more short 17 bytes files (for snapshots that did not change compared to the previous snapshot). The typical file composition of my borgbackup repository can be seen here.

What is your rclone version (output from rclone version)

1.52.0

Backblaze Slow Upload Speeds

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Backblaze Slowing Down Computer

Xubuntu Linux

Which cloud storage system are you using? (eg Google Drive)

Backblaze B2

The command you were trying to run (eg rclone copy /tmp remote:tmp)

The rclone config contents with secrets removed.

Backblaze Slow Upload

EDIT: Fixed missing 'sync' directive in the command.