New user's registration have been closed due to high spamming and low trafic on this forum. Please contact forum admins directly if you need an account. Thanks !

Problems backing up my files

Got problems with your B2 or B3? Share and get helped!
Post Reply
86ivar
Posts: 148
Joined: 02 Oct 2010, 11:08

Problems backing up my files

Post by 86ivar »

I have been trying to backup my files for a long time now. But it always fails and I dont know why. Ill try explain the problem.

-I mounted a WD Passport 2Gb external disk as FAT.
-Tried copy in the web interface (by copying directly and not by setting up backup) Some files was copyed but then it just stopped.
-Tried to use the cp command, which just returns some error: "omitting directory `/home/myuser`'"
-Then tried to run rsync with a -a flag, That failed after just a couple of files. Then I used the -r flag wich worked better but failed after awhile too. Also what happened was that the disk failed somehow (the disk was shown to be mounted but /extern/myexternaldisk was empty) Remounted the disk and then it worked agin

So I thought formatting the Hd in the web interface would help. Basicly tried everyting all over but got the same problems.
I also tried setting up a backup of all "users data"in the web interface. It returned a "Failed" after first run. And strangely then samba did not work. I tried to restart the smb deamon but it said no smb deamon script was present. A reboot fixed the samba problem.
-Last time i Tried rsync, it said the external disk was full. I checked the disk and only 134Gb was used out of 2TB. It also made my /home unavaliable on samba, but /storage was ok.

I set up some logfile with the rsync command. It does not stop on a specific file but just randomly
I remember I had alot of these problems before too with copying to external disks. But that was along time ago and I have reinstalled the firmware since. Maybe it is something wrong with the partition table or something?

Here is some sample of the rsync logs:

Code: Select all

1. Try -a flag
2014/09/23 23:12:03 [457] cd+++++++++ cloud/Arkiv/Brev/2013/
2014/09/23 23:12:11 [457] >f+++++++++ cloud/Arkiv/Brev/2013/1 semesterkort.jpg
2014/09/23 23:12:11 [457] cd+++++++++ cloud/Arkiv/Containers/
2014/09/23 23:14:05 [457] rsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at rsync.c(543) [sender=3.0.7]

2. Try, -r flag. It went abit further
2014/09/24 00:26:53 [1066] >f+++++++++ cloud/Arkiv/Containers/Container
2014/09/24 00:34:25 [1066] >f+++++++++ cloud/Arkiv/Containers/Data inv.tcc
2014/09/24 00:34:42 [1066] >f+++++++++ cloud/Arkiv/Containers/Pass og diverse
2014/09/24 00:38:42 [1066] rsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at rsync.c(543) [sender=3.0.7]

3. Try
2014/09/24 16:24:07 [8347] cd+++++++++ cloud/books/Collections/Great Science Textbooks DVD Library 2007 - Update Jun 2008/Psychology/
2014/09/24 16:24:31 [8347] >f+++++++++ cloud/books/Collections/Great Science Textbooks DVD Library 2007 - Update Jun 2008/Psychology/Gross - Psychology - Science of Mind and Behavior 5e (Hodder, 2005).djvu
2014/09/24 16:32:05 [8347] rsync: writefd_unbuffered failed to write 4 bytes to socket [sender]: Broken pipe (32)
2014/09/24 16:32:05 [8347] rsync: write failed on "/home/storage/extern/Elements_10B8-1/cloud/books/Collections/Great Science Textbooks DVD Library 2007 - Update Jun 2008/Psychology/Gross - Psychology - Science of Mind and Behavior 5e (Hodder, 2005).pdf": No space left on device (28)
2014/09/24 16:32:05 [8347] rsync error: error in file IO (code 11) at receiver.c(302) [receiver=3.0.7]
2014/09/24 16:32:06 [8347] rsync: connection unexpectedly closed (278536 bytes received so far) [sender]
2014/09/24 16:32:06 [8347] rsync error: error in rsync protocol data stream (code 12) at io.c(601) [sender=3.0.7]

4. Try, Disk full
2014/09/24 19:50:21 [14757] building file list
2014/09/24 19:57:56 [14757] rsync: writefd_unbuffered failed to write 4 bytes to socket [sender]: Broken pipe (32)
2014/09/24 19:57:56 [14757] rsync: write failed on "/home/storage/extern/Elements_10B8-1/cloud/Arkiv/Containers/Container": No space left on device (28)
2014/09/24 19:57:56 [14757] rsync error: error in file IO (code 11) at receiver.c(302) [receiver=3.0.7]
2014/09/24 19:57:57 [14757] rsync: connection unexpectedly closed (46 bytes received so far) [sender]
2014/09/24 19:57:57 [14757] rsync error: error in rsync protocol data stream (code 12) at io.c(601) [sender=3.0.7]

5. Try.  After a reboot, copyed for awhile abut then disk full agin
2014/09/25 21:42:53 [10437] >f+++++++++ media/music/Danny_Howells_-_ProtonGT_on_Proton_Radio_-_30.07.2009_mixing.dj.mp3
2014/09/25 21:43:33 [10437] >f+++++++++ media/music/Danny_Howells_-_Schaamteloos_DJs_-_Live_@_Panama_(Amsterdam)_-_31-07-2009_mixing.dj.mp3
2014/09/25 21:44:29 [10437] >f+++++++++ media/music/Filosofihistorie på 200 minutter128kbps.rar
2014/09/25 21:45:05 [10437] rsync: writefd_unbuffered failed to write 4 bytes to socket [sender]: Broken pipe (32)
2014/09/25 21:45:05 [10437] rsync: write failed on "/home/storage/extern/Elements_10B8-1/media/music/Project-Meditation _ LifeFlow 9.wav": No space left on device (28)
2014/09/25 21:45:05 [10437] rsync error: error in file IO (code 11) at receiver.c(302) [receiver=3.0.7]
2014/09/25 21:45:05 [10437] rsync: connection unexpectedly closed (422 bytes received so far) [sender]
2014/09/25 21:45:05 [10437] rsync error: error in rsync protocol data stream (code 12) at io.c(601) [sender=3.0.7]
If something is unclear, ask me.
Ubi
Posts: 1549
Joined: 17 Jul 2007, 09:01

Re: Problems backing up my files

Post by Ubi »

as for cp: if you use cp -a your copy will work.

as for rsync, your reported error "No space left on device (28)", suggests you are not writing to the location you think you are writing to. What's the output of "df -h" on your system with that USB disk mounted?
86ivar
Posts: 148
Joined: 02 Oct 2010, 11:08

Re: Problems backing up my files

Post by 86ivar »

Tried cp -a and it said no space left on device3 too.

Code: Select all

ksn@b2:~$ df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/sda1             9.2G  1.6G  7.2G  19% /
tmpfs                 125M     0  125M   0% /lib/init/rw
udev                   10M  148K  9.9M   2% /dev
tmpfs                 125M  4.0K  125M   1% /dev/shm
/dev/mapper/bubba-storage
                      1.8T  1.7T     0 100% /home
du -sh on the external disk

Code: Select all

ksn@b2:/home/storage/extern/Elements_10B8-1$ du -sh
131G    .
Ubi
Posts: 1549
Joined: 17 Jul 2007, 09:01

Re: Problems backing up my files

Post by Ubi »

Soooo.. Whats the problem? Your local disk is completely full. It seems you are moving dat to that disk while you think you are moving it to the usb, or the is another reason the disk is full, but i think you should address this first.
86ivar
Posts: 148
Joined: 02 Oct 2010, 11:08

Re: Problems backing up my files

Post by 86ivar »

Lol, you are right, I have been copying from b2 to b2.
But, When I copy or rsync i put the destination to /home/storage/extern/Elements_10B8-1 and not somewhere else in any of the tries. And the data appeared on the external disk too.
But now I removed the external disk and the data is still in the ./external/Myexternal disk folder. I dont understand why my b2 suddenly decided to copy to both itself and the disk. Is the destination "/home/storage/extern/Elements_10B8-1" wrong maybe?

Anyway I tried to rsync over ssh to another linux server with linux and that fails after awhile too, same problem.
Ubi
Posts: 1549
Joined: 17 Jul 2007, 09:01

Re: Problems backing up my files

Post by Ubi »

The problem is that the usb was never mounted inthe first place. You copied data to /mnt/usb (or whatever) thinking that this was the mount point. It wasn't, it was just a folder on the disk. Maybe the disk was mounted there at some stage, but when it got disconnected, all you were left with was a folder on the system, and linux has no problem copying data there...
86ivar
Posts: 148
Joined: 02 Oct 2010, 11:08

Re: Problems backing up my files

Post by 86ivar »

Makes sense, I tried mounting the disk in shell instead of in the web interface.
I have been copying for awhile now and it seems to work finally!
Post Reply