[arch-general] how to migrate installs between hard drives?
I know this isn't particularly an arch question, but I know Arch people are better off to ask then most. I'm in the process of upgrading my hard drive in my laptop but with the amounts of customizations I've done to my setup, I don't want to have to set it all up again. I know about running dd to copy the partition information, but the problem with that is that it also copies that partition information over. So, if I copy my root partition that started as a 40G partition with 90% used and now I have a 60G parition, the used portion will be kept at 90% so, it'll show something like 50G of data... which doesn't make sense. I've also just tried copying the partitions to an external, mount the iso's in a livecd session then copy the data over, but for some reason after I modified the menu.lst and fstab files to match my new setup and then restart, the computer doesn't boot. Is there something I'm missing in the second instance that I didn't change a file that should be changed? Is there a better way of copying the partitions so I don't run into this problem? Thanks, Will
On Sun, Jul 26, 2009 at 1:06 PM, Will Siddall<will.siddall@gmail.com> wrote:
I know this isn't particularly an arch question, but I know Arch people are better off to ask then most.
I'm in the process of upgrading my hard drive in my laptop but with the amounts of customizations I've done to my setup, I don't want to have to set it all up again.
I know about running dd to copy the partition information, but the problem with that is that it also copies that partition information over. So, if I copy my root partition that started as a 40G partition with 90% used and now I have a 60G parition, the used portion will be kept at 90% so, it'll show something like 50G of data... which doesn't make sense.
What about a dd followed by using parted/gparted or whatever to resize things as necessary? They have a good LiveCD too that you should be able to use to get things copied and then resized. I think gparted even has built in support for copying partitions; not sure if it can do it across drives. -Dan
That's what I wanted to do, but since I'm working in a laptop, I can only have one drive in at a time, which is making things really labour intensive. 1 question I do have is if I dd the entire disk (parition table and all) then reapply to a larger disk, would that keep everything intact or am I gonna run into the same problem? On Sun, Jul 26, 2009 at 6:12 PM, Dan McGee<dpmcgee@gmail.com> wrote:
On Sun, Jul 26, 2009 at 1:06 PM, Will Siddall<will.siddall@gmail.com> wrote:
I know this isn't particularly an arch question, but I know Arch people are better off to ask then most.
I'm in the process of upgrading my hard drive in my laptop but with the amounts of customizations I've done to my setup, I don't want to have to set it all up again.
I know about running dd to copy the partition information, but the problem with that is that it also copies that partition information over. So, if I copy my root partition that started as a 40G partition with 90% used and now I have a 60G parition, the used portion will be kept at 90% so, it'll show something like 50G of data... which doesn't make sense.
What about a dd followed by using parted/gparted or whatever to resize things as necessary? They have a good LiveCD too that you should be able to use to get things copied and then resized.
I think gparted even has built in support for copying partitions; not sure if it can do it across drives.
-Dan
On Sun, Jul 26, 2009 at 2:17 PM, Will Siddall <will.siddall@gmail.com>wrote:
1 question I do have is if I dd the entire disk (parition table and all) then reapply to a larger disk, would that keep everything intact or am I gonna run into the same problem?
Okay: A <- The disk that already has an installation but is smaller B <- The disk that that you want to put the installation on if you dd A onto B, B will get the partition structure from A and appear smaller. However, you can edit the partition sizes using gparted like Dan said, and make the partitions fill up the whole B disk. -- Alexander Lam
On Sun, 26 Jul 2009 14:34:35 -0400 Alexander Lam <lambchop468@gmail.com> wrote:
... A <- The disk that already has an installation but is smaller B <- The disk that that you want to put the installation on
if you dd A onto B, B will get the partition structure from A and appear smaller. However, you can edit the partition sizes using gparted like Dan said, and make the partitions fill up the whole B disk.
You can also dd a single partition from A onto B, then run fdisk, DELETE the partition and recreate it with bigger size, then run resize2fs to extend the file system to fill the whole new partition. (Of course resize2fs works only with ext2/ext3/ext4). Cheers, Sergey
I think clonezilla could help you here. On Sun, Jul 26, 2009 at 1:12 PM, Dan McGee <dpmcgee@gmail.com> wrote:
On Sun, Jul 26, 2009 at 1:06 PM, Will Siddall<will.siddall@gmail.com> wrote:
I know this isn't particularly an arch question, but I know Arch people are better off to ask then most.
I'm in the process of upgrading my hard drive in my laptop but with the amounts of customizations I've done to my setup, I don't want to have to set it all up again.
I know about running dd to copy the partition information, but the problem with that is that it also copies that partition information over. So, if I copy my root partition that started as a 40G partition with 90% used and now I have a 60G parition, the used portion will be kept at 90% so, it'll show something like 50G of data... which doesn't make sense.
What about a dd followed by using parted/gparted or whatever to resize things as necessary? They have a good LiveCD too that you should be able to use to get things copied and then resized.
I think gparted even has built in support for copying partitions; not sure if it can do it across drives.
-Dan
Another option is using rsync to copy all files to the other disk. This can be done with a temporary server storage if necessary. If you use the -a switch, it keeps permissions intact and works perfectly for Linux, not for Windows, but who uses that anyway? ;) Greetings! Erwin On Sunday 26 July 2009, Nergar wrote:
I think clonezilla could help you here.
On Sun, Jul 26, 2009 at 1:12 PM, Dan McGee <dpmcgee@gmail.com> wrote:
On Sun, Jul 26, 2009 at 1:06 PM, Will Siddall<will.siddall@gmail.com>
wrote:
I know this isn't particularly an arch question, but I know Arch people are better off to ask then most.
I'm in the process of upgrading my hard drive in my laptop but with the amounts of customizations I've done to my setup, I don't want to have to set it all up again.
I know about running dd to copy the partition information, but the problem with that is that it also copies that partition information over. So, if I copy my root partition that started as a 40G partition with 90% used and now I have a 60G parition, the used portion will be kept at 90% so, it'll show something like 50G of data... which doesn't make sense.
What about a dd followed by using parted/gparted or whatever to resize things as necessary? They have a good LiveCD too that you should be able to use to get things copied and then resized.
I think gparted even has built in support for copying partitions; not sure if it can do it across drives.
-Dan
Hi :) On Sunday 26 July 2009 20:34:12 Van de Velde Erwin wrote:
Another option is using rsync to copy all files to the other disk. This can be done with a temporary server storage if necessary. If you use the -a switch, it keeps permissions intact and works perfectly for Linux, not for Windows, but who uses that anyway? ;)
I agree. I use rsync to migrate between drives. Haven't had any problems yet. As Erwin wrote, you can use the -a switch and also the -v and --progress. I do this booting with a LiveCD/USB image -> rsync to the temp server/system -
rsync back.
Once you rsync back to your laptop with the new drive. Boot with the LiveCD/USB image and check things like fstab or /boot/grub/menu.lst because the ID will have changed. Maybe you have to boot a couple of times with the LiveCD/USB image because you forgot to edit this or that file. HTH Rafa
On Sunday 26 July 2009, Nergar wrote:
I think clonezilla could help you here.
On Sun, Jul 26, 2009 at 1:12 PM, Dan McGee <dpmcgee@gmail.com> wrote:
On Sun, Jul 26, 2009 at 1:06 PM, Will Siddall<will.siddall@gmail.com>
wrote:
I know this isn't particularly an arch question, but I know Arch people are better off to ask then most.
I'm in the process of upgrading my hard drive in my laptop but with the amounts of customizations I've done to my setup, I don't want to have to set it all up again.
I know about running dd to copy the partition information, but the problem with that is that it also copies that partition information over. So, if I copy my root partition that started as a 40G partition with 90% used and now I have a 60G parition, the used portion will be kept at 90% so, it'll show something like 50G of data... which doesn't make sense.
What about a dd followed by using parted/gparted or whatever to resize things as necessary? They have a good LiveCD too that you should be able to use to get things copied and then resized.
I think gparted even has built in support for copying partitions; not sure if it can do it across drives.
-Dan
-- "We cannot treat computers as Humans. Computers need love." rgriman@skype.com rgriman@jabberes.org
Thanks everyone for their suggestions. I'm really tempted to give each of these methods a try. For the time being, I did get it finished. Without having to take all the hardware apart, I just made a clean base install of arch onto the disk and use the livecd, mounted the iso and copied everything over. I'm up and running, but whenever this happens again, I'll be sure to give your suggestions a try (and at least it's documented). Thanks so much. Will On Sun, Jul 26, 2009 at 4:58 PM, Rafa Griman<rafagriman@gmail.com> wrote:
Hi :)
On Sunday 26 July 2009 20:34:12 Van de Velde Erwin wrote:
Another option is using rsync to copy all files to the other disk. This can be done with a temporary server storage if necessary. If you use the -a switch, it keeps permissions intact and works perfectly for Linux, not for Windows, but who uses that anyway? ;)
I agree. I use rsync to migrate between drives. Haven't had any problems yet. As Erwin wrote, you can use the -a switch and also the -v and --progress.
I do this booting with a LiveCD/USB image -> rsync to the temp server/system -
rsync back.
Once you rsync back to your laptop with the new drive. Boot with the LiveCD/USB image and check things like fstab or /boot/grub/menu.lst because the ID will have changed. Maybe you have to boot a couple of times with the LiveCD/USB image because you forgot to edit this or that file.
HTH
Rafa
On Sunday 26 July 2009, Nergar wrote:
I think clonezilla could help you here.
On Sun, Jul 26, 2009 at 1:12 PM, Dan McGee <dpmcgee@gmail.com> wrote:
On Sun, Jul 26, 2009 at 1:06 PM, Will Siddall<will.siddall@gmail.com>
wrote:
I know this isn't particularly an arch question, but I know Arch people are better off to ask then most.
I'm in the process of upgrading my hard drive in my laptop but with the amounts of customizations I've done to my setup, I don't want to have to set it all up again.
I know about running dd to copy the partition information, but the problem with that is that it also copies that partition information over. So, if I copy my root partition that started as a 40G partition with 90% used and now I have a 60G parition, the used portion will be kept at 90% so, it'll show something like 50G of data... which doesn't make sense.
What about a dd followed by using parted/gparted or whatever to resize things as necessary? They have a good LiveCD too that you should be able to use to get things copied and then resized.
I think gparted even has built in support for copying partitions; not sure if it can do it across drives.
-Dan
-- "We cannot treat computers as Humans. Computers need love."
rgriman@skype.com rgriman@jabberes.org
if think dd is the worst way to copy data between disk or partition i used to copy data from one partition to another the "old" way by using tar and a pipe tar -C /myfirst partition -csSf -|tar -C /mysecondpartition -xSsp rsync is not bad too.
Excerpts from solsTiCe d'Hiver's message of Mon Jul 27 10:16:21 -0400 2009:
if think dd is the worst way to copy data between disk or partition
Why, out of curiosity? -- Andrei Thorp, Developer: Xandros Corp. (http://www.xandros.com)
Why, out of curiosity?
dd copy the data of the raw device. i.e the files but also the filesystem data and metadata. which you don't really need or wish to copy to another partition/disk. i said it's the worst, not that it does not work. but you have to take extra step after you have used dd (to resize filesystem and so on)...
Here's another update. Using Mike's advice and I tried a simple 'cp -av' on my home directory. After everything was completed, I do a 'ls -al' and find that everything is set to root / root. Modes are intact, but that's it. I've tried this from the Ubuntu livecd and running from my original hard disk. Tonight, I'm going to give it another try and use And Solstice, I understand your point but everything else hasn't worked for me yet. I'm going to do a dd on the whole disk tonight and try a workaround. Thanks again everyone On Wed, Jul 29, 2009 at 7:52 AM, solsTiCe d'Hiver<solstice.dhiver@gmail.com> wrote:
Why, out of curiosity?
dd copy the data of the raw device. i.e the files but also the filesystem data and metadata. which you don't really need or wish to copy to another partition/disk.
i said it's the worst, not that it does not work. but you have to take extra step after you have used dd (to resize filesystem and so on)...
Yes I would dd (or ddrescue or dd_rescue - the rescues give you progress output) the whole drive, not the individual partitions. Then just use Parted Magic Live CD or GParted Live CD and expand the partitions. I've done this many many times without issue.. and usually you don't even have to repair grub afterwards... Another solution is using Clonezilla (use disk to local disk), (which I think might even have a switch to expand at the same time but I've never used that option) and then use Parted Magic Live CD which has Gparted in it to expand. BTW Parted Magic Live CD has Clonezilla as well so it's really all you need (I'm sure all the dd tools are on it too) -Jon ----- Original Message ---- From: Will Siddall <will.siddall@gmail.com> To: General Discusson about Arch Linux <arch-general@archlinux.org> Sent: Wednesday, July 29, 2009 6:22:08 PM Subject: Re: [arch-general] how to migrate installs between hard drives? And Solstice, I understand your point but everything else hasn't worked for me yet. I'm going to do a dd on the whole disk tonight and try a workaround. Thanks again everyone
I tried a simple 'cp -av' [...] and find that everything is set to root / root
if you want to preserve permission, you need to use -p too. Do you know that there exists something called the man pages (the manual pages) for each command on your system ? so if you run 'man cp', you get a list of all the options of cp and how it works. no offense, i am still reading them every day. i think at this point, you really need to read them carefully. otherwise at every new question you will ask you will get back a RTFM.
Thanks solsTiCe, no offense taken, but I am one of the people that RTFM. Plus, the -a option gives you -p anyways, so ownership, mode and timestamps are kept by default. This is just a weird coincidence that I can't explain. I've been able to copy a drive before, but never with this much difficulty. On Thu, Jul 30, 2009 at 7:39 AM, solsTiCe d'Hiver<solstice.dhiver@gmail.com> wrote:
I tried a simple 'cp -av' [...] and find that everything is set to root / root
if you want to preserve permission, you need to use -p too.
Do you know that there exists something called the man pages (the manual pages) for each command on your system ? so if you run 'man cp', you get a list of all the options of cp and how it works.
no offense, i am still reading them every day. i think at this point, you really need to read them carefully.
otherwise at every new question you will ask you will get back a RTFM.
On 07/30/09 at 12:39pm, solsTiCe d'Hiver wrote:
I tried a simple 'cp -av' [...] and find that everything is set to root / root
if you want to preserve permission, you need to use -p too.
Do you know that there exists something called the man pages (the manual pages) for each command on your system ? so if you run 'man cp', you get a list of all the options of cp and how it works.
man cp said: -a --archive same as -dR --preserve=all so shouldn't -a work just fine? (-p is --preserve btw) it worked fine for me when i migrated from 32 to 64 bit by reinstalling and restoring /home /etc -- patrick brisbin
Just so everyone knows what I'm doing, here is what I'm doing: $ls -al ~ | tail -n 5 -rw-r--r-- 1 myusername users 222118 2008-11-28 10:23 untitled.JPG -rwxr-xr-x 1 myusername users 172 2008-03-12 12:14 wmamp3 drwxr-xr-x 4 myusername users 4096 2008-10-05 22:41 workspace -rw-r--r-- 1 myusername users 1041452 2008-11-18 21:29 xine-out.wav -rw-r--r-- 1 myusername users 0 2009-07-21 21:18 zero.trf $cp -a --preserve=all ~ /media/bigdrive/backups/ $ls -al /media/bigdrive/backups | tail -n 5 -rwxrwxrwx 1 root root 222118 2008-11-28 10:23 untitled.JPG -rwxrwxrwx 1 root root 172 2008-03-12 12:14 wmamp3 drwxrwxrwx 4 root root 4096 2008-10-05 22:41 workspace -rwxrwxrwx 1 root root 1041452 2008-11-18 21:29 xine-out.wav -rwxrwxrwx 1 root root 0 2009-07-21 21:18 zero.trf I've been using this stuff enough to know what's in the man pages and how to use google. No matter what though, the output is the same whether I'm running it from within my Arch install or from a live cd like ubuntu. On Thu, Jul 30, 2009 at 10:44 AM, Patrick Brisbin<pbrisbin@gmail.com> wrote:
On 07/30/09 at 12:39pm, solsTiCe d'Hiver wrote:
I tried a simple 'cp -av' [...] and find that everything is set to root / root
if you want to preserve permission, you need to use -p too.
Do you know that there exists something called the man pages (the manual pages) for each command on your system ? so if you run 'man cp', you get a list of all the options of cp and how it works.
man cp said:
-a --archive same as -dR --preserve=all
so shouldn't -a work just fine? (-p is --preserve btw) it worked fine for me when i migrated from 32 to 64 bit by reinstalling and restoring /home /etc
-- patrick brisbin
On Thu, 2009-07-30 at 11:23 -0300, Will Siddall wrote:
Just so everyone knows what I'm doing, here is what I'm doing: $ls -al ~ | tail -n 5 -rw-r--r-- 1 myusername users 222118 2008-11-28 10:23 untitled.JPG -rwxr-xr-x 1 myusername users 172 2008-03-12 12:14 wmamp3 drwxr-xr-x 4 myusername users 4096 2008-10-05 22:41 workspace -rw-r--r-- 1 myusername users 1041452 2008-11-18 21:29 xine-out.wav -rw-r--r-- 1 myusername users 0 2009-07-21 21:18 zero.trf
$cp -a --preserve=all ~ /media/bigdrive/backups/ $ls -al /media/bigdrive/backups | tail -n 5 -rwxrwxrwx 1 root root 222118 2008-11-28 10:23 untitled.JPG -rwxrwxrwx 1 root root 172 2008-03-12 12:14 wmamp3 drwxrwxrwx 4 root root 4096 2008-10-05 22:41 workspace -rwxrwxrwx 1 root root 1041452 2008-11-18 21:29 xine-out.wav -rwxrwxrwx 1 root root 0 2009-07-21 21:18 zero.trf
I've been using this stuff enough to know what's in the man pages and how to use google. No matter what though, the output is the same whether I'm running it from within my Arch install or from a live cd like ubuntu.
What filesystem is the destination? You're aware of the fact that FAT32 doesn't support permissions and ownership?
The hd is ext3, the bigdrive is ntfs On Thu, Jul 30, 2009 at 11:27 AM, Jan de Groot<jan@jgc.homeip.net> wrote:
On Thu, 2009-07-30 at 11:23 -0300, Will Siddall wrote:
Just so everyone knows what I'm doing, here is what I'm doing: $ls -al ~ | tail -n 5 -rw-r--r-- 1 myusername users 222118 2008-11-28 10:23 untitled.JPG -rwxr-xr-x 1 myusername users 172 2008-03-12 12:14 wmamp3 drwxr-xr-x 4 myusername users 4096 2008-10-05 22:41 workspace -rw-r--r-- 1 myusername users 1041452 2008-11-18 21:29 xine-out.wav -rw-r--r-- 1 myusername users 0 2009-07-21 21:18 zero.trf
$cp -a --preserve=all ~ /media/bigdrive/backups/ $ls -al /media/bigdrive/backups | tail -n 5 -rwxrwxrwx 1 root root 222118 2008-11-28 10:23 untitled.JPG -rwxrwxrwx 1 root root 172 2008-03-12 12:14 wmamp3 drwxrwxrwx 4 root root 4096 2008-10-05 22:41 workspace -rwxrwxrwx 1 root root 1041452 2008-11-18 21:29 xine-out.wav -rwxrwxrwx 1 root root 0 2009-07-21 21:18 zero.trf
I've been using this stuff enough to know what's in the man pages and how to use google. No matter what though, the output is the same whether I'm running it from within my Arch install or from a live cd like ubuntu.
What filesystem is the destination? You're aware of the fact that FAT32 doesn't support permissions and ownership?
I think NTFS is the issue. I don't think that it supports the same permission and ownership capabilities as native *nix file systems. For example, when I mount my windows partition, I have to specify a gid and a umask, else I don't have permissions to access it. From my fstab: /dev/sda2 /mnt/windows ntfs ro,gid=users,umask=0222 0 1 Must the destination be NTFS? DR Will Siddall wrote:
The hd is ext3, the bigdrive is ntfs
What filesystem is the destination? You're aware of the fact that FAT32 doesn't support permissions and ownership?
If the NTFS partition is mandatory, and you're doing a backup, you could just tar everything. It will sure preserve every attribute. Em Thu, 30 Jul 2009 12:08:32 -0300, David Rosenstrauch <darose@darose.net> escreveu:
I think NTFS is the issue. I don't think that it supports the same permission and ownership capabilities as native *nix file systems.
For example, when I mount my windows partition, I have to specify a gid and a umask, else I don't have permissions to access it. From my fstab:
/dev/sda2 /mnt/windows ntfs ro,gid=users,umask=0222 0 1
Must the destination be NTFS?
DR
Will Siddall wrote:
The hd is ext3, the bigdrive is ntfs
What filesystem is the destination? You're aware of the fact that FAT32 doesn't support permissions and ownership?
If the NTFS partition is mandatory, and you're doing a backup, you could just tar everything. It will sure preserve every attribute.
Em Thu, 30 Jul 2009 12:08:32 -0300, David Rosenstrauch <darose@darose.net> escreveu:
I think NTFS is the issue. I don't think that it supports the same permission and ownership capabilities as native *nix file systems.
For example, when I mount my windows partition, I have to specify a gid and a umask, else I don't have permissions to access it. From my fstab:
/dev/sda2 /mnt/windows ntfs ro,gid=users,umask=0222 0 1
Must the destination be NTFS?
DR
Will Siddall wrote:
The hd is ext3, the bigdrive is ntfs
What filesystem is the destination? You're aware of the fact that FAT32 doesn't support permissions and ownership?
NTFS certainly doesn't support the same attributes. I'd recommend doing as was suggested (using tar) or some similar archiving method or just use another filesystem for the big drive -- I like to format all of my external drives with a large partition (most of the disk) that is ext3 and a very small partition on the beginning of the disk (20 mb or so)
Adriano de Moura wrote: that is fat32 which contains the ext3 filesystem driver for windows machines so that they can install it if necessary to access the other partition on the disk.
I like to format all of my external drives with a large partition (most of the disk) that is ext3 and a very small partition on the beginning of
On Thu, 30 Jul 2009 09:23:37 -0600, Tim Gelter <tgelter@gurulabs.com> wrote: the disk (20 mb or so) that is fat32 which contains the ext3 filesystem driver for windows machines so that they can install it if necessary to access the other partition on the disk. What driver do you use for accessing the ext3 partitions? I found the following to choose from: Ext2 IFS and Ext2 FSD How is the stability. Did you have any trouble getting it to work? Until now I have only used ext3 for one of my external harddrives, the other two have been formatted with the ntfs filesystem. It would be nice though to be able to use the drives with the native linux filesystem instead. Thanks, Best regards, Rene
On Thu, 30 Jul 2009 23:26:29 +0200 Rene Rasmussen <archlinux@paranoidix.dk> wrote:
... I found the following to choose from: Ext2 IFS and Ext2 FSD
How is the stability. Did you have any trouble getting it to work?
I use Ext2Fsd for long time (in read-only mode), it's pretty stable, I never had a problem with it. Cheers, Sergey
On Thu, Jul 30, 2009 at 03:47:17PM -0600, Sergey Manucharian wrote:
On Thu, 30 Jul 2009 23:26:29 +0200 Rene Rasmussen <archlinux@paranoidix.dk> wrote:
... I found the following to choose from: Ext2 IFS and Ext2 FSD
How is the stability. Did you have any trouble getting it to work?
I use Ext2Fsd for long time (in read-only mode), it's pretty stable, I never had a problem with it.
http://www.fs-driver.org/relnotes.html: The current version of Ext2 IFS only mounts volumes with an inode size of 128 like old Linux kernels have. Note that Arch Linux default inode size was recently changed to 256 (/etc/mke2fs.conf), so you have to manually specify a compatible inode size when creating an ext3 file system to be read with Ext2 IFS. Maybe Ext2fsd hasn't this limitation but I never used it. You can also use the Ext2+/Reiser Total Commander plugin; the last update should work with 256 byte inode size. bye
I've used both of them and found that Ext2Fsd works better. Sometimes I would just lose my partition reference in EXT IFS. Have been using Ext2Fsd for two years now for access to my external harddrive, which has one ext3 partition. Worked fine in every computer I've tried.
Thanks everyone for your help. I will run some checks and see what happens. I hadn't thought about total commander. I use it often, and will definately check the plugin out. Best regards, Rene
Guilherme M. Nogueira wrote:
I've used both of them and found that Ext2Fsd works better.
Sometimes I would just lose my partition reference in EXT IFS.
Have been using Ext2Fsd for two years now for access to my external harddrive, which has one ext3 partition. Worked fine in every computer I've tried.
Yeah, good call. Looks like my ext2 ifs setup stopped working for some reason. (Don't know if it was the inode size issue or not.) Just switched to FSD and it looks solid. Thanks, DR
On Fri, Jul 31, 2009 at 18:43, David Rosenstrauch<darose@darose.net> wrote:
Guilherme M. Nogueira wrote:
I've used both of them and found that Ext2Fsd works better.
Sometimes I would just lose my partition reference in EXT IFS.
Have been using Ext2Fsd for two years now for access to my external harddrive, which has one ext3 partition. Worked fine in every computer I've tried.
Yeah, good call. Looks like my ext2 ifs setup stopped working for some reason. (Don't know if it was the inode size issue or not.)
Just switched to FSD and it looks solid.
Also please note that there are problems with non-ASCII chars in either or both of these drivers and TC plugin (at least last time I tried I wasn't able to get Cyrillic chars visible). -- Roman Kyrylych (Роман Кирилич)
I have a personal motto of never naming files with non-ascii chars. I always move files around with a lot of filesystems (including ntfs and fat32), so I prefer to avoid this potential problem. -- Malformed message exception => Guilherme M. Nogueira => http://nirev.org/
On Fri, Jul 31, 2009 at 07:54:37PM +0300, Roman Kyrylych wrote:
Also please note that there are problems with non-ASCII chars in either or both of these drivers and TC plugin (at least last time I tried I wasn't able to get Cyrillic chars visible).
About the tc plugin: ex2fs.ini (it should reside in the plugin directory) [Options] UTF8=true For not utf8 file systems (from the Readme): The codepages can be obtained from Apache project http://www.apache.org Russian codepage translation KOI8 -> CP1251 are in project. To activate codepage just copy it in tables subfolder and write it's filename in ex2fs.ini file like this: XLATfile=tables\<codepage> Then - set variable EnableXLAT to true like this: EnableXLAT=true
I'm having the same configuration for my external drive: a small fat32 partition with these tools, and the big ext3 with the rest. I did not really tested them though, as I never connect the drive to a windows machine. Do these tools support ext4? 2009/7/31, Alessandro Doro <ordo.ad@gmail.com>:
On Fri, Jul 31, 2009 at 07:54:37PM +0300, Roman Kyrylych wrote:
Also please note that there are problems with non-ASCII chars in either or both of these drivers and TC plugin (at least last time I tried I wasn't able to get Cyrillic chars visible).
About the tc plugin:
ex2fs.ini (it should reside in the plugin directory) [Options] UTF8=true
For not utf8 file systems (from the Readme): The codepages can be obtained from Apache project http://www.apache.org Russian codepage translation KOI8 -> CP1251 are in project. To activate codepage just copy it in tables subfolder and write it's filename in ex2fs.ini file like this: XLATfile=tables\<codepage> Then - set variable EnableXLAT to true like this: EnableXLAT=true
I'm more concerned about compatibility between mac and ext3. Anyone have tried before ?
Rene Rasmussen wrote:
What driver do you use for accessing the ext3 partitions? I found the following to choose from: Ext2 IFS and Ext2 FSD
How is the stability. Did you have any trouble getting it to work?
Until now I have only used ext3 for one of my external harddrives, the other two have been formatted with the ntfs filesystem. It would be nice though to be able to use the drives with the native linux filesystem instead.
Thanks,
Best regards, Rene
I've used Ext2 IFS, but only lightly. Seems to work fine, as it was able to both read from and write to an ext3 partition. But again I've not used it in a heavy duty configuration, or used it often. HTH, DR
On Thu, 30 Jul 2009 18:06:47 -0400 David Rosenstrauch <darose@darose.net> wrote:
Rene Rasmussen wrote:
What driver do you use for accessing the ext3 partitions? I found the following to choose from: Ext2 IFS and Ext2 FSD
How is the stability. Did you have any trouble getting it to work?
Until now I have only used ext3 for one of my external harddrives, the other two have been formatted with the ntfs filesystem. It would be nice though to be able to use the drives with the native linux filesystem instead.
Thanks,
Best regards, Rene
I've used Ext2 IFS, but only lightly. Seems to work fine, as it was able to both read from and write to an ext3 partition. But again I've not used it in a heavy duty configuration, or used it often.
HTH,
DR
Since I have my external drives formatted as ext3 since years I've used ext2 IFS a couple of times and it worked very well, except once where it just didn't. ext fsd worked fine in that case. Never heard of that total commander plugin, might be a nice option. HTH, Philipp
Will Siddall wrote:
Just so everyone knows what I'm doing, here is what I'm doing: $ls -al ~ | tail -n 5 -rw-r--r-- 1 myusername users 222118 2008-11-28 10:23 untitled.JPG -rwxr-xr-x 1 myusername users 172 2008-03-12 12:14 wmamp3 drwxr-xr-x 4 myusername users 4096 2008-10-05 22:41 workspace -rw-r--r-- 1 myusername users 1041452 2008-11-18 21:29 xine-out.wav -rw-r--r-- 1 myusername users 0 2009-07-21 21:18 zero.trf
$cp -a --preserve=all ~ /media/bigdrive/backups/ $ls -al /media/bigdrive/backups | tail -n 5 -rwxrwxrwx 1 root root 222118 2008-11-28 10:23 untitled.JPG -rwxrwxrwx 1 root root 172 2008-03-12 12:14 wmamp3 drwxrwxrwx 4 root root 4096 2008-10-05 22:41 workspace -rwxrwxrwx 1 root root 1041452 2008-11-18 21:29 xine-out.wav -rwxrwxrwx 1 root root 0 2009-07-21 21:18 zero.trf
I've been using this stuff enough to know what's in the man pages and how to use google. No matter what though, the output is the same whether I'm running it from within my Arch install or from a live cd like ubuntu.
Maybe you need to run the cp as root in order to be able to set the owners/groups/modes properly on the new files? i.e.: $ sudo cp -a --preserve=all ~ /media/bigdrive/backups/ HTH, DR
solsTiCe d'Hiver wrote:
if think dd is the worst way to copy data between disk or partition
i used to copy data from one partition to another the "old" way by using tar and a pipe
tar -C /myfirst partition -csSf -|tar -C /mysecondpartition -xSsp
rsync is not bad too.
I also prefer to handle this type of things using tar, though without the pipe. I generally will generate a full tar archive of the original partition, then copy it over to the other disk and either fully untar it, or untar portions of it. The reason I go for the full archive is because I like to keep the tarball around afterwards in case I need to repeat the process, need to untar additional portions of it, etc. DR
Hey everyone, After several attempts, I'm still back to trying to resolve this. To explain in more detail, I had a 100G hd with a root partition (with my Arch Install), a data partition and a swap. I managed to run dd on both partitions and in the new hd (200G) apply both. But that only worked partially due to the fact that it copied the ratios of file sizes rather than the actual file size... Copying 80G of data from a 30G partition doesn't quite sit well with me. Next step was to mount the iso images and copy the files. That's what I was in the process of doing of my last message and it worked... until I went to restart and update. What I found that was that my permissions and ownership info was not kept. Because of this, as soon as I went to update anything, the installers would run, but just delete the files (it deleted pacman and yaourt so I had to find a way to compile pacman to install again... until it tried to update all of my bin tools... then everything was gone). Now following all of your suggestions, I tried rsync -arpol and a variety of different other settings but it still doesn't keep the permissions. I tried running tar on the partition, still not working. Does anyone have any other suggestions or know why I'm having this problem? I'm going to try to wipe out the new hard drive and run dd on the whole 100g disk and reapply it to the 200G disk. And by the way, I'm running a ubuntu livecd to run these processes. Thanks, Will On Mon, Jul 27, 2009 at 1:10 PM, David Rosenstrauch<darose@darose.net> wrote:
solsTiCe d'Hiver wrote:
if think dd is the worst way to copy data between disk or partition
i used to copy data from one partition to another the "old" way by using tar and a pipe
tar -C /myfirst partition -csSf -|tar -C /mysecondpartition -xSsp
rsync is not bad too.
I also prefer to handle this type of things using tar, though without the pipe. I generally will generate a full tar archive of the original partition, then copy it over to the other disk and either fully untar it, or untar portions of it. The reason I go for the full archive is because I like to keep the tarball around afterwards in case I need to repeat the process, need to untar additional portions of it, etc.
DR
On Tue, Jul 28, 2009 at 22:20, Will Siddall<will.siddall@gmail.com> wrote:
Hey everyone, After several attempts, I'm still back to trying to resolve this. To explain in more detail, I had a 100G hd with a root partition (with my Arch Install), a data partition and a swap. I managed to run dd on both partitions and in the new hd (200G) apply both. But that only worked partially due to the fact that it copied the ratios of file sizes rather than the actual file size... Copying 80G of data from a 30G partition doesn't quite sit well with me. Next step was to mount the iso images and copy the files. That's what I was in the process of doing of my last message and it worked... until I went to restart and update. What I found that was that my permissions and ownership info was not kept. Because of this, as soon as I went to update anything, the installers would run, but just delete the files (it deleted pacman and yaourt so I had to find a way to compile pacman to install again... until it tried to update all of my bin tools... then everything was gone). Now following all of your suggestions, I tried rsync -arpol and a variety of different other settings but it still doesn't keep the permissions. I tried running tar on the partition, still not working.
Does anyone have any other suggestions or know why I'm having this problem? I'm going to try to wipe out the new hard drive and run dd on the whole 100g disk and reapply it to the 200G disk. And by the way, I'm running a ubuntu livecd to run these processes.
Did you try the tar method? Also, when you copy files, did you use cp -a? You can also try partimage which makes copies of partitions. Doing full byte-to-byte copy of HDD and then doing partition/fs resize or creating an additional partition in empty space is my preferred method. -- Roman Kyrylych (Роман Кирилич)
Roman, I did try the tar method with the same results. The only method I could see working would be the dd, but even looking at the mounted iso afterwards, permissions were not set. I should be seeing at least ownership by my username, or 'user #1000' but after copying (and yes, with 'cp -a') it still returns root. Will On Tue, Jul 28, 2009 at 5:15 PM, Roman Kyrylych<roman.kyrylych@gmail.com> wrote:
On Tue, Jul 28, 2009 at 22:20, Will Siddall<will.siddall@gmail.com> wrote:
Hey everyone, After several attempts, I'm still back to trying to resolve this. To explain in more detail, I had a 100G hd with a root partition (with my Arch Install), a data partition and a swap. I managed to run dd on both partitions and in the new hd (200G) apply both. But that only worked partially due to the fact that it copied the ratios of file sizes rather than the actual file size... Copying 80G of data from a 30G partition doesn't quite sit well with me. Next step was to mount the iso images and copy the files. That's what I was in the process of doing of my last message and it worked... until I went to restart and update. What I found that was that my permissions and ownership info was not kept. Because of this, as soon as I went to update anything, the installers would run, but just delete the files (it deleted pacman and yaourt so I had to find a way to compile pacman to install again... until it tried to update all of my bin tools... then everything was gone). Now following all of your suggestions, I tried rsync -arpol and a variety of different other settings but it still doesn't keep the permissions. I tried running tar on the partition, still not working.
Does anyone have any other suggestions or know why I'm having this problem? I'm going to try to wipe out the new hard drive and run dd on the whole 100g disk and reapply it to the 200G disk. And by the way, I'm running a ubuntu livecd to run these processes.
Did you try the tar method? Also, when you copy files, did you use cp -a? You can also try partimage which makes copies of partitions. Doing full byte-to-byte copy of HDD and then doing partition/fs resize or creating an additional partition in empty space is my preferred method.
-- Roman Kyrylych (Роман Кирилич)
What's the problem changing back the permitions? Best, Jozsef -- "Fear God, and give Him glory, because the hour of His judgment has come; worship Him who made the heaven and the earth and sea and springs of waters." Revelation 14:7 On Wed, Jul 29, 2009 at 12:25 AM, Will Siddall <will.siddall@gmail.com>wrote:
Roman, I did try the tar method with the same results. The only method I could see working would be the dd, but even looking at the mounted iso afterwards, permissions were not set. I should be seeing at least ownership by my username, or 'user #1000' but after copying (and yes, with 'cp -a') it still returns root.
Will
On Tue, Jul 28, 2009 at 5:15 PM, Roman Kyrylych<roman.kyrylych@gmail.com> wrote:
On Tue, Jul 28, 2009 at 22:20, Will Siddall<will.siddall@gmail.com> wrote:
Hey everyone, After several attempts, I'm still back to trying to resolve this. To explain in more detail, I had a 100G hd with a root partition (with my Arch Install), a data partition and a swap. I managed to run dd on both partitions and in the new hd (200G) apply both. But that only worked partially due to the fact that it copied the ratios of file sizes rather than the actual file size... Copying 80G of data from a 30G partition doesn't quite sit well with me. Next step was to mount the iso images and copy the files. That's what I was in the process of doing of my last message and it worked... until I went to restart and update. What I found that was that my permissions and ownership info was not kept. Because of this, as soon as I went to update anything, the installers would run, but just delete the files (it deleted pacman and yaourt so I had to find a way to compile pacman to install again... until it tried to update all of my bin tools... then everything was gone). Now following all of your suggestions, I tried rsync -arpol and a variety of different other settings but it still doesn't keep the permissions. I tried running tar on the partition, still not working.
Does anyone have any other suggestions or know why I'm having this problem? I'm going to try to wipe out the new hard drive and run dd on the whole 100g disk and reapply it to the 200G disk. And by the way, I'm running a ubuntu livecd to run these processes.
Did you try the tar method? Also, when you copy files, did you use cp -a? You can also try partimage which makes copies of partitions. Doing full byte-to-byte copy of HDD and then doing partition/fs resize or creating an additional partition in empty space is my preferred method.
-- Roman Kyrylych (Роман Кирилич)
On Wed, Jul 29, 2009 at 6:25 AM, Will Siddall<will.siddall@gmail.com> wrote:
Roman, I did try the tar method with the same results. The only method I could see working would be the dd, but even looking at the mounted iso afterwards, permissions were not set. I should be seeing at least ownership by my username, or 'user #1000' but after copying (and yes, with 'cp -a') it still returns root.
Will
This sounds weird. I have used cp -av to copy entire installs from partition to partition and from disk to disk many times in the past and permissions were always maintained. You mentioned you are using a ubuntu live cd to do this. Is there any chance your destination disk is being mounted with options that would interfere with permissions ? Maybe try the Arch live cd? Mike
Mike Sampson wrote:
On Wed, Jul 29, 2009 at 6:25 AM, Will Siddall<will.siddall@gmail.com> wrote:
Roman, I did try the tar method with the same results. The only method I could see working would be the dd, but even looking at the mounted iso afterwards, permissions were not set. I should be seeing at least ownership by my username, or 'user #1000' but after copying (and yes, with 'cp -a') it still returns root.
Will
This sounds weird. I have used cp -av to copy entire installs from partition to partition and from disk to disk many times in the past and permissions were always maintained. You mentioned you are using a ubuntu live cd to do this. Is there any chance your destination disk is being mounted with options that would interfere with permissions ? Maybe try the Arch live cd?
Mike #Boot LiveCD #old_drive=/dev/sda #new_drive=/dev/sdb
mkdir -p /mnt/{old,new} fdisk /dev/sdb mkfs /dev/sdb1 mount /dev/sda1 /mnt/old mount /dev/sdb1 /tmp/new rsync -aHvW --numeric-ids /mnt/old/ /mnt/new/ cat /proc/mounts > /mnt/new/etc/mtab grub-install --no-floppy --root-directory=/mnt/new /dev/sdb reboot
Will Siddall 提到:
Is there something I'm missing in the second instance that I didn't change a file that should be changed? Is there a better way of copying the partitions so I don't run into this problem?
Thanks, Will Not only dd, you could also simply use archive mode of rsync or cp.
I've done this before, and the system I'm using now is migrated from a 250g to 500g. At that time I used rsync and skipped directory /dev, /proc and /sys. After a successful re-setup of grub, the system boots like a charm. regards, b4283.
participants (26)
-
Adriano de Moura
-
Alessandro Doro
-
Alexander Lam
-
Andrei Thorp
-
b4283
-
Dan McGee
-
David Rosenstrauch
-
edac val
-
Guilherme M. Nogueira
-
hollunder＠gmx.at
-
Jan de Groot
-
Jonathan Brown
-
Jozsef
-
ludovic coues
-
Mike Sampson
-
Nergar
-
Nicolas Bigaouette
-
Patrick Brisbin
-
Rafa Griman
-
Rene Rasmussen
-
Roman Kyrylych
-
Sergey Manucharian
-
solsTiCe d'Hiver
-
Tim Gelter
-
Van de Velde Erwin
-
Will Siddall