• Posts 3
  • Member Since
  • Last Active
  • Name Leszek A. Szczepanowski
  • Location: Wroclaw, Poland
  • Occupation: Technical Support Engineer
  • Hobbies: planespotting, jazz
  • Google Talk twinsen
All Posts Topics Started
Merge all clouds space into ONE folder
Those, who want to merge all free spaces into one, without paying for cloud storage. To have a big for example 250GB cloud, in one folder. For free.
I would pay for SME Personal (now I use free 3 cloud providers), if it had this feature [smile] Here you have an example what I mean:


That file 'haslo do biosa.txt' is on SME cloud storage and that 'DCIM' folder is on Dropbox. In mounts it looks like this:

http://webdaveu.storagemadeeasy.com on /mnt/sme type fuse (rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other,max_read=16384)
/mnt/sme/My DropBox files/;/mnt/sme/My SME files on /home/twinsen/Muzyka type fuse.mhddfs (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000)

So I don't need to worry to which cloud my files go. I just have a big 'pendrive', in the clouds [smile]
I think it is very useful solution.

Look here, there is nice mhddfs description: https://romanrm.net/mhddfs


As you can see, the new filesystem has been created. It joined the total size of all drives together (180G), added together the space used by all files there (95G) and summed up the free space (85G). If you look at files in /mnt/virtual, you'll notice that it has files from all three drives, with all three directory structures “overlayed” onto each other.

But what if you try to add new files somewhere inside that /mnt/virtual? Well, that is quite tricky issue, and I must say the author of mhddfs solved it very well. When you create a new file in the virtual filesystem, mhddfs will look at the free space, which remains on each of the drives. If the first drive has enough free space, the file will be created on that first drive. Otherwise, if that drive is low on space (has less than specified by “mlimit” option of mhddfs, which defaults to 4 GB), the second drive will be used instead. If that drive is low on space too, the third drive will be used. If each drive individually has less than mlimit free space, the drive with the most free space will be chosen for new files.

It's even more than that; if a certain drive runs out of free space in the middle of a write (suppose, you tried to create a very large file on it), the write process will not fail; mhddfs will simply transfer the already written data to another drive (which has more space available) and continue the write there. All this completely transparently for to the application which writes the file (it will not even know that anything happened).

Now you can simply work with files in /mnt/virtual, not caring about what is being read from which disk, etc. Also, the convenience of having large “contiguous” free space means you can simply drop any new files into that folder and (as long as there's space on at least one member of the virtual FS) not care about which file gets stored where.

Merge all clouds space into ONE folder
On Linux, there is a possibility to merge all clouds into one big folder, which can be evenly filled with files.
It can be achieved with below commands:

apt-get install mhddfs davfs2

mount -t davfs -o rw url /mnt/webdav1/
mount -t davfs -o rw url /mnt/webdav2/

mhddfs /mnt/webdav1,/mnt/webdav2 /mnt/webdav

All we need is WebDAV access to clouds. What we get in result is one folder, where files are together.
When we write to this folder, mhddfs sends files evenly to all clouds. So, we have a big free space,
concatenated from all clouds.

This is a thing which SME lacks of. There are some approach to this, 'smart folders', but when you write
a file it goes to defined default cloud provider. And in file manager, you can see clouds as folders, you
can rename them but still there are separate folders and files are not distributed among them automatically.
So, my proposition for SME is to implement this functionality in the future. I don't want to know to
which cloud my files go. I just want a big space made from clouds spaces. Now, I merged all owned
clouds into one folder, on Linux in VirtualBox, then shared it to host Windows 8 with CIFS/Samba.
I think it would be good to have it 'natively' in SME tools. One folder, one drive letter, many providers...
No separate cloud folders anymore [smile]

Please, add it fast [smile]
Feature request - unions of folders.
As UnionFS is not available for Windows OSes, it would be good to implement unions on WebDAV level.
Goal: to combine all free storage clouds into one. Instead of having folders in virtual share network drive,
let's place contents of all clouds _directly_ into it. And merge multiple folders for example: \Music folder
on Dropbox, will be shown merged with \Music folder on copy.com, and therefore all files inside will
be shown in one \Music folder on network drive.

And what about saving files to that kind of folders union? My idea is similar to Windows Libraries::
- to choose one of those folders as save destination (easiest way)


- to have a layer above all directories, which decides where files are going. It would be based on rules, like: first let fullfill first cloud, then next and so on, or let file go to first cloud, then next file to next cloud, and so on.

Of course, some kind of "FAT" tables should exist to restore virtual folder on mount and have proper access to all files.

And all idea above could be as plugin to purchase to SME Personal Cloud, or Business Cloud.

Then, you will be the best clouds aggregator in the world [smile]

count post selected

Add a Website Forum to your website.