with local storage on, Storing to AWS and digitalocean S3 :)

Important warning:

riofs is buggy and very dangerous dont use it at all.

Alex Baloo Leonid Andrew,

Hi guys,

I was in trouble with the AWS S3 service.

After the fix with Alex, it was mixed again and never worked  in any combination.

I started reading (like my patients do from google :))) ), discovered that there are more s3 services like digitalocean. (and its cost is even less then AWS.)

I checked the AWS plugin file of UNA It was configured for aws end point. I changed it to digitalocean`s .

But no it didnt work same error like AWS.

Then I thought to save UNA from object storage coding and endless AWS rule systems :)

In a fresh install, left it as local storing.

In the fresh install the storage folder was empty.

Installed s3fs and mounted the digitalocean "space" to the local "una/storage" folder.

tried to create an album and send photos and VOILA!!! the folders and file was created in digital oceans space...

I can add, delete the pictures like local. 

Only it is seen a little bit latency during the upload. Possibly due to the server connection/location and digitalocean space location.

 this method may solve the difficulties to migrate to S3 services.

What are your opinions?

Note:
After some trials with S3fs I found an alternative riofs.
Riofs works 10-20 times faster then s3fs.

  • Up vote
    1
    Down vote
  • View
    1121
  • More
Replies (6)

    • My idea is that your patients are in good hands. It's a good idea, clever! Not sure that you would not have a latency with S3 or any remote storage, you would have to test several to find out. In the past I had done something similar with Hubic you know?

      • Now I installed both una server and space to the same region of digitalocean and it works like local, very fast :)

        I am just learning /remembering things, I didnt heart about hubic yet :) I will check it.
        advantages of this configuration will be,

        • very good price for storage
        • ability to move the local installation to object based storage servers with local block system.
          copying to the mounted folder may do the trick for the migration.
          I will make trials and write a how to and if UNA team approves we may publish here.
          We have to think about the future consequences of such structure.

        • Hello Cem, I am not sure if you are still active here but I found your solution to what we need to do. Do you have that How To you mention in the comment here? We would like to add remote storage as DigitalOcean.

          • Hi Brand,

            We are now using https://www.hetzner.com/ dedicated servers.

            At there they have storage boxes that we use for backups (cause they are designed only for backups.)

            And you can connect a 16 TB enterprise HDD to your server. This gave us big flexibility that we sought before.

            The UNA storage folder is simply linked to a folder in that harddisk. It is also possible to connect multiple HDDS or nve ssds to your dedicated server there. The price of the 16 TB HDD is 24 euro/month.

            They also have S3 option but we dont feel a need for it any more.

            If you could explain your setup I may have ideas.

            • Sure.. DigitalOcean offers Remote Storage in what they call Spaces. We are storing our UNA Messenger recordings there currently and working with UNA on a way to link back to the chat session. We want to use Spaces to store other UNA video uploads via their videos module. As the only UNA instructions to date speak of integration with AWS, I thought you had figured out a way to integrate non-AWS storage that links back to UNA.

              • I dont know the current situation of DO spaces for usage with UNA as AWS, at hat times (7 years ago) it was not possible and thats why we ended up with some other file systems like riofs s3fs etc. But as I remember later when I had the space and the web server on the same data center it worked normally.

                The only thing to be carefull was to backup and move all storage folder content to the new space.

                Login or Join to comment.