Estimating server load and hardware requirements for UNA
Choosing the right server configuration and predicting operating costs for running a UNA-powered site may be important for your business strategy planning. This guide may help you choose correct hosting and plan for scale.
Please remember that this is a simplified approximation for the default UNA setup with standard modules only. The real site can have many more modules from 3rd-party developers (which can affect on-site load, space requirements, etc.) or can be focused on resource-intensive tasks that may call for a different estimation (i.e. video conversions, high-storage sites like pro-level photo sharing, etc.)
How to calculate load and choose proper hardware.
The load is very dependant on the number, purpose, functionality and quality of installed modules and the site template. Therefore it is almost impossible to predict it beforehand. But if you have a sample setup of the desired site configuration or pre-production setup on the web server, it is possible to at least predict the memory usage.
To do it install "Profiler" module, this module shows different timings at the bottom of every page for site administrator (by default). Try to open different pages and watch for memory usage and page execution time.
Try open different pages and measure average "Memory" and "Time" values. Let's assume that it is 20Mb for memory usage and 0.5 seconds execution time. Then, if you have a web server with 4G RAM (for example) the web server is capable to handle:
4G - 1G (for system usage) / 20 Mb ~ 150 simultaneous requests.
Please note, that simultaneous requests aren't a number of online users. Users make requests to the server one time in several seconds or a dozen of seconds.
Static Site
If it is a mostly static site (without much dynamically changing content like the Messenger, Shoutbox, Rocket.Chat, etc) then one request in 30 seconds from one user is likely. In this case, the server is capable of handling the following number of online users:
30 (average seconds per one request from one user) / 0.5 (our average "Time" value) * 150 (simultaneous requests) = 9000 online users
Dynamic Site
If it is a dynamic site (with the messenger, active timeline, notifications, etc.) like most UNA sites, 1 request from one user every second on average is likely. In this case, the server is capable of handling the following number of online users:
1 (average seconds per one request from one user) / 0.5 (our average "Time" value) * 150 (simultaneous requests) = 300 online users
As you can see a dynamic site require 30x more resources than a static site.
This is a very rough calculation which considers only server memory usage, while CPU usage is not counted at all. You may have CPU-intensive usage and low memory load and vice versa. For example, video conversions may cause very high CPU usage.
How to calculate load and choose proper hardware for the database server
DB server is dependant on many factors and can not be precisely planned until the site use patterns are observed in production. Just make sire to follow these guidelines:
- Tune MySQL settings for your needs, recheck settings as your database grows and the load increases. Try this tool to check and tune your MySQL settings: http://mysqltuner.pl/
- Installing more RAM can help a lot. Refer to the first advice to see if you need more RAM.
- Use InnoDB DB engine instead of MyISAM if you have high load.
- Store database tables on SSD disks, for the better performance you may need to tune MYSQL especially for SSD disks. (Note, that UNA Cloud servers work on SSD disks only).
- If the load is too high, you may need a server cluster for your MySQL DB.
How to calculate database and files storage needs
Storage varies depending on number and types of installed modules. The better method is to start site and when you will have a number of users, calculate average data size in DB and on Disk and multiply this values on some number of users you need going to plan for.
In the following calculations, we are using some sample UNA setup. The site has only 9 users, all standard modules are installed and almost every user has some content (text content, photos, videos and sounds) in different modules.
Let's assume that we need to calculate future storage for 100 000 users.
DB size
- Current size: 1.5 Mb
- Number of users: 9
- Average DB space per user: 1.5 Mb / 9 ~ 0.167 Mb
Approximate DB Storage required for 100 000 users
100 000 * 0.167 Mb = 16700 Mb ~ 16 Gb
Disk storage
- Current size: 374 Mb
- Number of users: 9
- Average DB space per user: 374 Mb / 9 ~ 41Mb
Approximate Disk Storage required for 100 000 users:
100 000 * 41 Mb = 4 T
Note, that UNA supports remote storage, so you can use, say, AWS S3 storage for quick and price-efficient media storage.
Hosting Server Costs
As a rule of thumb, dedicated servers would be more cost-effective for large sites with a predictable load. You can get a configuration with more RAM, storage and better CPUs compared to a similarly priced Cloud-based server. On the other hand, Cloud-servers can be scaled up more easily and it is possible to start with a smaller instance, scaling up as required - this approach may prove to be more cost-effective for a small to medium community site.
Another consideration is that SSD-based servers will always cost significantly more than a HDD-based ones, so it is best to use SSD-based servers only for the web-server and the database while leveraging external storage for media files.
For a rough estimate, let's take una.io community with a few active modules, messenger, albums and timelines enabled, but no specific focus on video sharing, file storage, etc.
40 online users / 10,000 members
$100/mo (UNA Cloud4)
$50/mo - dedicated server + $50/mo UNA Pro license
At this size only a few "online" users are present at any given time, so a basic server like UNA Cloud 4 would be sufficient. On-server storage can be used for the database, and media storage needs would be in the range of 50Gb, so the media can also be stored on site. A dedicated server with similar specifications would cost about $50. Note, that UNA Cloud comes with included UNA Pro plan, so this choice may still be preferable.
80 online users / 50,000 members
$150/mo (UNA Cloud8) + $100/mo for AWS S3
$100/mo - dedicated server with 2 disk arrays + $50/mo UNA Pro license
At this size you may expect more online users during peak times. Still, on-server storage can be used for the database. While at higher numbers average storage uptake tends to go down, we would still recommend connecting remote storage at this scale - you may need around 300Gb, which is likely to be relatively expensive with an on-server SSD.
A dedicated server with similar specifications would cost about $100 and may include a disk array for media storage.
150 online users / 100,000 members
$200/mo (UNA Cloud16) + $200/mo for AWS S3
$150/mo - dedicated server with 2 disk arrays (or SSD), extra RAM and upgraded CPUs + $50/mo UNA Pro license
A community with 100K members may result in 150 online users during peak times. Database will take only about 3Gb, so it's best store it on-server. Media may take 500GB, so it is definitely best to leverage remote storage.
A dedicated server with similar specifications would cost about $150, as it will require RAM and CPU upgrades as well as multiple disks for media storage and redundancy.
300 online users / 200,000 members
$400/mo (UNA Cloud32) + $400/mo for AWS S3
$300/mo - dedicated server + $50/mo UNA Pro license
When you reach such stage, some of the costs "per members" can be reduced significantly. Typically remote storage pricing for higher allocation is lower and you can pre-order fixed-price servers. Usage patterns become more established and it is possible to optimise the site to meet specific requirements for best efficiency. Even with 300 online users during peak times the site is likely to operate well on UNA Cloud 32 or similar server. The database can still be stored on-server but may need to be separated soon. Media may take about 1TB, making it expensive to store media on-server's SSD even if you're using a dedicated box.
500 online users / 500,000 members
$800/mo (UNA Cloud64) + $1,000/mo for AWS S3
$600/mo - dedicated server + $1,000/mo for AWS S3 + $50/mo UNA Pro license
At half million members stage, you may be seeing around 500 online users. It is very important to optimise database requests, site configuration, turn off unused features and minimise clutter. UNA Team would be happy to assist with this process.
1 Million Members
Congratulations!
Starting from this stage you'll need custom dedicated server setup (you'd likely need to make a 2-3 servers cluster).
A dedicated server will have to use remote storage, so while you'd need to further upgrade CPUs and RAM, most of the storage disks can be removed.
While cloud server can be easily scaled up to 512Gb RAM and 64 CPU without adding complexity.
-
SE-Asia alone has 642 million people. This gives me an idea. Bless UNA... It's a genuine gold digging tool.
-
SE asia ? what is it ?
-
the hosting cost seems really high to me ...
-
When you have 400 members. you must say that 20 of them will be always online.
If the community is highly activ.
So in any way - online the performance counts when lot of people are online - because offline users don´t need much resources (maybe sql queries) - so if you 300 users Online and it costs 400 a month - that will mean, that you CAN`T run your community without letting your members pay or have an other good finance strategy.
So if you are expecting to run something like facebook - where many users are online at the same time and for the most hours of a day, - maybe UNA is not the best solution.
That´s what someone could read out of this post.
-
-
SE Asia = South East Asia
-
Only a reliable stress test can determine how much it will cost roughly to have a certain amount users online.
That being said, i find the infos on the article a little unaccurate since it assumes among 10 k members a slight amount only will be online at the same time. Calculation seems a little strange to me.
Plus the cost of the hosting is high ...very high for a free open source ... i stress tested Phpfox, another social network script, and i could reach 400 online user in a 100-125 dollars a month server structure ...
We need clarification from the UNA team guys ... Thank you.
-
I this true? Like, UNA really suck that many server resources?
As someone said and mention that other social script...I can confirm! -
Hi. I am not sure how you based your number of Online Users compared to number of Members. But I can tell you that we have a dating site (not using UNA) on a dedicated server. We have close to 300,000 registered members. However, at any given time we have about 15,000 active members, meaning members who have logged in in the last 30 days. Of those 15,000 active members we can count on a minimum of 500 to login daily and ranging up to about 1200 logging in on many days. Based on that I think your estimates are low as to Online Users by at least half. I also suggest that you rework this based on Active Members and ignore total membership. But I recognize that it also depends on what service the membership site provides. So this is just a thought.
-
All these calculations in the article above shows a method to calculate resource needs with sample data, you may apply these methods to your site's own data as each site may have different profiles of online user ratios or CPU and storage needs per user.
