Pruning

I need a clear explanation of how pruning works in UNA. It seems that it is not considering long term use.

Files pruning:

  • 153 total
  • 101 deleted

Database pruning:

  • 0 deleted expired membership levels
  • 12926 deleted expired sessions
  • 27362 deleted expired keys
  • 31785 deleted expired storage tokens
  • 1 deleted outdated transcoded images
  • 0 deleted/suspended accounts
  • 0 deleted view tracks
  • 0 deleted vote tracks
  • 0 deleted score tracks
  • 0 deleted favorite tracks
  • 0 deleted report tracks

As I have been doing a lot of database work of late, I realized that most things have a pruning field with a number. Is this the longevity of a vote/score? Because I do not want votes to disappear if the member is still in the database? So what is the view tracks, vote tracks, score tracks, favorite tracks, and report tracks? Will these expire someday and just be removed??? Regardless if the member is still on the site?

And what files were deleted???? 101 files? Where? For what? I'm a bit concerned. If a site grows to consume multiple servers and hundred thousands of users, re-transcoding files would be a server shut down event. How does UNA calculate these files to delete? And from where??

UNA staff, please explain clearly how pruning works for each result above. This is a big deal. Thank you.

  • View
    1653
  • More
Replies (6)

    • I can provide some insight about the files.

      When a user uploads something in a form but never submits, the file remains a ghost until it's either submitted by the user or by the next pruning, if the pruning snags it, it's deleted.

      Same goes for profile pictures and covers. When a user changes them, the old ones are still housed on the server until next prune, to which they are deleted.

      • But it appears ALL files, including videos, expire after 30 days, in which transcoded files are removed, leaving original only. Then, when accessed, this transcoding happens 'on the fly' - for pictures this is nothing. For videos, this is an issue.

        Videos that need retranscoded don't play, until its transcoded. So you are stuck on the video screen wondering why it wont play. Then a minute or so, refresh window and it plays. This is ridiculous. 99% of members will just move on thinking the site is 'broke'. Next, a large burst of retranscoding video could bring a server to a halt.

        Question: are transcoded files part of a members storage allocation? Or just original video, photo, etc?

        -- concerning vote/score/favorite/views - how is pruning handled here?

        • For referece:

          sys_objects_(votes,scores,etc) has a column 'pruning' - default across all is 31536000. This is 365 days. Does this mean ANY score, vote, reaction will expire after a year? Or just ones with deleted accounts?

          @LeonidS Which UNA member wrote cron pruning?

          • Ok, correction. sys_objects_transcoder has atime_tracking and atime_pruning. Video elements are set to 0 and 0, which I would believe turn off pruning for them?

            Still can't track how votes, scores, views, reactions, etc prune. They all have that 365 day for default in pruning column.

            • Hello @Wise !

              You may see details in the @Alex T⚜️ answer here https://unacms.com/cmts-view/1ckng7f?sys=bx_forum&cmt_id=2899

              and in the inc/classes/BxDolCronPruning.php file, the cleanDatabase method. It works with the old views, reportsd, resdized images, accounts without profile etc.

              >@LeonidS Which UNA member wrote cron pruning?

              "I'm Spartacus!" (c) Could you please specify what do you plan to do with that dev? ;-)

              • I was going to make direct inquiry, that's all. I just loathe the lack of documentation. His answer mentions nothing about views, votes, scores, reactions, favorites, etc - which all have a pruning default of 365 days.

                My question is, is this for all, or just above with deleted accounts. In a year votes and reactions won't start disappearing will they?

                Login or Join to comment.