Buy Percona ServicesBuy Now!

Hot backup (4.0) creates additional 100 MB journal files every time

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Hot backup (4.0) creates additional 100 MB journal files every time

    Whenever we run hot backup, a new 100 MB journal file appears in /var/lib/mongodb/journal

    Then, these journal files get included with subsequent hot backups, so the backup filesize keeps growing and growing (seemingly forever). The only solution we've found is to restart the server, which likely isn't something that's ideal to do regularly.

    Here's a screenshot. Hot backup was ran 3x recently, and these are the 3 new journal files:

    Click image for larger version

Name:	Screenshot - 4_15_2019 , 12_42_04 PM.png
Views:	9
Size:	27.0 KB
ID:	53906

    Any suggestions?

    Sidenote ... is there no way to search these forums? I hope I didn't ask a duplicate question

  • #2
    Hello imk thanks for your question, I'll bring it to the attention of the team.
    Meanwhile... we're working on improving Forum usability, but if you're on a big screen then you can search the forum by using the search box top right of the screen, and then in the result set click on the FORUMS tab. It's not ideal I know...

    Comment


    • #3
      Hello imk, thanks for your question. PSMDB periodically flushes data to the file system. This is controlled by storage.syncPeriodSecs configuration parameter which is by default 60 seconds (see https://docs.mongodb.com/manual/refe...syncPeriodSecs).
      So if you created several backups and you see several WiredTigerLog files then in 60 seconds those files should disappear (except the latest one). Does this match your observations? If not then please tell which version of PSMDB do you use.

      Comment


      • #4
        Hi Igor!

        We're running Percona Server for MongoDB server version: v4.0.6-3

        Unfortunately it's been hours and those 3 additional journal files are still in that directory.

        So I just tried this:
        1. Added syncPeriodSecs: 60 to mongod.conf
        2. Restarted mongod service
        3. Ran hot backup 3 more times (3 new journal files appeared)
        4. Waited 60 seconds
        5. The 3 journal files are gone! Yay!
        So it appears that syncPeriodSecs: 60 is NOT a default and there is no default. FYI that config parameter did not exist in mongod.conf.

        Thanks so much for your help!

        Originally posted by Igor Solodovnikov View Post
        Hello imk, thanks for your question. PSMDB periodically flushes data to the file system. This is controlled by storage.syncPeriodSecs configuration parameter which is by default 60 seconds (see https://docs.mongodb.com/manual/refe...syncPeriodSecs).
        So if you created several backups and you see several WiredTigerLog files then in 60 seconds those files should disappear (except the latest one). Does this match your observations? If not then please tell which version of PSMDB do you use.

        Comment

        Working...
        X