Details

    • Type: Bug
    • Status: Done (View workflow)
    • Priority: Medium
    • Resolution: Done
    • Labels:
      None
    • Environment:

      PI: 20160421T151114Z
      Chunter: 0.8.3p4
      sniffle, snarl. howl: 0.8.3

      Description

      I use the backup script from pyfi to make periodic backups of my vms. There are about 60 vms and 20 of them have backup enabled. When running backup monthly or backup daily, sometimes, the backups go all successfully through, sometimes they hang and in cerberus I only see 0 as the size of the backup. When a few backups are in this state, every backup run is very long and unsuccessful until I delete these problematic backups with size 0.

      The only error I find is in the chunter logs:

      
      2017-01-11 10:57:55.352 [debug] <0.341.0>@chunter_vm_fsm:creating_backup:523 New Snapshot: <<"ff5a7055-07a4-4c7e-85c0-384f557447e7">>
      2017-01-11 10:57:55.446 [debug] <0.341.0>@chunter_zfs:zfs:87 ZFS: /usr/sbin/zfs ["snapshot",<<"zones/0526c9e2-1dec-4808-8bb5-4303acff81ce@ff5a7055-07a4-4c7e-85c0-384f557447e7">>]
      2017-01-11 10:57:56.100 [error] <0.22330.89> CRASH REPORT Process <0.22330.89> with 0 neighbours exited with reason: {error,{http_error,404,"Not Found",<<"<!DOCTYPE HTML PUBLIC \"-//IETF//DTD HTML 2.0//EN\">\n<html><head>\n<title>404 Not Found</title>\n</head><body>\n<h1>Not Found</h1>\n<p>The requested URL /0526c9e2-1dec-4808-8bb5-4303acff81ce/ff5a7055-07a4-4c7e-85c0-384f557447e7 was not found on this server.</p>\n<hr>\n<address>Apache Server at fifo-backups.xxx.xxx.xxx.xxx.xip.io Port 80</address>\n</body></html>\n">>}} in gen_server:init_it/6 line 344
      {{badmatch,{error,{error,{http_error,404,"Not Found",<<"<!DOCTYPE HTML PUBLIC \"-//IETF//DTD HTML 2.0//EN\">\n<html><head>\n<title>404 Not Found</title>\n</head><body>\n<h1>Not Found</h1>\n<p>The requested URL /0526c9e2-1dec-4808-8bb5-4303acff81ce/ff5a7055-07a4-4c7e-85c0-384f557447e7 was not found on this server.</p>\n<hr>\n<address>Apache Server at fifo-backups.xxx.xxx.xxx.xxx.xip.io Port 80</address>\n</body></html>\n">>}}}},[{chunter_snap,upload,4,[{file,"/opt/local/go-agent/pipelines/Chunter-Rel/_build/prod/lib/chunter/src/chunter_snap.erl"},{line,40}]},{chunter_vm_fsm,snapshot_action1,6,[{file,"/opt/local/go-agent/pipelines/Chunter-Rel/_build/prod/lib/chunter/src/chunter_vm_fsm.erl"},{line,1236}]},{chunter_vm_fsm,create_backup_fn,3,[{file,"/opt/local/go-agent/pipelines/Chunter-Rel/_build/prod/lib/chunter/src/chunter_vm_fsm.erl"},{line,536}]}]}
      
      

      No errors in the LeoFS logs or in sniffle. When browsing the Leo storage, there is no such backup in the fifo-backups bucket.

      Has somebody an idea where to look further? With fewer vms, the backup got problematic only after longer usage (a few months). With 20 vms, it breaks after max. 2 days .

        Attachments

          Activity

            People

            • Assignee:
              heinz Heinz N. Gies
              Reporter:
              Angelina Angelina Müller
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: