0

as I mentioned in the title, how should I back up a 10 TB PostgreSQL database to which a lot of data is written every day?

If I need to give a little more detail, the data I mentioned is partitioned and there is a partition for each month. There is approximately 400 GB of data for each month. In this case, it is impossible to take a backup every day with pg_dump. In this case, I tried to use pgbackrest to take an incremental backup, but although approximately 20 GB of data is written every day, it uses 500 GB for the changing data, and this creates a lot of traffic and I/O events inside. What kind of policy should I create to take a backup of such a large database?

7
  • Are you using block-level incremental backups? With databases of that size, it's usually more efficient to use volume snapshots, if your storage supports that.
    – mustaccio
    Commented Aug 28 at 17:58
  • What are the restoration requirements?
    – jjanes
    Commented Aug 28 at 18:27
  • @mustaccio Yes, I am currently taking block-based incremental backups as you said, but I am not sure how reliable the backups taken this way are.
    – Enes Uysal
    Commented Aug 28 at 19:24
  • @jjanes The RTO value is 12 hour approximately and the RPO value is 8 hour approximately
    – Enes Uysal
    Commented Aug 28 at 19:24
  • How long does it take to replay one days worth of WAL?
    – jjanes
    Commented Aug 28 at 22:23

0

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Browse other questions tagged or ask your own question.