[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
bug#51787: GC takes more than 9 hours on berlin
From: |
Christian Thäter |
Subject: |
bug#51787: GC takes more than 9 hours on berlin |
Date: |
Tue, 14 Dec 2021 04:31:23 +0100 |
On 2021-12-12 18:09, Mathieu Othacehe wrote:
>Hey,
>
>> OK, thanks. Looks it just finished removing the trash directory
>> content. I started a GC process from my session to monitor it
>> closely.
>
>Daily GC recap:
>
>* The GC process I started yesterday, did collect 5.5TiB in
> approximately 24 hours, that are now in the /gnu/store/trash
> directory.
>
>* The /gnu/store/trash directory contains 288910 entries. If those
>items
> are removed at the same rate than on the previous days, it will take
> days/months to delete them all.
On another note: when 'guix gc' determines that objects are dead, are
they really dead then or can it be that they are 'locally' dead but in
case the store serves as substitutes/offload server some external
clients may still request dead objects?
In the either case would make sense to run the GC more frequently, but
for the later case a --min-age option to preserve objects that just
died recently could be helping. Further it may consider the atime of
objects for removal.
And finally while I had this Idea: You mount the
guix store with 'relatime' or 'nodiratme', if not that could explain
the slow deletion process as well!
Christian
>
>* I noticed that the upstream Nix GC process can now operate without
> locking. I think it shouldn't be too hard to port it to our fork or
> maybe rewrite the process in Guile while we are at it.
>
> That will not fix the slow hard-drives issues though.
>
>Thanks,
>
>Mathieu
>
>
>
- bug#51787: GC takes more than 9 hours on berlin, Mathieu Othacehe, 2021/12/03
- bug#51787: GC takes more than 9 hours on berlin, Mathieu Othacehe, 2021/12/10
- bug#51787: GC takes more than 9 hours on berlin, Ludovic Courtès, 2021/12/10
- bug#51787: GC takes more than 9 hours on berlin, Mathieu Othacehe, 2021/12/10
- bug#51787: GC takes more than 9 hours on berlin, Ludovic Courtès, 2021/12/10
- bug#51787: GC takes more than 9 hours on berlin, Mathieu Othacehe, 2021/12/11
- bug#51787: GC takes more than 9 hours on berlin, Mathieu Othacehe, 2021/12/12
- bug#51787: GC takes more than 9 hours on berlin, Christian Thäter, 2021/12/13
- bug#51787: GC takes more than 9 hours on berlin,
Christian Thäter <=
- bug#51787: GC takes more than 9 hours on berlin, Mathieu Othacehe, 2021/12/17
- bug#51787: GC takes more than 9 hours on berlin, Ricardo Wurmus, 2021/12/17
- bug#51787: GC takes more than 9 hours on berlin, Ricardo Wurmus, 2021/12/17
- bug#51787: GC takes more than 9 hours on berlin, Mathieu Othacehe, 2021/12/10