Disk utilization on mdadm raid 5 is 100% even though none of the member disks is at 100%Grow/resize RAID when upgrading visible size of disksHow to mount a disk from destroyed raid system?mdadm; previously working; after “failure”, cannot join array due to disk size“Spare” disk in a 2-disk mdadm RAID1 array?mdadm RAID 5 and parted unrecognized disk labelHow do I migrate a RAID system to a larger set of HDDS?mdadm raid filesystem differs from disk filesystemHow do I (re)build/create/assemble an IMSM RAID-0 array from disk images instead of disk drives using mdadm?mdadm 2x Raid 5 missing drivesUbuntu: RAID 10 degrades to RAID 0 after reboot?
Where in the Bible does the greeting ("Dominus Vobiscum") used at Mass come from?
Irreducibility of a simple polynomial
when is out of tune ok?
Are there any comparative studies done between Ashtavakra Gita and Buddhim?
Can I use my Chinese passport to enter China after I acquired another citizenship?
Efficiently merge handle parallel feature branches in SFDX
Can a monster with multiattack use this ability if they are missing a limb?
Is a roofing delivery truck likely to crack my driveway slab?
Bash method for viewing beginning and end of file
Failed to fetch jessie backports repository
Everything Bob says is false. How does he get people to trust him?
How does residential electricity work?
Modify casing of marked letters
Mapping a list into a phase plot
Coordinate position not precise
What is the intuitive meaning of having a linear relationship between the logs of two variables?
Trouble understanding overseas colleagues
Greatest common substring
How was Earth single-handedly capable of creating 3 of the 4 gods of chaos?
What's a natural way to say that someone works somewhere (for a job)?
Your magic is very sketchy
Personal Teleportation as a Weapon
HashMap containsKey() returns false although hashCode() and equals() are true
Products and sum of cubes in Fibonacci
Disk utilization on mdadm raid 5 is 100% even though none of the member disks is at 100%
Grow/resize RAID when upgrading visible size of disksHow to mount a disk from destroyed raid system?mdadm; previously working; after “failure”, cannot join array due to disk size“Spare” disk in a 2-disk mdadm RAID1 array?mdadm RAID 5 and parted unrecognized disk labelHow do I migrate a RAID system to a larger set of HDDS?mdadm raid filesystem differs from disk filesystemHow do I (re)build/create/assemble an IMSM RAID-0 array from disk images instead of disk drives using mdadm?mdadm 2x Raid 5 missing drivesUbuntu: RAID 10 degrades to RAID 0 after reboot?
I am currently confused about the disk utilisation of one of my machines.
The setup:
I have a machine containing 4 2TB HDDs.
For those HDDs I used mdadm to configure a RAID 5 (called md2)
On MD2, I am using a luks-volume containing a btrfs filesystem.
Besides other use cases, I also have samba installed and use it to share files and create a TimeMachine Backup.
When copying over large files, I am able to use the complete 1G connection of the machine to read and write files. So regarding this, I am happy with the speed I get.
When it comes to timemachine backups (I assume, this causes non-sequential reads/writes) the transfer starts to be very slow.
The machine is not swapping and the CPU utilization is fine as well.
When looking at netdata, I see that the utilization for "root-crypted" is constantly on 100% (root-crypted is the name of the mounted file system).
I would then expect at least one of the HDDs to also be utilized at 100%, but actually none of them is. (They all are between 40 and 60%)
Now I am wondering, why the raid does not utilize the disks by 100%.
I assume, that I might be able to improve the performance by maybe 20% if I would just manage to have the raid utilizing the disks by 100%.
Is my thinking here correct or am I missing / misunderstanding something here.
Sadly my knowledge about disks and filesystems is not good enough to understand this.
Would be cool, if you could give me some support here.
Thanks a lot :)
hard-disk performance raid btrfs mdadm
add a comment |
I am currently confused about the disk utilisation of one of my machines.
The setup:
I have a machine containing 4 2TB HDDs.
For those HDDs I used mdadm to configure a RAID 5 (called md2)
On MD2, I am using a luks-volume containing a btrfs filesystem.
Besides other use cases, I also have samba installed and use it to share files and create a TimeMachine Backup.
When copying over large files, I am able to use the complete 1G connection of the machine to read and write files. So regarding this, I am happy with the speed I get.
When it comes to timemachine backups (I assume, this causes non-sequential reads/writes) the transfer starts to be very slow.
The machine is not swapping and the CPU utilization is fine as well.
When looking at netdata, I see that the utilization for "root-crypted" is constantly on 100% (root-crypted is the name of the mounted file system).
I would then expect at least one of the HDDs to also be utilized at 100%, but actually none of them is. (They all are between 40 and 60%)
Now I am wondering, why the raid does not utilize the disks by 100%.
I assume, that I might be able to improve the performance by maybe 20% if I would just manage to have the raid utilizing the disks by 100%.
Is my thinking here correct or am I missing / misunderstanding something here.
Sadly my knowledge about disks and filesystems is not good enough to understand this.
Would be cool, if you could give me some support here.
Thanks a lot :)
hard-disk performance raid btrfs mdadm
Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.
– wurtel
9 hours ago
add a comment |
I am currently confused about the disk utilisation of one of my machines.
The setup:
I have a machine containing 4 2TB HDDs.
For those HDDs I used mdadm to configure a RAID 5 (called md2)
On MD2, I am using a luks-volume containing a btrfs filesystem.
Besides other use cases, I also have samba installed and use it to share files and create a TimeMachine Backup.
When copying over large files, I am able to use the complete 1G connection of the machine to read and write files. So regarding this, I am happy with the speed I get.
When it comes to timemachine backups (I assume, this causes non-sequential reads/writes) the transfer starts to be very slow.
The machine is not swapping and the CPU utilization is fine as well.
When looking at netdata, I see that the utilization for "root-crypted" is constantly on 100% (root-crypted is the name of the mounted file system).
I would then expect at least one of the HDDs to also be utilized at 100%, but actually none of them is. (They all are between 40 and 60%)
Now I am wondering, why the raid does not utilize the disks by 100%.
I assume, that I might be able to improve the performance by maybe 20% if I would just manage to have the raid utilizing the disks by 100%.
Is my thinking here correct or am I missing / misunderstanding something here.
Sadly my knowledge about disks and filesystems is not good enough to understand this.
Would be cool, if you could give me some support here.
Thanks a lot :)
hard-disk performance raid btrfs mdadm
I am currently confused about the disk utilisation of one of my machines.
The setup:
I have a machine containing 4 2TB HDDs.
For those HDDs I used mdadm to configure a RAID 5 (called md2)
On MD2, I am using a luks-volume containing a btrfs filesystem.
Besides other use cases, I also have samba installed and use it to share files and create a TimeMachine Backup.
When copying over large files, I am able to use the complete 1G connection of the machine to read and write files. So regarding this, I am happy with the speed I get.
When it comes to timemachine backups (I assume, this causes non-sequential reads/writes) the transfer starts to be very slow.
The machine is not swapping and the CPU utilization is fine as well.
When looking at netdata, I see that the utilization for "root-crypted" is constantly on 100% (root-crypted is the name of the mounted file system).
I would then expect at least one of the HDDs to also be utilized at 100%, but actually none of them is. (They all are between 40 and 60%)
Now I am wondering, why the raid does not utilize the disks by 100%.
I assume, that I might be able to improve the performance by maybe 20% if I would just manage to have the raid utilizing the disks by 100%.
Is my thinking here correct or am I missing / misunderstanding something here.
Sadly my knowledge about disks and filesystems is not good enough to understand this.
Would be cool, if you could give me some support here.
Thanks a lot :)
hard-disk performance raid btrfs mdadm
hard-disk performance raid btrfs mdadm
asked yesterday
RacerRacer
315
315
Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.
– wurtel
9 hours ago
add a comment |
Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.
– wurtel
9 hours ago
Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.
– wurtel
9 hours ago
Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.
– wurtel
9 hours ago
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "106"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f508494%2fdisk-utilization-on-mdadm-raid-5-is-100-even-though-none-of-the-member-disks-is%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Unix & Linux Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f508494%2fdisk-utilization-on-mdadm-raid-5-is-100-even-though-none-of-the-member-disks-is%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.
– wurtel
9 hours ago