mastodon.ie is one of the many independent Mastodon servers you can use to participate in the fediverse.
Irish Mastodon - run from Ireland, we welcome all who respect the community rules and members.

Administered by:

Server stats:

1.8K
active users

#cow

11 posts11 participants1 post today

I have a small set of linux machines (~5) that are mostly sitting idle. How can I turn it into a modest #CoW (cluster of workstations) so that people can easily submit long-running jobs to it?

Jobs will be mostly written in #rstats and #python .

What's a good entry-level setup for this? Easy to maintain, easy to use, nothing fancy.

I haven't done anything like that for at least 10 years, I'm sure things have moved on since then.

Thanks!

Btrfs - Most curious case, is this flaw or not. Can't really tell. - I've got lots of scattered data in dirty write buffers to disk, due to scattered writes and high system memory. I've also got long commit interval to allow efficient flushing (as contiguous as possible) when that scattered data is finally written to disk. It all works fine, if I sync before shutdown. But if I just shutdown the system, the flush process takes longer than the maximum allowed file system unmount time is. Even worse, some of the data is written to SSD and some to HDD. The state data is on SSD and actual data is on HDD. When the flush timeout is encountered, the system shuts down in state where state file says that this data is written to disk, and the data actually isn't on disk yet. - Flaw or not? - Of course this requires this curious combination of things to trigger, but the problem is very real. - Who's fault it is? #btrfs #data #corruption #loss #cow #linux #filesystem #shutdown