few diskspace on this host

few diskspace on this host

For the discussion of infrastructure improvements and changes.

Moderator: Moderators

Post Reply
abma
Spring Developer
Posts: 3555
Joined: 01 Jun 2009, 00:08

few diskspace on this host

Post by abma » 31 Jul 2011, 12:57

can some admin on this host please du a "du -hs /home/*" or so and post results here so that we can anoy users which use many space?

please do it tuesday morning or so, as it seems to kill server doing a "du".

imo increasing size of disk is no solution, as we also need a backup...
0 x

Tobi
Spring Developer
Posts: 4598
Joined: 01 Jun 2005, 11:36

Re: few diskspace on this host

Post by Tobi » 31 Jul 2011, 13:02

Code: Select all

cat /home/tobi/disk_usage
0 x

User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: few diskspace on this host

Post by Licho » 31 Jul 2011, 13:52

There is also former /fast partition, dunno if its used .. disk will be repartitioned/merged on planned HW upgrade this december. So for now we could move some to other partition and purge some.
0 x

User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: few diskspace on this host

Post by Licho » 31 Jul 2011, 14:06

Also cheap way to recover space is to remove some springfiles stuff - like GB sized games not related to spring..
0 x

abma
Spring Developer
Posts: 3555
Joined: 01 Jun 2009, 00:08

Re: few diskspace on this host

Post by abma » 03 Aug 2011, 22:02

Licho wrote:Also cheap way to recover space is to remove some springfiles stuff - like GB sized games not related to spring..
+1 for that. i'm against non-spring stuff, too. but i'm not responsible for that, jj is.

i wish the service "springfiles" would be something like this:

a single html-upload form, with no images, no, no, ... just a plain html form.
frontend is something simple like http://mapinfo.adune.nl/ + xmlrpc service. it could be even simpler than mapinfo.adune.nl.

i think we only need a deadline where all non-spring stuff has to be removed from this host. maybe the next servers (please, if you rent new ones, rent multiple but cheaper!!) is a good deadline for that... and when doing that, i guess you need some stricter rules.


and thanks, someone really freed up many disk space! i removed also some old files from springfiles.com.
0 x

User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: few diskspace on this host

Post by Licho » 03 Aug 2011, 22:33

Yeah im considering multiple cheaper and virtualization options. But its still far away lots of time until november.
0 x

User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: few diskspace on this host

Post by Licho » 03 Aug 2011, 22:35

Also that old fast partition isnt mounted afaik. It couldbe mounted and some data moved there (mysql, virtual machine etc)
0 x

abma
Spring Developer
Posts: 3555
Joined: 01 Jun 2009, 00:08

Re: few diskspace on this host

Post by abma » 03 Aug 2011, 22:57

no, this won't solve problems and migrating to the new host would take longer because of more data... backup would take longer and make more i/o..

imo it would be better to already clean up stuff + remove old stuff + move non-spring stuff away.

whats that?
www-data 30064 28849 0 21:46 ? 00:00:00 sh -c convert -limit area 40mb -limit disk 500mb '/home/tgchan/kusaba/quest/src/131240079438.png'[0] -resize 200x200 -quality 90 '/home/tgchan/kusaba/qu
0 x

User avatar
aegis
Posts: 2456
Joined: 11 Jul 2007, 17:47

Re: few diskspace on this host

Post by aegis » 04 Aug 2011, 02:40

tgchan is lurker's site
0 x

User avatar
lurker
Posts: 3842
Joined: 08 Jan 2007, 06:13

Re: few diskspace on this host

Post by lurker » 04 Aug 2011, 17:29

Oops, looks like I left 15 gigs of junk around my home directory. I'll have that all cleared up by later today. And I don't see disk space being a major issue in the future considering almost half of the current disk space isn't even mounted.
0 x

User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: few diskspace on this host

Post by Licho » 07 Aug 2011, 23:50

I remounted /fast partition with 700gb free in stripped mode .. to store unimportant stuff..
Its suboptimal for performance.
If you know how to switch it to raid 1 instead feel free to do it.
0 x

abma
Spring Developer
Posts: 3555
Joined: 01 Jun 2009, 00:08

Re: few diskspace on this host

Post by abma » 08 Aug 2011, 00:10

/dev/md4 is mounted as /home2 and /fast... afaik thats not good. to make it raid1, you've to recreate it. (thanks to people who cleaned up!)
0 x

User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: few diskspace on this host

Post by Licho » 08 Aug 2011, 01:19

Yeah i know im unable to umoutn /home2 even with -f it says device in use
0 x

dansan
Server Owner & Developer
Posts: 1192
Joined: 29 May 2010, 23:40

Re: few diskspace on this host

Post by dansan » 08 Aug 2011, 01:27

abma wrote:/dev/md4 is mounted as /home2 and /fast... afaik thats not good.
It's no problem if you mount a partition in multiple places - the kernel serializes access at the fs driver level.
Licho wrote:Yeah i know im unable to umoutn /home2 even with -f it says device in use
To find out what process is using it, try:

Code: Select all

$ sudo fuser /home2

Code: Select all

$ sudo lsof | grep home2
0 x

abma
Spring Developer
Posts: 3555
Joined: 01 Jun 2009, 00:08

Re: few diskspace on this host

Post by abma » 08 Aug 2011, 01:34

@dasan:
https://bugzilla.redhat.com/show_bug.cgi?id=614957

i had some other bug in mind, but i can't find it :-/


i guess mounting the same partition twice isn't tested well, as it is very uncommon to do that. if you need it twice, do a mount -o bind
"it's no problem" is wrong, but it should be no problem ... (some wisenheimer stuff...)
0 x

dansan
Server Owner & Developer
Posts: 1192
Joined: 29 May 2010, 23:40

Re: few diskspace on this host

Post by dansan » 08 Aug 2011, 02:52

This kernel bug is unrelated. It happens, that when you use wrong mount options, the 1st time the kernel complains and doesn't mount, but the 2nd time it crashes.
abma wrote:i guess mounting the same partition twice isn't tested well, as it is very uncommon to do that. if you need it twice, do a mount -o bind
Ah yes - you're right - that's the correct way :)
0 x

abma
Spring Developer
Posts: 3555
Joined: 01 Jun 2009, 00:08

Re: few diskspace on this host

Post by abma » 13 Mar 2013, 19:20

disk space is getting low again...

still 33G available, but thats only ~6%...

see /var/tmp/disk_usage

folders i would like to cleanup:
/home/springie/.spring/demos

(thats about 63GB)

does anyone need these demo-pack? it could be at least compressed, this should maybe safe (1 guess) 30GB.
0 x

User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: few diskspace on this host

Post by Licho » 13 Mar 2013, 19:46

Hmm i could add another disk to VM too, VM host still has couple hudnred GB free

Those demos can be deleted afaik..
0 x

abma
Spring Developer
Posts: 3555
Joined: 01 Jun 2009, 00:08

Re: few diskspace on this host

Post by abma » 13 Mar 2013, 19:57

imo no need to add space... stuff should be cleaned up.
0 x

abma
Spring Developer
Posts: 3555
Joined: 01 Jun 2009, 00:08

Re: few diskspace on this host

Post by abma » 16 Sep 2013, 12:29

created a new file:
cat /var/tmp/disk_usage2
as licho tries to migrate to a new server, please cleanup your stuff!
0 x

Post Reply

Return to “Infrastructure Development”