You are not logged in.

#1 2016-03-15 18:23:18

archuser11301
Member
Registered: 2016-02-09
Posts: 40

[Solved] 'No space left on device' running python scripts

I have around 40 accounts where I am doing stuff online with selenium using a custom profile. Things work great till around account 30 then I get an error message that there is no space left in my tmp folders.

How do I stop this from happening besides restarting? I am not sure what causes it to run out of space. Is it because all the page loads stay in the cache even after the instance has finished to start the next one?

https://gist.github.com/anonymous/3e0b62c83ada956f17b5

Last edited by archuser11301 (2016-03-15 22:16:46)

Offline

#2 2016-03-15 18:33:18

ugjka
Member
From: Latvia
Registered: 2014-04-01
Posts: 1,952
Website

Re: [Solved] 'No space left on device' running python scripts

On arch /tmp use tmpfs which uses a portion of you RAM memory. You are running out of it

Either increase the the size of /tmp or tell systemd to make /tmp use your / partition by issuing systemctl mask tmp.mount

If you choose to mask your tmp, you'll need to periodically clean up your /tmp.

Last edited by ugjka (2016-03-15 19:00:04)

Offline

#3 2016-03-15 18:58:31

WorMzy
Administrator
From: Scotland
Registered: 2010-06-16
Posts: 13,356
Website

Re: [Solved] 'No space left on device' running python scripts

Although it's not important this time, in the future, please don't post a link to a page with the error message -- just include the error message in your actual post, using code tags.


Sakura:-
Mobo: MSI MAG X570S TORPEDO MAX // Processor: AMD Ryzen 9 5950X @4.9GHz // GFX: AMD Radeon RX 5700 XT // RAM: 32GB (4x 8GB) Corsair DDR4 (@ 3000MHz) // Storage: 1x 3TB HDD, 6x 1TB SSD, 2x 120GB SSD, 1x 275GB M2 SSD

Making lemonade from lemons since 2015.

Offline

#4 2016-03-15 20:01:56

archuser11301
Member
Registered: 2016-02-09
Posts: 40

Re: [Solved] 'No space left on device' running python scripts

ugjka wrote:

On arch /tmp use tmpfs which uses a portion of you RAM memory. You are running out of it

Either increase the the size of /tmp or tell systemd to make /tmp use your / partition by issuing systemctl mask tmp.mount

If you choose to mask your tmp, you'll need to periodically clean up your /tmp.

Thanks. Which route do you recommend I take? I have only 1500 ram on the computer in question if that has any bearing on the answer.

Yes I would like tmp to clear every boot while also being larger than it currently is.

Is it better to disable tmpfs completely given my small amount of ram or it is still advantageous to use it?

Last edited by archuser11301 (2016-03-15 20:07:58)

Offline

#5 2016-03-15 20:07:17

ugjka
Member
From: Latvia
Registered: 2014-04-01
Posts: 1,952
Website

Re: [Solved] 'No space left on device' running python scripts

If you have plenty of space on / then I'd just mask tmp.mount and create some script that clears /tmp upon reboot/shutdown. Other possibility could be creating a dedicated partition and add it to fstab

Offline

#6 2016-03-15 20:08:49

archuser11301
Member
Registered: 2016-02-09
Posts: 40

Re: [Solved] 'No space left on device' running python scripts

ugjka wrote:

If you have plenty of space on / then I'd just mask tmp.mount and create some script that clears /tmp upon reboot/shutdown. Other possibility could be creating a dedicated partition and add it to fstab

Yes I have plenty of hd space but very limited ram smile

Offline

#7 2016-03-15 20:15:22

WorMzy
Administrator
From: Scotland
Registered: 2010-06-16
Posts: 13,356
Website

Re: [Solved] 'No space left on device' running python scripts

Great, please remember to mark your thread as solved.


Sakura:-
Mobo: MSI MAG X570S TORPEDO MAX // Processor: AMD Ryzen 9 5950X @4.9GHz // GFX: AMD Radeon RX 5700 XT // RAM: 32GB (4x 8GB) Corsair DDR4 (@ 3000MHz) // Storage: 1x 3TB HDD, 6x 1TB SSD, 2x 120GB SSD, 1x 275GB M2 SSD

Making lemonade from lemons since 2015.

Offline

#8 2016-03-15 20:23:52

archuser11301
Member
Registered: 2016-02-09
Posts: 40

Re: [Solved] 'No space left on device' running python scripts

Hold on I haven't solved anything yet.

I was merely appraising what my current hardware setup is.

I haven't made any changes yet so not solved as of yet.

Still reading up on how to disable tmpfs and also be able to clear my tmp on boot which I imagine I will run into some hurdles when I try smile.

Last edited by archuser11301 (2016-03-15 20:25:03)

Offline

#9 2016-03-15 20:36:37

eschwartz
Fellow
Registered: 2014-08-08
Posts: 4,097

Re: [Solved] 'No space left on device' running python scripts

Cleaning a non-tmpfs /tmp on boot is best done via tmpfiles.d(5)

EDIT: See the wiki: https://wiki.archlinux.org/index.php/Tm … atic_mount

Last edited by eschwartz (2016-03-15 20:44:28)


Managing AUR repos The Right Way -- aurpublish (now a standalone tool)

Offline

#10 2016-03-15 20:43:27

ugjka
Member
From: Latvia
Registered: 2014-04-01
Posts: 1,952
Website

Re: [Solved] 'No space left on device' running python scripts

I'm not really sure whether this gets executed but it seems that /usr/lib/tmpfiles.d/tmp.conf already clears anything that's older than 10 Days.

Offline

#11 2016-03-15 20:48:33

archuser11301
Member
Registered: 2016-02-09
Posts: 40

Re: [Solved] 'No space left on device' running python scripts

ugjka wrote:

Either increase the the size of /tmp

By this do you mean increase the ram? or that I can increase the hd tmp while still using tmpfs such that it would still clear on boot while also using some hard drive storage for space -which i could increase?

Offline

#12 2016-03-15 20:52:20

eschwartz
Fellow
Registered: 2014-08-08
Posts: 4,097

Re: [Solved] 'No space left on device' running python scripts

ugjka wrote:

I'm not really sure whether this gets executed but it seems that /usr/lib/tmpfiles.d/tmp.conf already clears anything that's older than 10 Days.

Well, that is different from cleaning everything on boot.

archuser11301 wrote:

By this do you mean increase the ram? or that I can increase the hd tmp while still using tmpfs such that it would still clear on boot while also using some hard drive storage for space -which i could increase?

See the Wiki (my edit above) for more details, the tmpfs article has a nice summary of all the different options you have for your /tmp

I'd advise against allocating more RAM to your /tmp if you have only 1.5 GB RAM.

Last edited by eschwartz (2016-03-15 20:54:03)


Managing AUR repos The Right Way -- aurpublish (now a standalone tool)

Offline

#13 2016-03-15 20:53:39

archuser11301
Member
Registered: 2016-02-09
Posts: 40

Re: [Solved] 'No space left on device' running python scripts

what is the (5) part in tmpfiles.d? are they two different things or not ie tmpfiles.d and tmpfiles.d(5)?

Offline

#14 2016-03-15 20:54:24

archuser11301
Member
Registered: 2016-02-09
Posts: 40

Re: [Solved] 'No space left on device' running python scripts

Yup reading now..thanks.

Eschwartz wrote:
ugjka wrote:

I'm not really sure whether this gets executed but it seems that /usr/lib/tmpfiles.d/tmp.conf already clears anything that's older than 10 Days.

Well, that is different from cleaning everything on boot.

archuser11301 wrote:

By this do you mean increase the ram? or that I can increase the hd tmp while still using tmpfs such that it would still clear on boot while also using some hard drive storage for space -which i could increase?

See the Wiki (my edit above) for more details, the tmpfs article has a nice summary of all the different options you have for your /tmp

I'd advise against allocating more RAM to your /tmp if you have only 1.5 GB RAM.

Last edited by archuser11301 (2016-03-15 20:54:34)

Offline

#15 2016-03-15 20:54:48

eschwartz
Fellow
Registered: 2014-08-08
Posts: 4,097

Re: [Solved] 'No space left on device' running python scripts

the (5) means it is in the "5"th section of your manpages. wink


Managing AUR repos The Right Way -- aurpublish (now a standalone tool)

Offline

#16 2016-03-15 21:10:02

ugjka
Member
From: Latvia
Registered: 2014-04-01
Posts: 1,952
Website

Re: [Solved] 'No space left on device' running python scripts

Eschwartz wrote:
ugjka wrote:

I'm not really sure whether this gets executed but it seems that /usr/lib/tmpfiles.d/tmp.conf already clears anything that's older than 10 Days.

Well, that is different from cleaning everything on boot.

Different but better than nothing.

Offline

#17 2016-03-15 21:21:08

WorMzy
Administrator
From: Scotland
Registered: 2010-06-16
Posts: 13,356
Website

Re: [Solved] 'No space left on device' running python scripts

archuser11301 wrote:

Hold on I haven't solved anything yet.

I was merely appraising what my current hardware setup is.

I haven't made any changes yet so not solved as of yet.

Still reading up on how to disable tmpfs and also be able to clear my tmp on boot which I imagine I will run into some hurdles when I try smile.

Ah sorry, I figured you'd understood what ugjka said about masking /tmp since you didn't ask about it.


Sakura:-
Mobo: MSI MAG X570S TORPEDO MAX // Processor: AMD Ryzen 9 5950X @4.9GHz // GFX: AMD Radeon RX 5700 XT // RAM: 32GB (4x 8GB) Corsair DDR4 (@ 3000MHz) // Storage: 1x 3TB HDD, 6x 1TB SSD, 2x 120GB SSD, 1x 275GB M2 SSD

Making lemonade from lemons since 2015.

Offline

#18 2016-03-15 22:15:35

archuser11301
Member
Registered: 2016-02-09
Posts: 40

Re: [Solved] 'No space left on device' running python scripts

Ok I followed the wiki and so far so good.

Ran the python project again and ram was nice and clean after completion and just rebooted and tmp was cleared of remaining files.

Thanks for the prompt help y'all. smile

Last edited by archuser11301 (2016-03-15 22:16:03)

Offline

Board footer

Powered by FluxBB