-
-
Notifications
You must be signed in to change notification settings - Fork 3.3k
Error: EMFILE: too many open files, open 'xxx.mdx' (x10) : Content and Pages at very large scale #7241
Description
> When generating the content collections, should we turn off the watcher?
That makes sense. We're spinning up one-off Vite servers in some places and turning the watcher off could fix it. You can't shut it down entirely though since Vite always spins it up, but we can configure to ignore watching all files.
Do you think Astro can help meet that content volume requirement ?
The issue is related with the number of files in 'src/content'. It apear when >= +-4000K with any Astro version. I am very new in the Astro community, coming fron ApostropheCMS eco-system. I am hoping to achieve a more reactive & lean alternative with astro & alpine as base. Unfortunately, the capacity to serve efficiently >= 1000K files is mandatory. Do you think Astro can help meet that content volume requirement ?
We should be able to but seeing that many files is a first for me so maybe we're not doing something right at that scale. However, I think it's diverging from the original issue so I'd suggest opening another issue if you can find out which Astro version starts causing issues. The errors you get are because some other dependencies rely on the latest version of Astro, so you might need to downgrade the others too.
Thanks for the update! I'll go ahead and get the fix out then.
Originally posted by @bluwy in #7073 (comment)