MemoryError: Error allocating memory for feature #786
Description
Dear spaCy Team,
I tried to further train the default spacy entity recognizer, however I immediately run into a Memory Error.
import spacy
nlp = spacy.load("de")
nlp.entity.model.resume_training()
throws
MemoryError Traceback (most recent call last)
<ipython-input-29-6298edf1c0b7> in <module>()
----> 1 nlp.entity.model.resume_training()
C:\tools\Anaconda3\lib\site-packages\thinc\linear\avgtron.pyx in thinc.linear.avgtron.AveragedPerceptron.resume_training (thinc/linear/avgtron.cpp:4177)()
MemoryError: Error allocating memory for feature: 13665621275175813120
Have you ever encountered such things? Any suggestions how to proceed?
My Environment
- Operating System: Windows 10
- Python Version Used: 3.5
- spaCy Version Used: 1.6.0
- Environment Information: 32GB RAM