Neural Local Lossless Compression (NeLLoC)

This is a demo to do lossless compression with NeLLoC on CPU!

We provide aithmetic coding (AC), Asymmetric Numeral System (ANS) and interleaved ANS implementation of NeLLoC.

All the results in the notebooks are ran on a CPU of Macbook Air (M1, 2020, 8GB memory).

For more details about the method, please see paper On the Out-of-distribution Generalization of Probabilistic Image Modelling, appearing at Neurips 2021.

Update:

We proposed ParallelNeLLoC, which has a faster compression and decompression speed without sacrificing compression rate. See Parallel Neural Local Lossless Compression for an introduction of the method.

Name		Name	Last commit message	Last commit date
Latest commit History 18 Commits
batch_coder		batch_coder
coder		coder
model_save		model_save
.gitignore		.gitignore
BPD_test.ipynb		BPD_test.ipynb
NeLLoC_ac.ipynb		NeLLoC_ac.ipynb
NeLLoC_ans.ipynb		NeLLoC_ans.ipynb
NeLLoC_ians.ipynb		NeLLoC_ians.ipynb
README.md		README.md
model.py		model.py
train.py		train.py
utils.py		utils.py