Skip to content

Releases: Orange-OpenSource/Cool-Chic

v4.2.1

14 Oct 14:26
6430296

Choose a tag to compare

🎲 Cool-chic 4.2: Common Randomness & Wasserstein Distance! 🎲

This release focuses on perceptually-oriented image coding. This release draws heavily on the following paper: Good, Cheap, and Fast: Overfitted Image Compression with Wasserstein Distortion, Ballé et al..

  • Wasserstein Distance as a distortion metric: use --tune=wasserstein
  • Decoder-side common randomness for additional details in the decoded image
  • Improved image coding performance: around -50% rate versus Cool-chic 4.1 for the same visual quality
  • Low decoding complexity 1728 MAC / pixel

Attached to this release two bitstreams and the corresponding decoded images, with (wd) and without (mse) --tune=wasserstein.

Below, a subjective tests carried out on the CLIC 2025 test dataset comparing Cool-chic 4.1 (cc_mse), Cool-chic 4.2 with --tune=wasserstein (cc_wd) and H.266 / VVC (vtm). Additional details are available in Perceptually optimised Cool-chic for CLIC 2025, Philippe et al.

image

v4.1.0

19 Sep 14:51
d0f7ac1

Choose a tag to compare

🔮 Cool-chic 4.1.0: Revisiting temporal prediction! 🔮

Cool-chic 4.1 focuses on video coding, improving particularly the temporal
prediction through better and lighter sub-pixel motion compensation. This
release is linked to the following paper: Efficient Sub-pixel Motion Compensation in Learned Video Codecs, Ladune et al..

  • Replace 2-tap bilinear filtering with sinc-based 8-tap filters
  • Decode motion fields at 1/4 of the frame resolution for lighter decoding complexity
  • Improved video compression performance: -23.6% rate versus Cool-chic 4.0
  • Decrease motion-related complexity by 45%, from 391 to 214 MAC / decoded pixel

Check-out the release history to see previous versions of Cool-chic.

This release does not affect image compression performance which remains identical to v4.0.0

Video compression performance

The Cool-chic page provides comprehensive video rate-distortion results.

Random access results (intra period 32)

Sequence BD-rate of Cool-chic 4.1.0 against [%] Decoding complexity
HEVC (HM 16) HEVC (x265-medium) AVC (x264-medium) Cool-chic 4.0 MAC / pixel Frame rate [fps]
C-BasketballDrill +30.8 -5.2 -29.5 -17.5 639 13.3
C-BQMall +77.1 +16.6 -6.0 -21.1 639 13.2
C-PartyScene +28.3 -15.1 -39.2 -39.1 639 12.9
C-RaceHorses +79.6 +17.4 +8.6 -16.8 639 12.1
Average +54.0 +3.4 -14.0 -23.6 639 12.9

Image compression performance

The Cool-chic page provides comprehensive image rate-distortion results.

BD-rate of Cool-chic 4.1 vs. [%] Avg. decoder complexity
Cheng ELIC C3 HEVC (HM 16) VVC (VTM 19) MAC / pixel CPU Time [ms]
kodak -4.2 % +7.5 % -4.3 % -17.2 % +3.4 % 1303 74
clic20-pro-valid -13.2 % -0.2 % -1.3 % -25.1 % -2.3 %
1357 354
jvet (BCDEF) / / / -18.3 % +18.6 % 1249 143
jvet (class B) / / / -9.9 % +20.7 % 1300 282
jvet (class C) / / / -16.1 % +9.2 % 1289 69
jvet (class D) / / / -12.4 % +9.6 % 948 18
jvet (class E) / / / -6.2 % +27.8 % 1347 125
jvet (class F) / / / -31.8 % +20.6 % 1249 182

v4.0.0

19 Sep 14:49

Choose a tag to compare

🎥 Cool-chic 4.0.0: Video is back! 🎥

This release brings back video compression with Cool-chic. Based on the latest Cool-chic video paper. The main improvements are:

  • Cool-chic now compresses inter frames with two cool-chic modules: one for the motion and one for the residue
  • The motion module training is guided through a RAFT optical flow estimator for more accurate motion.

This release does not affect image compression performance which remains identical to v3.4.1

Image compression performance

BD-rate of Cool-chic 4.0 vs. [%] Avg. decoder complexity
Cheng ELIC C3 HEVC (HM 16) VVC (VTM 19) MAC / pixel CPU Time [ms]
kodak -4.2 % +7.5 % -4.3 % -17.2 % +3.4 % 1303 74
clic20-pro-valid -13.2 % -0.2 % -1.3 % -25.1 % -2.3 %
1357 354
jvet (BCDEF) / / / -18.3 % +18.6 % 1249 143
jvet (class B) / / / -9.9 % +20.7 % 1300 282
jvet (class C) / / / -16.1 % +9.2 % 1289 69
jvet (class D) / / / -12.4 % +9.6 % 948 18
jvet (class E) / / / -6.2 % +27.8 % 1347 125
jvet (class F) / / / -31.8 % +20.6 % 1249 182

Video compression performance (Random Acess, intra period 32)

Sequence BD-rate of Cool-chic 4.0.0 against [%] Decoding complexity
HEVC (HM 16) HEVC (x265-medium) AVC (x264-medium) MAC / pixel Frame rate [fps]
C-BasketballDrill +59.6 +15.2 -11.5 946 18.3
C-BQMall +128.7 +49.3 +20.6 945 16.7
C-PartyScene +113.0 +37.9 +20.3 946 17.5
C-RaceHorses +118.7 +41.0 +19.3 950 16.5
Average +105.0 +35.9 +12.2 947 17.3

v3.4.1

06 Jan 15:47

Choose a tag to compare

🎉 Cool-chic 3.4.1: Up to a 3x encoding speed-up! 🎉

This release only affects the encoding speed of Cool-chic, mostly by leveraging torch.compile to run faster.


encoding-time-kodak

v3.4.0

08 Nov 10:46

Choose a tag to compare

🎉 Cool-chic 3.4.0: 30% less complex! 🎉

This release introduces a new upsampling of the latent variables bringing compression gain. It also allows to rely on smaller Auto-Regressive Modules, lowering the overall decoder complexity significantly.

  • New and improved latent upsampling module
    • Leverage symmetric and separable convolution kernels to reduce complexity & parameters count
    • Learn two filters per upsampling step instead of one for all upsampling steps
  • 1% to 5% rate reduction for the same image quality
  • 30% complexity reduction using a smaller Auto-Regressive Module
    • From 2000 MAC / decoded pixel to 1300 MAC / decoded pixel
    • 10% faster decoding speed

Compression performance

BD-rate of Cool-chic 3.4 vs. [%] Avg. decoder complexity
Cheng ELIC Cool-chic 3.3 C3 HEVC (HM 16) VVC (VTM 19) MAC / pixel CPU Time [ms]
kodak -4.2 % +7.5 % -0.9 % -4.3 % -17.2 % +3.4 % 1303 74
clic20-pro-valid -13.2 % -0.2 % -0.3 % -1.3 % -25.1 % -2.3 %
1357 354
jvet / / -0.2 % / -18.3 % +18.6 % 1249 143

Kodak

Kodak rd results

CLIC20 Pro Valid

CLIC20 rd results

JVET Class B

JVET class B rd results

v3.3.0

30 Aug 17:11

Choose a tag to compare

🚀 Cool-chic 3.3: An even faster decoder 🚀

This release improves the speed of Cool-chic CPU-only C decoder and does not affect the compression performance.

Notable improvements:

  • Decode a 720p image in 100 ms, 2x faster than Cool-chic 3.2
  • Full integerization of the decoder for replicability
  • Reduce decoder memory footprint
  • Optimized implementation of 3x3 convolutions & fusion of successive 1x1 convolutions

Dataset Vs. Cool-chic 3.1 Vs. C3, Kim et al. Vs. HEVC (HM 16.20) Vs. VVC (VTM 19.1) Avg decoder MAC / pixel Avg decoding time [ms]
kodak - 1.9 % - 3.4 % - 16.4 % + 4.5 % 1880 96
clic20-pro-valid - 4.2 % - 1.0 % - 24.8 % - 1.9 % 1907 364
jvet class B - 7.2 % / - 10.8 % + 19.5 % 1803 260

Kodak performance complexity
CLIC20 Pro Valid performance complexity