Dataloader

• use opencv (cv2) to read and process images.

• read from image files OR from .lmdb for fast IO speed.

  • How to create .lmdb file? Please see codes/scripts/create_lmdb.py.

• can downsample images using matlab bicubic function. However, the speed is a bit slow. Implemented in util.py. More about matlab bicubic function.

• LR_dataset: only reads LR images in test phase where there is no GT images.
• LRHR_dataset: reads LR and HR pairs from image folder or lmdb files. If only HR images are provided, downsample the images on-the-fly. Used in SR and SRGAN training and validation phase.
• LRHR_seg_bg_dataset: reads HR images, segmentations and generates LR images, category. Used in SFTGAN training and validation phase.

1. Prepare the images. You can download classical SR datasets (including BSD200, T91, General100; Set5, Set14, urban100, BSD100, manga109; historical) from Google Drive or Baidu Drive. DIV2K dataset can be downloaded from DIV2K offical page, or from Baidu Drive.

2. For faster IO speed, you can make lmdb files for training dataset. Please see codes/scripts/create_lmdb.py.

3. We use DIV2K dataset for training the SR and SRGAN models.

   1. since DIV2K images are large, we first crop them to sub images using codes/scripts/extract_subimgs_single.py.
   2. generate LR images using matlab with codes/scripts/generate_mod_LR_bic.m. If you already have LR images, you can skip this step. Please make sure the LR and HR folders have the same number of images.
   3. generate .lmdb file if needed using codes/scripts/create_lmdb.py.
   4. modify configurations in options/train/xxx.json when training, e.g., dataroot_HR, dataroot_LR.

SFTGAN is now used for a part of outdoor scenes.

1. Download OutdoorScene training dataset from Google Drive (the training dataset is a little different from that in project page, e.g., image size and format) and OutdoorScene testing dataseet from Google Drive.
2. Generate the segmenation probability maps for training and testing dataset using codes/test_seg.py.
3. Put the images in a folder named img and put the segmentation .pth files in a folder named bicseg as the following figure shows.

4. The same for validation (you can choose some from the test folder) and test folder.

We use random crop, random flip/rotation, (random scale) for data augmentation.

Color-conversion-in-SR