Skip to content
/ LDMIC Public

🏠[ICLR 2023] LDMIC: Learning-based Distributed Multi-view Image Coding

License

Notifications You must be signed in to change notification settings

Xinjie-Q/LDMIC

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

LDMIC

The official PyTorch implementation of our ICLR 2023 paper:

LDMIC: Learning-based Distributed Multi-view Image Coding

Xinjie Zhang, Jiawei Shao, Jun Zhang

[ICLR Open Review] [ArXiv Preprint]

🔖Brief Introduction

Multi-view image compression plays a critical role in 3D-related applications. Existing methods adopt a predictive coding architecture, which requires joint encoding to compress the corresponding disparity as well as residual information. This demands collaboration among cameras and enforces the epipolar geometric constraint between different views, which makes it challenging to deploy these methods in distributed camera systems with randomly overlapping fields of view. Meanwhile, distributed source coding theory indicates that efficient data compression of correlated sources can be achieved by independent encoding and joint decoding, which motivates us to design a learning-based distributed multi-view image coding (LDMIC) framework. With independent encoders, LDMIC introduces a simple yet effective joint context transfer module based on the cross-attention mechanism at the decoder to effectively capture the global inter-view correlations, which is insensitive to the geometric relationships between images. Experimental results show that LDMIC significantly outperforms both traditional and learning-based MIC methods while enjoying fast encoding speed.

Acknowledgement

❤️❤️❤️Our idea is implemented based on the following projects. We really appreciate their wonderful open-source works!

Citation

If any parts of our paper and code help your research, please consider citing us and giving a star to our repository.

@inproceedings{zhang2023ldmic,
  title={LDMIC: Learning-based Distributed Multi-view Image Coding},
  author={Zhang, Xinjie and Shao, Jiawei and Zhang, Jun},
  booktitle={International Conference on Learning Representations},
  year={2023},
}

@article{zhang2023ldmic,
  title={LDMIC: Learning-based Distributed Multi-view Image Coding},
  author={Zhang, Xinjie and Shao, Jiawei and Zhang, Jun},
  journal={arXiv preprint arXiv:2301.09799},
  year={2023}
}

About

🏠[ICLR 2023] LDMIC: Learning-based Distributed Multi-view Image Coding

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages