new

Get trending papers in your email inbox!

Subscribe

Daily Papers

byAK and the research community

Apr 17

ImagePairs: Realistic Super Resolution Dataset via Beam Splitter Camera Rig

Super Resolution is the problem of recovering a high-resolution image from a single or multiple low-resolution images of the same scene. It is an ill-posed problem since high frequency visual details of the scene are completely lost in low-resolution images. To overcome this, many machine learning approaches have been proposed aiming at training a model to recover the lost details in the new scenes. Such approaches include the recent successful effort in utilizing deep learning techniques to solve super resolution problem. As proven, data itself plays a significant role in the machine learning process especially deep learning approaches which are data hungry. Therefore, to solve the problem, the process of gathering data and its formation could be equally as vital as the machine learning technique used. Herein, we are proposing a new data acquisition technique for gathering real image data set which could be used as an input for super resolution, noise cancellation and quality enhancement techniques. We use a beam-splitter to capture the same scene by a low resolution camera and a high resolution camera. Since we also release the raw images, this large-scale dataset could be used for other tasks such as ISP generation. Unlike current small-scale dataset used for these tasks, our proposed dataset includes 11,421 pairs of low-resolution high-resolution images of diverse scenes. To our knowledge this is the most complete dataset for super resolution, ISP and image quality enhancement. The benchmarking result shows how the new dataset can be successfully used to significantly improve the quality of real-world image super resolution.

  • 8 authors
·
Apr 17, 2020

Towards Real-world Event-guided Low-light Video Enhancement and Deblurring

In low-light conditions, capturing videos with frame-based cameras often requires long exposure times, resulting in motion blur and reduced visibility. While frame-based motion deblurring and low-light enhancement have been studied, they still pose significant challenges. Event cameras have emerged as a promising solution for improving image quality in low-light environments and addressing motion blur. They provide two key advantages: capturing scene details well even in low light due to their high dynamic range, and effectively capturing motion information during long exposures due to their high temporal resolution. Despite efforts to tackle low-light enhancement and motion deblurring using event cameras separately, previous work has not addressed both simultaneously. To explore the joint task, we first establish real-world datasets for event-guided low-light enhancement and deblurring using a hybrid camera system based on beam splitters. Subsequently, we introduce an end-to-end framework to effectively handle these tasks. Our framework incorporates a module to efficiently leverage temporal information from events and frames. Furthermore, we propose a module to utilize cross-modal feature information to employ a low-pass filter for noise suppression while enhancing the main structural information. Our proposed method significantly outperforms existing approaches in addressing the joint task. Our project pages are available at https://github.com/intelpro/ELEDNet.

  • 5 authors
·
Aug 27, 2024

Spatially Encoded Polaritonic Ultra-Strong Coupling in Gradient Metasurfaces with Epsilon-Near-Zero Modes

We introduce a platform to achieve ultra-strong coupling (USC) between light and matter using widely available materials. USC is a light-matter interaction regime characterized by coupling strengths exceeding 10% of the ground state energy. It gives rise to novel physical phenomena, such as efficient single-photon coupling and quantum gates, with applications in quantum sensing, nonlinear optics, and low-threshold lasing. Although early demonstrations in plasmonic systems have been realized, achieving USC in dielectric platforms, which offer lower losses and high Q-factors, remains challenging due to typically low mode overlap between the photonic field and the material resonance. Here we leverage dielectric dual gradient metasurfaces supporting quasi-bound states in the continuum to spatially encode both the spectral and coupling parameter space and demonstrate USC to an epsilon-near-zero (ENZ) mode in an ultra-thin SiO2 layer. The strong out-of-plane electric fields in our tapered bar structure overlap exceptionally well with those of the ENZ mode, resulting in a normalized coupling strength of 0.101 and a mode splitting equivalent to 20% of the ENZ mode energy; a four- to five-fold increase compared to previous approaches. The strong field confinement of our approach opens new possibilities for compact and scalable polaritonic devices, such as tunable frequency converters and low-energy optical modulators.

  • 7 authors
·
Feb 19, 2025