Perceptual AI

Setting the right goals for human-like perception

The appropriate use of objective functions is a fundamental research topic in the field of AI. Utilizing an objective function that aligns with the intended goal is key to efficient AI. No matter how advanced the neural architecture, a poorly chosen objective function leads to inefficient learning in neural networks. For visual information processing tasks where both input and output are image data, distortion measures (e.g., mean squared error) are widely used for both training and evaluating neural networks. However, there is a known trade-off between distortion and perceptual quality. We have studied objective functions for neural networks to balance perceptual quality and distortion (Cheon et al., 2018; Choi et al., 2020). Additionally, we have explored how to use language information for training neural networks to enhance perceptual quality of generated images (Lee et al., 2024).

References

2024

  1. ICML
    Neural image compression with text-guided encoding for both pixel-level and perceptual fidelity
    Hagyeong Lee, Minkyu Kim, Jun-Hyuk Kim, Seungeon Kim, Dokwan Oh, and Jaeho Lee
    International Conference on Machine Learning, 2024

2020

  1. Deep learning-based image super-resolution considering quantitative and perceptual quality
    Jun-Ho Choi, Jun-Hyuk Kim, Manri Cheon, and Jong-Seok Lee
    Neurocomputing, 2020

2018

  1. Generative adversarial network-based image super-resolution using perceptual content losses
    Manri Cheon, Jun-Hyuk Kim, Jun-Ho Choi, and Jong-Seok Lee
    European Conference on Computer Vision Workshops, 2018