Integration of structured energy-based models with deep neural networks for image restoration
Başlık çevirisi mevcut değil.
- Tez No: 721424
- Danışmanlar: DR. TAKAYUKİ OKATANİ
- Tez Türü: Yüksek Lisans
- Konular: Bilgisayar Mühendisliği Bilimleri-Bilgisayar ve Kontrol, Computer Engineering and Computer Science and Control
- Anahtar Kelimeler: Belirtilmemiş.
- Yıl: 2022
- Dil: İngilizce
- Üniversite: Tohoku Unıversıty
- Enstitü: Yurtdışı Enstitü
- Ana Bilim Dalı: Belirtilmemiş.
- Bilim Dalı: Belirtilmemiş.
- Sayfa Sayısı: Belirtilmemiş.
Özet
Özet yok.
Özet (Çeviri)
Image restoration has been an active research topic in computer vision and pattern recognition fields for the past few decades. Image restoration aims to fill in missing regions of images with visually realistic and semantically plausible content. The crucial part of image restoration task is how to model structural relationship between local regions of natural images. Another important point in the task is to use the modelled structural relationship for estimating pixel intensities of the missing regions. Therefore, modelling structural relationship has been a major concern in previous studies of image restoration. Thus, it is often formulated as a structured prediction problem. There have been several studies on image restoration task that uses convolutional neural networks and generative adversarial networks in a feed-forward manner from an input image to an output inpainted image. However, to the best of our knowledge, there is no study investigating energy-based methods that uses deep networks for image restoration task. Predicting structured outputs using energy-based models has been analyzed in previous studies. In general, structured prediction problems are formulated as energy minimization. Moreover, deep neural networks have been used for structured prediction problem due to its generative power. Motivated by the fact that natural images are highly structured, we aim to show that it is possible to complete missing regions in images using the structure with energy-based models and convolutional neural networks. In order to employ structured energy-based-models with deep neural networks for image restoration task, we proposed a structured image restoration method exploiting an energy based model. In order to learn structural relationship between patterns observed in images and missing regions of the images, we employed an energy-based structured prediction method. Energy function is defined by a simple convolutional neural network which takes an image with missing region and an estimate of the true image as inputs. The convolutional neural network has a specific network architecture which includes two paths i having inter-layer connections between paths. The convolutional neural network outputs energy for input image pairs from its final layer. The structural relationship is learned by minimizing energy function. The experimental results on various benchmark datasets show that our proposed method significantly outperforms the state-of-the-art methods which use Generative Adversarial Networks (GANs). We obtained 21.16 dB peak signal to noise ratio (PSNR) on the Olivetti face dataset compared to 18.92 dB provided by the state-of-the-art method. Moreover, we obtained 28.4 dB PSNR on the SVHN dataset and 23.53 dB on the CelebA dataset, compared to 22.3 dB and 21.3 dB, provided by the state-of-the-art methods, respectively.
Benzer Tezler
- A deep neural network methods to predict aeroelastic responses of a shape memory alloy hysteretic springs based typical airfoil section
Şekil hafıza alaşımlı histeretik yay içeren tipik bir kanat kesitinin aeroelastik tepkilerinin tahmini için derin sinir ağı yöntemleri
OSMAN DAĞLI
Doktora
İngilizce
2025
Uçak Mühendisliğiİstanbul Teknik ÜniversitesiUçak ve Uzay Mühendisliği Ana Bilim Dalı
PROF. DR. METİN ORHAN KAYA
- Forecasting of produced output electricity in photovoltaic power plants
Foto-voltaik güç santrallarında elektrik üretim tahmini
TARANEH SAADATI
Doktora
İngilizce
2025
Enerjiİstanbul Teknik ÜniversitesiEnerji Bilimi ve Teknolojileri Ana Bilim Dalı
DOÇ. DR. BURAK BARUTÇU
- Veri merkezleri için makine öğrenmesi temelli izleme sistemi tasarımı
Machine learning based monitoring system design for data centers
METEHAN HAN
Yüksek Lisans
Türkçe
2024
Bilgisayar Mühendisliği Bilimleri-Bilgisayar ve KontrolSakarya ÜniversitesiBilgisayar Mühendisliği Ana Bilim Dalı
DR. ÖĞR. ÜYESİ ABDULLAH SEVİN
- Gemi siber güvenlik dinamiklerinin belirlenmesi ve köprüüstü seyir ekipmanlari özelinde siber güvenlik risk değerlendirme uygulamalari
Determination of ship cyber security dynamics and cyber security risk assessment applications specifically for bridge navigation equipment
BÜNYAMİN GÜNEŞ
Doktora
Türkçe
2025
Denizcilikİstanbul Teknik ÜniversitesiDeniz Ulaştırma İşletme Mühendisliği Ana Bilim Dalı
DOÇ. DR. PELİN BOLAT
- Tuzlu su desalinasyonunda yapay zeka kullanımı
Application of artificial intelligence in saltwater desalination
RABİYA KARALI TÜRKER
Yüksek Lisans
Türkçe
2025
Elektrik ve Elektronik Mühendisliğiİstanbul Teknik ÜniversitesiElektronik ve Haberleşme Mühendisliği Ana Bilim Dalı
DR. ÖĞR. ÜYESİ CEMANUR AYDINALP PENÇE