Graduate Thesis Or Dissertation

 

Semantic image segmentation using domain constraints Pubblico Deposited

Contenuto scaricabile

Scarica il pdf
https://ir.library.oregonstate.edu/concern/graduate_thesis_or_dissertations/s1784r52p

Descriptions

Attribute NameValues
Creator
Abstract
  • This dissertation addresses the problem of semantic labeling of image pixels. In the course of our work, we considered different types of semantic labels, including object classes (e.g., car, person), 3D depth values (in the range 0 to 80 meters), and affordance classes (e.g., walkable, sittable). Semantic pixel labeling is challenging as objects may appear in various poses, under partial occlusion, and against a cluttered background in the scene. To address these challenges in semantic segmentation, we developed approaches in a unified research theme that of incorporating domain knowledge in learning and inference. As our results show, domain knowledge helps to resolve various ambiguities in semantic segmentation. We addressed this problem in supervised and weakly supervised settings, where the former provides pixel-wise ground-truth annotations in training, and the latter provides ground truths only as image-level tags. Our approaches range from beam search based inference to deep convolutional neural networks (CNN). Our approaches achieved state-of-the-art performance on the benchmark datasets for all types of semantic segmentation problems.Our main contributions include:1. Efficient beam search based inference that guarantees to respect domain constraints.2. Novel deep neural architecture called neural regression forest, which integratesdecision forests with CNNs.3. Multi-scale CNN architecture for extracting and fusing diverse mid-level visualcues, including depth map, surface normals, and object localization.4. Constraint-based regularized learning of a CNN where constraints are defined asspatial relationships between objects in the domain.5. Weakly supervised learning of CNNs using neural attention cues.6. We introduced first manually annotated dataset for evaluating affordance segmentation.
  • Keywords: computer vision, semantic image segmentation, deep learning
License
Resource Type
Date Available
Date Issued
Degree Level
Degree Name
Degree Field
Degree Grantor
Commencement Year
Advisor
Committee Member
Academic Affiliation
Non-Academic Affiliation
Dichiarazione dei diritti
Publisher
Peer Reviewed
Language
Replaces

Le relazioni

Parents:

This work has no parents.

In Collection:

Elementi