Image Based Haptic Feature Extraction

Table of Contents

1 Introduction

2 Related Work

2.1 Textural Properties

2.2 Structure of Texture Patterns

2.3 Features Defined by Tamura

2.3.1 Coarseness

2.3.2 Contrast

2.3.3 Directionality

2.3.4 Linelikeness

2.4 Other Features

2.4.1 Complexity

2.4.2 Regularity

2.5 Shortcomings

3 Recording Procedure

3.1 Original Database

3.2 Magnified Database

4 Haptically Related Textural Features

4.1 Improved Features

4.1.1 Coarseness

4.1.2 Directionality

4.1.3 Linelikeness

4.1.4 Complexity

4.1.5 Regularity

4.2 New Features Definitions

4.2.1 Edginess

4.2.2 Color Distance

4.2.3 Roughness

4.2.4 Glossiness

4.2.5 Softness

5 Subjective Experiment

6 Results

6.1 Statistical Evaluation of Features

6.1.1 Feature Scaling and Cross Validation

6.1.2 Statistical Analysis

6.1.3 Feature Quality Identification

6.2 Feature Selection for High-Dimensional Data Classification

6.3 Classification Accuracy

6.3.1 Original Database

6.3.2 Magnified Database

6.4 Discussion

7 Conclusion

Research Objective and Scope

This work explores the automated classification of various textured surfaces by extracting haptically relevant image features. The primary research question addresses whether robust image-based feature extraction can successfully classify materials under varying camera conditions, such as distance, rotation, and lighting, to support applications in e-commerce and robotics.

• Development of eleven haptically relevant texture features.
• Creation of two comprehensive image databases (original and magnified).
• Implementation of robust machine learning-based surface classification.
• Visio-haptic subjective experiment to establish human perception ground truth.
• Evaluation of classification accuracy and feature subset selection strategies.

Excerpt from the Book

Summary of Chapters

1 Introduction: Provides an overview of the importance of haptic texture perception in image processing and establishes the goal of using visual data to classify material textures.

2 Related Work: Reviews existing texture analysis methods and defines established textural features such as coarseness, contrast, directionality, and regularity.

3 Recording Procedure: Details the acquisition of the two image databases, including the use of smartphones and magnifying attachments to capture texture details under various conditions.

4 Haptically Related Textural Features: Presents improvements to classical features and introduces new descriptors like edginess, glossiness, and softness to better match human tactile perception.

5 Subjective Experiment: Describes the design and execution of a human user study to gather ground truth data on texture roughness via visual and tactile inspection.

6 Results: Evaluates the classification performance using various machine learning classifiers and analyzes the effectiveness of feature selection methods.

7 Conclusion: Summarizes the findings and discusses the potential for future improvements in automated haptic texture classification.

Keywords

Texture classification, Haptics, Image processing, Feature extraction, Coarseness, Contrast, Directionality, Linelikeness, Complexity, Regularity, Edginess, Glossiness, Softness, Naive Bayes, Machine learning

Frequently Asked Questions

What is the core purpose of this research?

The work aims to extract image-based features that correlate with human tactile perception, enabling automated classification of textured surfaces for applications like robotics or e-commerce.

Which specific textural characteristics are analyzed?

The study focuses on eleven features, including traditional properties like coarseness and directionality, and newly defined ones such as edginess, glossiness, and softness.

What is the primary goal of the feature extraction process?

The goal is to generate robust, rotation-invariant, and illumination-invariant features that allow for reliable machine learning-based classification of textures.

Which machine learning methods are employed?

The research primarily utilizes Naive Bayes classifiers, Quadratic Discriminant Analysis (QDA), and Linear Discriminant Analysis (LDA) to evaluate classification accuracy.

How is the classification performance measured?

Performance is measured using misclassification error (MCE), classification accuracy (CA), and a goodness of features criterion (GFC) to assess feature quality.

What are the fundamental challenges addressed by this thesis?

The thesis addresses issues such as the "curse of dimensionality," redundancy in textural data, and the sensitivity of feature calculations to varying capture conditions like light and camera distance.

Why are magnified images included in the study?

Magnified images are used to capture fine-grained intrinsic details—such as fiber orientation or small gaps in foams—that are invisible in standard wide-angle smartphone photography.

How does the subjective experiment influence the results?

The experiment provides human-labeled roughness data, which acts as a reference for optimizing the computational roughness feature to ensure it aligns with human tactile impressions.