Abstract
The inability to touch fabrics online frustrates consumers, who are used to evaluating
physical textiles by engaging in complex, natural gestural interactions. When
customers interact with physical fabrics, they combine cross-modal information about
the fabric’s look, sound and handle to build an impression of its physical qualities. But
whenever an interaction with a fabric is limited (i.e. when watching clothes online)
there is a perceptual gap between the fabric qualities perceived digitally and the actual
fabric qualities that a person would perceive when interacting with the physical fabric.
The goal of this thesis was to create a fabric simulator that minimized this perceptual
gap, enabling accurate perception of the qualities of fabrics presented digitally.
We designed iShoogle, a multi-gesture touch-screen sound-enabled fabric simulator
that aimed to create an accurate representation of fabric qualities without the need for
touching the physical fabric swatch. iShoogle uses on-screen gestures (inspired by
natural on-fabric movements e.g. Crunching) to control pre-recorded videos and
audio of fabrics being deformed (e.g. being Crunched). iShoogle creates an illusion of
direct video manipulation and also direct manipulation of the displayed fabric.
This thesis describes the results of nine studies leading towards the development and
evaluation of iShoogle. In the first three studies, we combined expert and non-expert
textile-descriptive words and grouped them into eight dimensions labelled with terms
Crisp, Hard, Soft, Textured, Flexible, Furry, Rough and Smooth. These terms were
used to rate fabric qualities throughout the thesis. We observed natural on-fabric
gestures during a fabric handling study (Study 4) and used the results to design
iShoogle’s on-screen gestures. In Study 5 we examined iShoogle’s performance and
speed in a fabric handling task and in Study 6 we investigated users’ preferences for
sound playback interactivity. iShoogle’s accuracy was then evaluated in the last three
studies by comparing participants’ ratings of textile qualities when using iShoogle
with ratings produced when handling physical swatches. We also described the
recording and processing techniques for the video and audio content that iShoogle
used. Finally, we described the iShoogle iPhone app that was released to the general
public. Our evaluation studies showed that iShoogle significantly improved the accuracy of
fabric perception in at least some cases. Further research could investigate which
fabric qualities and which fabrics are particularly suited to be represented with
iShoogle.

Abstract
For many people images are a medium preferable to text and yet, with the exception of star ratings, most formats for conventional computer mediated feedback focus on text. This thesis develops a new method of crowd feedback for designers based on images. Visual summaries are generated from a crowd’s feedback images chosen in response to a design. The summaries provide the designer with impressionistic and inspiring visual feedback. The thesis sets out the motivation for this new method, describes the development of perceptually organised image sets and a summarisation algorithm to implement it. Evaluation studies are reported which, through a mixed methods approach, provide evidence of the validity and potential of the new image-based feedback method.

It is concluded that the visual feedback method would be more appealing than text for that section of the population who may be of a visual cognitive style. Indeed the evaluation studies are evidence that such users believe images are as good as text when communicating their emotional reaction about a design. Designer participants reported being inspired by the visual feedback where, comparably, they were not inspired by text. They also reported that the feedback can represent the perceived mood in their designs, and that they would be enthusiastic users of a service offering this new form of visual design feedback.

Abstract
This thesis evaluates the ability of computational features to estimate perceptual texture similarity.

In the first part of this thesis, we conducted two evaluation experiments on the ability of 51 computational feature sets to estimate perceptual texture similarity using two different evaluation methods, namely, pair-of-pairs based and retrieval based evaluations. These experiments compared the computational features to two sets of human derived ground-truth data, both of which are higher resolution than those commonly used. The first was obtained by free-grouping and the second by pair-of-pairs experiments. Using these higher resolution data, we found that the feature sets do not perform well when compared to human judgements.

Our analysis shows that these computational feature sets either (1) only exploit power spectrum information or (2) only compute higher order statistics (HoS) on, at most, small local neighbourhoods. In other words, they cannot capture aperiodic, long-range spatial relationships. As we hypothesise that these long-range interactions are important for the human perception of texture similarity we carried out two more pair-of-pairs experiments, the results of which indicate that long-range interactions do provide humans with important cues for the perception of texture similarity.

In the second part of this thesis we develop new texture features that can encode such data. We first examine the importance of three different types of visual information for human perception of texture. Our results show that contours are the most critical type of information for human discrimination of textures. Finally, we report the development of a new set of contour-based features which performed well on the free-grouping data and outperformed the 51 feature sets and another contour type feature set with the pair-of-pairs data.

Abstract
This thesis presents a novel investigation into the effect stereoscopic vision has upon the strength of perceived gloss on rough surfaces. We demonstrate that in certain cases disparity is necessary for accurate judgements of gloss strength.We first detail the process we used to create a two-level taxonomy of property terms, which helped to inform the early direction of this work, before presenting the eleven words which we found categorised the property space. This shaped careful examination of the relevant literature, leading us to conclude that most studies into roughness, gloss, and stereoscopic vision have been performed with unrealistic surfaces and physically inaccurate lighting models.

To improve on the stimuli used in these earlier studies, advanced offline rendering techniques were employed to create images of complex, naturalistic, and realistically glossy 1/fβ noise surfaces. These images were rendered using multi-bounce path tracing to account for interreflections and soft shadows, with a reflectance model which observed all common light phenomena. Using these images in a series of psychophysical experiments, we first show that random phase spectra can alter the strength of perceived gloss. These results are presented alongside pairs of the surfaces tested which have similar levels of perceptual gloss. These surface pairs are then used to conclude that naïve observers consistently underestimate how glossy a surface is without the correct surface and highlight disparity, but only on the rougher surfaces presented.

Abstract
This thesis is concerned with the visual perception of glossy rough surfaces, specifically those characterised by 1 / f ^β noise.Computer graphics were used to model these natural looking surfaces, which were generated and animated to provide realistic stimuli for observers. Different methods were employed to investigate the effects of varying surface roughness and reflection model parameters on perceived gloss.

We first investigated how the perceived gloss of a matte Lambertian surface varies with RMS roughness. Then we estimated the perceived gloss of moderate RMS height surfaces rendered using a gloss reflection model. We found that adjusting parameters of the gloss reflection model on the moderate RMS height surfaces produces similar levels of gloss to the high RMS height Lambertian surfaces.

More realistic stimuli were modelled using improvements in the reflection model, rendering technique, illumination and viewing conditions. In contrast with previous research, a non-monotonic relationship was found between perceived gloss and mesoscale roughness when microscale parameters were held constant. Finally, the joint effect of variations in mesoscale roughness (surface geometry) and microscale roughness (reflection model) on perceived gloss was investigated and tested against conjoint measurement models. It was concluded that perceived gloss of rough surfaces is significantly affected by surface roughness in both mesoscale and microscale and can be described by a full conjoint measurement model.

Abstract
This thesis describes the development of a large database of texture stimuli, the production of a similarity matrix reflecting human judgements of similarity about the database, and the development of three browsing models that exploit structure in the perceptual information for navigation. Rigorous psychophysical comparison experiments are carried out and the SOM (Self Organising Map) found to be the fastest of the three browsing models under examination. We investigate scalable methods of augmenting a similarity matrix using the SOM browsing environment to introduce previously unknown textures. Further psychophysical experiments reveal our method produces a data organisation that is as fast to navigate as that derived from the perceptual grouping experiments.

Abstract
Much work has been done on developing algorithms for automated surface defect detection. However, comparisons between these models and human perception are rarely carried out. This thesis aims to investigate how well human observers can nd defects in textured surfaces, over a wide range of task diculties. Stimuli for experiments will be generated using texture synthesis methods and human search strategies will be captured by use of an eye tracker. Two dierent modelling approaches will be explored. A computational LNL-based model will be developed and compared to human performance in terms of the number of xations required to nd the target. Secondly, a stochastic simulation, based on empirical distributions of saccades, will be compared to human search strategies.

Abstract
Directionality is known to be an important dimension in human perception and classification of visual textures. Through a series of psychophysical experiments, this thesis investigates further the perception of directionality in textured surfaces, and uses the results to propose a measurement model for the perceived directionality of random-phase surfaces.

Height maps of textured surfaces were rendered and animated in real-time with controlled illumination. Observers’ judgements of the directionality of surfaces were obtained by direct-ratio estimation, and either the method of pair-wise comparisons or the method of constant stimuli. The responses were used to derive a perceptual scale of directionality (perceived directionality) that could be related to physical properties of the surfaces.

The thesis first investigates the relationships between each of two existing computational measures of directionality (Tamura’s variance and Davis’ variance) and human perception of directionality. This was done by using height maps captured from real surfaces, which were then manipulated to vary the computational measures of their directionality. From the psychophysical experiment, it was found that these two measures do not fully account for human perception of directionality, which must therefore be influenced by other properties of the textures.

In order to investigate more fully the factors determining perceived directionality, synthetic random-phase surfaces defined by a mathematical model were used in the subsequent experiments. It was found that three properties of the magnitude spectrum of such surfaces significantly affect human perception of their directionality: angular variance, RMS roughness and central radial frequency. After determining these effects, the thesis proposes a measurement model of perceived directionality, which predicts human perception of directionality of a random-phase surface.

Abstract
Virtual textile databases provide a cost-efficient alternative to the use of existing hardcover sample catalogues. By taking advantage of the high performance features offered by the latest generation of programmable graphics accelerator boards, it is possible to combine photometric stereo methods with 3D visualisation methods to implement a virtual textile database. In this thesis, we investigate and combine rotation invariant texture retrieval with interactive visualisation techniques. We use a 3D surface representation that is a generic data representation that allows us to combine real-time interactive 3D visualisation methods with present day texture retrieval methods. We begin by investigating the most suitable data format for the 3D surface representation and identify relief-mapping combined with Bézier surfaces as the most suitable 3D surface representations for our needs, and go on to describe how these representation can be combined for real-time rendering. We then investigate ten different methods of implementing rotation invariant texture retrieval using feature vectors. These results show that first order statistics in the form of histogram data are very effective for discriminating colour albedo information, while rotation invariant gradient maps are effective for distinguishing between different types of micro-geometry using either first or second order statistics.

Psychophysical experiments were conducted in which observers were asked to place texture samples into groups. Multidimensional Scaling was applied to the resulting similarity matrices to obtain a more manageable reduced perceptual space. A four dimensional representation was found to capture the majority of the variability. A corresponding feature space was created by linearly combining selected trace transform features. Retrieval was performed simply by determining the n closest neighbours to the query’s feature vector. An average retrieval precision of 60% was obtained in blind tests.

Due to some confidentiality agreement, the content of this thesis will be made available at a later time.

Abstract
This thesis reports and discusses results from a new methodology for investigating the visually perceived properties of surfaces; by doing so, it also discovers a measurement or estimator for perceived roughness of 1 / F ^&beta noise surfaces.

Advanced computer graphics were used to model natural looking surfaces (1 / F ^&beta noise surfaces). These were generated and animated in real-time to enable observers to manipulate dynamically the parameters of the rendered surfaces. A method of adjustment was then employed to investigate the effects of changing the parameters on perceived roughness. From psychophysical experiments, it was found that the two most important parameters related to perceived roughness were the magnitude roll-off factor (&beta) and RMS height (&sigma) for this kind of surfaces.

From the results of various extra experiments, an estimation method for perceived roughness was developed; this was inspired by common frequency-channel models. The final optimized model or estimator for perceived roughness in 1 / F ^&beta noise surfaces found was based on a FRF model. In this estimator, the first filter has a shape similar to a gaussian function and the RF part is a simple variance estimator. By comparing the results of the estimator with the observed data, it is possible to conclude that the estimator accurately represents perceived roughness for 1 / F ^&beta noise surfaces.

Table of contents and individual chapters are available here.

Abstract
Pursuing a goal of realistic rendering for mixed reality applications using bump mapping demands the acquisition of both surface height and reflectance data of real textures. In this thesis we consider the use of various computer vision techniques for this purpose. We focus on establishing a practical implementation of Lambertian photometric stereo. Our objective is to make the technique more accessible so that it could potentially complement consumer-oriented visualisation applications. In this regard it is important to be unambiguous with respect to the standard operating procedure for optimal performance. It is also vital to minimise the requisite calibration of equipment. With regard to three-image calibrated photometric stereo we determined that the optimal placement of the illumination vectors corresponds to an orthogonal arrangement. We also established that if the slant angle is constant, the optimal configuration corresponds to a difference of l20° between successive illumination tilt angles. Ignoring shadowing, we found the optimal slant angle to be a maximum of 90° for smooth surfaces and approximately 55° for rough surfaces.
With a view to reducing the requisite calibration, we developed a technique based on uncalibrated photometric stereo . It is practical to implement for surface texture planes and merely requires a single illumination tilt angle to be known. Its performance was found to be comparable to the equivalent calibrated technique.

Abstract
Texture synthesis has been extensively investigated by both computer vision and computer graphics communities during the past twenty years. However, the input and output are normally 2D intensity texture images. If the subjects are 3D surface textures (such as brick, woven or knitted textiles, embossed wallpapers etc.), these 2D synthesis techniques cannot provide the information required for rendering under other than the original illumination and viewpoint conditions. The aim of this thesis therefore is to develop inexpensive approaches for the synthesis of 3D surface textures. Few publications are available in this research area.We first introduce an overall framework for the synthesis of 3D surface textures. The framework essentially combines surface representation methods with 2D texture synthesis algorithms to synthesise and relight new surface representations. Then we investigate five low-dimensional methods, namely the 3I, Gradient, PTM, Eigen3 and Eigen6 methods, for extracting representations from a set of images of the 3D surface texture sample. The surface representations can be relit to generate new images under arbitrary lighting directions by linear combinations. These methods are quantitatively assessed by comparing the original and relit images. The results show that the Eigen6 produces the best performance.

We select a 2D texture synthesis algorithm which is then extended into multi-dimensional space to use the five surface representations as input. In this way, we develop five approaches for the synthesis of 3D surface textures. The synthesised results are compatible with computer graphics systems and can be used in real-time rendering applications. The five synthesis approaches are qualitatively assessed by employing psychophysical experiments and non-parametric statistics. The results show that the two low-dimensional methods, the Gradient and Eigen3, on average offer as good a performance as of any of the other methods and incur low computational cost.

Table of contents and individual chapters are available here.

Abstract
This thesis is concerned with the 3D estimation of rough surfaces from their intensity images. A technique which combines Photometric Stereo and frequency integration is proposed. The combination of these two standard methods for reconstructing rough surfaces is novel. We refer to this technique as the Benchmark technique. Two novel recovery algorithms which rely on assumptions about the linearity of the surface reflectance are also presented. We refer to them as the Optimal Linear Filter and the Linear Photometric Stereo. The proposed methods differ in the information that they require as well as in the assumptions that they make about the surface.The ability of the proposed techniques to estimate rough surfaces is assessed using simulation and real data. The assessment considers a diverse set of textures including those that are challenging for the algorithms, such as very rough or specular surfaces.

The most robust estimation is given by the Optimal Linear Filter. However this technique requires information about the surface topography, which is usually not available. Between the alternatives, the Benchmark technique gives more accurate reconstructions.

A post-processing step which can be used to improve the surface estimate is presented. This minimises the brightness error using an iterative approach. When the Linear Photometric Stereo method is combined with the post-processing step, its performance is similar to that of the Benchmark technique, despite requiring one less image. However the Linear Photometric Stereo algorithm is restricted to constant albedo surfaces. The choice of the most appropriate method is determined by the application requirements.

Table of contents and individual chapters are available here.

Abstract
This thesis presented a new three-dimensional surface texture classification scheme which was invariant to surface-rotation using photometric stereo. Many texture class ification approaches had been presented in the past that were image-rotation invariant, however, image rotation was not necessarily the same as surface rotation. A classifier therefore had been developed that used invariants that were derived from surface properties rather than image properties.Firstly, various surface models were considered and a classification scheme was developed that used magnitude spectra of the partial derivatives of the surface obtained using photometric stereo. A simple frequency domain method of removing the directional artefacts of partial derivatives was presented, and a 1D feature set of polar spectrum was also extracted from resulting spectrum. Classification was performed by comparing training and classification polar spectra over a range of rotations. Secondly, a new feature generator albedo spectrum was introduced to provide more information on surface texture properties, and an additional 1D feature set of the radial spectrum was employed too. In addition, by examining the effect of shadowing, a four-image photometric stereo method was developed to provide more accurate three-dimensional surface properties. Finally, a verification step was included in the classification where the 2D spectrum features were compared instead of 1D spectrum features.

The classification results using new-developed photometric stereo real texture database shown that combining 2D gradient and albedo data improves the classification’s performance to provide a successful classification rate of 99%

Table of contents and individual chapters are available here.

Abstract
This thesis sets texture analysis in a physical context. Models of the system components are obtained from the literature and integrated into a description of the process linking the rough surface to the feature set on which classification is based. The first component is the rough surface, models of the surface topography are selected from the fields of tribology and scattering. Various reflectance models are considered and a spectral model of the surface/image relationship from the literature, is evaluated and discussed. The relationship between the incident image and the captured data set is investigated and described. This model is integrated with the spectral description of the feature measures to form a model of the transition from surface to feature set.It is clear from this model that the direction of illumination can affect the directionality of an image obtained from a given surface. Changes in the illuminant direction will result in changes in the feature outputs. If the illuminant direction is altered between training and classification, the classification rule may be inappropriate and classification poor. Several schemes are considered to combat this problem. A technique which uses a representation of the physical surface as the basis for the generation of appropriate training data is selected for further evaluation. The surface derivative fields of the training surface are estimated using photometric techniques. A rendering algorithm uses these estimates to simulate the appearance of the training surface when it is illuminated from an arbitrary direction. It is shown that where illuminant direction is varied this system is able to perform significantly better than a naive classifier, and in some cases approaches the level of accuracy obtained from training the classifier under the conditions at which classification is performed.

Table of contents and individual chapters are available here.

Abstract
Texture analysis has been an extremely active and fruitful area of research over the past twenty years. Many advances have been made, but the effect of variation in lighting conditions on automated texture classification and segmentation has received little attention. This thesis shows that the direction of the illuminant is an important factor that should be taken into account when analysing images of three-dimensional texture.A frequency domain model is presented which predicts that both the directional characteristics and the variance of images of three-dimensional texture can be affected by changes in illuminant vector. Results of simulations and laboratory experiments support these predictions.

The responses of three sets of texture measures are analysed using a test set of isotropic and directional textures. The results show that the feature measures’ outputs are affected by changes in illuminant direction. These changes are also shown to significantly increase the error rates of statistical classifiers implemented using the three feature sets. Normalisation of images is shown to reduce the error rates in some cases.

The frequency domain model of image texture is further developed using empirical data and the resulting model used to design a set of tilt-compensation filters. These filters are used to pre-process images to reduce the effects of changes in the angle of tilt of the illuminant. Application of the filters to the test image set reduced the classification errors associated with directional textures.

Table of contents and individual chapters are available here.

The features used by the methods are based on a measure of the fractal dimension of surfaces in several directions, which allows the transformation of the image into a set of feature images, however no direct measurement of the fractal dimension is made. Using this set of features, supervised and unsupervised, statistical processing schemes are presented which produce low classification error rates. Natural texture images are examined with particular application to the analysis of sonar images of the seabed.

A number of processes based on fractal models for texture synthesis are also presented. These are used to produce realistic images of natural textures, again with particular reference to sonar images of the seabed, and which show the importance of phase and directionality in our perception of texture. A further extension is shown to give possible uses for image coding and object identification.