Automatic pose-independent 3D garment fitting

Given a virtual garment model on a reference human model, we propose an automated 3D garment fitting system that fits the garment model to a target human model. The proposed method can transfer garment models between human models without any user guidance even when the reference and target human models have different poses. Our goal is not to resize or deform the original garment model according to the target human model but to yield realistic fitting results of the given garment on the target human models. Using pose-independent segmentation and cloth simulation, we achieve realistic and automatic fitting results in reasonable running time. Our method can replace the time-consuming manual fitting process that is necessary for many applications that use virtual garments, such as games, animations, CAD tools and online clothing stores.     

适于网络试穿的快速三维服装仿真方法

三维服装仿真技术是虚拟试衣的核心,目前三维服装仿真常用有限元技术来实现,该方法仿真花费的时间较长不能满足网络试衣的要求。提出了一种基于服装裁剪分片技术的三维服装仿真方法,该方法参考服装设计知识将待仿真服装划分为若干衣片,然后用贝塞尔曲面分别模拟这些衣片,最后利用纹理映射技术把服装布料的图案映射到相应的衣片,得到服装三维仿真模型。实验表明利用该方法得到的三维服装模型能够把服装的基本试穿效果展示出来,而且所需的时间很短,可以满足在线试穿的要求。     

DeepGarment : 3D Garment Shape Estimation from a Single Image

3D garment capture is an important component for various applications such as free‐view point video, virtual avatars, online shopping, and virtual cloth fitting. Due to the complexity of the deformations, capturing 3D garment shapes requires controlled and specialized setups. A viable alternative is image‐based garment capture. Capturing 3D garment shapes from a single image, however, is a challenging problem and the current solutions come with assumptions on the lighting, camera calibration, complexity of human or mannequin poses considered, and more importantly a stable physical state for the garment and the underlying human body. In addition, most of the works require manual interaction and exhibit high run‐times. We propose a new technique that overcomes these limitations, making garment shape estimation from an image a practical approach for dynamic garment capture. Starting from synthetic garment shape data generated through physically based simulations from various human bodies in complex poses obtained through Mocap sequences, and rendered under varying camera positions and lighting conditions, our novel method learns a mapping from rendered garment images to the underlying 3D garment model. This is achieved by training Convolutional Neural Networks (CNN‐s) to estimate 3D vertex displacements from a template mesh with a specialized loss function. We illustrate that this technique is able to recover the global shape of dynamic 3D garments from a single image under varying factors such as challenging human poses, self occlusions, various camera poses and lighting conditions, at interactive rates. Improvement is shown if more than one view is integrated. Additionally, we show applications of our method to videos.     

基于VC 6.0和OpenGL的三维试衣系统研究*

提出了采用基于特征匹配的方法实现三维试衣效果的展示。首先提取Poser 6.0中的三维人体模型和服装模型数据;然后通过三维网格模型的曲率特征在人体模型与服装模型之间建立映射关系来完成匹配,这个过程是一种刚体变换即获取旋转矩阵和平移矢量两部分;最后在VC++ 6.0的开发环境下,利用OpenGL强大的三维建模功能实现了三维试衣平台的搭建。该平台不但可以帮助顾客快速、准确地完成服装款式的选择和试穿,而且为服装产品的个性化设计和网上销售提供了有力的支持。     

个性化三维虚拟试衣系统研究

为满足用户对虚拟试衣的个性化需求和提高虚拟试衣体验，提出一种包括自动化蒙皮、基于单张图片人脸三维自动重建、人体参数化变形以及服装模型穿透处理等模块的个性化虚拟试衣系统。设计了自动化蒙皮算法，解决已有虚拟试衣服装模型制作成本高的问题；通过基于单张图片的三维人脸自动重建和人体参数化变形，满足消费者个性化需求;运用基于自动透明贴图计算的服装穿透处理方法，改进系统试衣效果。实验表明，所提出的系统能够以较低的构建与运行成本实现较好的试衣效果，提供良好的个性化虚拟试衣体验。     

基于细分曲面的三维服装柔性实体模拟

提出一种基于细分曲面的三维服装柔性实体模拟算法，该算法将整个模拟过程分为两个阶段：首先利用四点细分曲面造型方法生成三维服装刚性曲面，然后在刚性曲面基础上通过引入织物的物理模型来模拟三维服装柔性曲面，通过物理和几何模拟方法有机结合，算法有效解决了复杂衣片间的缝合问题，较大地提高了模拟的计算效率，同时，也提出了一种基于细分曲面层次数据结构的碰撞检测算法，有效提高了模拟速度，提出的算法已全部在所开发的三维虚拟服装试衣系统中得以实现，实验结果表明：该算法具有模拟效率高、交互性强和易于计算机实现等优点。     

Reactive 2D/3D garment pattern design modification

This paper presents a new 3D garment simulation result update algorithm for the 2D garment pattern design modification. The proposed algorithm enables the 3D garment fitting simulation result directly to react to the modification in the 2D patterns. The algorithm performs a topological invariant deformation of the 2D pattern mesh after the boundary of the 2D pattern undergoes a topological consistent modification. The length of each of the edges in the mesh defined as the equilibrium state parameter is updated and then directly used in the 3D garment fitting simulation to update the original simulation result. The advantage of the proposed algorithm is that the mesh topology of the 2D garment pattern is preserved and thus simplifies the numerical scheme by maintaining the consistency of the matrix equation. With this approach, the 3D garment fitting simulation does not need to repeat the entire simulation for every modification and can react to the 2D pattern modification efficiently and speedily.     

Image warping for retargeting garments among arbitrary poses

We address the problem of warping 2D images of garments onto target mannequins of arbitrary poses. The motivation for this work is to enable an online shopper to drag and drop selected articles of clothing onto a single mannequin to configure and visualize outfits. Such a capability requires each garment to be available in a pose that is consistent with the target mannequin. A 2D deformation system is proposed, which enables a designer to quickly deform images of clothing onto a target shape with both fine and coarse controls over the deformation. This system has retargeted thousands of images for retailers to establish virtual dressing rooms for their online customers.     

基于款式设计的虚拟三维服装真实感效果模拟

介绍了由服装的二维款式设计研究三维款式真实感效果显示的步骤,并对人台参数化建模、服装的变空隙量模型等技术进行实践,提出了一种实现三维着装效果显示方法,为款式设计提供直观帮助.通过二维款式平面图到三维图形的映射得到可控的三维服装,通过精确可靠的三维数据模拟三维款式效果.在三维服装上添加全局纹理映射和多重纹理映射以及褶皱效果,增强服装设计可视化效果.     

A Sketch-Based Interface for Clothing Virtual Characters

This interactive system for garment creation determines a garment's shape and how the character wears it based on a user-drawn sketch. The system then uses distances between the 2D garment silhouette and the character model to infer remaining distance variations in 3D     

The development of an intelligent system for customized clothing making

This study presents the development of an intelligent system for customized clothing making. The system involves body dimension collection, clothing pattern generation and fabric cutting. First, body dimensions can be collected by analyzing the 3D scanning images or 2D photographs. Further, the clothing patterns can be generated by using computer-aided design (CAD) techniques based on the collected dimensions. By presenting the generated clothing patterns in DXF (Drawing Exchange Format), the CNC laser-cutting machine can then cut the fabric into pattern pieces automatically. Finally, by integrating the system with the processes of garment sewing, fitting test and final adjustment, the concept of customized clothing making can be realized. It can not only assure good fitness of the customized clothing but also reduce human efforts, costs, and production time.     

Designing Personalized Garments with Body Movement

The standardized sizes used in the garment industry do not cover the range of individual differences in body shape for most people, leading to ill-fitting clothes, high return rates and overproduction. Recent research efforts in both industry and academia, therefore, focus on virtual try-on and on-demand fabrication of individually fitting garments. We propose an interactive design tool for creating custom-fit garments based on 3D body scans of the intended wearer. Our method explicitly incorporates transitions between various body poses to ensure a better fit and freedom of movement. The core of our method focuses on tools to create a 3D garment shape directly on an avatar without an underlying sewing pattern, and on the adjustment of that garment's rest shape while interpolating and moving through the different input poses. We alternate between cloth simulation and rest shape adjustment based on stretch to achieve the final shape of the garment. At any step in the real-time process, we allow for interactive changes to the garment. Once the garment shape is finalized for production, established techniques can be used to parameterize it into a 2D sewing pattern or transform it into a knitting pattern.     

基于草图交互的个性化服装生成方法

以建立和交互修改三维服装草图为设计手段,提出在三维人体模型上生成三维个性化服装的参数化造型方法．服装草图由2种基本几何元素组成：体现人体围度信息的封闭样条曲线和体现人体在高度方向上曲面形状过渡的不封闭样条曲线．将服装草图约束分为2类4种：一类是体现服装宽松程度的人体与服装曲面之间的间隙约束;另一类是服装几何元素本身之间的共点、共面与对称约束．从人体的特征点出发,通过间隙约束生成服装草图的几何元素;在共点、对称和共面约束下,由服装草图几何元素建立拓扑结构为四边网格的服装草图．服装草图的交互修改是草图约束维护的过程,构建侧视图、正视图、断面图3个视图组成草图修改平台,在平台上交互编辑特征曲线．服装曲面则以三维草图为框架,通过对四边网格双线性Coons曲面插值生成．提供的设计方法使服装的造型变得简洁、灵活．     

服装CAD中三维人体模型的参数化研究

针对三角网格曲面表示的3D人体模型缺少语义信息，提出一种3D人体模型的参数化方法：首先通过三角面片求交的采样策略得到采样点，然后使用B样条曲线构造人体轮廓线，最后由用户交互得到3D人体模型的参数化信息，建立3D人体模型的参数化模板．这样，在参数化人体模型模板的基础上，可以根据用户所输入的特定人体参数信息，动态地调整轮廓线和重建人体模型体表曲面，快速生成逼真的3D人体模型，从而满足服装CAD中根据用户身材尺寸大小定制服装的应用需求．     

Generating unified model for dressed virtual humans

Scenes with crowds of dressed virtual humans are getting more attention and importance in 3D games and virtual reality applications. Crowd scenes, which include huge amounts of virtual humans, require complex computation for animation and rendering. In this research, new methods are proposed to generate efficient virtual human models by unifying a body and a garment into an animatable model, which has skinning parameters for the common skeleton-driven animation. The generated model has controlled complexity in geometry and semantic information. The unified model is constructed by using the correspondence between the body and the garment meshes. To establish the correspondence, two opposite optimization methods are proposed and compared: the first is to fit the body onto the garment and the second is to fit the garment onto the body. The innovative aspect of our method lies in supporting multiple correspondences between body and cloth parts. This enables us to handle the skirt model which is difficult to be processed by using previous works, due to its topological differences to the body model.     

Matlab和Web应用相结合及其在eMTM 在线系统中的应用

从满足电子化量身定制(eMTM系统快速实时的3D人体建模的要求入手,提出一种利用Matlab和传统Web应用相结合的方法,并用此方法建立了一个独立于Matlab平台的基于Web／Http的人体三维模型在线构建和仿真系统的模型,最后通过一个试验性应用示例表明了该方法的具体实现过程,试验结果表明了该方法在基于Web的实时快速人体3D模型的仿真方面具有较好的有效性。这些研究结果对于服装行业eMTM的发展具有积极的意义。     

Multi-View AAM Fitting and Construction

Active Appearance Models (AAMs) are generative, parametric models that have been successfully used in the past to model deformable objects such as human faces. The original AAMs formulation was 2D, but they have recently been extended to include a 3D shape model. A variety of single-view algorithms exist for fitting and constructing 3D AAMs but one area that has not been studied is multi-view algorithms. In this paper we present multi-view algorithms for both fitting and constructing 3D AAMs. Fitting an AAM to an image consists of minimizing the error between the input image and the closest model instance; i.e. solving a nonlinear optimization problem. In the first part of the paper we describe an algorithm for fitting a single AAM to multiple images, captured simultaneously by cameras with arbitrary locations, rotations, and response functions. This algorithm uses the scaled orthographic imaging model used by previous authors, and in the process of fitting computes, or calibrates, the scaled orthographic camera matrices. In the second part of the paper we describe an extension of this algorithm to calibrate weak perspective (or full perspective) camera models for each of the cameras. In essence, we use the human face as a (non-rigid) calibration grid. We demonstrate that the performance of this algorithm is roughly comparable to a standard algorithm using a calibration grid. In the third part of the paper, we show how camera calibration improves the performance of AAM fitting. A variety of non-rigid structure-from-motion algorithms, both single-view and multi-view, have been proposed that can be used to construct the corresponding 3D non-rigid shape models of a 2D AAM. In the final part of the paper, we show that constructing a 3D face model using non-rigid structure-from-motion suffers from the Bas-Relief ambiguity and may result in a “scaled” (stretched/compressed) model. We outline a robust non-rigid motion-stereo algorithm for calibrated multi-view 3D AAM construction and show how using calibrated multi-view motion-stereo can eliminate the Bas-Relief ambiguity and yield face models with higher 3D fidelity. Electronic Supplementary Material The online version of this article () contains supplementary material, which is available to authorized users.     

Garment Modeling from a Single Image

Modeling of realistic garments is essential for online shopping and many other applications including virtual characters. Most of existing methods either require a multi‐camera capture setup or a restricted mannequin pose. We address the garment modeling problem according to a single input image. We design an all‐pose garment outline interpretation, and a shading‐based detail modeling algorithm. Our method first estimates the mannequin pose and body shape from the input image. It further interprets the garment outline with an oriented facet decided according to the mannequin pose to generate the initial 3D garment model. Shape details such as folds and wrinkles are modeled by shape‐from‐shading techniques, to improve the realism of the garment model. Our method achieves similar result quality as prior methods from just a single image, significantly improving the flexibility of garment modeling.     

面向不同体型特征的服装款式迁移方法

大部分成衣的设计以标准比例的人模作为参照,而对于非标准体型的顾客,标码 服装的大小尺寸则很难与之进行有效匹配。基于此,提出了一种面向不同体型特征的服装款 式迁移方法。首先,对于一批不同款式的服装,通过物理模拟的方式穿着到标模及非标模人 体之上,形成标模试穿的服装实例及非标模试穿的服装实例;其次,使用仿射变换表示同款 服装在标模及非标模下服装实例间的变形映射,并借助主成分分析法求解服装变形,在保留 因体型特征导致的服装形变的基础上,剔除由服装款式信息引起的服装形变;最后,将服装 变形用于标模到非标模的服装款式迁移,并使用平均离散曲率衡量迁移前后服装款式的改变 程度。实验结果表明,迁移后的服装携带了标模服装的款式信息,并保留了非标模服装的体 型特征。     

基于二维衣片反求服装曲面方法研究

以服装立体裁剪所获得服装衣片结构线二维数据与人体模型特征线三维数据为基础,依据按已知条件构造可展面理论,研究在定长映射下服装衣片与服装曲面之间转换的几何学方法,进而实现服装曲面二维向三维的变换.