Constrained fitting for 2D profile-based reverse modeling

Profile curve reconstruction is crucial to surface reconstruction in reverse engineering. In this paper, we present a new constrained fitting method involving lines, circular arcs and B-spline curves for profile curve reconstruction. By using similarity transformation, we reduce the condition number of the Hessian matrix involved in the optimization process and, therefore, the numerical stability is significantly improved. Several industrial examples are presented to demonstrate the efficiency of our method. This paper describes a 2D constrained fitting method for profile curve reconstruction in reverse engineering. The method is an extension to the published methods for 2D constrained fitting. Further more, the numerical problem associated with constrained fitting is tackled in our paper. The described method has been implemented in RE-SOFT, which is a feature-based reverse engineering software developed by the CAD/CAE/CAM Lab of Zhejiang University.     

Volume-sampled 3D modeling

We present a 3D object-space antialiasing technique for volume graphics. Our approach performs antialiasing once-on a 3D view-independent representation-as part of the modeling stage. Unlike antialiasing of 2D scan-converted graphics, where the main focus is on generating aesthetically pleasing displays, antialiasing of 3D voxelized graphics emphasizes the production of alias-free 3D models for various volume graphics manipulations, including but not limited to the generation of aesthetically pleasing displays     

Think globally, act locally: decentralized supervisory control

Decentralized supervisory control is investigated by considering problem formulations that model systems whose specifications are given as global constraints, but whose solution is described by local controllers. A necessary and sufficient condition is given for the existence of a solution to the problem of finding decentralized supervisors that ensure that the behavior of the closed-loop system lies in a given range. Where the range of behavior can be described by regular languages, it can be effectively tested whether the decentralized control problem is solvable; in this case, a procedure is given to compute the associated supervisors     

Towards automatic generation of as-built BIM: 3D building facade modeling and material recognition from images

As-built building information model(BIM) is an urgent need of the architecture, engineering, construction and facilities management(AEC/FM) community. However, its creation procedure is still labor-intensive and far from maturity. Taking advantage of prevalence of digital cameras and the development of advanced computer vision technology, the paper proposes to reconstruct a building facade and recognize its surface materials from images taken from various points of view. These can serve as initial steps towards automatic generation of as-built BIM. Specifically, 3D point clouds are generated from multiple images using structure from motion method and then segmented into planar components, which are further recognized as different structural components through knowledge based reasoning. Windows are detected through a multilayered complementary strategy by combining detection results from every semantic layer. A novel machine learning based 3D material recognition strategy is presented. Binary classifiers are trained through support vector machines. Material type at a given 3D location is predicted by all its corresponding 2D feature points.Experimental results from three existing buildings validate the proposed system.     

Interactive evolutionary 3D fractal modeling

This paper presents a technique for creating 3D fractal art forms automatically. Using this approach, designers can get access to a large number of 3D art shapes that can be modified interactively. This is based on a modified evolutionary algorithm using Fractal Transform (FT) and Iterated Function System (IFS), which provides tunable geometric parameters. Fitness function for measuring the aesthetics of a fractal shape is formulated based on characteristic parameters in fractal theory, including capacity dimension, correlation dimension, and largest Lyapunov exponent. The productivity of visually appealing fractal can be enhanced by using the proposed technique. Experiments demonstrated the effectiveness of the proposed method, which can be applied to the design of jewelry, light fixture, and decorative patterns.     

Maxi-min margin machine: learning large margin classifiers locally and globally.

In this paper, we propose a novel large margin classifier, called the maxi-min margin machine M(4). This model learns the decision boundary both locally and globally. In comparison, other large margin classifiers construct separating hyperplanes only either locally or globally. For example, a state-of-the-art large margin classifier, the support vector machine (SVM), considers data only locally, while another significant model, the minimax probability machine (MPM), focuses on building the decision hyperplane exclusively based on the global information. As a major contribution, we show that SVM yields the same solution as M(4) when data satisfy certain conditions, and MPM can be regarded as a relaxation model of M(4). Moreover, based on our proposed local and global view of data, another popular model, the linear discriminant analysis, can easily be interpreted and extended as well. We describe the M(4) model definition, provide a geometrical interpretation, present theoretical justifications, and propose a practical sequential conic programming method to solve the optimization problem. We also show how to exploit Mercer kernels to extend M(4) for nonlinear classifications. Furthermore, we perform a series of evaluations on both synthetic data sets and real-world benchmark data sets. Comparison with SVM and MPM demonstrates the advantages of our new model.     

Stability analysis of complex discrete systems with locally and globally stable subsystems

This paper is concerned with the stability analysis of interconnected systems composed of locally and globally exponentially stable subsystems. Sufficient conditions for not necessarily asymptotic and exponentially asymptotic stability are derived. The problem of estimating the stability region of the composite system is also considered.     

A method of 3D modeling and codec

3D modeling and codec of real objects are hot issues in the field of virtual reality. In this paper, we propose an automatic registration two range images method and a cycle based automatic global registration algorithm for rapidly and automatically registering all range images and constructing a realistic 3D model. Besides, to meet the requirement of huge data transmission over Internet, we present a 3D mesh encoding/decoding method for encoding geometry, topology and attribute data with high compression ratio and supporting progressive transmission. The research results have already been applied successfully in digital museum. Supported by the National Natural Science Foundation of China (Grant Nos. 60533070, 60773153), the Key Grant Project of Chinese Ministry of Education (Grant No. 308004), the Project of Chinese Ministry of Science and Technology (Grant No. 2006BAK12B09), and the Project of Beijing Municipal Science and Technology Commission (Grant No. Z07000100560714)     

Feature-based reverse modeling strategies

We presented two integrated solution schemes, sectional feature based strategy and surface feature based strategy, for modeling industrial components from point cloud to surfaces without using triangulation. For the sectional feature based strategy, slicing, curve feature recognition and constrained fitting are introduced. This strategy emphasizes the advanced feature architecture patterns from 2D to 3D in reverse engineering. The surface feature based strategy relies on differential geometric attributes estimation and diverse feature extraction techniques. The methods and algorithms such as attributes estimation based on 4D Shepard surface, symmetry plane extraction, quadric surface recognition and optimization, extruded and rotational surface extraction, and blend feature extraction with probability and statistic theory are proposed. The reliable three-dimensional feature fabricated the valid substratum of B-rep model faultlessly. All the algorithms are implemented in RE-SOFT, a reverse engineering software developed by Zhejiang University. The proposed strategies can be used to capture the original design intention accurately and to complete the reverse modeling process conveniently. Typical industrial components are used to illustrate the validation of our feature-based strategies.     

The 3D Chinese head and face modeling

Perfect fit for people has always been a target for product design. Designers commonly use traditional anthropometric dimensions for 3D product design thus creating a lot of fitting problems when dealing with the complexities of human body shapes. The development of recent 3D anthropometric survey has created an opportunity for complex shape analysis on human model by collecting 3D scan data. Using 3D point cloud data from the SizeChina survey, a methodology of creating a homologous 3D head and face model was demonstrated in this study. Anatomical and virtual landmarks, and surface modeling algorithm based on point cloud data were applied in building the model. The head and face models for all scans had the same amount of vertices with consistent features. The average Chinese models showed obvious differences between male and female. The variations of head and face shapes were analyzed using Principal Component Analysis and the results showed that the largest variations among people were general size, especially for width and depth. However face height, forehead, back of the head, chin and jaw area were also important when describing the 3D shape. The results from this study may be useful in the design of head and facial products.     

A tangible goal for 3D modeling

As we progress into applications that incorporate interactive life-like 3D computer graphics, the mouse falls short as a user interface device, and it becomes obvious that 3D computer graphics could achieve much more with a more intuitive user interface mechanism. Haptic interfaces, or force feedback devices, promise to increase the quality of human-computer interaction by accommodating our sense of touch. The article discusses the application of touch feedback systems to 3D modelling. To achieve a high interactivity level requires novel rendering techniques such as volume-based rendering algorithms     

3D modeling of optically challenging objects

We present a system for constructing 3D models of real-world objects with optically challenging surfaces. The system utilizes a new range imaging concept called multi-peak range imaging, which stores multiple candidates of range measurements for each point on the object surface. The multiple measurements include the erroneous range data caused by various surface properties that are not ideal for structured-light range sensing. False measurements generated by spurious reflections are eliminated by applying a series of constraint tests. The constraint tests based on local surface and local sensor visibility are applied first to individual range images. The constraint tests based on global consistency of coordinates and visibility are then applied to all range images acquired from different viewpoints. We show the effectiveness of our method by constructing 3D models of five different optically challenging objects. To evaluate the performance of the constraint tests and to examine the effects of the parameters used in the constraint tests, we acquired the ground truth data by painting those objects to suppress the surface-related properties that cause difficulties in range sensing. Experimental results indicate that our method significantly improves upon the traditional methods for constructing reliable 3D models of optically challenging objects.     

Silhouette and stereo fusion for 3D object modeling

In this paper, we present a new approach to high quality 3D object reconstruction. Starting from a calibrated sequence of color images, the algorithm is able to reconstruct both the 3D geometry and the texture. The core of the method is based on a deformable model, which defines the framework where texture and silhouette information can be fused. This is achieved by defining two external forces based on the images: a texture driven force and a silhouette driven force. The texture force is computed in two steps: a multi-stereo correlation voting approach and a gradient vector flow diffusion. Due to the high resolution of the voting approach, a multi-grid version of the gradient vector flow has been developed. Concerning the silhouette force, a new formulation of the silhouette constraint is derived. It provides a robust way to integrate the silhouettes in the evolution algorithm. As a consequence, we are able to recover the contour generators of the model at the end of the iteration process. Finally, a texture map is computed from the original images for the reconstructed 3D model.     

Reshaping 3D facial scans for facial appearance modeling and 3D facial expression analysis

3D face scans have been widely used for face modeling and analysis. Due to the fact that face scans provide variable point clouds across frames, they may not capture complete facial data or miss point-to-point correspondences across various facial scans, thus causing difficulties to use such data for analysis. This paper presents an efficient approach to representing facial shapes from face scans through the reconstruction of face models based on regional information and a generic model. A new approach for 3D feature detection and a hybrid approach using two vertex mapping algorithms, displacement mapping and point-to-surface mapping, and a regional blending algorithm are proposed to reconstruct the facial surface detail. The resulting models can represent individual facial shapes consistently and adaptively, establishing facial point correspondences across individual models. The accuracy of the generated models is evaluated quantitatively. The applicability of the models is validated through the application of 3D facial expression recognition using the static 3DFE and dynamic 4DFE databases. A comparison with the state of the art has also been reported.     

3D modeling and motion parallax for improved videoconferencing

Computational Visual Media - We consider a face-to-face videoconferencing system that uses a Kinect camera at each end of the link for 3D modeling and an ordinary 2D display for output. The Kinect...     

Real-time video-based modeling and rendering of 3D scenes

Our work targets 3D scenes in motion. In this article, we propose a method for view-dependent layered representation of 3D dynamic scenes. Using densely arranged cameras, we've developed a system that can perform processing in real time from image pickup to interactive display, using video sequences instead of static images, at 10 frames per second. In our system, images on layers are view dependent, and we update both the shape and image of each layer in real time. This lets us use the dynamic layers as the coarse structure of the dynamic 3D scenes, which improves the quality of the synthesized images. In this sense, our prototype system may be one of the first full real-time image -based modelling and rendering systems. Our experimental results show that this method is useful for interactive 3D rendering of real scenes     

Towards modeling popularity of microblogs

As one kind of social media, microblogs are widely used for sensing the real-world. The popularity of microblogs is an important measurement for evaluation of the influencial of pieces of information. The models and modeling techniques for popularity of microblogs are studied in this paper. A huge data set based on Sina Weibo, one of the most popular microblogging services, is used in the study. First, two different types of popularity, namely number of retweets and number of possible views are defined, while their relationships are discussed. Then, the temporal dynamics, including lifecycles and tipping-points, of tweets’ popularity are studied. For modeling the temporal dynamics, a piecewise sigmoid model is used. Empirical studies show the effectiveness of our modeling methods.