基于草图界面的设计方案复用研究

当前的CAD工具缺乏对构思活动中各种设计知识的有效建模,造成设计方案难以在后续工作中灵活、快速地复用.采用基于草图界面的自然交互方式,通过对设计过程中草图信息的分析与建模实现对设计过程的描述;在复用过程中向用户提供推荐方案,支持设计意图的自然表达和方案的灵活复用,从而降低用户认知负担.实验结果表明,这种基于草图信息分析与建模的设计方案能满足敏捷设计的需要,实现了设计方案的灵活复用.     

基于手势和草图的概念设计协同交互的研究

基于手势和草图的交互模式提供了一种自然和谐的方式来支持概念设计协同操作,促进协同工作系统的发展与应用．基于以用户为中心的设计,比较了不同方式的概念设计过程,提出了基于手势和草图的协同设计方法,进一步讨论了以草图为设计过程中的信息载体,分析了草图信息模型;基于手势操作,提出了协同上下文感知的概念和协同设计上下文描述模型;最后分析并给出面向同步编辑的草图交互设计和双向约束求解方法．所提出的协同设计方法自然简便,提高了设计效率,改善了人机交互方式．     

一种支持超视频创建与可视呈现的草图界面技术

超视频打破了传统视频的单一线性的组织和浏览方式,有效地增强了用户的浏览效率和视频信息的表达能力.基于草图和草图界面在思维表达上的优势,针对目前对视频内容以及视频间或者视频内的关系展示上的不足,提出了一种支持超视频创建的草图界面来直观地表达用户的设计意图,改善了视频编辑过程中的交互体验.提出了一种基于force-directed 的图布局算法.该算法对视频语义进行建模,将时间、空间、视频结构、约束关系等语义信息融入到节点质量、引力和斥力等对象中.系统实例表明,该方法能够很好地适应视频特有的语义类型,表示出超视频的动态创建和编辑过程.     

笔式服装工艺设计系统的研究与实现

为了满足服装CAD的领域需求,提高服装工艺设计的效率,采用笔式用户界面进行草图勾画与知识编辑,通过对用户设计意图的隐式理解,利用几何约束求解技术,设计并实现了面向非计算机专业用户的基于笔交互的服装工艺设计系统.该系统与传统CAD软件相比改善了人机交互的方式,降低了用户的认知负担,提高了设计效率.     

一种面向个人信息管理的Post-WIMP 用户界面模型

提出了一种面向个人信息管理(personal information management,简称PIM)的Post-WIMP界面模型(Post-WIMP PIM interface model,简称PWPIM).首先给出了PWPIM的形式化描述,从5个方面对个人信息管理进行建模,分别描述了用户特征、领域对象和交互过程等;在此基础上给出了PWPIM的建模方法;最后,将PWPIM应用于一个基于实物界面的PIM系统.应用实例表明,PWPIM能够有效地描述PIM的Post-WIMP界面,能够满足PIM面向大众用户、多样信息及自然交互的需求,能够为PIM的Post-WIMP界面设计、开发与评估提供理论支持.     

基于草图的超视频构造方法及关键技术研究

由于视频媒体信息的线性结构特点,人们很难快速获取视频主要内容.利用视频资源构造超视频常需要借助复杂的计算机视觉技术,这给用户带来很大的认知与操纵负担.传统的基于时间轴或基于视频帧的交互方式在一定程度满足了视频的可操纵性,但仍不能有效辅助用户基于视频语义自然高效地组织与编辑视频,进而形成超视频媒体.针对这一问题,归纳了视频交互任务的类型及特点,分析了超视频媒体构造过程中的交互任务及相适应的草图用户界面,根据草图所表征的视频语义层次的不同,提出了情景草图与注释草图相结合的超视频构造方法并研究了相应的支撑技术,力求为超视频的构造提供简单、自然的交互方式.最后给出示例说明了如何利用草图有效地表征视频资源之间的语义关系进而构造面向视频语义的超视频.     

一种笔式表格组件的设计方法

传统基于WIMP界面范式的表格设计,无法满足用户与界面自然、高效、连续性交互的需求,尤其是用户无法根据设计意图自由勾画任意通用的表格,也无法自动标识表格界面逻辑.提出一个基于笔交互的表格组件的设计方法.该方法以数字笔代替鼠标键盘,能够连续输入笔迹并识别为文字、勾画草图并识别为正式表格或框线、使用笔手势操纵界面对象,并能自动识别表格的逻辑结构.本文讨论了该笔式表格组件的开发框架及关键技术,以及表格组件架构,并给出了应用实例及性能评估,实验结果表明,用户使用该方法设计表格具有较高的效率与用户满意度.     

基于手绘草图的三维CAD系统

Post-IMP界面是下一代用户界面的主要范式。该文研究并实现了一种新型的基于笔的手绘草图三维CAD系统。实现手绘草图三维CAD系统的关键是设计一个自然、合理、高效的草图语义表达与获取框架,它要着眼于解决用户在做什么和在哪里做这两方面的问题。该文详细地讨论了草图语义表达和获取框架的设计思路及实现方法,并开发出一个原型系统,该系统以一支手写笔和一块手写板为交互输入设备,能够较自然高效地进行一些复杂的三维实体和三维场景设计。     

虚拟教学环境中基于草图的自适应用户界面研究

将草图技术、自适应技术与传统的虚拟现实技术相结合应用于虚拟教学过程中,通过增强用户和系统之间个性化需求的交互处理来提高系统的智能性和友好性,进而有效提高虚拟教学环境的应用效果.旨在虚拟环境中构建基于草图的自适应用户界面并应用于虚拟教学来满足特定教学需求,着重结合实例分析了基于自适应草图用户界面的虚拟教学环境中的草图上下文处理机制.在上述研究基础上,设计开发了一个虚拟教学原型系统,实验证明该系统在用户体验上有明显的改善.     

基于特征提取的服装外形设计草图推荐技术

草图是服装外形设计中一类高效的信息载体,为了提高服装外形设计的效率,减少大量的重复操作,本文设计并实现了一种基于草图特征提取的二级推荐技术,在设计过程中整合草图轮廓的几何特征和草图勾画过程中的过程特征,同时结合相关反馈技术和用户交互历史数据,并结合笔式界面技术,开发了笔式服装外形设计原型,改善了人机交互方式,能够在用户设计过程中满足草图推荐的目的。     

A survey of sketch-based 3-D modeling techniques

As 3-D modeling applications transition from engineering environments into the hands of artists, designers, and the consumer market, there is an increasing demand for more intuitive interfaces. In response, 3-D modeling and interface design communities have begun to develop systems based on traditional artistic techniques, particularly sketching. Collectively this growing field of research has come to be known as sketch-based modeling, however the name belies a diversity of promising techniques and unique approaches. This paper presents a survey of current research in sketch-based modeling, including a basic introduction to the topic, the challenges of sketch-based input, and an examination of a number of popular approaches, including representative examples and a general analysis of the benefits and challenges inherent to each.     

Graph-based retrieval of building information models for supporting the early design stages

Building information modeling (BIM) principles are transforming today’s communication and working processes in the field of construction, however the early design phases are only rarely supported and information technology is therefore not exploited to its full potential. The early design phases are characterized by an iterative process of searching for plausible solutions. A common approach is to refer to similar examples, which are conventionally found using keyword-based search strategies.To this end we propose a method for indexing spatial configurations along with a sketch-based input method for search strategies that uses so-called semantic fingerprints of buildings. The topology of spatial configurations is extracted from building information models and represented as graphs. For both building information models and the user sketches, the extracted graphs are used as the basis for a subgraph-matching algorithm facilitating an intuitive novel query method for researching similar reference examples. The system is able to present corresponding existing solutions to even rudimentary sketches or fragments of a design idea. In addition to graph matching and sketch-based interaction, more recent BIM-based approaches are also taken into account.     

Sketch-based mesh cutting: A comparative study

In this paper we present the first comprehensive study and analysis on different sketch-based mesh cutting approaches. To compare a representative number of state-of-the-art sketch-based mesh cutting methods, we conduct a large scale user study which was carried out via extensive user experiments. To address the objective assessment of the performances of different algorithms, a complete framework with various intuitive sketch-based interfaces was developed to enable interactive mesh cutting by simply drawing sketches on mesh surface. To address the subjective assessment of user’s experience, we presented the analysis of the user’s responses, where the analytic hierarchy process was employed to quantify the performance of algorithms in terms of multiple criteria. Our results suggest that human in general agree on the evaluation of the performance of algorithms, and some sketch-based mesh cutting methods are consistently more favorable than others. The importance of our work lies in studying users’ experience on operating various sketch-based mesh cutting tools, to motivate more practical interactive systems in the future.     

基于草图的面向概念设计的协同图表绘制工具

概念设计过程使用了多种图表来表示设计概念以及构建功能结构.将手绘草图作为设计者之间的一种通信语言引入到异地同步协同概念设计过程,提出了基于手绘草图的协同图表绘制多agent 系统,包含草图交互、草图识别、通信、协调等多个agent.讨论了各agent 之间的通信机制以及主要agent 的实现策略,包括草图识别以及语义一致性维护策略.将系统应用到协同流程图绘制领域,运行结果表明,该工具能够改善人机交互模式,促进多用户之间的交流和协作.     

Iterative samples labeling for sketch recognition

Multimedia Tools and Applications - Sketch recognition is an important issue in human-computer interaction, especially in sketch-based interface. To provide a scalable and flexible tool for...     

A multi-layered architecture for sketch-based interaction within virtual environments

In this article, we describe a multi-layered architecture for sketch-based interaction within virtual environments. Our architecture consists of eight hierarchically arranged layers that are described by giving examples of how they are implemented and how they interact. Focusing on table-like projection systems (such as Virtual Tables or Responsive Workbenches) as human-centered output-devices, we show examples of how to integrate parts or all of the architecture into existing domain-specific applications — rather than realizing new general sketch applications — to make sketching an integral part of the next-generation human–computer interface.     

Generating systems from multiple sketched models

Diagrams are often used to model complex systems: in many cases several different types of diagrams are used to model different aspects of the system. These diagrams, perhaps from multiple stakeholders of different specialties, must be combined to achieve a full abstract representation of the system. Many CAD tools offer multi-diagram integration; however, sketch-based diagramming tools are yet to tackle this difficult integration problem. We extend the diagram sketching tool InkKit to combine software engineering sketches of different types. Our extensions support software design processes by providing a sketch-based approach that allows the iterative creation of multiple outputs interacting with one another from the inter-linked models. We demonstrate that InkKit can generate a functional system consisting of a user interface with processes to submit and retrieve data from a database from sketched user interfaces designs and sketched entity relationship diagrams.     

支持方案设计的手绘图形输入工具

手绘图形输入是表达设计意图，实现抽象概念与具体图形间相互转换的自然而有效手段之一、提出并初步实现了一个面向方案设计、采用在线图形识别方法和相似性相关反馈技术的手绘图形输人工具．在线图形识别方法将用户输入的笔画经过图形预处理、特征识别、图形拟合和规整等过程，即时地识别和预测用户的基本图形构造意图；相似性相关反馈技术则在基本图形按其空间和时间关系组合后，利用图形构成及其空间关系与图形模板的相似性计算，及时地捕捉和反馈用户输入图形的组成意图．实验表明：该工具具有很好的基本图形识别效果和良好的用户交互特性，为方案设计工具的研究提供了新的思路．     

A survey on freehand sketch recognition and retrieval

With the development of digital devices and pressure sensing equipment, research into freehand sketches from touch-screen interfaces has increased significantly in recent years. As such, we provide the first comprehensive survey of recognition tasks based on sketch generation, freehand sketch classification, sketch-based image retrieval (SBIR), fine-grained sketch-based image retrieval (FG-SBIR), and sketch-based 3D shape image retrieval. Specifically, SBIR and FG-SBIR were the main focus of the survey. Primary technologies and benchmark datasets related to all sketch-based recognition topics are also discussed, along with future trends for this promising technology.