Visual spatio-temporal function-based querying

Visual interfaces are very important for human interactions in cyberworlds. Visual spatio-temporal querying should be one of the basic tools for data mining and retrieval in cyberworlds. In this paper, we propose a novel function-based query model for arbitrary shape spatio-temporal querying. The queries are defined as geometric shapes changing over time. In our model, data are interpreted geometrically as multidimensional points with time dimension or as moving points. The queries are formulated with geometric objects and operations over them to form the query solid changing over time. The proposed query model allows us to pose arbitrary shape spatio-temporal range queries. With the uniform geometric model we integrate visual mining and querying of time-dependent data employing 3D visualization tools. It allows for creating an intuitive visual interface using 2D projections of 3D query shapes. Our approach combines visualization of spatio-temporal data with visualization of the range query formulation employing very compact function-based query model. The implemented visual query system and its visual interface are proposed and described. An example of application of the system in analysis of simulation results in molecular dynamics is considered.     

A visual query language for graphical interaction withschema-intensive databases

This paper presents a visual query language called VQL for interacting with an object-oriented schema-intensive data model. VQL allows convenient access to the various types of knowledge captured by the semantic model. It consists of a set of “graphical primitives” along with a combination grammar for creating graphical queries. The visual language is internally supported by a prolog-like predicate based query language. The formal grammar underlying the predicate based language is also presented. Apart from being able to create simple queries that can be specified in SQL or QBE, VQL can be used for making queries on any object-oriented data model including the generalization of the E-R model. VQL also handles complicated, indirect queries, specially those that require a reasoning system for query interpretation and response generation. Further, recursive queries on graph structures such as finding transitive closures of graphs may be easily specified. Perhaps the most powerful feature of VQL is its ability to provide high semantic expressibility (in being able to specify highly complex queries) while maintaining simplicity in the user's query formulation process. VQL is embedded in an object-oriented graphical database interaction environment that supports schema creation and manipulation in addition to database querying and updation. The prototype has been implemented in Smalltalk-80 running on a Sun 3/60 workstation. All the illustrations of visual interaction presented are taken from actual interaction sessions     

ComBiNet: Visual Query and Comparison of Bipartite Multivariate Dynamic Social Networks

We present ComBiNet, a visualization, query, and comparison system for exploring bipartite multivariate dynamic social networks. Historians and sociologists study social networks constructed from textual sources mentioning events related to people, such as marriage acts, birth certificates and contracts. We model this type of data using bipartite multivariate dynamic networks to maintain a representation faithful to the original sources while not too complex. Relying on this data model, ComBiNet allows exploring networks using both visual and textual queries using the Cypher language, the two being synchronized to specify queries using the most suitable modality; simple queries are easy to express visually and can be refined textually when they become complex. These queries are used for applying topological and attribute-based selection on the network. Query results are visualized in the context of the whole network and over a geographical map for geolocalized entities. We also present the design of our interaction techniques for querying social networks to visually compare the selections in terms of topology, measures and attribute distributions. We validate the query and comparison systems by showing how they have been used to answer historical questions and by explaining how they have been improved through a usability study conducted with historians.     

Querying multimedia presentations based on content

Considers the problem of querying multimedia presentations based on content information. Multimedia presentations are modeled as presentation graphs, which are directed acyclic graphs that visually specify the presentations. We present a graph data model for the specification of multimedia presentations and discuss query languages as effective tools to query and manipulate multimedia presentation graphs with respect to content information. To query the information flow throughout a multimedia presentation, as well as in each individual multimedia stream, we use revised versions of temporal operators Next, Connected and Until, together with path formulas. These constructs allow us to specify and query paths along a presentation graph. We present an icon-based graphical query language, GVISUAL, that provides iconic representations for these constructs and a user-friendly graphical interface for query specification. We also present an OQL-like language, GOQL (Graph OQL), with similar constructs, that allows textual and more traditional specifications of graph queries. Finally, we introduce GCalculus (Graph Calculus), a calculus-based language that establishes the formal grounds for the use of temporal operators in path formulas and for querying presentation graphs with respect to content information. We also discuss GCalculus/S (GCalculus with Sets) which avoids highly complex query expressions by eliminating the universal path quantifier, the negation operator and the universal quantifier. GCalculus/S represents the formal basis for GVISUAL, i.e. GVISUAL uses the constructs of GCalculus/S directly     

Querying Multiple Data Sources via an Object-Oriented Spatial Query Interface and Framework

A spatial query interface has been designed and implemented in the object-oriented paradigm for heterogeneous data sets. The object-oriented approach presented is shown to be highly suitable for querying typical multiple heterogeneous sources of spatial data. The spatial query model takes into consideration two common components of spatial data: spatial location and attributes. Spatial location allows users to specify an area or a region of interest, also known as a spatial range query. Also, the spatial query allows users to query spatial orientation and relationships (geometric and topological relationships) among other spatial data within the selected area or region. Queries on the properties and values of attributes provide more detailed non-spatial characteristics of spatial data. A query model specific to spatial data involves exploitation of both spatial and attribute components. This paper presents a conceptual spatial query model of heterogeneous data sets based on the object-oriented data model used in the geospatial information distribution system (GIDS).     

A constraint-based querying system for exploratory pattern discovery

In this article we present ConQueSt, a constraint-based querying system able to support the intrinsically exploratory (i.e., human-guided, interactive and iterative) nature of pattern discovery. Following the inductive database vision, our framework provides users with an expressive constraint-based query language, which allows the discovery process to be effectively driven toward potentially interesting patterns. Such constraints are also exploited to reduce the cost of pattern mining computation. ConQueSt is a comprehensive mining system that can access real-world relational databases from which to extract data. Through the interaction with a friendly graphical user interface (GUI), the user can define complex mining queries by means of few clicks. After a pre-processing step, mining queries are answered by an efficient and robust pattern mining engine which entails the state-of-the-art of data and search space reduction techniques. Resulting patterns are then presented to the user in a pattern browsing window, and possibly stored back in the underlying database as relations.     

A Graphical Navigator for viewing Databases

This paper describes the architecture and implementation of Graphical Navigator, a system for visualizing and querying databases. The schema of a database is represented by classes and associations between the classes. Thus, a database is viewed as a labeled graph. A graphical query notation was developed to query databases. The query notation allows formulation of recursive and predicated queries. The system facilitates incremental querying by way of workspaces. The formulation, execution and incremental querying are all done in a highly interactive and visual environment.     

Distribution-Driven Visualization of Volume Data

Feature detection and display are the essential goals of the visualization process. Most visualization software achieves these goals by mapping properties of sampled intensity values and their derivatives to color and opacity. In this work, we propose to explicitly study the local frequency distribution of intensity values in broader neighborhoods centered around each voxel. We have found frequency distributions to contain meaningful and quantitative information that is relevant for many kinds of feature queries. Our approach allows users to enter predicate-based hypotheses about relational patterns in local distributions and render visualizations that show how neighborhoods match the predicates. Distributions are a familiar concept to nonexpert users, and we have built a simple graphical user interface for forming and testing queries interactively. The query framework readily applies to arbitrary spatial data sets and supports queries on time variant and multifield data. Users can directly query for classes of features previously inaccessible in general feature detection tools. Using several well-known data sets, we show new quantitative features that enhance our understanding of familiar visualization results.     

As You Like It: Personalized Database Visualization Using a Visual Language

The Delaunay system supports a visual language that is specifically geared to the querying and visualization of databases. In this paper, we concentrate on the information visualization capabilities of the system. A distinctive feature of Delaunay is its full personalization capabilities: users can define their visualizations from scratch without limiting themselves to pre-defined visualization modes. Fine customization of the visualization is achieved by the availability of a visual alphabet of atomic graphical symbols and by the expressive power of the visual query language, which supports recursion.We describe the key components of the Delaunay system, namely its interface modules, which support advanced visualization techniques and principles, and its efficient constraint solver. The successful implementation of Delaunay demonstrates the feasibility of a powerful database system with which users can effectively specify a wide variety of visualizations supporting data and visualization exploration for different kinds of applications including graph visualization and business analysis.     

Query-by-Gaming: Interactive spatio-temporal querying and retrieval using gaming controller

Spatio-temporal querying and retrieval is a challenging task due to the lack of simple user interfaces for building queries despite the availability of powerful indexing structures and querying languages. In this paper, we propose Query-by-Gaming scheme for spatio-temporal querying that can benefit from gaming controller for building queries. By using Query-by-Gaming, we introduce our spatio-temporal querying and retrieval system named as GStar to interactively build subsequent spatio-temporal queries to determine if a state is directly reachable from current state and eventual spatio-temporal queries to know whether a spatial state is reachable from a current state. Queries are built using features of gaming controller by displaying the original video frames rather than on a graphical interface using a mouse or a keyboard. GStar has three main components: building the query, searching and retrieval of clips, and displaying query results. The queries are applied to an indexing structure called semantic sequence state graph (S³G) and results of the query are displayed dynamically to provide timely feedback to the user. Experimental results and user interface are provided for a tennis video database. Users define desired game state (player and ball position) using an interactive interface at multiple points in time and GStar automatically retrieves all rallies that contain both states. Finally, the user interface evaluation comparing gamepad-based interface and mouse interface for spatio-temporal querying has been studied.     

Content-based facial image retrieval using constrained independent component analysis

Content-based image retrieval (CBIR) is a method of searching, browsing, and querying images according to their content. In this paper, we focus on a specific domain of CBIR that involves the development of a content-based facial image retrieval system based on the constrained independent component analysis (cICA). Originating from independent component analysis (ICA), cICA is a source separation technique that uses priori constraints to extract desired independent components (ICs) from data. By providing query images as the constraints to the cICA, the ICs that share similar probabilistic features with the queries from the database can be extracted. Then, these extracted ICs are used to evaluate the rank of each image according to the query. In our approach, we demonstrate that, in addition to a single image-based query, a compound query with multiple query images can be used to search for images with compounding feature content. The experimental results of our CBIR system tested with different facial databases show that our system can improve retrieval performance by using a compound query. Furthermore, our system allows for online processing without the need to learn query images.     

Browsing large online data tables using generalized query previews

Companies, government agencies, and other organizations are making their data available to the world over the Internet. They often use large online relational tables for this purpose. Users query such tables with front-ends that typically use menus or form fillin interfaces, but these interfaces rarely give users information about the contents and distribution of the data. Such a situation leads users to waste time and network/server resources posing queries that have zero- or mega-hit results. Generalized query previews enable efficient browsing of large online data tables by supplying data distribution information to users. The data distribution information provides continuous feedback about the size of the result set as the query is being formed. Our paper presents a new user interface architecture and discusses three controlled experiments (with 12, 16, and 48 participants). Our prototype systems provide flexible user interfaces for research and testing of the ideas. The user studies show that for exploratory querying tasks, generalized query previews can speed user performance for certain user domains and can reduce network/server load.     

Querying Documents using Content, Structure and Properties

Much information is nowadays stored electronically in document bases. Users retrieve information from these document bases by browsing and querying. While a large number of tools are available nowadays, not much work has been done on tools that support queries involving all the characteristics of documents as well as the use of domain knowledge during the search for information. In this paper we propose a query language that allows for querying documents using content information, information about the logical structure of the documents as well as information about properties of the documents. Domain knowledge is taken into account during the search as well. We also present an architecture for a system supporting such a language and we describe a prototype implementation together with test results.     

A usability-driven approach to the development of a 3D web-GIS environment

The main goal of this work is to provide an advanced visual environment where users that are not skilled for what concerns the computer science domain may compose queries related to those geographical phenomena for which the third dimension is a relevant feature. Visual queries are composed in a 3D environment accessible from the web where the users manipulate geographical objects, called 3D geometaphors. The geometaphors represent the operands of an underlying algebra characterized by a set of topological, directional and metrical operators; such operators are expressed in the query environment in terms of visual relationships between the geographical objects. The introduction of the third dimension for querying the geographical databases has challenged the authors with a number of important issues related to the area of visualization, navigation and object manipulation. According to the principles of usability engineering, the authors have built different prototypes based on a client-server architecture that have been iteratively evaluated by experts and final users in order to discover drawbacks and to improve the quality of the proposal. The result is a coordinated user-friendly 3D visual metaphor for querying GIS on the web, where all the elements needed for composing a query have a visual, easy to understand, counterpart.     

DVQ: Towards Visual Query Processing of XML Database Systems

XML has been recognized as a promising language for data exchange over the Internet. A number of query languages have been proposed for querying XML data. Most of those languages are path-expression based. One difficulty in forming path-expression based queries is that users have to know the structure of XML data against which the queries were issued. In this paper, we describe a DTD-driven visual query interface for XML database systems. With such an interface, a user can easily form path-expression based queries by clicking elements in the DTD tree displayed on the screen and supplying conditions if necessary. The interface and the query generation process are described in detail.     

Continuous querying in database-centric Web applications

Web applications are becoming increasingly database-centric. Unfortunately, the support provided by most Web sites to explore such databases is rather primitive and is based on the traditional database metaphor of submitting an SQL query and packaging the response as an HTML page. Very often, the result set is empty or contains too many records. It is up to the user to refine the query by guessing how the query constraints must be tightened or relaxed and then go through another submit/response cycle. Furthermore, once results are displayed, typically no further exploration capabilities are offered. Web applications requiring interactive exploration of databases (e.g. e-commerce) need that the above submit/response metaphor be replaced with a continuous querying metaphor that seamlessly integrates querying with result browsing. In addition to supporting queries based on predicates on attribute values, queries based on example records should also be supported. We present techniques for supporting this metaphor and discuss their implementation in a Web-based database exploration engine.     

Making Database Schema Hierarchical for Visual Access to Databases

Making the database schema hierarchical can help a casual user retrieve information from a complex database. The hierarchical database schema provides further insight into database content and focuses on meaningful data by a top-down method. The user can proceed with a hierarchical visual query, which ultimately simplifies the query, reduces the syntax error rate and conserves the query time. In this paper, we present a hierarchical graph which makes the database schema hierarchical, naturally integrates the browsing and querying and, consequently, allows the user to proceed with an incremental query on the hierarchical database schema. Also proven herein are the existence, uniformity, and consistency of the hierarchical graph to verify that the graph can be used to query the database. This paper also discusses the semantics of high-level nodes and conducts an experiment to evaluate users’ performance. Finally, we describe how one can use the hierarchical graph to unify the tasks of making the schema hierarchical, creating concept hierarchies, and integrating the databases.     

Pictorial Query Specification for Browsing Through Spatially Referenced Image Databases

A pictorial query specification technique that enables the formulation of complex pictorial queries for browsing through a collection of spatially referenced images is presented. It is distinguished from most other methods by the fact that in these methods the query image specifies a target database image in its entirety whereas in our approach the query image specifies the combination of objects that the target database image should contain rather than being treated as a whole image. The query objects are represented by shape features although other features such as color, texture or wavelets could also be used. Using our technique, it is possible to specify which particular objects should appear in the target images as well as how many occurrences of each object are required. Moreover, it is possible to specify the minimum required certainty of matching between query-image objects and database-image objects, as well as to impose spatial constraints that specify bounds on the distance between objects and the relative direction between them. These spatial constraints can also be used to specify other topological relations such as enclosure, intersection, overlap, etc. Each pictorial query is composed of one or more query images. Each query image is constructed by selecting the required query objects and positioning them according to the desired spatial configuration. Boolean combinations of two or more query images are also possible by use of AND and OR operators. A query image may be negated in order to specify conditions that should not be satisfied by the database images that are retrieved successfully. In addition, a capability is provided to specify whether the same instance of an object is to be used when it appears in more than one of the query images that make up the pictorial query, or whether two different instances are allowed. Several example queries are given that demonstrate the expressive power of this query specification method. An algorithm for retrieving all database images that conform to a given pictorial query specification is presented. The user interface for using this pictorial query specification method to browse the results in a map image database application is described and illustrated via screen shots.     

Integrated spatial and feature image query

We present a new system for querying for images by regions and their spatial and feature attributes. The system enables the user to find the images that contain arrangements of regions similar to those diagrammed in a query image. By indexing the attributes of regions, such as sizes, locations and visual features, a wide variety of complex joint spatial and feature queries are efficiently computed. In order to demonstrate the utility of the system, we develop a process for the extracting color regions from photographic images. We demonstrate that integrated spatial and feature querying using color regions improves image search capabilities over non-spatial content-based image retrieval methods.     

VIREX and VRXQuery: interactive approach for visual querying of relational databases to produce XML

VIREX provides an interactive approach for querying and integrating relational databases to produce XML documents and the corresponding schemas. VIREX connects to each database specified by the user; analyzes the catalogue to derive an interactive diagram equivalent to the extended entity-relationship diagram; allows the user to display sample records from the tables in the database; allows the user to rename columns and relations by modifying directly the interactive diagram; facilitates the conversion of the relational database into XML; and derives the XML schema. VIREX works even when the catalogue of the relational database is missing; it extracts the required catalogue information by analyzing the database content. Further, VIREX supports VRXQuery, which is a visual naive-users-oriented query language that allows users to specify queries and define views directly on the interactive diagram as a sequence of mouse clicks with minimum keyboard input. The user is expected to interactively decide on certain factors to be considered in producing the XML result. Such factors include: 1) selecting the relations/attributes to be converted into XML; 2) specifying a predicate to be satisfied by the information to be converted into XML; 3) deciding on the order of nesting between the relations to be converted into XML; 4) ordering for the result. VRXQuery supports selection, projection, nesting/join, union, difference, and order-by. As the result of a query, VIREX displays on the screen the XML schema that satisfies the specified characteristics and generates colored (easy to read) XML document(s). Further, VIREX allows the user to display and review the SQL and XQuery equivalent to each query expressed in VRXQuery.