Coordinating Multiple Agents via Reinforcement Learning

In this paper, we attempt to use reinforcement learning techniques to solve agent coordination problems in task-oriented environments. The Fuzzy Subjective Task Structure model (FSTS) is presented to model the general agent coordination. We show that an agent coordination problem modeled in FSTS is a Decision-Theoretic Planning (DTP) problem, to which reinforcement learning can be applied. Two learning algorithms, coarse-grained and fine-grained, are proposed to address agents coordination behavior at two different levels. The coarse-grained algorithm operates at one level and tackle hard system constraints, and the fine-grained at another level and for soft constraints. We argue that it is important to explicitly model and explore coordination-specific (particularly system constraints) information, which underpins the two algorithms and attributes to the effectiveness of the algorithms. The algorithms are formally proved to converge and experimentally shown to be effective.     

A predicate transformer for the progress property ‘to-always’

The temporal property to-always has been proposed for specifying progress properties of concurrent programs. Although the to-always properties are a subset of the leads-to properties for a given program, to-always has more convenient proof rules and in some cases more accurately describes the desired system behavior. In this paper, we give a predicate transformerwta, derive some of its properties, and use it to define to-always. Proof rules for to-always are derived from the properties ofwta. We conclude by briefly describing two application areas, nondeterministic data flow networks and self-stabilizing systems where to-always properties are useful.     

When Physical Systems Realize Functions...

After briefly discussing the relevance of the notions computation and implementation for cognitive science, I summarize some of the problems that have been found in their most common interpretations. In particular, I argue that standard notions of computation together with a state-to-state correspondence view of implementation cannot overcome difficulties posed by Putnam's Realization Theorem and that, therefore, a different approach to implementation is required. The notion realization of a function, developed out of physical theories, is then introduced as a replacement for the notional pair computation-implementation. After gradual refinement, taking practical constraints into account, this notion gives rise to the notion digital system which singles out physical systems that could be actually used, and possibly even built.     

On a class of recursive procedures and equivalent iterative ones

Summary H. Partsch and P. Pepper gave translations for a special class of recursive procedures into equivalent iterative ones, motivated by the well-known recursive solution for the Towers of Hanoi problem. By generalizing their translations towards two directions, we investigate a class of recursive algorithms and obtain their translations, thus giving a unified view for these algorithms. Some of the included algorithms are mutually recursive procedures for plotting space-filling curves such as the Hilbert curves, and a recursive procedure by C.T. Fike which produces all the permutations of n symbols. These algorithms are characterized by the property that the values of a parameter given to recursive procedure calls in a procedure are uniform in a certain sense.     

Implementing the ‘Fool's model’ of combinatory logic

This paper studies Fool's models of combinatory logic, and relates them to Hindley's D-completeness problem. A fool's model is a family of sets of formulas, closed under condensed detachment. Alternatively, it is a model ofCL in naive set theory. We examine Resolution; and the P-W problem. A sequel shows T is D-complete; also, its extensions. We close with an implementation FMO of these ideas.     

Two and three-quarter dimensional meshing facilitators

This paper presents generated enhancements for robust two and three-quarter dimensional meshing, including: (1) automated interval assignment by integer programming for submapped surfaces and volumes, (2) surface submapping, and (3) volume submapping. An introduction to the simplex method, an optimization technique of integer programming, is presented. Simplification of complex geometry is required for the formulation of the integer programming problem. A method of i-j unfolding is defined which explains how irregular geometry can be realigned into a simplified form that is suitable for submap interval assignment solutions. Also presented is the processes by which submapping eliminates the decomposition of surface geometry, through a pseudodecomposition process, producing suitable mapped meshes. The process of submapping involves the creation of interpolated virtual edges, user defined vertex types and i-j-k space traversals. The creation of interpolated virtual edges is the method by which submapping automatically subdivides surface geometry. The interpolated virtual edge is formulated according to an interpolation scheme using the node discretization of curves on the surface. User defined vertex types allow direct user control of surface decomposition and interval assignment by modifying i-j-k space traversals. Volume submapping takes the geometry decomposition to a higher level by using mapped virtual surfaces to eliminate decomposition of complex volumes.     

On Computer-Assisted Proofs in Ordinal Number Theory

Some basic theorems about ordinal numbers were proved using McCunes computer program OTTER, building on Quaifes modification of Gödels class theory. Our theorems are based on Isbells elegant definition of ordinals. Neither the axiom of regularity nor the axiom of choice is used.     

Obvious inferences

The notion of obvious inference in predicate logic is discussed from the viewpoint of proof-checker applications in logic and mathematics education. A class of inferences in predicate logic is defined and it is proposed to identify it with the class of obvious logical inferences. The definition is compared with other approaches. The algorithm for implementing the obviousness decision procedure follows directly from the definition.     

Organisational development issues and the implementation of the Clean Technology paradigm in industry

Environmental protection activities in industry have rapidly increased in number over the last years. Additionally, surveys of environmental activities have identified a change in the kind or in the approaches used to environmental problem solving. A new paradigm Clean Technology has been developed which gradually seems to replace the Clean-up Technology paradigm and the older Dilute and Disperse paradigm. The new Clean Technology paradigm brings with it not only a new way of looking at environmental protection, but also a range of rules guiding the application of technology and the design of technological systems. This paper presents a few case studies highlighting and evaluating Clean Technology activities.     

Relevant logic programming

In this paper we present a fragment of (positive) relevant logic which can be computed by a straightforward extension to SLD resolution while allowing full nesting of implications. These two requirements lead quite naturally to a fragment in which the major feature is an ambiguous user-level conjunction which is interpreted intensionally in query positions and extensionally in assertion positions. These restrictions allow a simple and efficient extension to SLD resolution (and more particularly, the PROLOG evaluation scheme) with quite minor loss in expressive power.     

Physically touching and tasting virtual objects enhances the realism of virtual experiences

Experiment 1 explored the impact of physically touching a virtual object on how realistic the virtual environment (VE) seemed to the user. Subjects in a no touch group picked up a 3D virtual image of a kitchen plate in a VE, using a traditional 3D wand. See and touch subjects physically picked up a virtual plate possessing solidity and weight, using a technique called tactile augmentation. Afterwards, subjects made predictions about the properties of other virtual objects they saw but did not interact with in the VE. See and touch subjects predicted these objects would be more solid, heavier, and more likely to obey gravity than the no touch group. In Experiment 2 (a pilot study), subjects physically bit a chocolate bar in one condition, and imagined biting a chocolate bar in another condition. Subjects rated the event more fun and realistic when allowed to physically bite the chocolate bar. Results of the two experiments converge with a growing literature showing the value of adding physical qualities to virtual objects. This study is the first to empirically demonstrate the effectiveness of tactile augmentation as a simple, safe, inexpensive technique with large freedom of motion for adding physical texture, force feedback cues, smell and taste to virtual objects. Examples of practical applications are discussed.Based in part on Physically touching virtual objects using tactile augmentation enhances the realism of virtual environments' by Hunter Hoffman which appeared in the Proceedings of the IEEE Virtual Reality Annual International Symposium '98, Atlanta GA, pp 59–63. ¢ 1998 IEEE.     

The Implications of an Externalist Theory of Rule-Following Behaviour for Robot Cognition

Given (1) Wittgensteins externalist analysis of the distinction between following a rule and behaving in accordance with a rule, (2) prima facie connections between rule-following and psychological capacities, and (3) pragmatic issues about training, it follows that most, even all, future artificially intelligent computers and robots will not use language, possess concepts, or reason. This argument suggests that AIs traditional aim of building machines with minds, exemplified in current work on cognitive robotics, is in need of substantial revision.     

On a covering relation for context-free grammars

Summary Given a grammar for translation or compiling purposes, the structure of the grammar reflects the semantics of the language rather than good properties for parsing the language. Thus the language is often parsed with respect to another grammar which satisfies the property that the derivation trees in the original grammar can be recovered from those of the parsing grammar. Undercover is introduced as a new concept for the formal treatment of such grammatical relations and properties of this relation are explored with an emphasis on decidability results and the relationship to existing concepts such as cover and Reynolds cover. Some decidability questions can be related to language theoretic results on inclusion problems for simple deterministic languages.This work was carried out when the first author was visiting the Unit for Computer Science, McMaster University, Hamilton, Ontario, Canada. The work of both authors was supported in part under a Natural Sciences and Engineering Research Council of Canada Grant No. A-7700     

Online and multiplayer gaming — An overview

This paper gives a broad overview of the technology and market for on-line and multiplayer computer gaming. Some economic considerations and their influence on the choice of technologies are examined. Particular attention is given to the massively-multiplayer and persistent world type of games, and the special problems that arise in these environments. Lastly, some ongoing problems are investigated, particularly the thorny issue of cheating in multiplayer games.     

TMPR: A tree-structured modified problem reduction proof procedure and its extension to three-valued logic

This paper deals with automated deduction for classical and partial logics, especially for the three-valued logic L3, which has been introduced, for example, in the study of natural language semantics. Based on ideas from a Plaisted's Gentzen style system for classical two-valued logic, we present a new tree-structured proof procedure (TMPR) together with a new completeness proof using proof transformation techniques and some improvements including the generation and use of lemmata. TMPR extends SLD-resolution with a Prolog-style backward chaining to full first-order logic by a controlled use of case analysis. This is done without having to extend negative goals needed, for example, for model elimination. A classification of TMPR, model elimination and related calculi in a common tableau framework is given. Thereafter, we present our extension of the TMPR proof procedure to L3 and show its soundness and completeness. As a side result, a TMPR proof system for the four-valued logic L4 is given. Finally, the restriction of TMPR to L3-Horn clauses is considered, and, additionally, an idea for similarly extending model elimination and related systems to L3 (and L4) is illustrated.This work is supported by the KI-Verbund NRW, founded by the Ministry for Science and Research of North Rhine Westphalia and by the Deutsche Forschungs Gemeinschaft in the scope of the research topic Deduktion, and is an extended version of a talk held at the German-Japanese Workshop on Logic and Natural Language (23–25 October 1990, in Kyoto, Japan).     

The crisis of control: A progressive approach towards information systems integration for small companies

When small companies grow, they face a range of strategic managerial challenges. Stage models for small company growth predict that a crisis of control can occur when existing information systems for communication and control are no longer able to cope with increased throughput, nor are they able to respond flexibly to opportunities and challenges in the business environment. In response, owner-managers (OMs) may seek technological enterprise-wide solutions, in a drive towards integrated information systems (IIS). This paper reports a case study in which the Viable Systems Model (VSM) was used during an integration project in a small manufacturing company. In this case, the solution was found in organisational learning, rather than technology. It is argued that such a phase may be an essential step to the adoption of ERP/MRP at a later date for small growing companies.     

Behaviour Synthesis of the Erect Stance for a Biped Control

In this paper we use free fall approach to develop a high level control/command strategy for a bipedal robot called BIPMAN, based on a multi-chain mechanical model with a general control architecture. The strategy is composed of three levels: the Legs and arms level, the Coordinator level and the Supervisor level. The Coordinator level is devoted to controlling leg movements and to ensure the stability of the whole biped. Actually perturbation effects threaten the equilibrium of the human robot and can only be compensated using a dynamic control strategy. This one is based on dynamic stability studies with a center of mass acceleration control and a force distribution on each leg and arm. Free fall in the gravity field is assumed to be deeply involved in the human locomotor control. According to studies of this specific motion through a direct dynamic model,the notion of equilibrium classes is introduced. They allow one to define time intervals in which the biped is able to maintain its posture. This notion is used for the definition of a reconfigurable high level control of the robot.     

A Writing Support Tool with Multiple Views

This paper describes both SuperText,a computer program designed to support productiveexpository writing processes among students at adistance teaching university, and its theoreticaljustification. Being able to write well is animportant communication skill, and the writingprocess can help to build and clarify the writersknowledge. Computers can support this by providing amedium to externalise and record the writersunderstanding. Representations appropriate to thisexternalisation are uninstantiated idea labels,instantiated text units, and a variety ofrelationships between these items. SuperText usesthese representations to support a range of writingstyles. It provides several independent Views thatrepresent the structure of the evolving documentthrough expanding hierarchies, each with a varietyof Presentations. Allied to these Views is a textwork space providing access to a database ofcontinuous text nodes. Taken together, these providean ability to represent global and intermediatestructures of the document well beyond that ofconventional editors. These aspects were all ratedhighly by students participating in a series offield trials of SuperText.     

Symbols and Computation A Critique of the Computational Theory of Mind

Over the past several decades, the philosophical community has witnessed the emergence of an important new paradigm for understanding the mind.¹ The paradigm is that of machine computation, and its influence has been felt not only in philosophy, but also in all of the empirical disciplines devoted to the study of cognition. Of the several strategies for applying the resources provided by computer and cognitive science to the philosophy of mind, the one that has gained the most attention from philosophers has been the Computational Theory of Mind (CTM). CTM was first articulated by Hilary Putnam (1960, 1961), but finds perhaps its most consistent and enduring advocate in Jerry Fodor (1975, 1980, 1981, 1987, 1990, 1994). It is this theory, and not any broader interpretations of what it would be for the mind to be a computer, that I wish to address in this paper. What I shall argue here is that the notion of symbolic representation employed by CTM is fundamentally unsuited to providing an explanation of the intentionality of mental states (a major goal of CTM), and that this result undercuts a second major goal of CTM, sometimes refered to as the vindication of intentional psychology. This line of argument is related to the discussions of derived intentionality by Searle (1980, 1983, 1984) and Sayre (1986, 1987). But whereas those discussions seem to be concerned with the causal dependence of familiar sorts of symbolic representation upon meaning-bestowing acts, my claim is rather that there is not one but several notions of meaning to be had, and that the notions that are applicable to symbols are conceptually dependent upon the notion that is applicable to mental states in the fashion that Aristotle refered to as paronymy. That is, an analysis of the notions of meaning applicable to symbols reveals that they contain presuppositions about meaningful mental states, much as Aristotle's analysis of the sense of healthy that is applied to foods reveals that it means conducive to having a healthy body, and hence any attempt to explain mental semantics in terms of the semantics of symbols is doomed to circularity and regress. I shall argue, however, that this does not have the consequence that computationalism is bankrupt as a paradigm for cognitive science, as it is possible to reconstruct CTM in a fashion that avoids these difficulties and makes it a viable research framework for psychology, albeit at the cost of losing its claims to explain intentionality and to vindicate intentional psychology. I have argued elsewhere (Horst, 1996) that local special sciences such as psychology do not require vindication in the form of demonstrating their reducibility to more fundamental theories, and hence failure to make good on these philosophical promises need not compromise the broad range of work in empirical cognitive science motivated by the computer paradigm in ways that do not depend on these problematic treatments of symbols.     

Information Gaps as Communication Needs: A New Semantic Foundation for Some Non-Classical Logics

Semantics connected to some information based metaphor are well-known in logic literature: a paradigmatic example is Kripke semantic for Intuitionistic Logic. In this paper we start from the concrete problem of providing suitable logic-algebraic models for the calculus of attribute dependencies in Formal Contexts with information gaps and we obtain an intuitive model based on the notion of passage of information showing that Kleene algebras, semi-simple Nelson algebras, three-valued ukasiewicz algebras and Post algebras of order three are, in a sense, naturally and directly connected to partially defined information systems. In this way wecan provide for these logic-algebraic structures a raison dêetre different from the original motivations concerning, for instance, computability theory.