Visualization and Intelligent Multimodal Interfaces Group Home PageVisualization and Intelligent Multimodal Interfaces Group
Research projects:

LEMe Wall
An Intelligent and Immersive Environment
Description: LEMe room is an intelligent environment with a multi-projection display Wall as its main component.
Homepage: Click Here

EMG Interface Control
Control applications through muscle contractions
Description: This project studies the muscular activity as an input in order to control applications. The main goal is to provide tetraplegic individuals the capability to control a portable device (specially to be able to write and send SMS).
Homepage: Click Here

3GM
Tactile interface for users carrying visual deficiency input text on a PDA
Description: 3GM is a multipurpose multimodal interface with the purpose of allowing blind and ambliop users to input text on a mobile device (Pocket PC).
Homepage: Click Here

BajaVista
Sketch-Based Retrieval of ClipArt Drawings
Description: BajaVista is based on a generic approach suitable for content-based retrieval of structured graphics and drawings. It allows indexing and retrieving ClipArt drawings by content from large datasets. Drawings are described using topological and geometric information automatically extracted from their contents. Before indexing ClipArts, we apply a set of heuristics to simplify drawings, by eliminating redundant information and useless elements.
Homepage: Click Here

BlobMaker
Modelling and Visualization of Implicit Surfaces
Description: BlobMaker is a program for modelling surfaces using variational implicit surfaces. This system offers a solution to use variational implicit surfaces as a geometrical representation for free-form shapes.
The modeller allows new modelling operations to support stroke (pen-based) input. Shapes are created and manipulated using sketches on a perspective or parallel view.
The main operations are inflate, which creates 3D forms from a 2D stroke, merge which creates a 3D shape from two blobs and oversketch which allows users to redefine shapes using a single stroke to change their boundaries or to modify a surface by an implicit extrusion.

Homepage: Click Here

CALI
A Software Library for Calligraphic Interfaces
Description: CALI is a software library for the development of Calligraphic Interfaces (intelligent interfaces based on sketches and gesture interaction) centered mainly on a simple Shape Recognizer.
This recognizer is a fast, simple and compact approach to identify Scribbles (multi-stroke geometric shapes) drawn with a stylus on a digitizing tablet. Our method combines temporal adjacency, Fuzzy Logic and geometric features to classify scribbles.
Homepage: Click Here

CGEMS
Computer Graphics Educational Materials Source
Description: The Computer Graphics Educational Materials Source (CGEMS) is an online web-based application that provides the necessary tools for publishing and managing quality curricular materials for Computer Graphics educators.
Homepage: Click Here

GIDeS++
Gesture Interface Design System
Description: GIDeS ++ is a gesture based calligraphic 3D modeller using expectation lists, and extends the notion of natural and efficient interface.
Using the well established ACIS modeller kernel, the modelling process is powerful and full of possibilities.
Homepage: Click Here

NDR
Narratives for Document Retrieval
Description: The numbers and types of documents users must deal with are growing.
However, document organizarion is still based on document classification
into the file system's hierarchy. This is a difficult task and causes
undue cognitive loads on users. Furthermore, it is not what users would
more easily remember about their documents, when trying to retrieve them
later on.
Humans are storytellers by nature. We propose that an interface that
allows users to 'tell the story' about a document, including all kinds
of contextual, auto-biographical, information, will provide a more
natural, straightforward and efficient way for them to retrieve their
documents. We are therefore studying what shape do document-describing
stories take, what is their accuracy, and what would be a good interface
to allow users to tell them in order to retrieve their documents.
Homepage: Click Here

SBR
Sketch Based Retrieval
Description: The Sketch-Based Retrieval (SBR) system uses a new approach to classify, index and retrieve technical drawings by content from large data sets. In contrast to textual organization, we propose a visual classification scheme based on spatial relationships, geometry and high-dimensional indexing structures, which are better suited to this problem, because they take advantage of designers visual memory and explore their ability to sketch as a query mechanism.
Homepage: Click Here

BiblioPad
Survey helper application
Description: Every survey project involves reading of several sources, sometimes dozens, sometimes hundreds. Information can be gathered from Internet pages, books, magazines, conference proceedings, etc. Dealing with so many documents can sometimes be a daunting and confusing task. Our goal is to help organize such work. The user will add to the survey every document he locates and we'll try to help by parsing it and rating its relative importance (according to the ones already read) and suggesting the user which non-read document he should read next. We'll also provide him with a handy graph-like representation of the references each document contains, that can also help by visually highlighting relevant sources to read.
Homepage: Click Here

HOMERO
Storytelling for Wayfinding
Description: The project "HOMERO: Storytelling for Wayfinding" consists in the development of a location-based service, aimed towards aiding pedestrian navigation in an unknown urban space. The system will give directions to the user in natural language - as if he was asking a well-informed local bystander - along with feedback and reactions to events such as crossing checkpoints, getting lost and such.
Homepage: Click Here

PeopleFinder
Indoor People Localization
Description: PeopleFinder is an indoor localization system. It's suitable for locating people, resources (like digital cameras and projectors), and specific spaces (such as conference rooms, receptions, libraries and emergency exits). The system can also show the way (through multimodal outputs) to the specific chosen target.
Homepage: Click Here

DecoSketch
Caligraphic Interface to Support Decoration
Description: DecoSketch is an application designed to help the creation and visualization of architectural plans using a free-hand drawing interface and recognizing user sketches. It allows the user to draw a plan of a house and then navigate through a virtual representation of the same. It also allows the user to decorate and furnish the house, making it look more realistic, so the user can have a picture of how the house will look like, before the actual construction and decoration.
Homepage: Click Here

Curricula Virtuais
Curricula Virtuais
Description: Curricula Virtuais is a system that will greatly enhance the e-Learning in the meanings that, it will bring knowledge directly in to our homes. This system will allow lecturing classes to the web, with the help of streaming media technologies, and other contents, like presentation slides and extras documents that fulfil a class. The system will be able to create a view for the teacher as well as a view to the student that can be anywhere, at home, at a coffee shop, using only a web browser to view the class. The system will use a media encoder, and a streaming media server, with synchronized slides that change as the teacher does so.
Homepage: Click Here

AMEx
Analysis of Mathematical Expressions
Description: AMEx is an offline recognizer of handwritten mathematical expressions using the Tablet PC plattform. This recognizer is divided in three main phases: first the written formula is segmented in its different symbols, these symbols are then recognized and combined using a grammar and the structure of the formula and finnaly a result is produced in a formal language. Among the recognized formulas there are functions, square roots, integrals, summations and others.
Homepage: Click Here

Smart Tape
Smart Tape: Multimodal Interface for 3D Tape Drawing in Augmented Reality enviroment
Description: This project is about building an application that integrates finger tracking and voice command recognition to tape drawing. The user is able to sketch a 3D curve using both hands and voice commands as input devices. One hand draws the curve, the other control its derivate and the simple commands as “start” “stop” or “back” are voice commands. The system uses a wireless and natural interface where the user doesn’t have to handle any unfamiliar devices, which can anyhow be uncomfortable and reduce his natural designing skills.
Homepage: Click Here

JavaSketchIt
JavaSketchIt: Sketch-Based User Interface Design
Description: JavaSketchIt is based on the idea of combining and interpreting graphical primitives (triangle, rectangle, line, etc.) to achieve a visual grammar. It generates widgets with working java code for the user interface.
Homepage: Click Here

JavaSketchIt 2
JavaSketchIt 2: Sketch-Based User Interface Design
Description: JavaSketchIt2 is the following step from JavaSketchIt. Based on the same concept of using graphical primitives to define a visual grammar, it's meant to allow the user to decide which widgets to recognize and what are the elements and rules which identify each widget. It allows to export an XML document with all the widgets in the sketched user interface.
Homepage: Click Here