Daniel Wigdor

A system and method are disclosed for using a touch sensing system capable of sensing location of a finger or object above a touch surface to inform a touch response system in an electronic device of a predicted future user input event or motion data in advance of an actual touch event. Current user input is sensed via the touch sensing system and data reflecting hover information is created. A model of user interaction with a touch surface is applied to the data representative of the user… Show more

A system and method are disclosed for using a touch sensing system capable of sensing location of a finger or object above a touch surface to inform a touch response system in an electronic device of a predicted future user input event or motion data in advance of an actual touch event. Current user input is sensed via the touch sensing system and data reflecting hover information is created. A model of user interaction with a touch surface is applied to the data representative of the user input to create data reflecting a prediction of a future user input event. In an embodiment, prior to occurrence of the predicted user input event, a predicted location and a predicted time at which the predicted future user input event will occur are provided to a touch response system. Show less

In an embodiment, a touch sensitive device includes touch interface having rows and columns and a signal generator for generating unique orthogonal signals on a plurality of the rows, respectively. A touch processor identifies touch on the touch interface by processing touch signals present on the columns, and outputting a stream of touch events. A decimator receives the stream of touch events including information as to a pressure of the touch event or the contact area of the touch event… Show more

In an embodiment, a touch sensitive device includes touch interface having rows and columns and a signal generator for generating unique orthogonal signals on a plurality of the rows, respectively. A touch processor identifies touch on the touch interface by processing touch signals present on the columns, and outputting a stream of touch events. A decimator receives the stream of touch events including information as to a pressure of the touch event or the contact area of the touch event, selectively identifies one or more of the touch events in the stream, and outputs a modified stream of touch events for use by the touch sensitive device.

Show less

A low-latency touch sensitive device provides a method for determining a location of a touch event thereon. The touch sensitive device row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Each of a set of orthogonal row signals are simultaneously transmitted on a respective one of at least some of the row conductors and an amount of each of the plurality of orthogonal row signals present on each of the plurality of… Show more

A low-latency touch sensitive device provides a method for determining a location of a touch event thereon. The touch sensitive device row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Each of a set of orthogonal row signals are simultaneously transmitted on a respective one of at least some of the row conductors and an amount of each of the plurality of orthogonal row signals present on each of the plurality of column conductors is detected. A set of orthogonal column signals are simultaneously transmitted on a respective one of at least some of the column conductors. An amount of each of the orthogonal column signals present on each of the plurality of row conductors is detected. The detected amount of each of the plurality of orthogonal row signals and the detected amount of each of the plurality of orthogonal column signals is used to determine the location of a touch event on the device.

Show less

System and processes for transmitting orthogonal frequencies on a touch sensor are provided. In one example process, the rows of the sensor panel can have signals transmitted thereon having orthogonal frequencies. The orthogonal frequencies can be separated by a frequency spacing (.DELTA.f) that is at least the reciprocal of a measurement period .tau. (e.g., an integration time) of the touch sensor. Touch events cause and correspond to signals on the columns, which can be received by a receive… Show more

System and processes for transmitting orthogonal frequencies on a touch sensor are provided. In one example process, the rows of the sensor panel can have signals transmitted thereon having orthogonal frequencies. The orthogonal frequencies can be separated by a frequency spacing (.DELTA.f) that is at least the reciprocal of a measurement period .tau. (e.g., an integration time) of the touch sensor. Touch events cause and correspond to signals on the columns, which can be received by a receive system including appropriate amplifiers. The orthogonal frequencies can be detected by the receiver with a Fourier Transform or filter bank. Separate digitization and signal processing can be implemented for every column. The receiver can measure the quantity of each of the orthogonal transmitted signals present on each column, identifying the rows in touch with each column and may also provide additional (e.g., qualitative) information concerning the touch.

Show less

A low-latency touch sensor is disclosed for use in connection with a touch surface having first and second conductors sensitive to changes in coupling therebetween as a result of touch (and/or near-touch). A signal generator generates unique orthogonal signals, a transmitter transmits the orthogonal signals on each of the first conductors. Receivers connected to the second conductors receive signals during a measurement period. The signals measured during the measurement period are processed to… Show more

A low-latency touch sensor is disclosed for use in connection with a touch surface having first and second conductors sensitive to changes in coupling therebetween as a result of touch (and/or near-touch). A signal generator generates unique orthogonal signals, a transmitter transmits the orthogonal signals on each of the first conductors. Receivers connected to the second conductors receive signals during a measurement period. The signals measured during the measurement period are processed to determine, for each measurement period, and for each of the second conductors, a signal strength corresponding to each of the unique orthogonal signals. The signal strengths can be used as a basis to determine touch events. Show less

Methods are disclosed for dynamic assignment of possible channels in a touch sensitive device having rows and columns. In an embodiment, a method determines a first signal space in which to generate signals for use in the touch sensor. Signals are then generated in the first signal space on separate ones of the rows and a column signal is sensed on a column. The first signal space is replaced with a second signal space, and a second plurality of signals is generated for use in the touch sensor… Show more

Methods are disclosed for dynamic assignment of possible channels in a touch sensitive device having rows and columns. In an embodiment, a method determines a first signal space in which to generate signals for use in the touch sensor. Signals are then generated in the first signal space on separate ones of the rows and a column signal is sensed on a column. The first signal space is replaced with a second signal space, and a second plurality of signals is generated for use in the touch sensor in the second frequency space. The second plurality of signals is sensed to identify a touch event in the touch sensitive device. Show less

A method and system for distinguishing between sources of simultaneous touch events on a touch sensitive device with row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Orthogonal signals are simultaneously transmitted on a respective one of the rows. Each column is processed to determine strength of each of the orthogonal signals present thereon. Simultaneous touch locations are associated with a discrete source based… Show more

A method and system for distinguishing between sources of simultaneous touch events on a touch sensitive device with row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Orthogonal signals are simultaneously transmitted on a respective one of the rows. Each column is processed to determine strength of each of the orthogonal signals present thereon. Simultaneous touch locations are associated with a discrete source based on the presence of body-transmitted cross-talk therebetween, as reflected by the determined signal strength corresponding to the touch locations. Alternatively or additionally, a user-coupled signal generator generating another orthogonal signal provides a user-unique signal to the receivers. The signal strength of the user-unique signal is used to associate one or more touch locations with the user coupled to the user-coupled signal generator.

Show less

Disclosed are touch sensitive devices and methods of responding to hits in touch sensitive devices that include a graphical user interface having interface elements, each associated with a program element. A hit test map updater is used to process graphical user interface information into a hit test map in connection with the rendering of the graphical user interface, such that the hit test map associates properties with interface elements appearing on the graphical user interface. An input… Show more

Disclosed are touch sensitive devices and methods of responding to hits in touch sensitive devices that include a graphical user interface having interface elements, each associated with a program element. A hit test map updater is used to process graphical user interface information into a hit test map in connection with the rendering of the graphical user interface, such that the hit test map associates properties with interface elements appearing on the graphical user interface. An input processor is used to receive a location corresponding to an input in connection with an input event, search the hit test map in which values are associated with interface elements appearing in the graphical user interface, and identify a property of the interface element from the values. In an embodiment, the identified property is proved to a central processing system and a user interface event is generated. In an embodiment, the properties received from the hit test map updater and the input processor are used to determine a program element associated with the property, and the program element is signaled. In an embodiment, the identified property is processed to determine a change to the graphical user interface, and the change is displayed.

Show less

In an embodiment, a touch sensitive device includes a touch interface having rows and columns and a signal generator for generating unique orthogonal signals on a plurality of the rows, respectively. A touch processor is identifies touch on the touch interface by processing touch signals present on the columns, and outputting a stream of touch events. A decimator receives the stream of touch events, selectively identifies one or more of the touch events in the stream and assembles information… Show more

In an embodiment, a touch sensitive device includes a touch interface having rows and columns and a signal generator for generating unique orthogonal signals on a plurality of the rows, respectively. A touch processor is identifies touch on the touch interface by processing touch signals present on the columns, and outputting a stream of touch events. A decimator receives the stream of touch events, selectively identifies one or more of the touch events in the stream and assembles information concerning one or more touch events in the stream, and outputs both the selectively identified touch events and the assembled information for use by the touch sensitive device. Show less

A system for processing user input includes an input device, an input processing unit, a high-latency subsystem, a low-latency subsystem, input processing unit software for generating signals in response to user inputs, and an output device. The low-latency subsystem processes signals corresponding to at least some events and generates corresponding programmable low-latency output, the programmable output being based, at least in part, on state information being maintained by the high-latency… Show more

A system for processing user input includes an input device, an input processing unit, a high-latency subsystem, a low-latency subsystem, input processing unit software for generating signals in response to user inputs, and an output device. The low-latency subsystem processes signals corresponding to at least some events and generates corresponding programmable low-latency output, the programmable output being based, at least in part, on state information being maintained by the high-latency subsystem. The high-latency subsystem processes signals corresponding to at least some events, and generates corresponding output, the output of the high-latency subsystem being higher latency than the output of the low-latency subsystem with respect to a given event. Show less

In an embodiment, a latency measuring head is provided for use in measuring touch-to-response latency in a test device, the test device including a capacitive user interface that responds to touch input. The latency measuring head includes a conductive element adapted to be positioned in static proximity with and/or in contact with the capacitive user interface. An electron sink is operatively connected to the conductive element via a normally open switch having an open and a closed position… Show more

In an embodiment, a latency measuring head is provided for use in measuring touch-to-response latency in a test device, the test device including a capacitive user interface that responds to touch input. The latency measuring head includes a conductive element adapted to be positioned in static proximity with and/or in contact with the capacitive user interface. An electron sink is operatively connected to the conductive element via a normally open switch having an open and a closed position. The electron sink has capacity to hold or dissipate a sufficient charge to trigger a touch event on the test device when the switch is closed. A photosensitive element is positioned in static proximity with and/or in contact with the capacitive user interface such that the photosensitive element can output a signal in response to a change in an optical property of at least a portion of the capacitive user interface. Software for performing analysis of latency measurements from a latency measuring device and generating statistics that summarize latency performance of a test device is further disclosed. Show less

A low-latency touch sensitive device provides a method for determining a location of a touch event thereon. The touch sensitive device row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Each of a set of orthogonal row signals are simultaneously transmitted on a respective one of at least some of the row conductors and an amount of each of the plurality of orthogonal row signals present on each of the plurality of… Show more

A low-latency touch sensitive device provides a method for determining a location of a touch event thereon. The touch sensitive device row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Each of a set of orthogonal row signals are simultaneously transmitted on a respective one of at least some of the row conductors and an amount of each of the plurality of orthogonal row signals present on each of the plurality of column conductors is detected. A set of orthogonal column signals are simultaneously transmitted on a respective one of at least some of the column conductors. An amount of each of the orthogonal column signals present on each of the plurality of row conductors is detected. The detected amount of each of the plurality of orthogonal row signals and the detected amount of each of the plurality of orthogonal column signals is used to determine the location of a touch event on the device. Show less

In an embodiment, a touch sensitive device includes touch interface having rows and columns and a signal generator for generating unique orthogonal signals on a plurality of the rows, respectively. A touch processor identifies touch on the touch interface by processing touch signals present on the columns, and outputting a stream of touch events. A decimator receives the stream of touch events including information as to a pressure of the touch event or the contact area of the touch event… Show more

In an embodiment, a touch sensitive device includes touch interface having rows and columns and a signal generator for generating unique orthogonal signals on a plurality of the rows, respectively. A touch processor identifies touch on the touch interface by processing touch signals present on the columns, and outputting a stream of touch events. A decimator receives the stream of touch events including information as to a pressure of the touch event or the contact area of the touch event, selectively identifies one or more of the touch events in the stream, and outputs a modified stream of touch events for use by the touch sensitive device. Show less

A system and method are disclosed for using a touch sensing system capable of sensing location of a finger or object above a touch surface to inform a touch response system in an electronic device of a predicted future user input event or motion data in advance of an actual touch event. Current user input is sensed via the touch sensing system and data reflecting hover information is created. A model of user interaction with a touch surface is applied to the data representative of the user… Show more

A system and method are disclosed for using a touch sensing system capable of sensing location of a finger or object above a touch surface to inform a touch response system in an electronic device of a predicted future user input event or motion data in advance of an actual touch event. Current user input is sensed via the touch sensing system and data reflecting hover information is created. A model of user interaction with a touch surface is applied to the data representative of the user input to create data reflecting a prediction of a future user input event. In an embodiment, prior to occurrence of the predicted user input event, a predicted location and a predicted time at which the predicted future user input event will occur are provided to a touch response system. Show less

A low-latency touch sensitive device provides a method for determining a location of a touch event thereon. The touch sensitive device row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Each of a set of orthogonal row signals are simultaneously transmitted on a respective one of at least some of the row conductors and an amount of each of the plurality of orthogonal row signals present on each of the plurality of… Show more

A low-latency touch sensitive device provides a method for determining a location of a touch event thereon. The touch sensitive device row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Each of a set of orthogonal row signals are simultaneously transmitted on a respective one of at least some of the row conductors and an amount of each of the plurality of orthogonal row signals present on each of the plurality of column conductors is detected. A set of orthogonal column signals are simultaneously transmitted on a respective one of at least some of the column conductors. An amount of each of the orthogonal column signals present on each of the plurality of row conductors is detected. The detected amount of each of the plurality of orthogonal row signals and the detected amount of each of the plurality of orthogonal column signals is used to determine the location of a touch event on the device. Show less

A technology is described for interfacing with a computing application using a multi-digit sensor. A method may include obtaining an initial stroke using a single digit of a user on the multi-digit sensor. A direction change point for the initial stroke can be identified. At the direction change point for the initial stroke, a number of additional digits can be presented by the user to the multi-digit sensor. Then a completion stroke can be identified as being made with the number of additional… Show more

A technology is described for interfacing with a computing application using a multi-digit sensor. A method may include obtaining an initial stroke using a single digit of a user on the multi-digit sensor. A direction change point for the initial stroke can be identified. At the direction change point for the initial stroke, a number of additional digits can be presented by the user to the multi-digit sensor. Then a completion stroke can be identified as being made with the number of additional digits. A user interface signal to can be sent to the computing application based on the number of additional digits used in the completion touch stroke. In another configuration of the technology, the touch stroke or gesture may include a single stroke where user interface items can be selected when additional digits are presented at the end of a gesture. Show less

In an embodiment, a touch sensitive device includes a touch interface having conductors and a signal generator for generating signals on the conductors. A touch processor identifies touch on the touch interface by processing touch signals present on the conductors, and outputting a stream of touch events. A decimator receives the stream of touch events and outputs a modified stream of touch events for use by the touch sensitive device, the modified stream of touch events may include predicted… Show more

In an embodiment, a touch sensitive device includes a touch interface having conductors and a signal generator for generating signals on the conductors. A touch processor identifies touch on the touch interface by processing touch signals present on the conductors, and outputting a stream of touch events. A decimator receives the stream of touch events and outputs a modified stream of touch events for use by the touch sensitive device, the modified stream of touch events may include predicted or estimated usable touch events. Show less

A method and system for distinguishing between sources of simultaneous touch events on a touch sensitive device with row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Orthogonal signals are simultaneously transmitted on a respective one of the rows. Each column is processed to determine strength of each of the orthogonal signals present thereon. Simultaneous touch locations are associated with a discrete source based… Show more

A method and system for distinguishing between sources of simultaneous touch events on a touch sensitive device with row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Orthogonal signals are simultaneously transmitted on a respective one of the rows. Each column is processed to determine strength of each of the orthogonal signals present thereon. Simultaneous touch locations are associated with a discrete source based on the presence of body-transmitted cross-talk therebetween, as reflected by the determined signal strength corresponding to the touch locations. Alternatively or additionally, a user-coupled signal generator generating another orthogonal signal provides a user-unique signal to the receivers. The signal strength of the user-unique signal is used to associate one or more touch locations with the user coupled to the user-coupled signal generator.

Show less

A system and method for distinguishing between sources of simultaneous touch events on a touch sensitive device are disclosed. The touch sensitive device includes row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Orthogonal row signals are generated on the row conductors and orthogonal column signals are generated on the column conductors. In an embodiment, an amount of each of the plurality of orthogonal row signals… Show more

A system and method for distinguishing between sources of simultaneous touch events on a touch sensitive device are disclosed. The touch sensitive device includes row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Orthogonal row signals are generated on the row conductors and orthogonal column signals are generated on the column conductors. In an embodiment, an amount of each of the plurality of orthogonal row signals present on each of the plurality of row conductors is detected, an amount of each of the plurality of orthogonal column signals present on each of the plurality of column conductors is detected, and at least one of such amounts is used to associate each of the plurality of simultaneous touch events with a discrete source. The strength of such detected "crosstalk" between row conductors can be used to distinguish two or more touch events, such as by distinguishing a two-handed gesture from a one-handed gesture, distinguishing two touch events as having been initiated by different users, distinguishing a passive object from a hand, identifying a passive object, improving palm rejection and improving accidental-touch rejection.

Show less

A system for processing user input includes an input device, an input processing unit, a high-latency subsystem, a low-latency subsystem, input processing unit software for generating signals in response to user inputs, and an output device. The low-latency subsystem receives the signals and generates low-latency output and the high-latency subsystem processes the signals and generates high-latency output.

A finger device initiates actions on a computer system when placed in contact with a surface. The finger device includes instrumentation that captures images and gestures. When in contact with a surface, the finger device captures images of the surface and gestures made on the surface. The finger device also transmits the images and gesture data to the computer system. An application on the computer system matches the images received from the finger device to a representation of the surface… Show more

A finger device initiates actions on a computer system when placed in contact with a surface. The finger device includes instrumentation that captures images and gestures. When in contact with a surface, the finger device captures images of the surface and gestures made on the surface. The finger device also transmits the images and gesture data to the computer system. An application on the computer system matches the images received from the finger device to a representation of the surface, identifies an action associated with the surface representation and gesture, and executes the action. Instrumenting the finger instead of the surface, allows a user to configure virtually any surface to accept touch input. Show less

A head-mounted display (HMD) provides an augmented view of advertisements to an HMD wearer. In some embodiments, when an advertisement is within an HMD wearer's field of view, the HMD may augment the HMD wearer's view of the advertisement to provide additional information and/or to personalize the advertisement to the HMD wearer. In other embodiments, when an advertisement is within an HMD wearer's field of view, the HMD may augment the HMD wearer's view of the advertisement to remove the… Show more

A head-mounted display (HMD) provides an augmented view of advertisements to an HMD wearer. In some embodiments, when an advertisement is within an HMD wearer's field of view, the HMD may augment the HMD wearer's view of the advertisement to provide additional information and/or to personalize the advertisement to the HMD wearer. In other embodiments, when an advertisement is within an HMD wearer's field of view, the HMD may augment the HMD wearer's view of the advertisement to remove the advertisement from the HMD wearer's view or to replace the content of the advertisement with non-advertising content. Show less

A touch sensitive device includes a touch interface having rows and columns, a signal generator for generating a plurality of unique orthogonal signals in a first range and having a first frequency spacing on at least a plurality of the rows, respectively, and a heterodyning frequency converter. The heterodyning frequency converter receives a signal present on a column, the signal comprising signals within the first range and having the first frequency spacing. The heterodyning frequency… Show more

A touch sensitive device includes a touch interface having rows and columns, a signal generator for generating a plurality of unique orthogonal signals in a first range and having a first frequency spacing on at least a plurality of the rows, respectively, and a heterodyning frequency converter. The heterodyning frequency converter receives a signal present on a column, the signal comprising signals within the first range and having the first frequency spacing. The heterodyning frequency converter converts the signal to a heterodyned signal comprising signals in a second range and having the first frequency spacing, and outputs the heterodyned signal. A touch processor identifies touch on the touch interface at least in part by processing the heterodyned signal. Show less

In an embodiment, a touch sensitive device includes a touch interface having rows and columns and a signal generator for generating unique orthogonal signals on a plurality of the rows, respectively. A touch processor is identifies touch on the touch interface by processing touch signals present on the columns, and outputting a stream of touch events. A decimator receives the stream of touch events, selectively identifies one or more of the touch events in the stream, and outputs a modified… Show more

In an embodiment, a touch sensitive device includes a touch interface having rows and columns and a signal generator for generating unique orthogonal signals on a plurality of the rows, respectively. A touch processor is identifies touch on the touch interface by processing touch signals present on the columns, and outputting a stream of touch events. A decimator receives the stream of touch events, selectively identifies one or more of the touch events in the stream, and outputs a modified stream of touch events for use by the touch sensitive device. Show less

A system and method are disclosed for measuring latency in a device which includes a user interface that receives user input and provides output in response. In an embodiment, a body separate from the device under test is provided. A first sensor operatively attached to the body detects a touch event input to the device at a first time and a second sensor detects a response output from the device at a second time. A computational engine computes a time differential between the first time and… Show more

A system and method are disclosed for measuring latency in a device which includes a user interface that receives user input and provides output in response. In an embodiment, a body separate from the device under test is provided. A first sensor operatively attached to the body detects a touch event input to the device at a first time and a second sensor detects a response output from the device at a second time. A computational engine computes a time differential between the first time and the second time and an output outputs an indication of a measurement of latency in the device, the measurement being reflective of the time differential between the first time and the second time.

Show less

A method for providing a visual response to input with reduced latency in a computing device includes computing alternative sets of intermediate data for a first graphical user interface element, each alternative set of intermediate data comprising data useful to produce a visual representation of the graphical user interface element. The plurality of alternative sets of intermediate data and a set of intermediate data for a second graphical user interface element are stored in memory. The… Show more

A method for providing a visual response to input with reduced latency in a computing device includes computing alternative sets of intermediate data for a first graphical user interface element, each alternative set of intermediate data comprising data useful to produce a visual representation of the graphical user interface element. The plurality of alternative sets of intermediate data and a set of intermediate data for a second graphical user interface element are stored in memory. The method creates an index identifying a first one of the plurality of alternative sets of intermediate data for the first graphical user interface element to use in forming a final pixel image. The index, the first set of alternative intermediate data for the graphical user interface element, and the intermediate data for the second graphical user interface element are used to create a first final pixel image for display to a user, the first final pixel image including the first and second graphical user interface elements. In response to user input, the index is modified to include an identification of a second one of the plurality of alternative sets of intermediate data for the first graphical user interface element, and the modified index is used to create a final pixel image for display to a user. Show less

System and processes for transmitting orthogonal frequencies on a touch sensor are provided. In one example process, the rows of the sensor panel can have signals transmitted thereon having orthogonal frequencies. The orthogonal frequencies can be separated by a frequency spacing (.DELTA.f) that is at least the reciprocal of a measurement period .tau. (e.g., an integration time) of the touch sensor. Touch events cause and correspond to signals on the columns, which can be received by a receive… Show more

System and processes for transmitting orthogonal frequencies on a touch sensor are provided. In one example process, the rows of the sensor panel can have signals transmitted thereon having orthogonal frequencies. The orthogonal frequencies can be separated by a frequency spacing (.DELTA.f) that is at least the reciprocal of a measurement period .tau. (e.g., an integration time) of the touch sensor. Touch events cause and correspond to signals on the columns, which can be received by a receive system including appropriate amplifiers. The orthogonal frequencies can be detected by the receiver with a Fourier Transform or filter bank. Separate digitization and signal processing can be implemented for every column. The receiver can measure the quantity of each of the orthogonal transmitted signals present on each column, identifying the rows in touch with each column and may also provide additional (e.g., qualitative) information concerning the touch. Show less

In an embodiment, a system for processing user input on a device is disclosed which includes a low-latency subsystem (LLS) adapted to receive signals from an input subsystem and to selectively forward the signals to a conventional software stack. The subsystem is adapted to generate a low-latency response in response to one or more of the signals and the signals received by the subsystem comprise an input which triggers a cross-control behavior that inhibits forwarding of at least some of the… Show more

In an embodiment, a system for processing user input on a device is disclosed which includes a low-latency subsystem (LLS) adapted to receive signals from an input subsystem and to selectively forward the signals to a conventional software stack. The subsystem is adapted to generate a low-latency response in response to one or more of the signals and the signals received by the subsystem comprise an input which triggers a cross-control behavior that inhibits forwarding of at least some of the signals to the conventional software stack. In another embodiment, a system for processing user input having an input subsystem is disclosed. A LLS is adapted to receive signals from the input subsystem and to generate a low-latency response in response to one or more of the signals, and to send at least one of the signals to a regular output subsystem. The LLS is configured to identify the cross-control behavior and generate a response reflecting the behavior. Show less

A low-latency touch sensitive device provides a method for determining a location of a touch event thereon. The touch sensitive device row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Each of a set of orthogonal row signals are simultaneously transmitted on a respective one of at least some of the row conductors and an amount of each of the plurality of orthogonal row signals present on each of the plurality of… Show more

A low-latency touch sensitive device provides a method for determining a location of a touch event thereon. The touch sensitive device row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Each of a set of orthogonal row signals are simultaneously transmitted on a respective one of at least some of the row conductors and an amount of each of the plurality of orthogonal row signals present on each of the plurality of column conductors is detected. A set of orthogonal column signals are simultaneously transmitted on a respective one of at least some of the column conductors. An amount of each of the orthogonal column signals present on each of the plurality of row conductors is detected. The detected amount of each of the plurality of orthogonal row signals and the detected amount of each of the plurality of orthogonal column signals is used to determine the location of a touch event on the device. Show less

A method and system for distinguishing between sources of simultaneous touch events on a touch sensitive device with row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Each of a plurality of orthogonal row signals are simultaneously transmitted on a respective one of at least some of the plurality of row conductors. An amount of each of the orthogonal row signals present on each of the plurality of column conductors… Show more

A method and system for distinguishing between sources of simultaneous touch events on a touch sensitive device with row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Each of a plurality of orthogonal row signals are simultaneously transmitted on a respective one of at least some of the plurality of row conductors. An amount of each of the orthogonal row signals present on each of the plurality of column conductors is detected, and the touch events are identified using the detected amount. Each of the simultaneous touch events is associated with a discrete source based on the detected amount of each of the plurality of orthogonal row signals. Show less

A touch sensitive device includes a touch interface having rows and columns, a signal generator for generating a plurality of unique orthogonal signals on at least a plurality of the rows, respectively, and a frequency converter. The frequency converter receives a first touch signal present on at least one of the plurality of columns, converts the first touch signal to a second signal having a second center frequency, and outputs the second signal. A touch processor is identifies touch on the… Show more

A touch sensitive device includes a touch interface having rows and columns, a signal generator for generating a plurality of unique orthogonal signals on at least a plurality of the rows, respectively, and a frequency converter. The frequency converter receives a first touch signal present on at least one of the plurality of columns, converts the first touch signal to a second signal having a second center frequency, and outputs the second signal. A touch processor is identifies touch on the touch interface by processing the second signal having the second center frequency and outputting touch event data. Show less

A system for processing user input with reduced control response latency includes an input device, an input processing unit, a high-latency subsystem, a low-latency subsystem, input processing unit software for generating signals, and an output device. The low-latency subsystem receives the signals and generates low-latency output and the high-latency subsystem processes the signals and generates high-latency output. In an embodiment, the signals comprise an identification of a defined… Show more

A system for processing user input with reduced control response latency includes an input device, an input processing unit, a high-latency subsystem, a low-latency subsystem, input processing unit software for generating signals, and an output device. The low-latency subsystem receives the signals and generates low-latency output and the high-latency subsystem processes the signals and generates high-latency output. In an embodiment, the signals comprise an identification of a defined cross-control behavior. Show less

A system for processing user input includes an input device, an input processing unit, a high-latency subsystem, a low-latency subsystem, input processing unit software for generating signals in response to user inputs, and an output device. The low-latency subsystem receives the signals and generates low-latency output and the high-latency subsystem processes the signals and generates high-latency output.

A method of operating a graphical user interface of a computing device is disclosed. The method comprises displaying a graphical user interface (GUI) element on the touch sensitive display screen. The method further comprises in response to receiving touch input data indicative of a one-touch gesture mapping the one-touch gesture to a corresponding GUI element function. The method further comprises in response to receiving touch input data indicative of a multi-touch gesture, mapping the… Show more

A method of operating a graphical user interface of a computing device is disclosed. The method comprises displaying a graphical user interface (GUI) element on the touch sensitive display screen. The method further comprises in response to receiving touch input data indicative of a one-touch gesture mapping the one-touch gesture to a corresponding GUI element function. The method further comprises in response to receiving touch input data indicative of a multi-touch gesture, mapping the multi-touch gesture to the corresponding GUI element function. The method further comprises transforming display of the GUI element on the touch sensitive display screen based on the corresponding GUI element function. Show less

Disclosed are a sensor and method that provide detection of touch events from human fingers on a two-dimensional manifold with the capability for multiple simultaneous touch events to be detected and distinguished from each other. In accordance with an embodiment, the touch events are detected, processed and supplied to downstream computational processes with very low latency, i.e. on the order of one millisecond or less. Disclosed is a projected capacitive method that has been enhanced for… Show more

Disclosed are a sensor and method that provide detection of touch events from human fingers on a two-dimensional manifold with the capability for multiple simultaneous touch events to be detected and distinguished from each other. In accordance with an embodiment, the touch events are detected, processed and supplied to downstream computational processes with very low latency, i.e. on the order of one millisecond or less. Disclosed is a projected capacitive method that has been enhanced for high update rate and low latency measurements of touch events. The technique can use parallel hardware and higher frequency waveforms to gain the above advantages. Also disclosed are methods to make the measurements sensitive and robust, allow the technique to be used on transparent display surfaces and permit economical manufacturing of products which employ the technique.

Show less

A proximity-aware multi-touch tabletop is disclosed that includes both a touch screen display and proximity sensors. The proximity sensors are disposed in one or more annular groups around the touch screen display and are positioned in upward- and outward-facing directions. The proximity sensors allow the multi-touch tabletop to sense the distance of a body, arm, hand, or fingers of a user from the multi-touch tabletop. Thus, hand, arm, and finger positions of a user can be determined relative… Show more

A proximity-aware multi-touch tabletop is disclosed that includes both a touch screen display and proximity sensors. The proximity sensors are disposed in one or more annular groups around the touch screen display and are positioned in upward- and outward-facing directions. The proximity sensors allow the multi-touch tabletop to sense the distance of a body, arm, hand, or fingers of a user from the multi-touch tabletop. Thus, hand, arm, and finger positions of a user can be determined relative to the body position of the user, which enables the multi-touch tabletop to differentiate between left hand/arm gestures and right hand/arm gestures. Further, because the multi-touch tabletop can correlate left arm and right arm movements to a user body, the multi-touch tabletop can differentiate gestures originating from different users. The ability of the multi-touch tabletop to distinguish between users greatly enhances user experiences, particularly in a multi-user environment. Show less

A proximity-aware multi-touch tabletop is disclosed that includes both a touch screen display and proximity sensors. The proximity sensors are disposed in one or more annular groups around the touch screen display and are positioned in upward-and outward-facing directions. The proximity sensors allow the multi-touch tabletop to sense the distance of a body, arm, hand, or fingers of a user from the multi-touch tabletop. Thus, hand, arm, and finger positions of a user can be determined relative… Show more

A proximity-aware multi-touch tabletop is disclosed that includes both a touch screen display and proximity sensors. The proximity sensors are disposed in one or more annular groups around the touch screen display and are positioned in upward-and outward-facing directions. The proximity sensors allow the multi-touch tabletop to sense the distance of a body, arm, hand, or fingers of a user from the multi-touch tabletop. Thus, hand, arm, and finger positions of a user can be determined relative to the body position of the user, which enables the multi-touch tabletop to differentiate between left hand/arm gestures and right hand/arm gestures. Further, because the multi-touch tabletop can correlate left arm and right arm movements to a user body, the multi-touch tabletop can differentiate gestures originating from different users. The ability of the multi-touch tabletop to distinguish between users greatly enhances user experiences, particularly in a multi-user environment.

Show less

A technology is described for interfacing with a computing application using a multi-digit sensor. A method may include obtaining an initial stroke using a single digit of a user on the multi-digit sensor. A direction change point for the initial stroke can be identified. At the direction change point for the initial stroke, a number of additional digits can be presented by the user to the multi-digit sensor. Then a completion stroke can be identified as being made with the number of additional… Show more

A technology is described for interfacing with a computing application using a multi-digit sensor. A method may include obtaining an initial stroke using a single digit of a user on the multi-digit sensor. A direction change point for the initial stroke can be identified. At the direction change point for the initial stroke, a number of additional digits can be presented by the user to the multi-digit sensor. Then a completion stroke can be identified as being made with the number of additional digits. A user interface signal to can be sent to the computing application based on the number of additional digits used in the completion touch stroke. In another configuration of the technology, the touch stroke or gesture may include a single stroke where user interface items can be selected when additional digits are presented at the end of a gesture. Show less

A head-mounted display (HMD) provides an augmented view of advertisements to an HMD wearer. In some embodiments, when an advertisement is within an HMD wearer's field of view, the HMD may augment the HMD wearer's view of the advertisement to provide additional information and/or to personalize the advertisement to the HMD wearer. In other embodiments, when an advertisement is within an HMD wearer's field of view, the HMD may augment the HMD wearer's view of the advertisement to remove the… Show more

A head-mounted display (HMD) provides an augmented view of advertisements to an HMD wearer. In some embodiments, when an advertisement is within an HMD wearer's field of view, the HMD may augment the HMD wearer's view of the advertisement to provide additional information and/or to personalize the advertisement to the HMD wearer. In other embodiments, when an advertisement is within an HMD wearer's field of view, the HMD may augment the HMD wearer's view of the advertisement to remove the advertisement from the HMD wearer's view or to replace the content of the advertisement with non-advertising content.

Show less

A method for providing multi-touch input training on a display surface is disclosed. A touch input is detected at one or more regions of the display surface. A visualization of the touch input is displayed at a location of the display surface offset from the touch input. One or more annotations are displayed at a location of the display surface offset from the touch input and proximate to the visualization, where each annotation shows a different legal continuation of the touch input.

A method of controlling a virtual object within a virtual workspace includes recognizing a hand posture of an initial touch gesture directed to a touch-input receptor, and a mode constraint is set based on the hand posture. The mode constraint specifies a constrained parameter of a virtual object that is to be maintained responsive to a subsequent touch gesture. The method further includes recognizing a subsequent touch gesture directed to the touch-input receptor. An unconstrained parameter of… Show more

A method of controlling a virtual object within a virtual workspace includes recognizing a hand posture of an initial touch gesture directed to a touch-input receptor, and a mode constraint is set based on the hand posture. The mode constraint specifies a constrained parameter of a virtual object that is to be maintained responsive to a subsequent touch gesture. The method further includes recognizing a subsequent touch gesture directed to the touch-input receptor. An unconstrained parameter of the virtual object is modulated responsive to the subsequent touch gesture while the constrained parameter of the virtual object is maintained in accordance with the mode constraint. Show less

Embodiments are disclosed herein that relate to multi-modal interaction on a computing device comprising a multi-touch display. One disclosed embodiment comprises a method of multi-modal interaction including recognizing a hand posture of a user's first hand directed at the display and displaying a modal region based on the hand posture, wherein the modal region defines an area on the display. The method further includes receiving an input selecting a mode to be applied to the modal region… Show more

Embodiments are disclosed herein that relate to multi-modal interaction on a computing device comprising a multi-touch display. One disclosed embodiment comprises a method of multi-modal interaction including recognizing a hand posture of a user's first hand directed at the display and displaying a modal region based on the hand posture, wherein the modal region defines an area on the display. The method further includes receiving an input selecting a mode to be applied to the modal region, wherein the mode indicates functionalities to be associated with the modal region and defines a mapping of touch gestures to actions associated with the mode. The method further includes, while the modal region remains displayed, recognizing a touch gesture from a user's second hand directed at the display within the modal region and performing an action on the display based upon a mapping of the touch gesture. Show less

The provision of visual responses to touch inputs is disclosed. For example, one disclosed embodiment provides a computing device comprising a touch-sensitive display, a processor in operative communication with the touch-sensitive display, and memory comprising instructions stored thereon that are executable by the processor to detect a touch input made via the touch-sensitive display, display on the touch-sensitive display a first visual response to the touch input indicating that the touch… Show more

The provision of visual responses to touch inputs is disclosed. For example, one disclosed embodiment provides a computing device comprising a touch-sensitive display, a processor in operative communication with the touch-sensitive display, and memory comprising instructions stored thereon that are executable by the processor to detect a touch input made via the touch-sensitive display, display on the touch-sensitive display a first visual response to the touch input indicating that the touch input was detected by the computing device, and if the touch input is made in a touch-interactive area on the touch-sensitive display, then to display a second visual response to the touch input indicating that the touch was made in the touch-interactive area of the display. Show less

An interactive display system with a contact geometry interface is disclosed. The interactive display system may include a multi-touch display, a touch detection system configured to detect a touch input on the multi-touch display and to generate contact geometry for a contact region of the touch input, and an application programming interface executed on a processor of the interactive display system. The application programming interface may be configured to receive the contact geometry and to… Show more

An interactive display system with a contact geometry interface is disclosed. The interactive display system may include a multi-touch display, a touch detection system configured to detect a touch input on the multi-touch display and to generate contact geometry for a contact region of the touch input, and an application programming interface executed on a processor of the interactive display system. The application programming interface may be configured to receive the contact geometry and to send the contact geometry to a requesting application program for application-level processing. Further, the application programming interface may be configured to receive from the application program a display command based on the application level-processing. The application programming interface may be configured to send the display command to the multi-touch display to adjust a display of a graphical element on the multi-touch display. Show less

A computing system for displaying a GUI element on a natural user interface is described herein. The computing system includes a display configured to display a natural user interface of a program executed on the computing system, and a gesture sensor configured to detect a gesture input directed at the natural user interface by a user. The computing system also includes a processor configured to execute a gesture-recognizing module for recognizing a registration phase, an operation phase, and… Show more

A computing system for displaying a GUI element on a natural user interface is described herein. The computing system includes a display configured to display a natural user interface of a program executed on the computing system, and a gesture sensor configured to detect a gesture input directed at the natural user interface by a user. The computing system also includes a processor configured to execute a gesture-recognizing module for recognizing a registration phase, an operation phase, and a termination phase of the gesture input, and a gesture assist module configured to first display a GUI element overlaid upon the natural user interface in response to recognition of the registration phase. The GUI element includes a visual or audio operation cue to prompt the user to carry out the operation phase of the gesture input, and a selector manipulatable by the user via the operation phase of the gesture. Show less

A system and method for entering data on a portable device includes determining a tilt state (tilt sensor 304) as a button (keypad 306) is being pressed. The determined tilt state can be used to disambiguate from among a plurality of characters associated with the pressed button. In a preferred embodiment, the portable device is a mobile phone and the button is part of a standard 12-button keypad.

A system and method are disclosed for using a touch sensing system capable of sensing location of a finger or object above a touch surface to inform a touch response system in an electronic device of a predicted future user input event or motion data in advance of an actual touch event. Current user input is sensed via the touch sensing system and data reflecting hover information is created. A model of user interaction with a touch surface is applied to the data representative of the user… Show more

A system and method are disclosed for using a touch sensing system capable of sensing location of a finger or object above a touch surface to inform a touch response system in an electronic device of a predicted future user input event or motion data in advance of an actual touch event. Current user input is sensed via the touch sensing system and data reflecting hover information is created. A model of user interaction with a touch surface is applied to the data representative of the user input to create data reflecting a prediction of a future user input event. In an embodiment, prior to occurrence of the predicted user input event, a predicted location and a predicted time at which the predicted future user input event will occur are provided to a touch response system. Show less