What is a touch screen tablet?

Input and output device

A user operating a touchscreen

A touchscreen or touch screen is the assembly of both an input ('touch panel') and output ('display') device. The touch panel is normally layered on the top of an electronic visual display of an electronic device.

The display is often an LCD, AMOLED or OLED display.

A user can give input or control the information processing system through simple or multi-touch gestures by touching the screen with a special stylus or one or more fingers.[1] Some touchscreens use ordinary or specially coated gloves to work, while others may only work using a special stylus or pen. The user can use the touchscreen to react to what is displayed and, if the software allows, to control how it is displayed; for example, zooming to increase the text size.

The touchscreen enables the user to interact directly with what is displayed, rather than using a mouse, touchpad, or other such devices (other than a stylus, which is optional for most modern touchscreens).[2]

Touchscreens are common in devices such as smartphones, handheld game consoles, personal computers, electronic voting machines, automated teller machines and point-of-sale (POS) systems. They can also be attached to computers or, as terminals, to networks. They play a prominent role in the design of digital appliances such as personal digital assistants (PDAs) and some e-readers. Touchscreens are also important in educational settings such as classrooms or on college campuses.[3]

The popularity of smartphones, tablets, and many types of information appliances is driving the demand and acceptance of common touchscreens for portable and functional electronics. Touchscreens are found in the medical field, heavy industry, automated teller machines (ATMs), and kiosks such as museum displays or room automation, where keyboard and mouse systems do not allow a suitably intuitive, rapid, or accurate interaction by the user with the display's content.

Historically, the touchscreen sensor and its accompanying controller-based firmware have been made available by a wide array of after-market system integrators, and not by display, chip, or motherboard manufacturers. Display manufacturers and chip manufacturers have acknowledged the trend toward acceptance of touchscreens as a user interface component and have begun to integrate touchscreens into the fundamental design of their products.

History

[

edit

]

One predecessor of the modern touchscreen includes stylus based systems.

1946 DIRECT LIGHT PEN - A patent was filed by Philco Company for a stylus designed for sports telecasting which, when placed against an intermediate cathode ray tube display (CRT) would amplify and add to the original signal. Effectively, this was used for temporarily drawing arrows or circles onto a live television broadcast, as described in US 2487641A, Denk, William E, "Electronic pointer for television images", issued 1949-11-08 .

1962 OPTICAL - The first version of a touchscreen which operated independently of the light produced from the screen was patented by AT&T Corporation US 3016421A, Harmon, Leon D, "Electrographic transmitter", issued 1962-01-09 . This touchscreen utilized a matrix of collimated lights shining orthogonally across the touch surface. When a beam is interrupted by a stylus, the photodetectors which no longer are receiving a signal can be used to determine where the interruption is. Later iterations of matrix based touchscreens built upon this by adding more emitters and detectors to improve resolution, pulsing emitters to improve optical signal to noise ratio, and a nonorthogonal matrix to remove shadow readings when using multi-touch.

1963 INDIRECT LIGHT PEN - Later inventions built upon this system to free telewriting styli from their mechanical bindings. By transcribing what a user draws onto a computer, it could be saved for future use. See US 3089918A, Graham, Robert E, "Telewriting apparatus", issued 1963-05-14 .

1965 CAPACITANCE AND RESISTANCE - The first finger driven touchscreen was developed by Eric Johnson, of the Royal Radar Establishment located in Malvern, England, who described his work on capacitive touchscreens in a short article published in 1965[8][9] and then more fully—with photographs and diagrams—in an article published in 1967.[10]

MID-60s ULTRASONIC CURTAIN - Another precursor of touchscreens, an ultrasonic-curtain-based pointing device in front of a terminal display, had been developed by a team around Rainer Mallebrein [de] at Telefunken Konstanz for an air traffic control system.[11] In 1970, this evolved into a device named "Touchinput-Einrichtung" ("touch input facility") for the SIG 50 terminal utilizing a conductively coated glass screen in front of the display.[12][11] This was patented in 1971 and the patent was granted a couple of years later.[12][11] The same team had already invented and marketed the Rollkugel mouse RKS 100-86 for the SIG 100-86 a couple of years earlier.[12]

1968 CAPACITANCE - The application of touch technology for air traffic control was described in an article published in 1968.[13] Frank Beck and Bent Stumpe, engineers from CERN (European Organization for Nuclear Research), developed a transparent touchscreen in the early 1970s,[14] based on Stumpe's work at a television factory in the early 1960s. Then manufactured by CERN, and shortly after by industry partners,[15] it was put to use in 1973.[16]

1972 OPTICAL - A group at the University of Illinois filed for a patent on an optical touchscreen[17] that became a standard part of the Magnavox Plato IV Student Terminal and thousands were built for this purpose. These touchscreens had a crossed array of 16×16 infrared position sensors, each composed of an LED on one edge of the screen and a matched phototransistor on the other edge, all mounted in front of a monochrome plasma display panel. This arrangement could sense any fingertip-sized opaque object in close proximity to the screen.

1973 MULTI-TOUCH CAPACITANCE - In 1973, Beck and Stumpe published another article describing their capacitive touchscreen. This indicated that it was capable of multi-touch but this feature was purposely inhibited, presumably as this was not considered useful at the time ("A...variable...called BUT changes value from zero to five when a button is touched. The touching of other buttons would give other non-zero values of BUT but this is protected against by software" (Page 6, section 2.6).[18] "Actual contact between a finger and the capacitor is prevented by a thin sheet of plastic" (Page 3, section 2.3). At that time Projected capacitance had not yet been invented.

1977 RESISTIVE - An American company, Elographics – in partnership with Siemens – began work on developing a transparent implementation of an existing opaque touchpad technology, U.S. patent No. 3,911,215, October 7, 1975, which had been developed by Elographics' founder George Samuel Hurst.[19] The resulting resistive technology touch screen was first shown on the World's Fair at Knoxville in 1982.[20]

1982 MULTI-TOUCH CAMERA - Multi-touch technology began in 1982, when the University of Toronto's Input Research Group developed the first human-input multi-touch system, using a frosted-glass panel with a camera placed behind the glass.

1983 OPTICAL - An optical touchscreen was used on the HP-150 starting in 1983. The HP 150 was one of the world's earliest commercial touchscreen computers.[21] HP mounted their infrared transmitters and receivers around the bezel of a 9-inch Sony cathode ray tube (CRT).

Track layout for projected capacitance keypad or touchscreen for operation through thick glass.

UP TO 1984 CAPACITANCE - Although, as cited earlier, Johnson is credited with developing the first finger operated capacitive and resistive touchscreens in 1965, these worked by directly touching wires across the front of the screen.[9] Stumpe and Beck developed a Self capacitance touchscreen in 1972, and a mutual capacitance touchscreen in 1977. Both these devices could only sense the finger by direct touch or through a thin insulating film.[22] This was 11 microns thick according to Stumpe's 1977 report.[23]

1984 FIRST PROJECTED CAPACITANCE TOUCHSCREEN - A capacitance keypad and touchscreen, capable of multi-touch, was invented[24] that could "project" this touch sensing ability through several centimeters of air and other non-conductive materials, enabling the accurate detection of fingers through very thick glass and even double-glazing (see keypad for image).[25] The massively increased functionality was due to much greater processing power being available 10 years on, and the use of a simple form of artificial intelligence (see Patent Claim1). An Acorn BBC Computer was initially used to process the data. This technique later became known as projected capacitance.

Projected capacitance uses a simple form of artificial intelligence to measure the changes in capacitance caused by one particular variable (or group of variables) by specifically profiling the effects expected for that variable and eliminating any measured capacitance changes attributable to other global and/or local events.[26]

Instead of a keypad, the device could be used as a continuous x/y sensing area (see Claim 9). A transparent version was usable as a projected capacitance touchscreen (see Claim 10), but it was limited in size due to the high resistance of the narrow, transparent Indium Tin Oxide tracks (numbered 96 in the image) used to link all sensing zones (80,82,84,86,88,90) independently to a common edge.

1984 TOUCHPAD - Fujitsu released a touch pad for the Micro 16 to accommodate the complexity of kanji characters, which were stored as tiled graphics.[27]

1984 MULTI-TOUCH CAPACITANCE - Bob Boie, of Bell Labs, is often cited in "Histories of touchscreen technology", with developing in 1984 the first multi-touch capacitive touchscreen for operation through a thin CRT overlay,[28][29][30] but it was never patented by Boie.[31] Many of these citations rely on anecdotal evidence from Bill Buxton of Bell Labs.[32] However, Bill Buxton did not have much luck getting his hands on this technology. As he states in the citation: "Our assumption (false, as it turned out) was that the Boie technology would become available to us in the near future. Around 1990 I took a group from Xerox to see this technology it since I felt that it would be appropriate for the user interface of our large document processors. This did not work out". Intriguingly, in 1993, Bob Boie patented a much less ambitious, but similar technology - a mouse / keypad (not a transparent touchscreen) that capacitively sensed just one finger through a thin insulator. This did not use projected capacitance.[33]

1986 GRAPHIC TABLET - A graphic touch tablet was released for the Sega AI computer.[34][35]

EARLY 80s EVALUATION FOR AIRCRAFT - Touch-sensitive control-display units (CDUs) were evaluated for commercial aircraft flight decks in the early 1980s. Initial research showed that a touch interface would reduce pilot workload as the crew could then select waypoints, functions and actions, rather than be "head down" typing latitudes, longitudes, and waypoint codes on a keyboard. An effective integration of this technology was aimed at helping flight crews maintain a high level of situational awareness of all major aspects of the vehicle operations including the flight path, the functioning of various aircraft systems, and moment-to-moment human interactions.[36]

EARLY 80s EVALUATATION FOR CARS - also, in the early 1980s, General Motors tasked its Delco Electronics division with a project aimed at replacing an automobile's non-essential functions (i.e. other than throttle, transmission, braking, and steering) from mechanical or electro-mechanical systems with solid state alternatives wherever possible. The finished device was dubbed the ECC for "Electronic Control Center", a digital computer and software control system hardwired to various peripheral sensors, servos, solenoids, antenna and a monochrome CRT touchscreen that functioned both as display and sole method of input.[37] The ECC replaced the traditional mechanical stereo, fan, heater and air conditioner controls and displays, and was capable of providing very detailed and specific information about the vehicle's cumulative and current operating status in real time. The ECC was standard equipment on the 1985–1989 Buick Riviera and later the 1988–1989 Buick Reatta, but was unpopular with consumers—partly due to the technophobia of some traditional Buick customers, but mostly because of costly technical problems suffered by the ECC's touchscreen which would render climate control or stereo operation impossible.[38]

1985 GRAPHIC TABLET - Sega released the Terebi Oekaki, also known as the Sega Graphic Board, for the SG-1000 video game console and SC-3000 home computer. It consisted of a plastic pen and a plastic board with a transparent window where pen presses are detected. It was used primarily with a drawing software application.[39]

1985 MULTI-TOUCH CAPACITANCE - The University of Toronto group, including Bill Buxton, developed a multi-touch tablet that used capacitance rather than bulky camera-based optical sensing systems (see History of multi-touch).

1985 USED FOR POINT OF SALE - The first commercially available graphical point-of-sale (POS) software was demonstrated on the 16-bit Atari 520ST color computer. It featured a color touchscreen widget-driven interface.[40] The ViewTouch[41] POS software was first shown by its developer, Gene Mosher, at the Atari Computer demonstration area of the Fall COMDEX expo in 1986.[42]

Transparent projected capacitance keypad used as a touchscreen.

1987 PROJECTED CAPACITANCE - A large projected capacitance touchscreen was developed for sensing fingers through very thick glass and double-glazing. This enabled touchscreens to be operated through shop windows.[43] The resistance of the transparent Indium Tin Oxide used was not a problem as the 16 touch sensing zones were connected directly to the four edges of the touchscreen (see image), thereby avoiding the necessity for narrow tracks linking each sensing zone to just one edge. An order was placed for $0.7M worth of these touchscreens for use in a US hotel chain.[44]

1987 CAPACITANCE TOUCH KEYS - Casio launched the Casio PB-1000 pocket computer with a touchscreen consisting of a 4×4 matrix, resulting in 16 touch areas in its small LCD graphic screen.

1988 SELECT ON "LIFT-OFF" - Touchscreens had a bad reputation of being imprecise until 1988. Most user-interface books would state that touchscreen selections were limited to targets larger than the average finger. At the time, selections were done in such a way that a target was selected as soon as the finger came over it, and the corresponding action was performed immediately. Errors were common, due to parallax or calibration problems, leading to user frustration. "Lift-off strategy"[45] was introduced by researchers at the University of Maryland Human–Computer Interaction Lab (HCIL). As users touch the screen, feedback is provided as to what will be selected: users can adjust the position of the finger, and the action takes place only when the finger is lifted off the screen. This allowed the selection of small targets, down to a single pixel on a 640×480 Video Graphics Array (VGA) screen (a standard of that time).

1990 SINGLE AND MULTI-TOUCH GESTURES - Sears et al. (1990)[46] gave a review of academic research on single and multi-touch human–computer interaction of the time, describing gestures such as rotating knobs, adjusting sliders, and swiping the screen to activate a switch (or a U-shaped gesture for a toggle switch). The HCIL team developed and studied small touchscreen keyboards (including a study that showed users could type at 25 wpm on a touchscreen keyboard), aiding their introduction on mobile devices. They also designed and implemented multi-touch gestures such as selecting a range of a line, connecting objects, and a "tap-click" gesture to select while maintaining location with another finger.

1990 TOUCHSCREEN SLIDER AND TOGGLE SWITCHES - HCIL demonstrated a touchscreen slider,[47] which was later cited as prior art in the lock screen patent litigation between Apple and other touchscreen mobile phone vendors (in relation to U.S. Patent 7,657,849).[48]

1991 THE FIRST PROJECTED CAPACITANCE PATENT IS GRANTED - The 1984 projected capacitance patent application is granted to Binstead Designs of Nottingham, England.[49]

1991 INERTIAL CONTROL - From 1991 to 1992, the Sun Star7 prototype PDA implemented a touchscreen with inertial scrolling.[50]

1993 FIRST RESISTIVE TOUCHSCREEN PHONE - IBM released the IBM Simon, which is the first touchscreen phone.

EARLY 90s ABANDONED GAME CONTROLLER - An early attempt at a handheld game console with touchscreen controls was Sega's intended successor to the Game Gear, though the device was ultimately shelved and never released due to the expensive cost of touchscreen technology in the early 1990s.

16 I/O multiple input proximity detector and keypad.

1994 FIRST X/Y PROJECTED CAPACITANCE TOUCHSCREEN - An x/y multiplexed, projected capacitance, multiple input proximity detector and touchpad / touchscreen, was invented. This was capable of multi-touch and could accurately and reliably sense fingers through thick plastic and glass overlays.[51] Together with the inventors earlier patent, [52] this was very similar to an Apple patent taken out 10 years later in 2004.[53]

8 x 8 projected capacitance touchscreen manufactured using 25 micron insulation coated copper wire embedded in a clear polyester film.

1994 FIRST WIRE BASED PROJECTED CAPACITANCE - Stumpe and Beck's touchscreens (1972/1977 - already cited), used opaque conductive copper tracks that obscured about 50% of the screen (80 micron track / 80 micron space). The advent of projected capacitance in 1984, however, with its improved sensing capability, indicated that most of these tracks could be eliminated. This proved to be so, and led to the invention of a wire based touchscreen in 1994, where one 25 micron diameter, insulation coated wire replaced about 30 of these 80 micron wide tracks, and could also accurately sense fingers through thick glass. Screen masking, caused by the copper, was reduced from 50% to less than 0.5%.

The use of fine wire meant that very large touchscreens, several meters wide, could be plotted onto a thin polyester support film with a simple x/y pen plotter,[54] eliminating the need for expensive and complicated sputter coating, laser ablation, screen printing or etching. The resulting, incredibly flexible, touchscreen film, less than 100 microns thick, could be attached by static or non-setting weak adhesive to one side of a sheet of glass, for sensing through that glass.[55] Early versions of this device were controlled by the PIC16C54 microchip.

1994 FIRST PUB GAME WITH TOUCHSCREEN - Appearing in pubs in 1994, JPM's Monopoly SWP (skill with prizes) was the first machine to use touch screen technology instead of buttons (see Quiz_machine / History). It used a 14 inch version of this newly invented wire based projected capacitance touchscreen and had 64 sensing areas - the wiring pattern being similar to that shown in the lower diagram. The zig-zag pattern was introduced to minimize visual reflections and prevent Moire interference between the wires and the monitor line scans. About 600 of these were sold for this purpose, retailing at £50 apiece, which was very cheap for the time.[56] Working through very thick glass made it ideal for operation in a "hostile" environment, such as a pub. Although reflected light from the copper wires was noticeable under certain lighting conditions, this problem was eliminated by using tinted glass. The reflection issue was later resolved by using finer (10 micron diameter), dark coated wires. Throughout the following decade JPM continued to use touchscreens for many other games such as "Cluedo" and "Who wants to be a Millionaire".[57]

1998 PROJECTED CAPACITANCE LICENSES - This technology was licensed four years later to Romag Glass Products - later to become Zytronic Displays, and Visual Planet in 2003 (see page 4).[58]

2004 MOBILE MULTI-TOUCH PROJECTED CAPACITANCE PATENT - Apple patents its multi-touch capacitive touchscreen for mobile devices.[59]

2004 VIDEO GAMES WITH TOUCHSCREENS - Touchscreens were not be popularly used for video games until the release of the Nintendo DS in 2004.[60]

2007 MOBILE PHONE WITH CAPACITANCE - The first mobile phone with a capacitive touchscreen was LG Prada, released in May 2007 (which was before the first iPhone released).[61] By 2009, touchscreen-enabled mobile phones were becoming trendy and quickly gaining popularity in both basic and advanced devices.[62][63] In Quarter-4 2009 for the first time, a majority of smartphones (i.e. not all mobile phones) shipped with touchscreens over non-touch.[64]

2013 RESISTIVE VERSUS PROJECTED CAPACITANCE SALES - In 2007, 93% of touchscreens shipped were resistive and only 4% were projected capacitance. In 2013, 3% of touchscreens shipped were resistive and 96% were projected capacitance (see page 5).[65]

2015 FORCE SENSING TOUCHSCREENS - Until recently,[when?] most consumer touchscreens could only sense one point of contact at a time, and few have had the capability to sense how hard one is touching. This has changed with the commercialization of multi-touch technology, and the Apple Watch being released with a force-sensitive display in April 2015.

16 I/O diagonal touchscreen made with 10 micron diameter insulation coated wire. Diagonal wiring allows touchscreen width to be increased indefinitely without increasing electrode resistance.

2015 DIAGONALLY "WIRED" PROJECTED CAPACITANCE - A new diagonal "wiring" arrangement was invented for multiplexed resistive and multi-touch projected capacitance touchscreens, whereby all the I/O sensing elements came from just one edge, there being no "dead zone" round the other three edges (see top image on right). Touch resolution was almost doubled compared to x/y multiplexing, 16 x/y I/Os creating a maximum of 64 sensing element intersections, whereas 16 diagonal I/Os create 120 intersections.[66][67]

2015 BISTATE PROJECTED CAPACITANCE - Diagonal wiring sometimes required two alternating states (bistate) from the I/O lines. When used as a projected capacitance touchscreen, in self-capacitance mode, all the I/O lines were in one of two states, being either sensing inputs or turned off. When used in mutual capacitance mode, however, one I/O line at a time was an output and the remainder were inputs, but each input had to be capable of becoming an output once every scan. The touchscreen I/O lines, therefore, changed from input to output, or vice versa, many times a second. This bistate requirement could be avoided by deploying a separate "one of n counter", a multiplexor, or a shift register, in parallel with the n I/O lines. This allowed the I/O lines to remain permanently as inputs. Tristate multiplexing was required for some resistive touchscreens. This design won an Electronics Weekly Elektra Award in 2017.[68]

2021 "INFINITELY WIDE" PROJECTED CAPACITANCE - A diagonally wired touchscreen, of unrestricted width, was invented. This was due to the sensing elements never exceeding 1.414 times the height of the touchscreen ⌈ H 2 ⌋ {\textstyle \left\lceil H{\sqrt {2}}\right\rfloor } , no matter how wide.[69] This was reduced to 1.12 times the height of the touchscreen ⌈ H 1.25 ⌋ {\textstyle \left\lceil H{\sqrt {1.25}}\right\rfloor } , if the sensing elements intersected at 60 degrees instead of 90 degrees. The touchscreen could be controlled by a single processor, or the two ends could be controlled totally independently by different processors if linked by a synchronizing processor in the overlapping middle section. The number of unique intersections was increased by many of the sensing elements being split in two - as shown in the diagram.

Technologies

[

edit

]

There is a variety of touchscreen technologies with different methods of sensing touch.[46]

Resistive

[

edit

]

A resistive touchscreen panel comprises several thin layers, the most important of which are two transparent electrically resistive layers facing each other with a thin gap between. The top layer (that which is touched) has a coating on the underside surface; just beneath it is a similar resistive layer on top of its substrate. One layer has conductive connections along its sides, the other along top and bottom. A voltage is applied to one layer and sensed by the other. When an object, such as a fingertip or stylus tip, presses down onto the outer surface, the two layers touch to become connected at that point.[70] The panel then behaves as a pair of voltage dividers, one axis at a time. By rapidly switching between each layer, the position of pressure on the screen can be detected.

Resistive touch is used in restaurants, factories and hospitals due to its high tolerance for liquids and contaminants. A major benefit of resistive-touch technology is its low cost. Additionally, as only sufficient pressure is necessary for the touch to be sensed, they may be used with gloves on, or by using anything rigid as a finger substitute. Disadvantages include the need to press down, and a risk of damage by sharp objects. Resistive touchscreens also suffer from poorer contrast, due to having additional reflections (i.e. glare) from the layers of material placed over the screen.[71] This type of touchscreen has been used by Nintendo in the DS family, the 3DS family, and the Wii U GamePad.[72]

For the same number of inputs, tri-state multiplexed touchscreens have many more intersections than x/y multiplexed touchscreens.

Due to their simple structure, with very few inputs, resistive touchscreens are mainly used for single touch operation, although some two touch versions (often described as multi-touch) are available. [73] [74] There are, however, some true multi-touch resistive touchscreens available. These need many more inputs, and rely on x/y multiplexing to keep the I/O count down.

One example of a true multi-touch resistive touchscreen,[75] can detect 10 fingers at the same time. This has 80 I/O connections. These are possibly split 34 x inputs / 46 y outputs, forming a standard 3:4 aspect ratio touchscreen with 1564 x/y intersecting touch sensing nodes.

Tri-state multiplexing could have been used instead of x/y multiplexing. This would have reduced the I/O count from 80 to 60 while creating 1770 unique touch sensing nodes, with no need for a bezel, and with all inputs coming from just one edge. [76]

Surface acoustic wave

[

edit

]

Surface acoustic wave (SAW) technology uses ultrasonic waves that pass over the touchscreen panel. When the panel is touched, a portion of the wave is absorbed. The change in ultrasonic waves is processed by the controller to determine the position of the touch event. Surface acoustic wave touchscreen panels can be damaged by outside elements. Contaminants on the surface can also interfere with the functionality of the touchscreen.

SAW devices have a wide range of applications, including delay lines, filters, correlators and DC to DC converters.

Capacitive touchscreen

[

edit

]

Capacitive touchscreen of a mobile phone The Casio TC500 Capacitive touch sensor watch from 1983, with angled light exposing the touch sensor pads and traces etched onto the top watch glass surface.

A capacitive touchscreen panel consists of an insulator, such as glass, coated with a transparent conductor, such as indium tin oxide (ITO).[77] As the human body is also an electrical conductor, touching the surface of the screen results in a distortion of the screen's electrostatic field, measurable as a change in capacitance. Different technologies may be used to determine the location of the touch. The location is then sent to the controller for processing. Some touchscreens use silver instead of ITO, as ITO causes several environmental problems due to the use of indium.[78][79][80][81] The controller is typically a complementary metal–oxide–semiconductor (CMOS) application-specific integrated circuit (ASIC) chip, which in turn usually sends the signals to a CMOS digital signal processor (DSP) for processing.[82][83]

Unlike a resistive touchscreen, some capacitive touchscreens cannot be used to detect a finger through electrically insulating material, such as gloves. This disadvantage especially affects usability in consumer electronics, such as touch tablet PCs and capacitive smartphones in cold weather when people may be wearing gloves. It can be overcome with a special capacitive stylus, or a special-application glove with an embroidered patch of conductive thread allowing electrical contact with the user's fingertip.

A low-quality switching-mode power supply unit with an accordingly unstable, noisy voltage may temporarily interfere with the precision, accuracy and sensitivity of capacitive touch screens.[84][85][86]

Some capacitive display manufacturers continue to develop thinner and more accurate touchscreens. Those for mobile devices are now being produced with 'in-cell' technology, such as in Samsung's Super AMOLED screens, that eliminates a layer by building the capacitors inside the display itself. This type of touchscreen reduces the visible distance between the user's finger and what the user is touching on the screen, reducing the thickness and weight of the display, which is desirable in smartphones.

A simple parallel-plate capacitor has two conductors separated by a dielectric layer. Most of the energy in this system is concentrated directly between the plates. Some of the energy spills over into the area outside the plates, and the electric field lines associated with this effect are called fringing fields. Part of the challenge of making a practical capacitive sensor is to design a set of printed circuit traces which direct fringing fields into an active sensing area accessible to a user. A parallel-plate capacitor is not a good choice for such a sensor pattern. Placing a finger near fringing electric fields adds conductive surface area to the capacitive system. The additional charge storage capacity added by the finger is known as finger capacitance, or CF. The capacitance of the sensor without a finger present is known as parasitic capacitance, or CP.

Surface capacitance

[

edit

]

In this basic technology, only one side of the insulator is coated with a conductive layer. A small voltage is applied to the layer, resulting in a uniform electrostatic field. When a conductor, such as a human finger, touches the uncoated surface, a capacitor is dynamically formed. The sensor's controller can determine the location of the touch indirectly from the change in the capacitance as measured from the four corners of the panel. As it has no moving parts, it is moderately durable but has limited resolution, is prone to false signals from parasitic capacitive coupling, and needs calibration during manufacture. It is therefore most often used in simple applications such as industrial controls and kiosks.[87]

Although some standard capacitance detection methods are projective, in the sense that they can be used to detect a finger through a non-conductive surface, they are very sensitive to fluctuations in temperature, which expand or contract the sensing plates, causing fluctuations in the capacitance of these plates.[88] These fluctuations result in a lot of background noise, so a strong finger signal is required for accurate detection. This limits applications to those where the finger directly touches the sensing element or is sensed through a relatively thin non-conductive surface.

Projected capacitance

[

edit

]

Back side of a Multitouch Globe, based on projected capacitive touch (PCT) technology Schema of projected-capacitive touchscreen

Projected capacitive touch (PCT; also PCAP) technology is a variant of capacitive touch technology but where sensitivity to touch, accuracy, resolution and speed of touch have been greatly improved by the use of a simple form of artificial intelligence. This intelligent processing enables finger sensing to be projected, accurately and reliably, through very thick glass and even double glazing.[89]

DEFINITION OF PROJECTED CAPACITANCE - Projected capacitance is a method for accurately detecting and tracking a particular variable, or group of variables (such as finger(s)), by: a) using a simple form of artificial intelligence to develop a profile of the capacitance changing effects expected for that variable, b) specifically looking for such changes, and c) eliminating measured capacitance changes that do not match this profile, attributable to global variables (such as temperature/humidity, dirt build-up, electrical noise), and local variables (such as rain drops, partial shade and hands/elbows). Capacitance sensors may be discrete - possibly (but not necessarily) in a regular array, or they may be multiplexed.[90]

Assumptions.

In practice, various assumptions are made, such as: - a) fingers will not be touching the screen at "power-up", b) a finger will not be on the same spot for more than a fixed period of time, and c) fingers will not be touching everywhere at the same time.

a) If a finger IS touching the screen at "power-up", then, as soon as it is removed a large "anti-touch" capacitance change will be detected. This signals to the processor to reset the touch thresholds and store new "no touch" values for each input.

b) Long-term drift compensation is used to gradually raise or lower these thresholds (trending eventually to "no-touch"). This compensates for global changes in temperature and humidity. It also eliminates the possibility of any position appearing to be touched for too long, due to some "non-finger" event. This might be caused, for example, by a wet leaf landing on, and sticking to the screen.

c) When a decision is to be made about the validity of one or more touches, then, assumption c) means that the average value, of changes measured for some of the inputs with the smallest change, can be used to "offset" the touch thresholds of the inputs in contention. This minimizes the influence of hands and arms.

By these and other means, the processor is constantly fine tuning the touch thresholds, and tweaking the touch sensitivity of each input. This enables very small changes, caused only by fingers, to be accurately detected through thick overlays, or several centimeters of air.[91]

When a conductive object, such as a finger, comes into contact with a PCT panel, it distorts the local electrostatic field at that point. This is measurable as a change in capacitance. If a finger bridges the gap between two of the "tracks", the charge field is further interrupted and detected by the controller. The capacitance can be changed and measured at every individual point on the grid. This system is able to accurately track touches.[92]

Due to the top layer of a PCT being glass, it is sturdier than less-expensive resistive touch technology. Unlike traditional capacitive touch technology, it is possible for a PCT system to sense a passive stylus or gloved fingers.

Moisture on the surface of the panel, high humidity, or collected dust are not a problem, especially with 'fine wire' based touchscreens due to the fact that wire based touchscreens have a very low 'parasitic' capacitance, and there is a greater distance between neighboring conductors. Projected capacitance has "long term drift compensation" built in. This minimizes the effects of slowly changing environmental factors, such as the build-up of dirt and effects caused by changes in the weather.[93] Drops of rain have little effect, but flowing water, and especially flowing sea water (due to its electrical conductivity), can cause short term issues.

A high frequency (RF) signal, possibly from 100kHz to 1 MHz, is imposed on one track at a time, and appropriate capacitance measurements are taken ( as described later in this article). [94] This process is repeated until all the tracks have been sampled.

Conductive tracks are often transparent, one example being Indium tin oxide (ITO), a transparent electrical conductor, but these conductive tracks can be made of very fine, non-transparent metal mesh[95] or individual fine wires.[96]

Projected capacitance touchscreen layout.

[

edit

]

This diagram shows how eight inputs to a lattice touchscreen or keypad creates 28 unique intersections, as opposed to 16 intersections created using a standard x/y multiplexed touchscreen. 16 I/O diagonal touchscreen made with 10 micron diameter insulation coated wire.

32 input diagonally wired touchscreen 8 x 8 projected capacitance touchscreen manufactured using 25 micron insulation coated copper wire embedded in a clear polyester film.

Layout can vary depending on whether a single finger is to be detected or multiple fingers.

In order to detect many fingers at the same time, some modern PCT touch screens are composed of thousands of discrete keys,[97] each key being linked individually to the edge of the touch screen. This is enabled by etching an electrode grid pattern in a transparent conductive coating on one side of a sheet of glass or plastic.

To reduce the number of input tracks, most PCT touch screens use multiplexing. This enables, for example, 100 (n) discrete key inputs to be reduced to 20 ⌈ 2 n ⌋ {\textstyle \left\lceil 2{\sqrt {n}}\right\rfloor } when using x/y multiplexing, or 15 ⌈ 1.5 n ⌋ {\textstyle \left\lceil 1.5{\sqrt {n}}\right\rfloor } if using bistate multiplexing or tri-state multiplexing.

Capacitance multiplexing requires a grid of intersecting, but electrically isolated conductive tracks. This can be achieved in many different ways. One way is by creating parallel conductive tracks on one side of a plastic film, and similar parallel tracks on the other side, orientated at 90 degrees to the first side. [98] [99]

Another way is to etch tracks on separate sheets of glass, and join these sheets, with tracks at right angles to each other, face to face using a thin non-conductive, adhesive interlayer.[100]

A simple alternative is to embed an x/y or diagonal grid of very fine, insulation coated conductive wires in a thin polyester film. This film can then be attached to one side of a sheet of glass, for operation through the glass.[101]

Touch resolution and the number of fingers that can be detected simultaneously is determined by the number of cross-over points (x * y). If x + y = n, then the maximum possible number of cross-overs is (n/2)2. However, the number of cross-over points can be almost doubled by using a diagonal lattice layout ( see Lattice/diagonal touchscreen diagrams ) where, instead of x elements only ever crossing y elements, each conductive element crosses every other element. Under these circumstances the maximum number of cross-overs is (n2-n)/2. [102] All the connector inputs come from just one edge.

See video (above) of raw data from 32 input diagonally wired touchscreen.

Diagonal touchscreen arrays

[

edit

]

Folding (n) conductors over themselves forms a triangular array of (n^2 − n)/2 unique intersections. Double folding 6 (n) parallel conductors over each other forms a square array, in the central region, composed of 15 ((n2 − n) / 2) unique intersections.

The diagram (left) shows how a group of 6 parallel conductive elements, folded back on themselves (at right angles), can create a triangular array of 15 unique intersections. An x/y array (with 6 conductive elements), would have created a maximum of 9 unique intersections.

Although conductive elements are normally connected to a terminal point at one end, the diagram shows that these folded elements can be terminated at the fold - forming split elements.

A square/rectangular diagonal array can be formed by double folding the parallel conductors - see diagram on the right. Two connectors could be fitted at the folds, on opposite sides of the array. Alternatively, a single connector can be fitted at one end of the array - as shown in the diagram.

--Cylindrical touchscreens--

Nine conductive elements form a cylindrical multitouch touchscreen with 36 uniquely addressable intersections.

Diagonal sensing elements can also be formed into a seamless cylindrical array. The diagram on the right shows a split, 9 I/O, bi-state cylindrical layout, with 36 unique intersections - all the I/O lines connected to one end of the cylinder (a standard x/y array would require horizontal I/O lines entering the side of the cylinder). Unsplit diagonal sensing elements can also be formed into cylinders, but 9 I/Os would only create 20 (5x4) unique intersections. These cylinders can be physically transformed into complex 3 dimensional shapes, by a range of different methods - such as blow molding, vacuum forming, etc..

A similar layout is possible for a complementary cylindrical LED display. [103]

--Infinitely wide touchscreens--

Diagonal wiring allows touchscreen width to be increased indefinitely without increasing electrode resistance.

Touchscreen width is normally restricted by the resistance of the conductive material used. As the width of an x/y touchscreen is increased, eventually the resistance of the horizontal conductors becomes too great for the touchscreen to work properly. "Infinitely" wide touchscreens are possible, however, when using diagonal wiring, because track lengths are always 1.414 x the height of the touchscreen ⌈ H 2 ⌋ {\textstyle \left\lceil H{\sqrt {2}}\right\rfloor } , and are independent of touchscreen width (see diagram on right).[104]

--- There are two types of PCT: mutual capacitance and self-capacitance ---

Mutual capacitance

[

edit

]

An electrical signal, imposed on one electrical conductor, can be capacitively "sensed" by another electrical conductor that is in very close proximity, but electrically isolated - a feature that is exploited in mutual capacitance touchscreens. In a mutual capacitive sensor array, the "mutual" crossing of one electrical conductor with another electrical conductor, but with no direct electrical contact, forms a capacitor (see touchscreen#Construction).

High frequency voltage pulses are applied to these conductors, one at a time. These pulses capacitively couple to every conductor that intersects it.

Bringing a finger or conductive stylus close to the surface of the sensor changes the local electrostatic field, which in turn reduces the capacitance between these intersecting conductors. Any significant change in the strength of the signal sensed is used to determine if a finger is present or not at an intersection.[105]

The capacitance change at every intersection on the grid can be measured to accurately determine one or more touch locations.

Mutual capacitance allows multi-touch operation where multiple fingers, palms or styli can be accurately tracked at the same time.The greater the number of intersections, the better the touch resolution and the more independent fingers that can be detected.[106] [107] This indicates a distinct advantage of diagonal wiring over standard x/y wiring, since diagonal wiring creates nearly twice the number of intersections.

Mutual capacitance arrays can have an x/y format or a diagonal format.

A 30 i/o, 16×14 x/y array, for example, would have 224 of these intersections / capacitors, and a 30 i/o diagonal lattice array could have 435 intersections.

Each trace of an x/y mutual capacitance array only has one function, it is either an input or an output. The horizontal traces may be transmitters while the vertical traces are sensors, or vice versa.

The traces in a diagonal mutual capacitance array, however, have to continuously change their functionality, "on the fly", by a process called bi-state multiplexing or Tri-state multiplexing. Some of the time a trace will be an output, at another time it will be an input or "grounded". A "look-up" table can be used to simplify this process. By slightly distorting the conductors in a "n" I/O diagonal matrix, the equivalent of a (n-1) by (n/2) array is formed. After address decoding, this can then be processed as a standard x/y array.

Self-Capacitance sensors can have the same X/Y or diagonal grid layout [108] as Mutual-Capacitance sensors, but, with Self-Capacitance all the traces usually operate independently, with no interaction between different traces. Along with several other methods, the extra capacitive load of a finger on a trace electrode may be measured by a current meter, or by the change in frequency of an RC oscillator.[109]

Traces are sensed, one after the other until all the traces have been sensed. A finger may be detected anywhere along the whole length of a trace ( even "off-screen" ), but there is no indication where the finger is along that trace. If, however, a finger is also detected along another intersecting trace, then it is assumed that the finger position is at the intersection of the two traces. This allows for the speedy and accurate detection of a single finger.

There is, however, ambiguity if more than one finger is to be detected.[110] Two fingers may have four possible detection positions, only two of which are true, the other two being "ghosts". However, by selectively de-sensitizing any touch-points in contention, conflicting results are easily resolved.[111] This enables "Self Capacitance" to be used for two touch operation.

Although "Mutual-Capacitance" is simpler for multi-touch, multi-touch can be achieved using "Self-Capacitance".

Hand sensed through thick glass, by projected capacitance - using "masked" self capacitance.

If the trace being sensed is intersected by another trace that has a "desensitizing" signal on it, then that intersection is insensitive to touch. By imposing such a "desensitizing" signal on all the intersecting traces, except one, along the trace being sensed, then just a short length of that trace will be sensitive to touch. [111] By selecting a sequence of these sensing sections along the trace, it is possible to determine the accurate position of multiple fingers along the one trace. This process can then be repeated for all the other traces until the whole screen has been scanned.

Self-capacitive touch screen layers are used on mobile phones such as the Sony Xperia Sola,[112] the Samsung Galaxy S4, Galaxy Note 3, Galaxy S5, and Galaxy Alpha.

Self-Capacitance is far more sensitive than Mutual-Capacitance and is mainly used for single touch, simple gesturing and proximity sensing where the finger does not even have to touch the glass surface. Mutual-Capacitance is mainly used for multitouch applications. [113] Many touchscreen manufacturers use both Self and Mutual capacitance technologies in the same product, thereby combining their individual benefits. [114]

Self-capacitance vs mutual capacitance

[

edit

]

Self Capacitance creates n^2 possible finger positions when detecting n fingers.

When using a 16 x 14 x/y array to determine the position of a single finger by Self Capacitance, 30 (i.e.16+14) capacitance measurements are required - the finger being determined to be at the intersection of the strongest of the 16 x measurements and the strongest of the 14 y measurements. However, when using Mutual Capacitance, every intersection may have to be measured - making a total of 224 ( i.e. 16x14) capacitance measurements. In this example, therefore, Mutual Capacitance requires nearly 7 times as many measurements as Self Capacitance to detect the position of a finger.

Many applications, such as selecting items from a list or menu , require just one finger, and Self Capacitance is eminently suitable for such applications, due to the relatively low processing load, simpler processing method, the ability to sense through thick dielectric materials or air, and the possibility of reducing the number of inputs required, through repeat track layouts.[115]

For many other applications, however, such as for expanding / contracting items on the screen and for other gestures, two or more fingers need to be tracked.

Two fingers can be detected and tracked accurately using Self Capacitance, but this does involve a few extra calculations, and 4 extra capacitance measurements to eliminate the 2 "ghost" positions. One method is to undertake a full Self Capacitance scan, to detect the 4 ambiguous finger positions, then use just 4 targeted Mutual Capacitance measurements to discover which two of the 4 positions are valid and which 2 are not. This gives a total of 34 measurements - still far less than the 224 required when using Mutual Capacitance alone.

With 3 fingers - 9 disambiguations are required, with 4 fingers - 16 disambiguations etc..

With more fingers, it may be decided that the process of disambiguation is too unwieldy. If sufficient processing power is available, the switch can then be made to full Mutual Capacitance scanning.[111]

Use of stylus on capacitive screens

[

edit

]

Capacitive touchscreens do not necessarily need to be operated by a finger, but until recently the special styli required could be quite expensive to purchase. The cost of this technology has fallen greatly in recent years and capacitive styli are now widely available for a nominal charge, and often given away free with mobile accessories. These consist of an electrically conductive shaft with a soft conductive rubber tip, thereby resistively connecting the fingers to the tip of the stylus.

Infrared grid

[

edit

]

Infrared sensors mounted around the display watch for a user's touchscreen input on this PLATO V terminal in 1981. The monochromatic plasma display's characteristic orange glow is illustrated.

An infrared touchscreen uses an array of X-Y infrared LED and photodetector pairs around the edges of the screen to detect a disruption in the pattern of LED beams. These LED beams cross each other in vertical and horizontal patterns. This helps the sensors pick up the exact location of the touch. A major benefit of such a system is that it can detect essentially any opaque object including a finger, gloved finger, stylus or pen. It is generally used in outdoor applications and POS systems that cannot rely on a conductor (such as a bare finger) to activate the touchscreen. Unlike capacitive touchscreens, infrared touchscreens do not require any patterning on the glass which increases durability and optical clarity of the overall system. Infrared touchscreens are sensitive to dirt and dust that can interfere with the infrared beams, and suffer from parallax in curved surfaces and accidental press when the user hovers a finger over the screen while searching for the item to be selected.

Infrared acrylic projection

[

edit

]

A translucent acrylic sheet is used as a rear-projection screen to display information. The edges of the acrylic sheet are illuminated by infrared LEDs, and infrared cameras are focused on the back of the sheet. Objects placed on the sheet are detectable by the cameras. When the sheet is touched by the user, frustrated total internal reflection results in leakage of infrared light which peaks at the points of maximum pressure, indicating the user's touch location. Microsoft's PixelSense tablets use this technology.

Optical imaging

[

edit

]

Optical touchscreens are a relatively modern development in touchscreen technology, in which two or more image sensors (such as CMOS sensors) are placed around the edges (mostly the corners) of the screen. Infrared backlights are placed in the sensor's field of view on the opposite side of the screen. A touch blocks some lights from the sensors, and the location and size of the touching object can be calculated (see visual hull). This technology is growing in popularity due to its scalability, versatility, and affordability for larger touchscreens.

Dispersive signal technology

[

edit

]

Introduced in 2002 by 3M, this system detects a touch by using sensors to measure the piezoelectricity in the glass. Complex algorithms interpret this information and provide the actual location of the touch.[116] The technology is unaffected by dust and other outside elements, including scratches. Since there is no need for additional elements on screen, it also claims to provide excellent optical clarity. Any object can be used to generate touch events, including gloved fingers. A downside is that after the initial touch, the system cannot detect a motionless finger. However, for the same reason, resting objects do not disrupt touch recognition.

Acoustic pulse recognition

[

edit

]

The key to this technology is that a touch at any one position on the surface generates a sound wave in the substrate which then produces a unique combined signal as measured by three or more tiny transducers attached to the edges of the touchscreen. The digitized signal is compared to a list corresponding to every position on the surface, determining the touch location. A moving touch is tracked by rapid repetition of this process. Extraneous and ambient sounds are ignored since they do not match any stored sound profile. The technology differs from other sound-based technologies by using a simple look-up method rather than expensive signal-processing hardware. As with the dispersive signal technology system, a motionless finger cannot be detected after the initial touch. However, for the same reason, the touch recognition is not disrupted by any resting objects. The technology was created by SoundTouch Ltd in the early 2000s, as described by the patent family EP1852772, and introduced to the market by Tyco International's Elo division in 2006 as Acoustic Pulse Recognition.[117] The touchscreen used by Elo is made of ordinary glass, giving good durability and optical clarity. The technology usually retains accuracy with scratches and dust on the screen. The technology is also well suited to displays that are physically larger.

Construction

[

edit

]

There are several principal ways to build a touchscreen. The key goals are to recognize one or more fingers touching a display, to interpret the command that this represents, and to communicate the command to the appropriate application.

Multi-touch projected capacitance screens

Section through a micro-capacitor created when two insulation coated conductive wires cross. Single wire plot for a 32 input, diagonally wired, projected capacitance touchscreen film.

A very simple, low cost way to make a multi-touch projected capacitance touchscreen, is to sandwich an x/y or diagonal matrix of fine, insulation coated copper or tungsten wires between two layers of clear polyester film. This creates an array of proximity sensing micro-capacitors. One of these micro-capacitors every 10 to 15mm is probably sufficient spacing if fingers are relatively widely spaced apart, but very high discrimination multi-touch may need a micro-capacitor every 5 or 6 mm. A similar system can be used for ultra-high resolution sensing - such as fingerprint sensing. Fingerprint sensors require a micro-capacitor spacing of about 44 to 50 microns.[118]

The touchscreens can be manufactured at home, using readily available tools and materials, or it can be done industrially.

First, a "continuous-trace" wiring pattern is generated using a simple CAD system.

The wire is threaded through a plotter pen and plotted directly, as one continuous wire, onto a thin sheet of adhesive coated, clear polyester film (such as "window film"), using a standard, low cost x/y pen plotter.[119] After plotting, the single wire is gently cut into individual sections with a sharp scalpel, taking care not to damage the film.

A second identical polyester film is laminated over the first film. The resulting touchscreen film is then trimmed to shape, and a connector is retro-fitted.

The end product is extremely flexible, being about 75 microns thick - about the thickness of a human hair. It can even be creased without loss of functionality.

32 input diagonally wired touchscreen

The film can be mounted on, or behind non-conducting (or slightly conducting) surfaces. Usually, it is mounted behind a sheet of glass up to 12mm. thick (or more), for sensing through the glass.

On the right is an example video showing 10 fingers being tracked, using the film made by this method.

This method is suitable for a wide range of touchscreen sizes from very small to several meters wide - or even wider, if using a diagonally wired matrix.[120] [121]

The end product is environmentally friendly as it uses recyclable polyester, and minute quantities of copper wire. The film could even have a second life as another product, such as drawing film (art), or wrapping film. Unlike some other touchscreen technologies - no complex processes, or rare materials are used.

For non-touchscreen applications, other plastics (e.g. vinyl or ABS) can be used - the film can be blow molded or heat formed into complex three dimensional shapes, such as bottles, globes or car dashboards. Alternatively, the wires can be embedded in thick plastic such as fiber glass or carbon fiber body panels.

Single touch resistive touchscreens

In the resistive approach, which used to be the most popular technique, there are typically four layers:

• Top polyester-coated layer with a transparent metallic-conductive coating on the bottom.
• Adhesive spacer
• Glass layer coated with a transparent metallic-conductive coating on the top
• Adhesive layer on the backside of the glass for mounting.

When a user touches the surface, the system records the change in the electric current that flows through the display.

Dispersive signal

An Dispersive signal technology measures the piezoelectric effect—the voltage generated when mechanical force is applied to a material that occurs chemically when a strengthened glass substrate is touched.

Infrared

There are two infrared-based approaches. In one, an array of sensors detects a finger touching or almost touching the display, thereby interrupting infrared light beams projected over the screen. In the other, bottom-mounted infrared cameras record heat from screen touches.

In each case, the system determines the intended command based on the controls showing on the screen at the time and the location of the touch.

Development

[

edit

]

The development of multi-touch screens facilitated the tracking of more than one finger on the screen; thus, operations that require more than one finger are possible. These devices also allow multiple users to interact with the touchscreen simultaneously.

With the growing use of touchscreens, the cost of touchscreen technology is routinely absorbed into the products that incorporate it and is nearly eliminated. Touchscreen technology has demonstrated reliability and is found in airplanes, automobiles, gaming consoles, machine control systems, appliances, and handheld display devices including cellphones; the touchscreen market for mobile devices was projected to produce US$5 billion by 2009.[122][needs update]

The ability to accurately point on the screen itself is also advancing with the emerging graphics tablet-screen hybrids. Polyvinylidene fluoride (PVDF) plays a major role in this innovation due its high piezoelectric properties, which allow the tablet to sense pressure, making such things as digital painting behave more like paper and pencil.[123]

TapSense, announced in October 2011, allows touchscreens to disting