The need for a more-readily usable interface for programmable devices is widely recognized. The present invention relates to programmable sequencing devices, or, more particularly, the remote controls for consumer electronic devices. The present invention provides an enhanced interface for facilitating human input of a desired control sequence in a programmable device by employing specialized visual feedback. The present invention also relates to a new interface and method of interfacing with a programmable device, which is usable as an interface for a programmable video cassette recorder.

Significant difficulties are experienced by users when programmable complex devices are infrequently used or programmed, or when a user attempts to use uncommon functions of these devices, such as, for example video cassette recorders (hereinafter "VCRs"). Studies have concluded that 80% of users cannot correctly program their VCRs. This has been due, in part, to the fact that manufacturers continue to add more features to existing devices, without simplifying those which already exist.
People learn most efficiently through the interactive experiences of doing, thinking, and knowing. For ease-of-use, efficiency, and lack of frustration of the user, utilizing the device should be intuitive. Users should be able to operate the device without referring to an instruction manual. Well-designed products should contain visual clues which prompt and convey their meanings, however, prior art devices do not always live up to this ideal. This problem is accentuated by various manufacturers and designers who focus on the production and design of feature-rich systems, rather than on ones which are also "User Friendly" and thus easier to use. Therefore, many products are extremely complex and thus difficult to use, thereby preventing all but the most technically advanced people from using them.
The act of programming, or determining a sequence of operations to be performed by, for example, a VCR, several steps are required. In addition to setting the clock, the user must assign a program number, set the current date and current time, select the start and stop times, choose the channel from which to record, and choose a tape speed. These actions require a minimum of four actuators ("Program", "+", "−", and "Enter"). Presently, some VCR controls contain up to 123 buttons, double function keys, and symbols which are not immediately recognized by the user.
In order to simplify commonly-used functions, a number of methods have been devised. Certain VCRs employ a bar-code reader in order to allow entry of programming steps from a menu of functions, or from an encoded description of an event to be programmed. However, this method suffers from the limitation that the channel, time and duration must be available in encoded form, otherwise the use of the device will not simplify the use or programming of the VCR. These machines come with a laminated sheet of bar codes. In order to program the VCR, the user must press a button on a wand, which lights its tip, and then run or pass the tip over a bar-code, to set each step separately. Finally, when all the information has been scanned in, the user must press the "Transmit" button. The "VCRplus+" is a device which allows the entry of a code representing a channel, time, date and duration of a program to be recorded, which when entered into the remote control device, is translated into commands for programming the VCR, and transmitted through an infrared link to the VCR, thus programming the VCR. This system has the limitations that the published codes must be available, and manually entered, which may be thus be erroneously entered, and the system does not allow for rescheduled programs, so that any variation in schedule will result in a defective recording. The time and date in the VCR device must also be set accurately for this system to operate.
On-screen programming systems exist; however, these generally require the user to scroll through menus and option choices without allowing direct entry of programming information. Direct-entry systems are available with, for example, programmable controllers with keypad entry. However, these do not generally have full information visual displays, meaning that all vital information is not or cannot be simultaneously displayed, and must be "multiplexed", meaning that data must share display space with other data, displayed at different times. In a VCR with On-screen programming, all programming information feedback is displayed on the television screen, and prompts are provided to guide the user through the necessary steps. Some VCRs have numeric keypads to enter the information, while others allow choices to be entered by the selection method, which depends on the use of "up" and "down" arrow keys to select a desired option.
The other major presently used method, which is available on most VCRs, as well as other types of programmable devices, is Display Panel Programming. This method is generally inadequate because full instructions are not normally available on the display panel, and the amount of information simultaneously displayed is limited. Users do not need a television set to see the displayed information, but they might have trouble reading the small, usually multifunctional multiplexed display and keypad. When programming the VCR, information may be entered on the display panel using the selection method, with either the "up" key or both "up" and "down" keys, or by direct entry in devices that support such a system.
The remote control device of a VCR is often the primary input device, and it sometimes has control functions not accessible from a keypad input present on the VCR itself. Remote controls often contain many buttons, which may be found overwhelming and confusing by the user. This results in under-utilization of the various actuators or buttons, and consequently, various useful features are unused or inaccessible, or the programming operation is inefficient. The extra clutter results in a greater "search time", the time needed to locate and execute a desired function, and thus it takes longer to program the VCR. The general structure of the search time in programming a VCR is shown diagrammatically in FIG. 1. Other problems arise from the layout and coding of the buttons. A study performed by Kamran Abedini and George Hadad in 1987 entitled "Guidelines for Designing Better VCRs", Report No. IME 462, Feb. 4, 1987, California State Polytechnic University, incorporated herein by reference, has shown that varying the shape of the remote control device is more effective than varying its size. In addition, they found that color coding and adequate contrast can effect a significant improvement in programming performance. Abedini and Kamran, in "An Ergonomically-improved Remote Control Unit Design", Interface '87 Proceedings, 375–380 (1987), incorporated herein by reference, found that 78% of the people surveyed favored direct entry numbers (0–9) in addition to labels, symbols, discrete volume switches, and channel up/down buttons for casual searching. In addition, the people surveyed preferred remote controls which fit comfortably into their hand.
Many techniques have been used to facilitate the programming of devices such as VCRs, including:                Display Panels (1982)—Programmed with the aid of an LED display panel on the front of the machine.        Programming Via Remote Control (1983)—Programmed using a remote control device with keys for input.        On-Screen Displays (1984)—Programmed by a series of menus on the television screen.        Bar Code Scanners (1987)—Programmed by a wand passing over a series of lines, which are decoded and then transmitted to the VCR.        Light Pens (1987)—Programmed by aiming a pointing device with a light beam sensor at the television screen, which allows timing signals to be extracted to determine the position of the device with respect to the screen, and hence, the intended instruction.        Video Program System Signal Transmitters (1988)—The VCR is programmed by entering the unique code number of a desired program to record, which is emitted by television stations in West Germany as videotext digital signals associated with each program.        Phone Lines (1989)—Programmed over a telephone line at from a remote location. The numeric keys on the phone are the input keys.        Video Memories (1989)—Programmed by a computer from a remote location. For example, a user contacts a service, who then records certain programs at a user's request. These can be characterized in a number of ways, e.g. comedies, movies, etc. and the service will then manually scan the broadcast schedules for these provided characterizations and record the desired programs.        Voice Coaches (1990)—Programmed by responding to, voice instructions, e.g. speech prompts, from the remote control.
As the technology becomes more mature, and VCRs and other types of programmable consumer electronic devices become less expensive, a proportionally less-educated segment of society will be confronted with these devices. While education and ability to program a VCR are not necessarily correlated, the present invention is directed toward improving the interface to allow all segments of the population to effectively interface with these programmable devices. By making the user interface more intuitive, and facilitating program entry by all levels of users, the present method and apparatus allow a manufacturer to produce a single device, without regard to the ability of the user to learn the programming steps. It is also noted that, because of their previous inability to provide a programmable consumer electronic device with various user interface levels, manufacturers have had to compromise the programming power of their user interface to allow less than advanced users to program it, or to compromise the usability of the device in order to make the full programming power available.
Technology for Implementing the Human Interface, Image Processing and Decision Making Methods of the Present Invention
The following references are relevant to the interface aspects of the present invention, are contained in the appendix hereto, and are expressly incorporated herein by reference:    Hoffberg, Linda I, "AN IMPROVED HUMAN FACTORED INTERFACE FOR PROGRAMMABLE DEVICES: A CASE STUDY OF THE VCR" Master's Thesis, Tufts University (Master of Sciences in Engineering Design, November, 1990)    "Bar Code Programs VCR", Design News, Feb. 1, 1988, 26.    "The Highs and Lows of Nielsen Homevideo Index", Marketing & Media Decisions, November 1985, 84–86+.    "The Quest for 'User Friendly'", U.S. News & World Report, Jun. 13, 1988. 54–56.    "The Smart House: Human Factors in Home Automation", Human Factors in Practice, December 1990, 1–36.    "VCR, Camcorder Trends", Television Digest, Vol. 29, Mar. 20, 1989, 16.    Abedini, Kamran, "An Ergonomically-improved Remote Control Unit Design", Interface '87 Proceedings, 375–380.    Abedini, Kamran, and Hadad, George, "Guidelines For Designing Better VCRs", Report No. IME 462, Feb. 4, 1987.    Bensch, U., "VPV—VIDEOTEXT PROGRAMS VIDEORECORDER", IEEE Transactions on Consumer Electronics, Vol. 34, No. 3, 788–792.    Berger, Ivan, "Secrets of the Universals", Video, February 1989, 45–47+.    Beringer, D. B., "A Comparative Evaluation of Calculator Watch Data Entry Technologies: Keyboards to Chalkboards", Applied Ergonomics, December 1985, 275–278.    Bishop, Edward W., and Guinness, G. Victor Jr., "Human Factors Interaction with Industrial Design", Human Factors, Vol. 8, No. 4, August 1966, 279–289.    Brown, Edward, "Human Factors Concepts For Management", Proceedings of the Human Factors Society, 1973, 372–375.    Bulkeley, Debra, "The Smartest House in America", Design News, Oct. 19, 1987, 56–61.    Card, Stuart K., "A Method for Calculating Performance times for Users of Interactive Computing Systems", IEEE, 1979, 653–658.    Carlson, Mark A., "Design Goals for an Effective User Interface", Electro/82 Proceedings, 3/1/1–3/1/4.    Carlson, Mark A., "Design Goals for an Effective User Interface", Human Interfacing with Instruments, Session 3.    Carroll, Paul B., "High Tech Gear Draws Cries of "Uncle", Wall Street Journal, Apr. 27, 1988, 29.    Cobb, Nathan, "I don't get it", Boston Sunday Globe Magazine, Mar. 25, 1990, 23–29.    Davis, Fred, "The Great Look-and-Feel Debate", A+, Vol. 5, July 1987, 9–11.    Dehning, Waltraud, Essig Heidrun, and Maass, Susanne, The Adaptation of Virtual Man-Computer Interfaces to User Requirements in Dialogs, Germany: Springer-Verlag, 1981.    Ehrenreich, S. L., "Computer Abbreviations—Evidence and Synthesis", Human Factors, Vol. 27, No. 2, April 1985, 143–155.    Friedman, M. B., "An Eye Gaze Controlled Keyboard", Proceedings of the 2nd International Conference on Rehabilitation Engineering, 1984, 446–447.    Gilfoil, D., and Mauro, C. L., "Integrating Human Factors and Design: Matching Human Factors Methods up to Product Development", C. L. Mauro Assoc., Inc., 1–7.    Gould, John D., Boies, Stephen J., Meluson, Antonia, Rasammy, Marwan, and Vosburgh, Ann Marie, "Entry and Selection Methods For Specifying Dates". Human Factors, Vol. 32, No. 2, April 1989, 199–214.    Green, Lee, "Thermo Tech: Here's a common sense guide to the new thinking thermostats", Popular Mechanics, October 1985, 155–159.    Grudin, Jonathan, "The Case Against User Interface Consistency", MCC Technical Report Number ACA-HI-002-89, January 1989.    Harvey, Michael G., and Rothe, James T., "VideoCassette Recorders: Their Impact on Viewers and Advertisers", Journal of Advertising, Vol. 25, December/January 1985, 19–29.    Hawkins, William J., "Super Remotes", Popular Science, February 1989, 76–77.    Henke, Lucy L., and Donohue, Thomas R., "Functional Displacement of Traditional TV Viewing by VCR Owners", Journal of Advertising Research, V29, April–May 1989, 18–24.    Hoban, Phoebe, "Stacking the Decks", New York, Feb. 16, 1987, Vol. 20, 14.    "How to find the best value in VCRs", Consumer Reports, March 1988, 135–141.    Howard, Bill, "Point and Shoot Devices", PC Magazine, Vol 6, August 1987, 95–97.    Jane Pauley Special, NBC TV News Transcript, Jul. 17, 1990, 10:00 PM.    Kolson, Ann, "Computer wimps drown in a raging sea of technology", The Hartford Courant, May 24, 1989, B1.    Kreifeldt, J. G., "A Methodology For Consumer Product Safety Analysis", The 3rd National Symposium on Human Factors in Industrial Design in Consumer Products, August 1982, 175–184.    Kreifeldt, John, "Human Factors Approach to Medical Instrument Design". Electro/82 Proceedings, 3/3/1–3/3/6.    Kuocheng, Andy Poing, and Ellingstad, Vernon S., "Touch Tablet and Touch Input", Interface '87, 327.    Ledgard, Henry, Singer, Andrew, and Whiteside, John, Directions in Human Factors for Interactive Systems, New York: Springer-Verlag, 1981.    Lee, Eric, and MacGregor, James, "Minimizing User Search Time Menu Retrieval Systems", Human Factors, Vol. 27, No. 2, April 1986, 157–162.    Leon, Carol Boyd, "Selling Through the VCR", American Demographics, December 1987, 40–43.    Long, John, "The Effect of Display Format on the Direct Entry of Numerical Information by Pointing", Human Factors, Vol. 26, No. 1, February 1984, 3–17.    "Low-Cost VCRs: More For Less", Consumer Reports, March 1990, 168–172.    Mantei, Marilyn M., and Teorey, Toby J., "Cost/Benefit Analysis for Incorporating Human Factors in the Software Lifecycle", Association for Computing Machinery, 1988.    Meads, Jon A., "Friendly or Frivolous", Datamation, Apr. 1, 1988, 98–100.    Moore, T. G. and Dartnall, "Human Factors of a Microelectronic Product: The Central Heating Timer/Programmer", Applied Ergonomics, 1983, Vol. 13, No. 1, 15–23.    "Nielsen Views VCRs", Television Digest, Jun. 23, 1988, 15.    Norman, Donald A., "Infuriating By Design", Psychology Today, Vol. 22, No. 3, March 1988, 52–56.    Norman, Donald A., The Psychology of Everyday Things, New York: Basic Book, Inc. 1988.    Platte, Hans-Joachim, Oberjatzas, Gunter, and Voessing, Walter, "A New Intelligent Remote Control Unit for Consumer Electronic Device", IEEE Transactions on Consumer Electronics, Vol. CE-31, No. 1, February 1985, 59–68.    Rogus, John G. and Armstrong, Richard, "Use of Human Engineering Standards in Design", Human Factors, Vol. 19, No. 1, February 1977, 15–23.    Rosch, Winn L., "Voice Recognition: Understanding the Master's Voice", PC Magazine, Oct. 27, 1987, 261–308.    Sarver, Carleton, "A Perfect Friendship", High Fidelity, Vol. 39, May 1989, 42–49.    Schmitt, Lee, "Let's Discuss Programmable Controllers", Modern Machine Shop, May 1987, 90–99.    Schniederman, Ben, Designing the User Interface: Strategies for Effective Human-Computer Interaction, Reading, Mass.: Addison-Wesley, 1987.    Smith, Sidney J., and Mosier, Jane N., Guidelines for Designing User Interface Software, Bedford, Mass.: MITRE, 1986.    Sperling, Barbara Bied, & Tullis Thomas S., "Are You a Better 'Mouser' or 'Trackballer'? A Comparison of Cursor-Positioning Performance", An Interactive/Poster Session at the CHI+GI'87 Graphics Interface and Human Factors in Computing Systems Conference.    Streeter, L. A., Ackroff, J. M., and Taylor, G. A. "On Abbreviating Command Names", The Bell System Technical Journal, Vol. 62, No. 6, July/August 1983, 1807–1826.    Swanson, David, and Klopfenstein, Bruce, "How to Forecast VCR Penetration", American Demographic, December 1987, 44–45.    Tello, Ernest R., "Between Man And Machine", Byte, September 1988, 288–293.    Thomas, John, C., and Schneider, Michael L., Human Factors in Computer Systems, New Jersey: Ablex Publ. Co., 1984.    Trachtenberg, Jeffrey A., "How do we confuse thee? Let us count the ways", Forbes, Mar. 21, 1988, 159–160.    Tyldesley, D. A., "Employing Usability Engineering in the Development of Office Products", The Computer Journal", Vol. 31, No. 5, 1988, 431–436.    "VCR's: A Look At The Top Of The Line", Consumer Reports, March 1989, 167–170.    Verplank, William L., "Graphics in Human-Computer Communication: Principles of Graphical User-Interface Design", Xerox Office Systems.    "VHS Videocassette Recorders", Consumer Guide, 1990, 17–20.    Voyt, Carlton F., "PLC's Learn New Languages", Design News, Jan. 2, 1989, 78.    Whitefield, A. "Human Factors Aspects of Pointing as an Input Technique in Interactive Computer Systems", Applied Ergonomics, June 1986, 97–104.    Wiedenbeck, Susan, Lambert, Robin, and Scholtz, Jean, "Using Protocol Analysis to Study the User Interface", Bulletin of the American Society for Information Science, June/July 1989, 25–26.    Wilke, William, "Easy Operation of Instruments by Both Man and Machine". Electro/82 Proceedings, 3/2/1–3/2/4.    Yoder, Stephen Kreider, "U.S. Inventors Thrive at Electronics Show", The Wall Street Journal, Jan. 10, 1990, B1.    Zeisel, Gunter & Tomas, Philippe & Tomaszewski, Peter, "An Interactive Menu-Driven Remote Control Unit for TV-Receivers and VC-Recorders", IEEE Transactions on Consumer Electronics, Vol. 34, No. 3, 814–818.
The following cited patents and publications are relevant to pattern recognition and control aspects of the present invention, and are herein expressly incorporated by reference:
U.S. Pat. No. 5,067,163, incorporated herein by reference, discloses a method for determining a desired image signal range from an image having a single background, in particular a radiation image such as a medical X-ray. This reference teaches basic image enhancement techniques.
U.S. Pat. No. 5,068,664, incorporated herein by reference, discloses a method and device for recognizing a target among a plurality of known targets, by using a probability based recognition system. This patent document cites a number of other references, each incorporated herein by reference, which are relevant to the problem of image recognition: Proceedings of the 1988 IEEE National Radar Conference, 20–21 Apr. 1988, pp. 157–164, Vannicola et al., "Applications of Knowledge Based Systems to Surveillance"; Ksienski et al., "Low Frequency Approach to Target Identification", Proc. of the IEEE, vol. 63, No. 12, pp. 1651–1660, December 1975; A. Appriou, "Interet des theories de l'incertain en fusion de donnees", Colloque International sur le Radar Paris, 24–28 avril 1989; A. Appriou "Procedure d'aide a la decision multi-informateurs. Applications a la classification multi-capteurs de cibles", Symposium de l'Avionics Panel (AGARD) Turquie, 25–29 avril 1988; K. J. Arrow, "Social choice and individual valves", John Wiley and Sons Inc. (1963); D. Blair, R. Pollack, "La logique du choix collectif" Pour la Science (1983); A. Scharlic, "Decider sur plusieurs criteres. Panorama de l'aide a la decision multicritere" Presses Polytechniques Romandes (1985), R. L. Keeney, B. Raiffa, "Decisions with multiple objectives: Preferences and value tradeoffs", John Wiley and Sons, New York (1976); R. J. Jeffrey, "The logic of decision", The University of Chicago Press, Ltd., London (1983)(2nd Ed.); B. Roy, "Classements et choix en presence de points de vue multiples", R.I.R.O.-2eme annee-no. 8, pp. 57–75 (1968); B. Roy "Electre III: un algorithme de classements fonde sur une representation floue des preferences en presence de criteres multiples" Cahiers du CERO, Vol. 20, no. 1, pp. 3–24 (1978); R. O. Duda, P. E. Hart, M. J. Nilsson, "Subjective Bayesian methods for rule-based inference systems", Technical Note 124-Artificial Intelligence Center-SRI International; R. K. Bhatnagar, L. N. Kamal, "Handling uncertain information: a review of numeric and non-numeric methods", Uncertainty in Artificial Intelligence, L. N. Kamal and J. F. Lemmer, Eds. (1986); A. P. Dempster, "Upper and lower probabilities induced by a multivalued mapping", Annals of mathematical Statistics, no. 38 (1967); A. P. Dempster, "A generalization of Bayesian inference", Journal of the Royal Statistical Society, Vol. 30, Series B (1968); G. Shafer, "A mathematical theory of evidence", Princeton University Press, Princeton, N.J. (1976); D. Dubois, N. Prade, "Combination of uncertainty with belief functions: a reexamination", Proceedings 9th International Joint Conference on Artificial Intelligence, Los Angeles (1985); H. E. Kyburg, "Bayesian and non Bayesian evidential updating", Artificial Intelligence 31, pp. 271–293 (1987); P. V. Fua, "Using probability density functions in the framework of evidential reasoning Uncertainty in knowledge based systems", B. Bouchon, R. R. Yager, Eds. Springer Verlag (1987); J. J. Chao, E. Drakopoulos, C. C. Lee, "An evidential reasoning approach to distributed multiple hypothesis detection", Proceedings of the 20th Conference on decision and control, Los Angeles, Calif., December 1987; R. R. Yager, "Entropy and specificity in a mathematical theory of Evidence", Int J. General Systems, Vol. 9, pp. 249–260 (1983); M. Ishizuka, "Inference methods based on extended Dempster and Shafer's theory for problems with uncertainty/fuzziness", New Generation Computing 1 (1983), Ohmsha, Ltd, and Springer Verlag p.p. 159–168; L. A. Zadeh, "Fuzzy sets", Information and Control no. 8, pp. 338–353 (1965); L. A. Zadeh, "Probability measures of fuzzy events", Journal of Mathematical Analysis and Applications, Vol. 23, pp. 421–427 (1968); A. Kaufmann, "Introduction a la theorie des sous-ensembles flous", Vol. 1, 2 et 3-Masson-Paris (1975); M. Sugeno, "Theory of fuzzy integrals and its applications", Tokyo Institute of Technology (1974); R. E. Bellman, L. A. Zadeh, "Decision making in a fuzzy environment", Management Science, Vol. 17, No. 4, December 1970; D. Dubois, N. Prade, "Fuzzy sets and systems-Theory and applications", Academic Press, New York (1980); L. A. Zadeh, "Fuzzy sets as a basis for a theory of possibility", Fuzzy sets and Systems 1, pp. 3–28 (1978); D. Dubois, "Modeles mathematiques de l'imprecis et de l'incertain en vue d'applications aux techniques d'aide a la decision", Doctoral Thesis, University of Grenoble (1983); D. Dubois, N. Prade, "Theorie des possibilites: application a la representation des connaissances en informatique", Masson, Paris (1985). Thus, the image or object recognition feature of the present invention may be implemented in the manner of U.S. Pat. No. 5,068,664. Further, it is clear that this recognition feature may form an integral part of certain embodiments of the present invention. It is also clear that the various features of the present invention would be applicable as an adjunct to the various elements of the system disclosed in U.S. Pat. No. 5,068,664.
U.S. Pat. Nos. 5,065,447, and 4,941,193, both incorporated herein by reference, relate to the compression of image data by using fractals. These are discussed in detail below. U.S. Pat. No. 5,065,447 cites a number of references, all incorporated herein by reference, relevant to the use of fractals in image processing: U.S. Pat. No. 4,831,659; "Hidden Variable Fractal Interpolation Functions", by Barnsley et al., School of Mathematics, Georgia Institute of Technology, Atlanta, Ga. 30332, July, 1986; Barnsley, M. F., and Demko, S., "Iterated Function Systems and The Global Construction of Fractals", Proc. R. Soc. Lond., A399, 243–275 (1985); Barnsley, M. F., Ervin, V., Hardin, D., Lancaster, J., "Solution of an Inverse Problem for Fractals and Other Sets", Proc. Natl. Acad. Sci. U.S.A., vol. 83, 1975–1977 (April 1986); "A New Class of Markov Processes for Image Encoding", School of Mathematics, Georgia Inst. of Technology (1988), pp. 14–32; "Fractal Modelling of Biological Structures", Perspectives in Biological Dynamics and Theoretical Medicine, Koslow, Mandell, Shlesinger, eds., Annals of New York Academy of Sciences, vol. 504, 179–194 (date unknown); Elton, J., "An Ergodic Theorem for Iterated Maps", Journal of Ergodic Theory and Dynamical Systems, 7 (1987); "Construction of Fractal Objects with Iterated Function Systems", Siggraph '85 Proceedings, vol. 19, No. 3, 271–278 (1985); "Fractal Modelling of Real World Images, Lecture Notes for Fractals: Introduction, Basics and Perspectives", Siggraph (1987); "Packing It In-Fractals . . . ", Science News, vol. 131, No. 18, pp. 283–285, May 2, 1987; "Fractal Geometry-Understanding Chaos", Georgia Tech Alumni Magazine, p. 16 (Spring 1986); "Fractals—A Geometry of Nature", Georgia Institute of Technology Research Horizons, p. 9 (Spring 1986); Fractal Modelling of Biological Structures, School of Mathematics, Georgia Institute of Technology (date unknown); "Packing It In", Ivars Peterson, Science News, vol. 131, No. 18, pp. 283–285, May 2, 1987; A Better Way to Compress Images, by Barnsley et al., Byte Magazine, January 1988, pp. 213–225; Researchers Use Fractal Geometry, . . . , by Skip Derra, Research and Development Magazine, March 1988; Data Compression: Pntng by Numbrs, The Economist, May 21, 1988; Just the Bare Facts, Please, by William Baldwin, Forbes Magazine, Dec. 12, 1988; "Harnessing Chaos For Images Systhesis", by Barnsley et al., Computer Graphics, vol. 22, No. 4, August, 1988, pp. 131–140; Chaotic Compression, by Barnsley et al., Computer Graphics World, November 1987; Making a New Science, pp. 215, 239, by James Gleick, date unknown.
Byte Magazine, January 1988., cites, Mandelbrot, B., "The Fractal Geometry of Nature", W.H. Freeman & Co., San Francisco, Calif., 1982, 1977, and Barnsley, M. F., "Fractals Everywhere", Academic Press, Boston, Mass., 1988, both of which are also incorporated herein by reference.
U.S. Pat. No. 5,063,603, incorporated herein by reference, relates to a dynamic method for recognizing objects and image processing system therefor. This reference discloses a method of distinguishing between different members of a class of images, such as human beings. A time series of successive relatively high-resolution frames of image data, any frame of which may or may not include a graphical representation of one or more predetermined specific members (e.g., particular known persons) of a given generic class (e.g. human beings), is examined in order to recognize the identity of a specific member; if that member's image is included in the time series. The frames of image data may be examined in real time at various resolutions, starting with a relatively low resolution, to detect whether some earlier-occurring frame includes any of a group of image features possessed by an image of a member of the given class. The image location of a detected image feature is stored and then used in a later-occurring, higher resolution frame to direct the examination only to the image region of the stored location in order to (1) verify the detection of the aforesaid image feature, and (2) detect one or more other of the group of image features, if any is present in that image region of the frame being examined. By repeating this type of examination for later and later occurring frames, the accumulated detected features can first reliably recognize the detected image region to be an image of a generic object of the given class, and later can reliably recognize the detected image region to be an image of a certain specific member of the given class. Thus, the personae recognition feature of the present invention may be implemented in this manner. Further, it is clear that this recognition feature may form an integral part of certain embodiments of the present invention. It is also clear that the various features of the present invention would be applicable as an adjunct to the various elements of the system disclosed in U.S. Pat. No. 5,063,603.
U.S. Pat. No. 5,055,658, incorporated herein by reference, relates to a security system employing digitized personal characteristics, such as voice. The following cited references are incorporated herein by reference: Naik et al., "High Performance Speaker Verification . . . " ICASSP 86, Tokyo, CH2243-4/86/0000-0881, IEEE 1986, pp. 881–884; "Voice Recognition and Speech Processing", Elektor Electronics, September 1985, pp. 56–57; Shinan et al., "The Effects of Voice Disguise . . . " ICASSP 86, Tokyo, CH2243-4/6/0000-0885, IEEE 1986, pp. 885–888. Parts of this system relating to speaker recognition may be used to implement a voice recognition system of the present invention for determining an actor or performer in a broadcast.
U.S. Pat. No. 5,067,164, incorporated herein by reference, relates to a hierarchical constrained automatic learning neural network for character recognition, and thus represents an example of a trainable neural network for pattern recognition, which discloses methods which are useful for the present invention. This patent document cites various references of interest, which are incorporated herein by reference: U.S. Pat. Nos. 4,760,604, 4,774,677 and 4,897,811; D. E. Rumelhart et al., Parallel Distr. Proc.: Explorations in Microstructure of Cognition, vol. 1, 1986, "Learning Internal Representations by Error Propagation", pp. 318–362; R. P. Lippmann, IEEE ASSP Magazine, vol. 4, No. 2, April 1987, "An Introduction to Computing with Neural Nets", pp. 4–22; Y. LeCun, Connectionism in Perspective, R. Pfeifer, Z. Schreter, F. Fogelman, L. Steels, (Eds.), 1989, "Generalization and Network Design Strategies", pp. 143–55; Y. LeCun et al., IEEE Comm. Magazine, November 1989, "Handwritten Digit Recognition: Applications of Neural . . . ", pp. 41–46. U.S. Pat. Nos. 5,048,100, 5,063,601 and 5,060,278, all incorporated herein by reference, also relate to neural network adaptive pattern recognition methods and apparatuses. It is clear that the methods of U.S. Pat. Nos. 5,048,100, 5,060,278 and 5,063,601 may be used to perform the adaptive pattern recognition functions of the present invention. More general neural networks are disclosed in U.S. Pat. Nos. 5,040,134 and 5,058,184, both incorporated herein be reference, which provide background on the use of neural networks. In particular, U.S. Pat. No. 5,058,184 relates to the use of the apparatus in information processing and feature detection applications.
U.S. Pat. No. 5,058,180, incorporated herein by reference, relates to neural network apparatus and method for pattern recognition, and is thus relevant to the intelligent pattern recognition functions of the present invention. This patent document cites the following documents of interest, which are incorporated herein by reference: U.S. Pat. Nos. 4,876,731 and 4,914,708; Computer Visions, Graphics, and Image Processing 1987, 37, 54–115; L. D. Jackel, H. P. Graf, J. S. Denker, D. Henderson and I. Guyon, "An Application of Neural Net Chips: Handwritten Digit Recognition," ICNN Proceeding, 1988, pp. II-107–15; G. A. Carpenter and S. Grossberg, "The Art of Adaptive Pattern Recognition by a Self-Organizing Neural Network," IEEE Computer, March 1988, pp. 77–88; T. F. Pawlicki, D. S. Lee, J. J. Hull and S. N. Srihari, "Neural Network Models and their Application to Handwritten Digit Recognition," ICNN Proceeding, 1988, pp. II-63–70; E. Gullichsen and E. Chang, "Pattern Classification by Neural Network: An Experiment System for Icon Recognition," ICNN Proceeding on Neural Networks, March 1987, pp. IV-725–32; S. Grossberg and G. Carpenter, "A Massively Parallel Architecture for a Self-Organizing Neural Pattern Recognition Machine," Computer Vision, Graphics, and Image Processing (1987, 37, 54–115), pp. 252–315; R. P. Lippman, "An Introduction to Computing with Neural Nets," IEEE ASSP Magazine, April 1987, pp. 4–22.
U.S. Pat. No. 5,067,161, incorporated herein by reference, relates to a video image pattern recognition system, which recognizes objects in near real time.
U.S. Pat. Nos. 4,817,176 and 4,802,230, both incorporated herein by reference, relate to harmonic transform methods of pattern matching of an undetermined pattern to known patterns, and are useful in the pattern recognition method of the present invention. U.S. Pat. No. 4,998,286, incorporated herein by reference, relates to a harmonic transform method for comparing multidimensional images, such as color images, and is useful in the present pattern recognition methods.
U.S. Pat. No. 5,060,282, incorporated herein by reference, relates to an optical pattern recognition architecture implementing the mean-square error correlation algorithm. This method allows an optical computing function to perform pattern recognition functions. The patent document cites the following references, incorporated herein by reference, which are relevant to optical pattern recognition: D. Psaltis, "Incoherent Electro-Optic Image Correlator", Optical Engineering, January/February 1984, vol. 23, No. 1, pp. 12–15; P. Kellman, "Time Integrating Optical Signal Processing", Ph. D. Dissertation, Stanford University, 1979, pp. 51–55; P. Molley, "Implementing the Difference-Squared Error Algorithm Using An Acousto-Optic Processor", SPIE, vol. 1098, 1989, pp. 232–239; W. Rhodes, "Acousto-Optic Signal Processing: Convolution and Correlation", Proc. of the IEEE, vol. 69, No. 1, January 1981, pp. 65–79; A. Vander Lugt, "Signal Detection By Complex Spatial Filtering", IEEE Transactions On Information Theory, IT-10, vol. 2, April 1964, pp. 139–145; D. Psaltis, "Two-Dimensional Optical Processing Using One-Dimensional Input Devices", Proceedings of the IEEE, vol. 72, No. 7, July 1984, pp. 962–974; P. Molley et al., "A High Dynamic Range Acousto-Optic Image Correlator for Real-Time Pattern Recognition", SPIE, vol. 938, 1988, pp. 55–65. U.S. Pat. No. 5,063,602, incorporated herein by reference, also relates to an optical image correlators.
U.S. Pat. No. 5,067,160, incorporated herein by reference, relates to a motion-pattern recognition apparatus. The apparatus recognizes a motion of an object which is moving and is hidden in an image signal, and discriminates the object from the background within the signal. The apparatus has an image forming unit comprising non-linear oscillators, which forms an image of the motion of the object in accordance with an adjacent-mutual-interference-rule, on the basis of the image signal. A memory unit, comprising non-linear oscillators, stores conceptualized meanings of several motions. A retrieval unit retrieves a conceptualized meaning close to the motion image of the object. An altering unit alters the rule, on the basis of the conceptualized meaning. The image forming unit, memory unit, retrieval unit and altering unit form a holonic-loop. Successive alterations of the rules by the altering unit within the holonic loop change an ambiguous image formed in the image forming unit into a distinct image. The patent document cites the following references, incorporated herein by reference, which are relevant to the task of discriminating a moving object in a background: U.S. Pat. No. 4,710,964; "Principle of Holonic Computer and Holovision" in Journal of the Institute of Electronics, Information and Communication, vol. 70, No. 9, pp. 921–930 (1987), Shimizu et al; "Holonic Model of Motion Perception", IEICE Technical Reports, Mar. 26, 1988, pp. 339–346, Omata et al; "Entrainment of Two Coupled van der Pol Oscillators by an External Oscillation", in Biological Cybernetics, vol. 51, pp. 225–239 (1985), Ohsuga et al. It is clear that U.S. patent discloses an adaptive pattern recognition system that may be useful in various embodiments of the present invention. It is also clear that the interface and control systems of the present invention provide useful adjuncts to the elements disclosed in U.S. Pat. No. 5,067,160.
U.S. Pat. No. 5,065,440, incorporated herein by reference, relates to a pattern recognition apparatus, which compensates for, and is thus insensitive to pattern shifting, thus being useful for decomposing an image into its structural features and recognizing the features. The patent document cites the following references, incorporated herein by reference, which are also relevant to the present invention: U.S. Pat. Nos. 4,543,660, 4,630,308, 4,677,680, 4,809,341, 4,864,629, 4,872,024 and 4,905,296.
U.S. Pat. No. 5,067,166, incorporated herein by reference, relates to a pattern recognition system, in which a local optimum match between subsets of candidate reference label sequences and candidate templates. It is clear that this method is useful in the pattern recognition aspects of the present invention. It is also clear that the interface and control system of the present invention are useful adjuncts to the method disclosed in U.S. Pat. No. 5,067,166.
U.S. Pat. No. 5,048,095, incorporated herein by reference, relates to the use of a genetic learning algorithm to adaptively segment images, which is an initial stage in image recognition. This patent has a software listing for this method. It is clear that this method is useful in the pattern recognition aspects of the present invention. It is also clear that the interface and control system of the present invention are useful adjuncts to the method disclosed in U.S. Pat. No. 5,048,095.
In addition, the following patents are considered relevant to the data compression and pattern recognition functions of the apparatus and interface of the present invention and are incorporated herein by reference: U.S. Pat. Nos. 3,950,733, 4,044,243, 4,254,474, 4,326,259, 4,442,544, 4,449,240, 4,468,704, 4,491,962, 4,501,016, 4,543,660, 4,547,811, 4,630,308, 4,656,665, 4,658,429, 4,660,166, 4,677,680, 4,682,365, 4,685,145, 4,710,822, 4,710,964, 4,719,591, 4,731,863, 4,736,439, 4,742,557, 4,752,890, 4,760,604, 4,764,971, 4,771,467, 4,773,099, 4,774,677, 4,790,025, 4,799,270, 4,803,736, 4,805,224, 4,805,255, 4,809,341, 4,817,171, 4,821,333, 4,823,194, 4,831,659, 4,833,637, 4,837,842, 4,845,610, 4,864,629, 4,872,024, 4,876,731, 4,887,304, 4,888,814, 4,891,762, 4,897,811, 4,905,296, 4,906,099, 4,914,708, 4,926,491, 4,932,065, 4,933,872, 4,941,193, 4,944,023, 4,958,375, 4,958,375, 4,965,725, 4,972,499, 4,979,222, 4,987,604, 4,989,258, 5,014,219, 5,014,327, 5,018,218, 5,018,219, 5,020,112, 5,022,062, 5,034,991, 5,038,379, 5,040,134, 5,046,121, 5,046,122, 5,046,179, 5,048,112, 5,050,223, 5,051,840, 5,052,043, 5,052,045, 5,052,046, 5,053,974, 5,054,093, 5,054,095, 5,054,101, 5,054,103, 5,055,658, 5,055,926, 5,056,147, 5,058,179, 5,058,180, 5,058,186, 5,059,126, 5,060,276, 5,060,277, 5,060,279, 5,060,282, 5,060,285, 5,061,063, 5,063,524, 5,063,525, 5,063,603, 5,063,605, 5,063,608, 5,065,439, 5,065,440, 5,065,447, 5,067,160, 5,067,161, 5,067,162, 5,067,163, 5,067,164, 5,068,664, 5,068,723, 5,068,724, 5,068,744, 5,068,909, 5,068,911, H 331, and Re. 33,316. These patent documents, some of which are mentioned elsewhere in this disclosure, which form a part of this disclosure, may be applied in known manner by those skilled in the art in order to practice various embodiments of the present invention.
The following scientific articles are incorporated by reference, and their relevance is understood by those skilled in the art and relate to the pattern recognition and image compression functions of the apparatus and interface of the present invention:    G. E. Liepins & M. R. Hilliard, "Genetic Algorithms: Foundations & Applications", Annals of Operations Research, 21, (1989), pp. 31–58.    J. M. Fitzpatrick, J. J. Grefenstette & D. Van Gucht, "Image Registration by Genetic Search", Conf. Proc., IEEE Southeastcon 1984, pp. 460–464.    A. D. McAulay & J. C. Oh, "Image Learning Classifier System Using Genetic Algorithms", IEEE Proc. of the National Aerospace & Electronics Conference, vol. 2, 1989, pp. 705–710.    Philip D. Wasserman, "Neural Computing-Theory & Practice", 1989, pp. 128–129.    N. J. Nilsson, The Mathematical Foundations of Learning Machines ((c) 1990: Morgan Kaufmann Publishers; San Mateo, Calif.) and particularly section 2.6 "The Threshold Logic Unit (TLU)", on pp. 21–23 and Chapter 6 Layered Machines on pp. 95–114.    G. L. Martin et al., "Recognizing Hand-Printed Letters and Digits Using Backpropagation Learning", Technical Report of the MCC, Human Interface Laboratory, Austin, Tex., January 1990, pp. 1–9.    J. S. N. Jean et al., "Input Representation and Output Voting Considerations for Handwritten Numeral Recognition with Backpropagation", International Joint Conference on Neural Networks, Washington, D.C., January 1990, pp. I-408 to I-411.    X. Zhu et al., "Feature Detector and Application to Handwritten Character Recognition", International Joint Conference on Neural Networks, Washington, D.C., January 1990, pp. II-457 to II-460.    K. Haruki et al., "Pattern Recognition of Handwritten Phonetic Japanese Alphabet Characters", International Joint Conference on Neural Networks, Washington, D.C., January 1990, pp. II-515 to II-518.    R. K. Miller, Neural Networks ((c) 1989: Fairmont Press; Lilburn, Ga.), pp. 2–12 and Chapter 4 "Implementation of Neural Networks", on pp. 4–1 to 4–26.    Y. Hayashi et al., "Alphanumeric Character Recognition Using a Connectionist Model with the Pocket Algorithm", Proceedings of the International Joint Conference on Neural Networks, Washington, D.C. Jun. 18–22, 1989, vol. 2, pp. 606–613.    M. Caudill, "Neural Networks Primer-Part III", AI Expert, June 1988, pp. 53–59.    D. J. Burr, "A Neural Network Digit Recognizer", Proceedings of the 1986 IEEE International Conference of Systems, Man and Cybernetics, Atlanta, Ga., pp. 1621–1625.    D. E. Rumelhart, et al., Parallel Distributed Processing, ((c) 1986: MIT Press; Cambridge, Mass.), and specifically Chapter 8 thereof "Learning Internal Representations by Error Propagation", pp. 318–362.    IEEE Computer, November, 1981, pp. 53–67, "Computer Architectures for Pictorial Inf. Systems", Per Erik Danielsson et al.    Computing with Neural Circuits: A Model; Science; vol. 233; 8 August 1986; Hopfield et al; pp. 625–633.    Boltzmann Machines: Constraint Satisfaction Networks that Learn; Hinton et al. Tech. Report CMU-CS-85-119; Carnegie-Mellon Univ; May 1984.    Neurons with graded response have collective computational properties like those of two-state neurons; Hopfield; Proc. Natl. Acad. Sci. USA; vol. 81; pp. 3088–3092; May 1984.    Non-Holographic Associative Memory; Nature; vol. 222; pp. 960–962; Jun. 7, 1969; Willshaw et al.    A Possible Organization of Animal Memory and Learning; L. N. Cooper; Nobel 24 (1973); Collective Properties of Physical Systems; pp. 252–264.    Neural Networks and Physical Systems with Emergent Collective Computational Abilities; Hopfield; Proc. Natl. Acad. Sci. USA; vol. 79, April 1982; pp. 2554–25558.    B. G. Batchelor: "Practical Approach to Pattern Classification", Plenum Press, London and New York; (1974).    B. G. Batchelor: "Pattern Recognition, Ideas in Practice", Plenum Press, London and New York; (1978).    K. Udagawa et al: "A Parallel Two-Stage Decision Method for Statistical Character Recognition . . . ", Electronics and Communications in Japan (1965).    J. Schurmann, "Zur Zeichen und Worterkennung beim Automatischen Anschriftenlesen", Wissenschaftlichl. Berichte, vol. 52, No. 1/2 (1979).    Computers and Biomedical Research 5, 388–410 (1972), pp. 388–410. Proceedings, 6th International Conference on Pattern Recognition 1982, pp. 152–136.    Information Processing 71-North-Holland Publishing Company (1972) pp. 1530–1533.    Scientific American "Not Just a Pretty Face", March 1990, pp. 77–78.    "Recursive Block Coding—A New Approach to Transform Coding": IEEE Transactions on Communications, Paul M. Farrelle and Anil K. Jain; vol. Com. 34, No. 2, February 1986.    Yamane et al., "An Image Data Compression Method Using Two-Dimensional Extrapolative Prediction-Discrete Sine Transform", Oct. 29–31, 1986, pp. 311–316.    Chen et al., "Adaptive Coding of Monochrome and Color Images", November 1977, pp. 1285–1292.    O'Neal et al., "Coding Isotropic Images", November 1977, pp. 697–707.    F. Anderson, W. Christiansen, B. Kortegaard, "Real Time, Video Image Centroid Tracker," Apr. 16–20, 1990.    B. L. Kortegaard, "PAC-MAN, a Precision Alignment Control System for Multiple Laser Beams Self-Adaptive Through the Use of Noise," Los Alamos National Laboratory, date unknown.    B. L. Kortegaard, "Superfine Laser Position Control Using Statistically Enhanced Resolution in Real Time," Los Alamos National Laboratory, SPIE-Los Angeles Technical Symposium, Jan. 23–25, 1985.    "Guide to Pattern Recognition Using Random-Access Memories," I. Aleksander, Computers and Digital Techniques, February 1979, vol. 2, No. 1, pp. 29–40.    D. E. Rumelhart et al., Parallel Distr. Proc.: Explorations in Microstructure of Cognition, vol. 1, 1986, "Learning Internal Representations by Error Propagation", pp. 318–362.    R. P. Lippmann, IEEE ASSP Magazine, vol. 4, No. 2, April 1987, "An Introduction to Computing with Neural Nets", pp. 4–22.    Y. LeCun, Connectionism in Perspective, R. Pfeifer, Z. Schreter, F. Fogelman, L. Steels (Eds.), 1989, "Generalization and Network Design Strategies", pp. 143–155.    Y. LeCun et al., IEEE Comm. Magazine, November 1989, "Handwritten Digit Recognition: Applications of Neural . . . ", pp. 41–46.    Denker, 1984 International Test Conf., October 1984, Philadelphia, Pa., pp. 558–563.    Gogoussis et al., Proc. SPIE Intl. Soc. Opt. Eng., November 1984, Cambridge, Mass., pp. 121–127.    Svetkoff et al., Hybrid Circuits (GB), No. 13, May 1987, pp. 5–8. Kohonen, Self-Organization & Memory, Second Ed., 1988, Springer-Verlag, pp. 199–209.    Specht, IEEE Internatl. Conf. Neural Networks, vol. 1, July 1988, San Diego, Calif., pp. I-525 to I-532.    Wald, Sequential Analysis, Dover Publications Inc., 1947, pp. 34–43.    Digital Picture Processing, Second Edition, Volume 2, Azriel Rosenfeld and Avinash C. Kak, Academic Press, 1982.    "Towards the construction of a large-scale neural network" (Mori; Electronics Information Communications Association Bulletin PRU 88-59, pp. 87–94).    "Character recognition system using a neural network" (Yamada et. al.: Electronics Information Communications Association Bulletin PRU 88-58, pp. 79–86).    Inspec. Abstract No. 86C010699, Insepc IEE (London) & IEE Coll. on "Adaptive Filters", Digest No. 76, Oct. 10, 1985, Crawford et al. Adaptive Pattern Recognition Applied To An Expert System For Fault Diagnosis In Telecommunications Equipment, pp. 10/1–8.    Inspec. Abstract No. 84C044315, Inspec IEE (London) & IEE Saraga Colloquium on Electronic Filters, May 21, 1984; Rutter et al., "The Timed Lattice—A New Approach To Fast Converging Equalizer Design", pp. VIII/1–5.    W. R. Simpson & C. S. Dowling, "WRAPLE: The Weighted Repair Assistance Program Learning Extension", IEEE Design & Test, vol. No. 2, April 1986; pp. 66–73.    B. B. Dunning, "Self-Learning Data-Base For Automated Fault Localization", IEEE, 1979; pp. 155–157.    R. M. Stewart, "Expert Systems For Mechanical Fault Diagnosis", IEEE, 1985; pp. 295–300.    H. K. Lin et al., "Real-Time Screen-Aided Multiple-Image Optical Holographic Matched-Filter Correlator", Applied Optics, vol. 21, No. 18, Sep. 15, 82, pp. 3278–3286.    A. Vander Lugt et al., "The Use of Film Nonlinearites in Optical Spatial Filtering", Applied Optics, vol. 9, No. 1, January 1970, pp. 215–222.    A. Vander Lugt, "Practical Considerations for the Use of Spatial Carrier-Frequency Filters", Applied Optics, vol. 5, No. 11, November 1966, pp. 1760–1765.    Silverston et al., "Spectral Feature Classification and Spatial Pattern Rec.", SPIE vol. 201 Optical Pattern Recognition (1979), pp. 17–26.    Perry et al., "Auto-Indexing Storage Device", IBM Tech. Disc. Bulletin, vol. 12, No. 8, January 1970, p. 1219.    Vitols, "Hologram Memory for Storing Digital Data," IBM Tech. Disc. Bulletin, vol. 8, No. 11, April 1966, pp. 1581–1583.    Stanley R. Sternberg, "Biomedical Image Processing", 1983, pp. 22–34, IEEE Computer.    "Object Identification and Measurement from Images with Access to the Database to Select Specific Subpopulations of Special Interest"; H. G. Rutherford, F. Taub and B. Williams, May 1986.    Ney, H., et al. "A Data Driven Organization of the Dynamic Programming Beam Search for Continuous Speech Recognition", Proc. ICASSP 87, pp. 833–836, 1987.    Sakoe, H., "A Generalization of Dynamic Programming Based Pattern Matching Algorithm Stack DP-Matching", Transactions of the Committee on Speech Research, The Acoustic Society of Japan, p. S83-23, 1983.    Sakoe, H., "A Generalized Two-Level DP-Matching Algorithm for Continuous Speech Recognition", Transactions of the IECE of Japan, vol. E65, No. 11, pp. 649–656, November 1982.    A. Mahalanobis et al., "Minimum Average Correlation Energy Filters," Applied Optics, Sep. 1, 1987, vol. 26, No. 17, pp. 3633–40.    R. A. Sprageu, "A Review of Acousto-Optic Signal Correlators," Optical Engineering, September/October 1977, vol. 16, No. 5, pp. 467–74.    D. Casasent et al., "General I and Q Data Processing on a Multichannel AO System," Applied Optics, Sep. 15, 1986, vol. 25, No. 18, pp. 3217–24.    Proceedings of the 1988 IEEE National Radar Conference, 20–21 April 1988, pp. 157–164, Vannicola et al., "Applications of Knowledge Based Systems to Surveillance".    Ksienski et al., "Low Frequency Approach to Target Identification", Proc. of the IEEE, vol. 63, No. 12, pp. 1651–1660, December 1975.    A. Appriou, "Interet des theories de l'incertain en fusion de donnees", Colloque International sur le Radar Paris, 24–28 avril 1989.    A. Appriou "Procedure d'aide a la decision multi-informateurs. Applications a la classification multi-capteurs de cibles", Symposium de l'Avionics Panel (AGARD) Turquie, 25–29 avril 1988.    K. J. Arrow, "Social choice and individual valves", John Wiley and Sons Inc. (1963).    D. Blair, R. Pollack, "La logique du choix collectif" Pour la Science (1983);    A. Scharlic, "Decider sur plusieurs criteres. Panorama de l'aide a la decision multicritere" Presses Polytechniques Romandes (1985).    R. L. Keeney, B. Raiffa, "Decisions with multiple objectives: Preferences and value tradeoffs", John Wiley and Sons, New York (1976).    R. J. Jeffrey, "The logic of decision", The University of Chicago Press, Ltd., London (1983)(2nd Ed.).    B. Roy, "Classements et choix en presence de points de vue multiples", R.I.R.O.-2eme annee-no. 8, pp. 57–75 (1968).    B. Roy "Electre III: un algorithme de classements fonde sur une representation floue des preferences en presence de criteres multiples" Cahiers du CERO, Vol. 20, no. 1, pp. 3–24 (1978),    R. O. Duda, P. E. Hart, M. J. Nilsson, "Subjective Bayesian methods for rule-based inference systems", Technical Note 124-Artificial Intelligence Center-SRI International.    R. K. Bhatnagar, L. N. Kamal, "Handling uncertain information: a review of numeric and non-numeric methods", Uncertainty in Artificial Intelligence, L. N. Kamal and J. F. Lemmer, Eds. (1986).    A. P. Dempster, "Upper and lower probabilities induced by a multivalued mapping", Annals of mathematical Statistics, no. 38 (1967).    A. P. Dempster, "A generalization of Bayesian inference", Journal of the Royal Statistical Society, Vol. 30, Series B (1968).    G. Shafer, "A mathematical theory of evidence", Princeton University Press, Princeton, N.J. (1976).    D. Dubois, N. Prade, "Combination of uncertainty with belief functions: a reexamination", Proceedings 9th International Joint Conference on Artificial Intelligence, Los Angeles (1985).    H. E. Kyburg, "Bayesian and non Bayesian evidential updating", Artificial Intelligence 31, pp. 271–293 (1987).    P. V. Fua, "Using probability density functions in the framework of evidential reasoning Uncertainty in knowledge based systems", B. Bouchon, R. R. Yager, Eds. Springer Verlag (1987).    J. J. Chao, E. Drakopoulos, C. C. Lee, "An evidential reasoning approach to distributed multiple hypothesis detection", Proceedings of the 20th Conference on decision and control, Los Angeles, Calif., December 1987.    R. R. Yager, "Entropy and specificity in a mathematical theory of Evidence", Int J. General Systems, Vol. 9, pp. 249–260 (1983).    M. Ishizuka, "Inference methods based on extended Dempster and Shafer's theory for problems with uncertainty/fuzziness", New Generation Computing 1 (1983), Ohmsha, Ltd, and Springer Verlag p.p. 159–168.    L. A. Zadeh, "Fuzzy sets", Information and Control no. 8, pp. 338–353 (1965); L. A. Zadeh, "Probability measures of fuzzy events", Journal of Mathematical Analysis and Applications, Vol. 23, pp. 421–427 (1968).    A. Kaufmann, "Introduction a la theorie des sous-ensembles flous", Vol. 1, 2 et 3-Masson-Paris (1975).    M. Sugeno, "Theory of fuzzy integrals and its applications", Tokyo Institute of Technology (1974).    R. E. Bellman, L. A. Zadeh, "Decision making in a fuzzy environment", Management Science, Vol. 17, No. 4, December 1970.    D. Dubois, N. Prade, "Fuzzy sets and systems-Theory and applications", Academic Press, New York (1980).    L. A. Zadeh, "Fuzzy sets as a basis for a theory of possibility", Fuzzy sets and Systems 1, pp. 3–28 (1978).    D. Dubois, "Modeles mathematiques de l'imprecis et de l'incertain en vue d'applications aux techniques d'aide a la decision", Doctoral Thesis, University of Grenoble (1983).    D. Dubois, N. Prade, "Theorie des possibilites: application a la representation des connaissances en informatique", Masson, Paris (1985).    "Hidden Variable Fractal Interpolation Functions", by Barnsley et al., School of Mathematics, Georgia Institute of Technology, Atlanta, Ga. 30332, July, 1986.    L. Anson, M. Barnsley, "Graphics Compression Technology", SunWorld, October 1991, pp. 43–52.    "Fractal Compression Breakthrough for Multimedia Applications", B. Caffery, Inside, Oct. 9, 1991.    Fractal Modelling of Real World Images, Lecture Notes for Fractals: Introduction, Basics and Perspectives, Siggraph (1987).    Fractal Geometry—Understanding Chaos, Georgia Tech Alumni Magazine, p. 16 (Spring 1986).    "Fractals Yield High Compression", Electronic Engineering Times, Sep. 30, 1991, p. 39.    Fractals—A Geometry of Nature, Georgia Institute of Technology Research Horizons, p. 9 (Spring 1986).    Fractal Modelling of Biological Structures, School of Mathematics, Georgia Institute of Technology (date unknown).    Packing It In by Ivars Peterson, Science News, vol. 131, No. 18, p. 283, May 2, 1987.    A Better Way to Compress Images, by Barnsley et al., Byte Magazine, January 1988.    Harnessing Chaos For Images Systhesis, by Barnsley et al., Computer Graphics, vol. 22, No. 4, August 1988.    Naik et al., "High Performance Speaker Verification ICASSP 86, Tokyo, CH2243-4/86/0000-0881, IEEE 1986, pp. 881–884.    "Voice Recognition and Speech Processing", Elektor Electronics, September 1985, pp. 56–57.    Shinan et al., "The Effects of Voice Disguise . . . " ICASSP 86, Tokyo, CH2243-4/86/0000-0885, IEEE 1986, pp. 885–888.    Computer Visions, Graphics, and Image Processing 1987, 37, 54–115.    L. D. Jackel, H. P. Graf, J. S. Denker, D. Henderson and I. Guyon, "An Application of Neural Net Chips: Handwritten Digit Recognition," ICNN Proceeding, 1988, pp. II-107–15.    G. A. Carpenter and S. Grossberg, "The Art of Adaptive Pattern Recognition by a Self-Organizing Neural Network," IEEE Computer, March 1988, pp. 77–88.    T. F. Pawlicki, D. S. Lee, J. J. Hull and S. N. Srihari, "Neural Network Models and their Application to Handwritten Digit Recognition," ICNN Proceeding, 1988, pp. II-63–70.    E. Gullichsen and E. Chang, "Pattern Classification by Neural Network: An Experiment System for Icon Recognition," ICNN Proceeding on Neural Networks, March 1987, pp. IV-725–32.    S. Grossberg and G. Carpenter, "A Massively Parallel Architecture for a Self-Organizing Neural Pattern Recognition Machine," Computer Vision, Graphics, and Image Processing (1987, 37, 54–115), pp. 252–315.    R. P. Lippman, "An Introduction to Computing with Neural Nets," IEEE ASSP Magazine, April 1987, pp. 4–22.    D. Psaltis, "Incoherent Electro-Optic Image Correlator", Optical Engineering, January/February 1984, vol. 23, No. 1, pp. 12–15.    P. Kellman, "Time Integrating Optical Signal Processing", Ph. D. Dissertation, Stanford University, 1979, pp. 51–55.    P. Molley, "Implementing the Difference-Squared Error Algorithm Using An Acousto-Optic Processor", SPIE, vol. 1098, 1989, pp. 232–239.    W. Rhodes, "Acousto-Optic Signal Processing: Convolution and Correlation", Proc. of the IEEE, vol. 69, No. 1, January 1981, pp. 65–79.    A. Vander Lugt, "Signal Detection By Complex Spatial Filtering", IEEE Transactions On Information Theory, IT-10, vol. 2, April 1964, pp. 139–145.    D. Psaltis, "Two-Dimensional Optical Processing Using One-Dimensional Input Devices", Proceedings of the IEEE, vol. 72, No. 7, July 1984, pp. 962–974.    P. Molley et al., "A High Dynamic Range Acousto-Optic Image Correlator for Real-Time Pattern Recognition", SPIE, vol. 938, 1988, pp. 55–65.    "Principle of Holonic Computer and Holovision" in Journal of the Institute of Electronics, Information and Communication, vol. 70, No. 9, pp. 921–930 (1987), Shimizu et al.    "Holonic Model of Motion Perception", IEICE Technical Reports, Mar. 26, 1988, pp. 339–346, Omata et al.    "Entrainment of Two Coupled van der Pol Oscillators by an External Oscillation", in Biological Cybernetics, vol. 51, pp. 225–239 (1985), Ohsuga et al.
The above-mentioned references are exemplary, and are not meant to be limiting in respect to the resources available to those skilled in the art. Of course it should be realized that the hardware available and the choice of specific method or software algorithm are interactive, and therefore must be specified together, however, it is noted that in view of the present disclosure, it is obvious to combine compatible technologies to achieve the advanced interface and control system of the present invention.

Adaptive pattern recognition based controller apparatus and method and human-factored interface therefore


Systems and methods are disclosed for notifying users of vehicle conditions. According to certain embodiments, the system comprises at least one processor configured to determine whether an ambient temperature associated with a vehicle exceeds a temperature threshold and detect a sound associated with the vehicle. The at least one processor is further configured to output a notification based on the determined ambient temperature and detected sound.

Vehicle telematics technologies have greatly improved the driving experience in recent years. For example, the incorporation of global positioning system (GPS) technology into vehicles has enabled drivers to navigate to their destinations more safely and efficiently. Hands-free cellular communications have allowed drivers to communicate with others more safely by minimizing the distractions associated with operating a handheld cellular phone. Numerous other benefits are provided by vehicle telematics, including roadside assistance, theft protection and vehicle recovery, and internal climate control.
Many of these technologies help improve the safety and comfort of users' experiences while driving, but safety is also a concern while a vehicle is shut off. For example, the climate inside a vehicle may become very dangerous for a child or pet that is left unattended, particularly on a hot day. Moreover, whereas current theft protection systems may provide some defense against vehicle theft, these systems fail to take advantage of the full potential of vehicle telematics. Aspects of the disclosed embodiments address these and other concerns regarding vehicle safety and security.

Systems and methods for notifying users of vehicle conditions


The present disclosure describes a termination structure for a high voltage semiconductor transistor device. The termination structure is composed of at least two termination zones and an electrical disconnection between the body layer and the edge of the device. A first zone is configured to spread the electric field within the device. A second zone is configured to smoothly bring the electric field back up to the top surface of the device. The electrical disconnection prevents the device from short circuiting the edge of the device. It is emphasized that this abstract is provided to comply with the rules requiring an abstract that will allow a searcher or other reader to quickly ascertain the subject matter of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims.

Conventional technologies to configure and manufacture high voltage semiconductor power devices are still confronted with difficulties and limitations to further improve the performance due to different tradeoffs. In vertical semiconductor power devices, there is a tradeoff between the drain to source resistance, i.e., on-state resistance, commonly represented by Rao, (i.e., drain-source resistance X Active Area) as a performance characteristic, and the breakdown voltage sustainable by the power device. A commonly recognized relationship between the breakdown voltage (BV) and the RdsA is expressed as: RdsA is directly proportional to BV2.5. For the purpose of reducing the RdsA, an epitaxial layer is formed with a higher dopant concentration. However, a heavily doped epitaxial layer also reduces the breakdown voltage sustainable by the semiconductor power device.
It is within this context that embodiments of the present invention arise.

This patent is subject to a terminal disclaimer.

Termination design for high voltage device

ALPHA AND OMEGA SEMICONDUCTOR INCORPORATED


A semiconductor device includes a substrate, a fin structure protruding from the substrate, a gate insulating layer covering a channel region formed of the fin structure, a gate electrode layer covering the gate insulating layer, and isolation layers disposed on opposite sides of the fin structure. The fin structure includes a bottom portion, a neck portion, and a top portion sequentially disposed on the substrate. A width of the neck portion is less than a width of the bottom portion and a width of a portion of the top portion.

In a fin field-effect transistor (FinFET), current leakage in a region below a channel region of the FinFET in a bottom portion of a fin structure should be prevented or suppressed.
To reduce current leakage, a Silicon-On-Insulator (SOI) substrate, which is much more expensive than a traditional silicon substrate, may be used such that a buried oxide layer of the SOI substrate can be used to isolate the source and drain regions.
Alternatively, a punch-through stopper or an oxide layer may be buried below the channel region so as to increase resistivity thereof, thereby reducing current leakage. However, forming a punch-through stopper below the channel region and forming an oxide layer below the channel region are complicated and difficult to control.

Semiconductor device with fin structures and manufacturing method thereof

TAIWAN SEMICONDUCTOR MANUFACTURING CO., LTD.


The present invention is directed to compounds useful for treating addictive behavior and sleep disorders represented by structural Formula (I)

There exists a substantial correlation for the relationship between 5-HT2 receptor modulation and a variety of diseases and therapies. To date, three subtypes of the 5-HT2 receptor class have been identified, 5-HT2A, 5-HT2B, and 5-HT2C. Prior to the early 1990's the 5-HT2C and 5-HT2A receptors were referred to as 5-HT1C and 5-HT2, respectively.
The agonism or antagonism of 5-HT2 receptors, either selectively or nonselectively, has been associated with the treatment of various central nervous system (CNS) disorders. Ligands possessing affinity for the 5-HT2 receptors have been shown to have numerous physiological and behavioral effects (Trends in Pharmacological Sciences, 11, 181, 1990). In the recent past the contribution of serotonergic activity to the mode of action of antidepressant drugs has been well documented. Compounds that increase the overall basal tone of serotonin in the CNS have been successfully developed as antidepressants. The serotonin selective reuptake inhibitors (SSRI) function by increasing the amount of serotonin present in the nerve synapse. These breakthrough treatments, however, are not without side effects and suffer from delayed onset of action (Leonard, J. Clin. Psychiatry, 54(suppl), 3, 1993). Due to the mechanism of action of the SSRIs, they effect the activity of a number of serotonin receptor subtypes. This non-specific modulation of the serotonin family of receptors most likely plays a significant role in the side effect profile. In addition, these compounds often have a high affinity for a number of the serotonin receptors as well as a multitude of other monoamine neurotransmitters and nuisance receptors. Removing some of the receptor cross reactivity would allow for the examination and possible development of potent therapeutic ligands with an improved side effect profile.
There is ample evidence to support the role of selective 5-HT2 receptor ligands in a number of disease therapies. Modulation of 5-HT2 receptors has been associated with the treatment of schizophrenia and psychoses (Ugedo, L., et. al., Psychopharmacology, 98, 45, 1989). Mood, behavior and hallucinogenesis can be affected by 5-HT2 receptors in the limbic system and cerebral cortex. 5-HT2 receptor modulation in the hypothalamus can influence appetite, thermoregulation, sleep, sexual behavior, motor activity, and neuroendocrine function (Hartig, P., et. al., Annals New York Academy of Science, 149, 159). There is also evidence indicating that 5-HT2 receptors mediate hypoactivity, effect feeding in rats, and mediate penile erections (Pyschopharmacology, 101, 57, 1990).
Compounds exhibiting selectivity for the 5-HT2B receptor are useful in treating conditions such as tachygastria, hypermotility associated with irritable bowel disorder, constipation, dyspepsia, and other peripherally mediated conditions.
5-HT2A antagonists have been shown to be effective in the treatment of schizophrenia, anxiety, depression, and migraines (Koek, W., Neuroscience and Behavioral reviews, 16, 95, 1996). Aside from the beneficial antipsychotic effects, classical neuroleptic are frequently responsible for eliciting acute extrapyramidal side effects and neuroendocrine disturbances. These compounds generally possess signifcant dopamine D2 receptor affinity (as well as other nuisance receptor affinity) which frequently is associated with extra pyramidal symptoms and tardive dyskinesia, thus detracting from their efficacy as front line treatments in schizophrenia and related disorders. Compounds possessing a more favorable selectivity profile would represent a possible improvement for the treatment of CNS disorders.
Serotonin (5HT) may have a critical role in the regulation of some drug-induced addictive behaviors. Serotonin is involved in neuronal processes related to inhibitory control and impulsivity. (Roy et al., Acta Psychiotr. Scand. 78 (1988) 529-535; Soubrie et al., Behav. Brain. Sci. 9 (1986) 319-364) Some studies have implicated serotonergic mechanisms in the development or expression of drug-induced sensitization (King et al., Psychopharmacology 130 (1997) 159-165; Olausson et al., Psychopharmacology 142 (1999) 111-119) The relationship between 5HT and impulsive behavior as well as drug intake has been described, and manipulations that attenuate 5HT neurotransmission both increase impulsive behavior (Roy et al., Acta Psychiotr. Scand. 78 (1988) 529-535; Soubrie et al., Behav. Brain. Sci. 9 (1986) 319-364) and elevate the intake of various drugs of abuse (Engel et al., in Naranjo, C. A., Sellers, E. M. (Eds.). Novel Pharmacological Interventions for Alcoholism, Springer, New York, pp. 68-82 (1999); Roberts et al., Pharmacol. Biochem. Behav. 49 (1994) 177-182).
A series of animal investigations have reported that central 5HT2 receptors are related to the many symptoms associated with drug-dependent withdrawal. Withdrawal from chronic exposure to low doses of cocaine causes reversible supersensitivity of 5HT2 receptors in mice. (Baumann et al., Neuropharmacology 35 (1996) 295-301; Darmani et al., Neurotoxicol. Tertol. 22 (2000) 61-69) Moreover, the 5HT2 receptor antagonists, ketanserin and mianserin, block or attenuate morphine withdrawal syndrome in rats. (Neal et al., J. Pharmacol. Exp. Ther. 236 (1986) 157-165; Neal et al., Eur. J. Pharmacol. 132 (1986) 299-304)
The effects of 5HT receptor agonists on the behavioral and neurochemical consequences of repeated nicotine treatment have also been studied. (Olausson et al., Eur. J. Pharmacol. 420 (2001) 45-54) The results of that study provided evidence that repeated daily nicotine treatment is associated with both locomotor sensitization and behavioral disinhibition, and that the expression of those behaviors can be modulated by specific agonists at 5HT receptor subtypes.
Studies with experimental animals have shown that nicotine withdrawal leads to increased sensitivity of serotonergic neurons in the dorsal raphe to 5HT1A agonists in rats. (Rasmussen et al., Psychopharmacology (Berl) 133 (1997) 343-346) Other findings suggest that cessation of chronic nicotine increases the sensitivity to 5HT2 receptor systems, and that the 5HT2 receptor systems may be related to some aspect of the nicotine withdrawal syndrome. (Suemaru et al., Psychopharmacology (Berl) 159 (2001) 31-38) Other studies have also examined the effect of nicotine cessation on the central serotonergic systems in mice and the involvement of 5HT2 receptors. (Yasuda et al., Naunyn-Schmiedeberg's Arch. Pharmacol. 366 (2002) 276-281) The studies by Yasuda et al. suggested that cessation of repeated nicotine administration resulted in increased sensitivity to 5HT2 receptor systems and decreased 5HT2 turnover, and that these phenomena may be related to the manifestation of nicotine withdrawal symptoms.
Modulation of the 5-HT2 receptors has been observed to play a role in sleep disorders. Ritanserin, a selective 5HT2 receptor antagonist, massively enhances slow save sleep (stage 3 and 4) in humans (Declerck et al., Curr. Ther. Res. 41 (1987)427-432; Idzikowsky et al., Psychopharmacology 93 (1987) 416-420; Ikzikowsky et al., Brain Res. 378 (1986) 164-168) and increases deep slow wave sleep in rats. (Detari et al., Psychopharmacology 142 (1999) 318-326; Dugovic et al., Eur. J. Pharmaol. 137 (1987) 145-146; Kantor et al., J. Physiol. 526 (2000) 66-67) Ritanserin and other 5HT2 receptor antagonists increase low frequency EEG activity administered at the beginning of the passive phase of sleep, that is in the light period in rats (Borbely et al., Eur. J. Pharmacol. 156 (1988) 275-278) and in the dark period in humans (Dijk et al., Eur. J. Pharmacol. 171 (1989) 207-218).
The effects of the 5HT2 receptor antagonist ritanserin on electroencephalogram (EEG) power spectra, sleep and motor activity have also been studied. (Kantor et al., Brain Research 943 (2002) 105-111) The studies by Kantor et al. showed that the 5HT2 receptor antagonist ritanserin has longterm effects on EEG power spectra, sleep and motility. Kantor et al. concluded that because ritanserin is a 5HT2 receptor antagonist, under physiological conditions, serotonin increases electroencephalogram (EEG) synchronization and produces an increase in vigilance level and motor activity by tonic activation of 5HT2 receptors. The proposed regulatory mechanism plays an important role in the waking process and the appearances of its effects in the light and dark phases were markedly different.
U.S. Pat. Nos. 3,914,421; 4,013,652; 4,115,577; 4,183,936; and 4,238,607 disclose pyridopyrrolobenz-heterocycles of formula:
where X is O, S, S(═O), or SO2; n is 0 or 1; R1 is various carbon substituents, and Z is a monosubstituent of H, methyl, or chloro.
U.S. Pat. No. 4,219,550 discloses pyridopyrrolo-benzheterocycles of formula:
where X is O or S; R1 is C1-4 alkyl or cyclopropyl; R2 is H, CH3, OCH3, Cl, Br, F, or CF3; and (A) is —CH2—, —CH(CH3)—, or —CH2CH2—.

Substituted heterocycle fused gamma-carbolines

Abstract: or pharmaceutically acceptable salt forms thereof, wherein R1, R5, R6a, R6b, R7, R8, R9, X, b, k, m, and n, and the dashed lines are described herein. The compounds used in the method of treatment of this invention are serotonin agonists and antagonists and are useful in the control or prevention of central nervous system disorders including addictive behavior and sleep disorders.


Estimating power consumption of a circuit design includes associating, using a processor, each partition of a plurality of partitions of a circuit design with a probability distribution (315). For each partition, the associated probability distribution specifies a distribution for a probability distribution parameter correlated with power consumption for the partition. Using the processor, an output probability distribution specifying power consumption of the circuit design can be calculated according to the probability distribution of each partition of the circuit design (320).

Conventional circuit simulators estimate power consumption of a circuit design using a number of different techniques. One technique used to estimate dynamic power consumption of a circuit design uses average current per transition of circuit elements. For the various portions of the circuit design, the average current is determined on a per transition basis. The circuit simulator receives a user input specifying average switching activity for the various portions of the circuit design. The circuit simulator then calculates an estimate of the average dynamic power consumed by each portion of the circuit design and for the circuit design as a whole.
From the average dynamic power consumption calculation, the circuit simulator estimates peak power consumption. Typically, the peak power consumption for a circuit design is calculated by either increasing the average switching rate for each module unilaterally by a predetermined amount, e.g., 15%, or by adding a margin of error to the estimated average dynamic power consumption for the circuit design as a whole, e.g., increase the dynamic average power consumption by 15%. Thus, both the average dynamic power consumption and the peak dynamic power consumption are output as single values.
Another technique is to perform a cycle accurate simulation of the circuit design using a back annotated netlist. The back annotated netlist is used to build a current profile for the circuit design. This approach, however, is not practical due to the difficulties involved in creating a suitable test bench and the excessive runtime that is required. Moreover, in many cases, only high level models are available for one or more portions of the circuit design meaning that cycle accurate models are not available. As such, the opportunity to perform a cycle accurate simulation may be foreclosed by the lack of available models even if runtime and the ability to create a suitable test bench were not concerns.


A method comprises an operation for facilitating authentication of a client device attempting to connect to a port of a network element. Facilitating authentication includes determining whether the client device is configured for being authenticated using a first authentication mechanism and, in response to determining that the client device is not configured for being authenticated using the first authentication mechanism, determining whether the client device is configured for being authenticated using at least one other authentication mechanism. For each one of the authentication mechanisms, an operation is provided for providing the client device with network connectivity dependent upon a respective first classification policy structure in response to the client device being successfully authenticated and an operation is provided for providing the client device with network connectivity dependent upon a respective second classification policy structure different that the first classification policy structure in response to the client device failing to be successfully authenticated.

In an enterprise data network, known authentication methodologies have required that the network administrator select and configure a particular authentication methodology (i.e. configured authentication methodology) that is to be used on a network access port of a particular switch or router. In some instances, the network access port might be configured with one default authentication methodology to classify a client device should the client device fail authentication under the configured authentication methodology. Examples of such known authentication methodologies include, but are not limited to, 802.1x authentication protocol, Media Access Control (MAC) authentication protocol, Web-based login and the like. This need to manually determine and configure the particular authentication methodology limits the device connected to a network access port to only use the configured authentication methodology because client devices connected to a network access port would be limited to only the configured authentication methodology and extensive manual administration would be necessary to support heterogeneous authentication methodologies whenever a client device compatible with one of many potential authentication methodologies moved in the network.
In accordance with 802.1x authentication protocol during a port start-up event on a network access port of a switch or router, an Extensible Authentication Protocol (EAP)-Request/Identity frame is sent to an 802.1x group MAC address in order to solicit start of authentication from supplicants connected to the port. After that, EAP-Request-Identity frames are sent only to the specific MAC addresses of the client devices sending data traffic on the port. This will trigger the start of the client device authentication if a client device is a supplicant (i.e., an 802.1X compliant device). If the client device is a supplicant, it should return an EAP-Response/Identity frame to start the authentication. If no EAP-Response/Identity frame is received, after a number of tries, the client device is considered to be a non-supplicant and, by default, is blocked. This scenario exemplifies the shortcoming associated with authentication of a client device that is attempting to connect to a network access port of a router or switch being limited to only a single authentication methodology. Similar shortcomings exist for authentication methodologies for non-supplicants.
Therefore, facilitating authentication of a client device in a manner that allows several different authentication methodologies to be automatically and sequentially applied in an effort to identify an authentication methodology that is compatible with authentication abilities of the client device would be advantageous, desirable and useful.

Facilitating heterogeneous authentication for allowing network access


A method of programming a NAND flash memory device includes providing a flash memory device, wherein word lines are disposed between a drain selecting line and a source selecting line, wherein a first word line is provided adjacent to the source selecting line and a last word line is provided adjacent to the drain selecting line; and selecting a word line to program memory cells coupled to the selected word line to perform an even LSB program operation and an odd LSB program operation for the selected first word line. Each of the word lines is selected until all of the word lines have been selected, so that the even LSB program operation and the odd LSB program operation can be performed for all of the word lines. The even LSB program operation is performed to store a lower rank data bit in memory cells coupled to an even bit line assigned a selected word line. The odd LSB program operation is performed to store a lower rank data bit in memory cells coupled to an odd bit line assigned to the selected word line.

The present invention relates to a method of programming a NAND multi-level cell flash memory device, and more particularly to a method of programming that reduces the interference between cells.
A semiconductor memory device is generally divided into a volatile memory device and a non-volatile memory device. In the volatile memory device, data is erased when the supply of power is stopped. In the non-volatile memory device, data is maintained even though the supply of power is stopped.
Recently, the non-volatile flash memory device has become widely used. The two main types of flash memory device is a NOR flash memory and a NAND flash memory. The NOR flash memory has excellent random access time characteristics because memory cells are independently connected to bit lines and word lines. Whereas, in the NAND flash memory, only one contact is required for one cell string because memory cells are connected in series, and so the NAND flash memory has excellent characteristics for integration. Recently, the demand for high density flash memory has increased, and thus the NAND flash memory having high degree of integration has been widely employed as the flash memory device of choice.
A single level cell (hereinafter, referred to as "SLC") is employed when storing 1 bit data in a memory cell. A multi-level cell (hereinafter, referred to as "MLC") is employed for storing data of 2 bits or more in a memory cell. Recently, because of the need for a flash memory device having a high degree of integration, the MLC has been actively studied.
The MLC generally has at least four threshold voltage levels, and also has four or more data storing conditions corresponding to the threshold voltage levels.
A typical MLC has four data storing conditions, e.g. '11', '10', '00' and '01'. Here, when the four data storing conditions corresponds to one of the threshold voltage levels, a 2 bit data can be stored in a memory cell.
The MLC is programmed by a Fowler-Nordheim tunneling phenomenon. A program voltage is applied to a row of gates of a selected cell, and a ground voltage Vss is provided to the channels of the selected cell. Accordingly, a high electric field is formed between a floating gate of a programmed cell and a channel.
FIG. 1 is a view illustrating a method of programming a common flash memory device. The MLC stores data of 2 bits or more, wherein the bits are divided into a most significant bit (hereinafter, referred to as "MSB"), and a least significant bit (hereinafter, referred to as "LSB"). For example, when storing the binary value '10', the MSB and LSB are 1 and 0, respectively.
Accordingly, in case that LSB is programmed in '11', data storing condition '11' is converted into data storing condition '10. Subsequently, to program MSB, the programming result of LSB is detected, and then the MSB is programmed in accordance with the detecting result.
For instance, if LSB is detected to be 1, data storing condition is '11'. Accordingly, in case of programming the MSB, data storing condition becomes '01'. If, on the other hand, LSB is detected to be 0, data storing condition is '10'. Accordingly, in case of programming the MSB, data storing condition becomes '00'.
However, since the MLC has more threshold voltage levels than the SLC (i.e., four instead of two), the read margin between the threshold voltage states for the MLC becomes more important.
Generally, the factors for causing interference between adjacent cells and changing the threshold voltage occurs commonly in NAND flash memory. The change in the threshold voltage increases as the flash memory devices become highly integrated and the density increases. The device characteristics of the flash memory are deteriorated.
In addition, comparing A of FIG. 2B to A of FIG. 2A, the threshold voltage distribution of the cell is increased due to the interference, and thus a pass voltage Vpass in FIG. 2B needs to be increased so that the cells have the same read margins as shown in B and C of FIGS. 2A and 2B. However, read disturb will occur due to the increase of the pass voltage Vpass.
In one embodiment, a method of programming a NAND flash memory device includes providing a flash memory device where N word lines are disposed between a drain selecting line and a source selecting line, each word line being assigned with a first bit line and a second bit line; performing an LSB program operation for storing a lower rank data bit from a first word line adjacent to the source selecting line to an Nth word line adjacent to the drain selecting line; and performing a MSB program operation for storing a higher rank data bit from the first word line adjacent to the source selecting line to the Nth word line adjacent to the drain selecting line. The LSB program operation includes: selecting a given word line, and programming first memory cells coupled to the first bit line of the selected word line and then second memory cells coupled to the second bit line of the select word line, wherein the selecting-a-given-word-line step and the programming-first-memory-cells step are repeated until the Nth word line has been processed. The first bit line is an even bit line, and the second bit line is an odd bit line.
In one embodiment, the MSB program operation includes selecting a given word line, and programming first memory cells coupled to the first bit line of the selected word line and then second memory cells coupled to the second bit line of the select word line, wherein the selecting-a-given-word-line step and the programming-first-memory-cells step are repeated until the Nth word line has been processed. The LSB program operation uses a method of incrementally increasing a word line voltage that is smaller than a word line voltage used for the MSB program operation.
In another embodiment, a method of programming a NAND flash memory device includes providing a flash memory device, wherein word lines are disposed between a drain selecting line and a source selecting line, wherein a first word line is provided adjacent to the source selecting line and a last word line is provided adjacent to the drain selecting line; and selecting a word line to program memory cells coupled to the selected word line to perform an even LSB program operation and an odd LSB program operation for the selected first word line. Each of the word lines is selected until all of the word lines have been selected, so that the even LSB program operation and the odd LSB program operation can be performed for all of the word lines. The even LSB program operation is performed to store a lower rank data bit in memory cells coupled to an even bit line assigned a selected word line. The odd LSB program operation is performed to store a lower rank data bit in memory cells coupled to an odd bit line assigned to the selected word line.
In another embodiment, the word lines are selected sequentially from the first word line until the last word line has been selected. The method further includes performing an even MSB program operation for storing a higher rank data bit in the memory cells coupled to the even bit line of the selected word line; and performing an odd MSB program operation for storing a higher rank data bit in memory cells coupled to the odd bit line of the selected word line, wherein the even MSB program operation and the odd MSB program operation are performed for each selected word line until the even MSB program operation and the odd MSB program operation have been performed for all of the selected word lines. The LSB program operation uses a method of incrementally increasing a word line voltage that is smaller than a word line voltage used for the MSB program operation.

Method of programming a NAND flash memory device


One or more systems for silencing and extracting waste heat from exhaust of a combustion system for performing an operation and using the waste heat to perform an additional operation are provided herein. The system can include a heat recovery silencer. An inner housing of the heat recovery silencer can be in fluid communication with a combustion system. A heat recovery flow path of the heat recovery silencer can have an outlet port in fluid communication with an auxiliary device inlet, and the heat recovery flow path can have an inlet in fluid communication with an axially device outlet of the auxiliary device.

A need exists for a system that can recover waste heat from a first combustion system in an efficient manner and use the waste heat to perform an auxiliary operation.
A further need exists for a system that can eliminate the need for a second combustion system to prevent unnecessary emissions. Furthermore, there is a need for a system that eliminates the need for multiple combustion systems to prevent unnecessarily unsafe working conditions.
A need also exists for a system that can muffle or eliminate a sound emanating from an exhaust system of a combustion system, and can efficiently recover waste heat from exhaust gas from the combustion system.
The present embodiments meet these needs.
The present embodiments are detailed below with reference to the listed Figures.

System for recovering waste heat from exhaust


A window assembly for a vehicle includes a window opening defined by a margin of material. The window assembly also includes a window having an adhesive member bonded on it prior to an installation operation on a vehicle. The adhesive member is further bonded to the margin of material when the window assembly is attached to the vehicle.

Window assemblies may be attached to openings formed in the sheet metal of a vehicle using fasteners and separate adhesive systems that are attached to the vehicle in a manufacturing facility. Such bonding systems require the use of a separate attachment operation for the adhesive leading to a more complex assembly in a manufacturing facility.
There is therefore a need in the art for an improved window assembly including an integrated bonding system that is easier to install in a vehicle. There is also a need in the art for a window assembly that that can be installed with a reduced number of operations.

Window assembly having an integral bonding system


The present disclosure describes compositions comprising β-lactam antibiotics and branched polyethylenimines (BPEI), having efficacy against various Gram-positive bacteria, for example Gram-positive bacteria having resistance against β-lactam antibiotics, one non-limiting example of which is Methicillin-resistant Staphylococcus aureus (MRSA). The compositions result in the resensitization of such resistant bacterial strains to traditional antibiotic therapies such as β-lactam antibiotics.

Resistance of certain bacterial strains to previously-effective antibiotics is a growing global problem. For example, colonies of methicillin-resistant Staphylococcus aureus (MRSA) bacteria invade host tissue to release toxins that cause tissue injury, leading to significant patient morbidity. The patient suffers while numerous first- and second-line antibiotics are prescribed to no avail. This increases the threat of MRSA to public health. Timely MRSA diagnosis and delivering drugs of last resort are essential to prevent mortality. In 2011 for example, MRSA infected 80,500 people and nearly 1 in 7 cases resulted in death (11,300; 14%). While, several antibiotics of last resort (vancomycin, linezolid, daptomycin) are effective at killing MRSA, and there has never been a S. aureus isolate resistant to all approved antibiotics, patients still die from MRSA infections. The reason for this is because the drugs of last resort are given after morbidity from staphylococcal toxins has set in, too late to prevent mortality. Moreover, vancomycin, a primary treatment option after MRSA diagnosis, presents additional barriers of high cost and toxicity. New antibiotics, such as oxadiazoles, tedizolid, and teixobactin, are awaiting FDA approval to meet the critical need for new treatments because S. aureus strains resistant to vancomycin and β-lactams have emerged. New treatment options for MRSA and other bacterial strains which have become resistant to standard β-lactam antibiotics are needed.
Originally acquired exclusively in health care settings, MRSA is now regularly found outside the health care environment for a variety of reasons including drug-resistance, which hinders efforts to develop safe clinical treatments for MRSA infections. Resistance mechanisms include a novel penicillin-binding protein 2a (PBP2a) with a lower affinity for β-lactams than the native penicillin-binding protein 2 (PBP2) protein. β-lactamases, enzymes that degrade β-lactam antibiotics, are also common. Approaches to overcome these resistance factors are efflux-pump inhibitors that increase the intracellular concentration of antibiotics, using β-lactamase inhibitors, or increasing cell wall permeability. Nevertheless, the cell wall remains an especially rich antimicrobial target, containing many components shown to contribute to resistance, such as excess peptidoglycan, techoic acids and novel proteins. While these approaches have shown promise, the presence of side-effects and slow transfer from discovery to clinical usage have failed to stem the rate of MRSA infection and mortality. Community-acquired MRSA is less likely than healthcare-associated MRSA to exhibit multidrug resistance, but resistance to β-lactam antibiotics is a defining characteristic in both cases. New formulations to effectively treat MRSA and other antibiotic-resistant bacteria are urgently needed.

Methods of treating bacterial infections with penam β-lactam antibiotics and branched poly(ethylenimine)

The Board of Regents of the University of Oklahoma


An optical AND gate includes at least one semiconductor laser amplifier (SLA) and inputs for first and second optical signals. The gate produces an output corresponding to the AND product of A and B. In one aspect of the invention, the first and second signals are equal in wavelength. The gate may comprise a single SLA which receives the first signal A together with a third signal P, which may be a continuous wave pump. The second signal B is input in an orthogonal polarization state to A and P. Alternatively, the gate may comprise a pair of SLAs. A first SLA receives the first signal A together with the pump P. A sideband is selected from the output of the first SLA and input to the second SLA together with the second signal B. A sideband is selected from the output of the second SLA corresponding to the AND product C of A and P with B.

1. Field of the Invention
The present invention relates to an all-optical gate for carrying out an AND logic operation. Such a gate might be used, for example, in an optical telecommunications system, or in optical data-processing devices.
2. Related Art
AND is a fundamental logic operation necessary for example, for the implementation of optical networks including photonic switching nodes. Our co-pending international application no PCT/GB94/00397, the contents of which are incorporated herein by reference, describes and claims one example of the use of an AND function in recognising an address carried in the header of a frame on the optical network, and controlling a routing switch accordingly.
It has recently been proposed to use the process known as four-wave mixing (FWM) to implement an AND function. FWM produces an output proportional to the product of the electric fields of two input optical signals. Andrekson et al: "16 Gbit/s All Optical Demultiplexing Using Four-wave Mixing," Electron. Lett., 27, 1991, pp. 922 and R. Schnable, W. Pieper, R. Ludwig, H. G. Weber: "All Optical AND Gate using Femtosecond Non-linear Gain Dynamics in Semiconductor Laser Amplifiers", ECOC '93 describe implementations of AND functions using FWM in single-mode optical fibre and in semiconductor laser amplifiers (SLAs) respectively. Potentially such devices might be appropriate for switching or logic processing functions in optical telecommunications networks. However, the optical-fibre based devices require long interaction lengths, and so have a large in-built switch latency. This latency makes such devices unsuitable for applications where a fast decision time is required. SLAs by contrast have short device lengths, and hence low latency and are capable of high switching speeds due to their non-linear gain dynamics.

British Telecommunications public limited company