A method and apparatus for assigning a network address of a target server/host system in a network system having server/host systems interconnected by network links. The apparatus includes a first part residing in a management server/host system and a second part residing in the target server/host system and each part includes a plurality of network address sub-mechanisms and an address manager mechanism for controlling operation of the network address mechanisms. The network address mechanism include, for example, a setup wizard mechanism, a reverse address resolution protocol mechanism, a unit-cast address discovery mechanism and a dynamic host configuration protocol mechanism. The address manager mechanism directs the operation of the network address sub-mechanisms through three modes of operation designated as the address discovery mode, the address verification mode and the operation mode, using each network address sub-mechanism cooperatively and in its own mode of operation, and in certain instances concurrently, to obtain a network address, a subnetwork mask and a gateway address for the target server/host system.

The use of networked systems has become common and widespread as offering greatly enhanced access to and communication between a user connected to a network and other users and resources also connected to the network. As is well known and understood, such networked systems are typically comprised of one or more server/host systems and a number of user/client systems, all interconnected through communications links and communicating through a common network protocol. The user/client systems are typically directly accessible to the network users and the server/host systems typically support and provide resources to the user/client systems and communications between user/client systems and between the user/client systems and the server/host systems.
While such systems can and do use a variety of protocols for communication between the elements of the system, one feature and requirement that is common to all such protocols is a means for individually identifying and addressing the elements of a system, that is, the server/host systems and the user/client systems. The internet, for example and as will be discussed further with regard to a presently preferred embodiment of the invention, uses a TCP/IP protocol in which Internet Protocol (IP) addresses, together with domain names and address masks, are used to uniquely identify each individual server/host or user/client in the network and to control the addressing of the server/host and user/client systems in the internet.
The assignment, tracking and maintenance of addresses for system elements in a network is a recurring problem, however, and particularly in the case of the server/host systems which function as the primary controllers of a system. This problem appears whenever a server/host is newly connected into a network and a network address has not been assigned, whenever an address has been assigned to a server/host but has not yet been verified as valid, and when a server/host has been moved to another network address and its address has not been update, or rediscovered.
A number of mechanisms and facilities have been developed in the prior art to deal with these problems. For example, the IP address for an uninitialized network server/host system has typically been determined through the BootP Protocol, the Dynamic Host Configuration Protocol (DHCP), which is an extension of the BootP Protocol, the Reverse Address Resolution Protocol (RARP), or the use of Uni-Cast Ethernet/IP packets, all of which are well known to those of ordinary skill in the relevant arts. In a like manner, DHCP has commonly been used for IP address validation and rediscovery. All of these protocols and methods have proven unsatisfactory, however, as none meet all of the requirements for performing all of the necessary operations. DHCP and BootP Protocol, for example, is inadequate in applications and systems that require that a server/host system be assigned a fixed IP address and in situations wherein a server/host system, such as a World Wide Web server, must be assigned multiple IP addresses.
The present invention provides a solution to these and other problems of the prior art and, while illustrated below for the specific example of an internet system, may be readily implemented for any network based device or system whose primary management interface, that is, the interface through which network addresses are assigned, verified and re-discovered, is network based.

Methods and apparatus for determining, verifying, and rediscovering network IP addresses


An aquatic weed cutter has a continuous cable strung along the horizontal and vertical members of an inverted T-shaped cable frame. The cable is moved by a motor drive in a circuit between opposed sheaves on the ends of the horizontal and vertical members. The drive comprises a pair of engaging belts which hold the cable therebetween and drive it about the circuit. Cutting clips are attached at spaced intervals to the cable for cutting the stems of underwater plants.

This invention relates generally to aquatic weed cutting machines. More particularly, this invention pertains to boat-mounted machines for cutting aquatic plants growing in bodies of water.
The overgrowth of aquatic plants in freshwater lakes often results in the deprivation of subsurface sunshine, the depletion of dissolved oxygen, and contributes to the eutrophication of the water body, particularly in the die-off which occurs in the autumn of the year. Nutrients which have been deposited in the sediments over a long time period are re-introduced to the water body, resulting in over-fertilization.
Often, over-growth of aquatic weeds decreases the viability of the fish population, limiting the water surface area available for use by waterfowl and anglers, swimmers and waterskiers.
Eurasian watermilfoil is a particularly troublesome weed, having a high reproduction rate which enables it to completely take over a body of water in a few years. Other plants are rapidly displaced, and the water body loses much of its value as a resource for wildlife and recreational values, e.g. boating, fishing and swimming.
While the introduction of copper compounds into the water body has been used to limit plant growth, its general application is considered not acceptable for ecological reasons.
Various types of apparatus have been devised for cutting aquatic weeds. For example, U.S. Pat. No. 1,200,096 of Firman discloses a kelp harvester using cutter blades mounted on a pair of spinning horizontal circular disks.
U.S. Pat. No. 2,317,367 of Foerster describes a submarine weed cutter using a straight saw blade suspended between the ends of a cable, by which the blade is reciprocally moved.
A U.S. Pat. No. 4,205,507 of McClure discloses a weed cutter with a cutter bar comprising two elongate members. Each member has a plurality of teeth, and relative reciprocating movement of the members provides a cutting action therebetween.
In U.S. Pat. Nos. 4,328,658, 4,815,260 and 4,942,722, Desrosiers et al. show a weed harvester which is basically a multi-strand cable which is drawn through a weedy area and continuously twisted. The twisting action wraps weeds around the cable, and cable movement wrenches the weeds from the ground, drawing them to the drive mechanism. The apparatus is not a cutter.
In U.S. Pat. Nos. 4,885,902 and 5,189,867, Schmidt describes another aquatic vegetation cutter using a cutter bar with two reciprocating blade assemblies, each with multiple teeth.
These prior art cutters suffer from various disadvantages, including low cutting rates, clogging, substantial maintenance downtime, high construction cost, and the necessity for a dedicated weed cutting watercraft. In addition, none of the prior art cutters known to applicant are capable of following bottom terrain changes. An aquatic vegetation cutter is needed which is simple in construction, easy to operate and maintain, adaptable to various water and plant conditions, and effective to achieve a high harvest rate.


A transconductance push-pull amplifier (20) generates primary push-pull currents (I1, I2) corresponding to a voltage input signal (VIN). Current mirrors (42,44) generate secondary push-pull currents (I3, I4) corresponding to the primary push-pull currents (I1, I2). For sampling, both the primary and secondary push-pull currents (I1, I2, I3, I4) are applied to charge a capacitor (C3) in a current feed-forward arrangement with high slew rate and fast signal acquisition to produce a voltage output signal (VOUT). The capacitor (C3) is disconnected from the amplifier (20) and current mirrors (42,44) to hold the output signal (VOUT). Switching transistors (Q13, Q15) which are connected between the capacitor (C3) and the current mirrors (42,44) have substantially the same non-linear modulation characteristics as corresponding output transistors (Q7, Q8) in the amplifier (20). The output and switching transistors (Q7, Q8, Q13, Q15) are connected to modulate out-of-phase such that non-linear modulation of the primary push-pull currents (I1, I2) by the output transistors (Q7, Q8) is canceled by non-linear modulation of the secondary push-pull currents (I3, I4) by the switching transistors (Q13, Q15), and the output signal (VOUT) is a highly linear replica of the input signal (VIN).

1. Field of the Invention
The present invention generally relates to the art of electronic waveform sampling circuits, and more specifically to a sample-and-hold circuit including a push-pull transconductance current amplifier and current mirrors for high slew current, fast signal acquisition and high linearity.
2. Description of the Related Art
Sample-and-hold circuits charge a holding element, which is usually a capacitor, to the instantaneous amplitude of an analog input signal during a tracking or sampling interval, and then disconnect the input signal from the capacitor during a holding interval. The sampled voltage which is held by the capacitor is typically applied to an analog-to-digital converter which produces a corresponding digital value which is stored in a random access memory of a waveform processing unit. A set of stored digital values obtained at increments of a sampled waveform constitutes a digital approximation of the analog signal, and can be analyzed or processed using a variety of known algorithms in accordance with a particular application.
A typical prior art sample-and-hold circuit is described in U.S. Pat. No. 4,659,945, entitled "SAMPLING BRIDGE", issued Apr. 21, 1987 to A Metz. The circuit includes diodes which are connected in a bridge configuration and alternatingly switched between forward and reverse bias to couple an input signal to a capacitor for sampling, and to disconnect the input signal from the capacitor for holding.
The basic diode bridge sample-and-hold circuit does not provide input buffering, and the preceding stage is required to supply the dynamic slew current in the sampling mode. In addition, the sampled pedestal as well as the D.C. offset are determined by the matching of the diode pairs.
The effect of the diode mismatch can be reduced by decreasing the D.C. bias current through the diodes in sampling mode. This, however, reduces the maximum dynamic slew current which is available for charging and discharging the capacitor, thereby limiting the slew rate and increasing the signal acquisition time during the transition from holding to sampling mode.
As another drawback, the maximum dynamic slew current in the basic diode bridge is limited to one-half of the D.C. standing or bias current flowing through the circuit. This also limits the slew rate and increases the acquisition time.
An improved sample-and-hold circuit which uses diodes as switching elements is disclosed in article entitled "A 1.2-.mu.m Bicmos Sample-and-Hold Circuit with a Constant-Impedance Slew-Enhanced Sampling Gate", by M. Wakayama et al, in IEEE Journal of Solid-State Circuits, Vol. 27, No. 12, Dec. 1992, pp. 1697-1708. This circuit is illustrated in FIG. 1 and designated as 10.
The circuit 10 includes diodes D1 to D4 which are connected in an arrangement which resembles, but does not function as a bridge. A voltage input signal VIN is applied to the bases of NPN bipolar transistors Q1 and Q2. The emitters of the transistors Q1 and Q2 are connected to the collectors of similar transistors Q3 and Q4 respectively, the emitters of which are connected to a constant current source IS1 which sinks a constant current IBIAS.
The emitter of the transistor Q1 is also connected to the cathode of the diode D1 and the anode of the diode D3. The emitter of the transistor Q2 is connected to the anode of the diode D2 and the cathode of the diode D4. The junction of the diodes D1 and D2 is connected across a capacitor C1 which produces an output voltage VOUT1. The junction of the diodes D3 and D4 is connected across a capacitor C2 which produces an output voltage VOUT2.
The collectors of the transistors Q1 and Q2 are connected to the input of a current mirror 12 to produce a reference current IREF. The current mirror 12 generates output currents IOUT1 and IOUT2 which are each equal to IREF and are applied to the emitters of the transistors Q1 and Q2 respectively.
The circuit 10 is periodically switched such that the capacitor C1 is charged or discharged to sample the input signal VIN while the capacitor C2 is disconnected to hold the input signal VIN as previously sampled, and vice-versa.
When a TRACK1/HOLD2 switching signal applied to the base of the transistor Q3 is high and a TRACK2/HOLD1 switching signal applied to the base of the transistor Q4 is low, the capacitor C1 operates in sampling mode and the capacitor C2 operates in holding mode. The transistors Q1 and Q3 are turned on and the transistors Q2 and Q4 are turned OFF. The diodes D1 and D2 are forward biased and the diodes D3 and D4 are reverse biased. The capacitor C2 is effectively disconnected from the rest of the circuit 10 and holds the voltage to which it was charged when it was previously operated in sampling mode.
Under static conditions, the mirror currents IREF, IOUT1 and IOUT2 are each equal to IBIAS/3 and flow through the transistor Q1 into the source IS1. The path for the current OUT2 is through the diodes D2 and D1. The signal VIN is coupled to the capacitor C1 through the transistor Q1 and the diode D1. The voltage VIN is reduced by one forward-biased diode drop Vbe across the base-emitter junction of the transistor Q1, and increased by one diode drop Vbe across the diode D1. The voltage VOUT1 is therefore substantially equal to the voltage VIN.
An increase in the input signal VIN causes the voltage at the emitter of the transistor Q1 to temporarily increase above VOUT1, and reverse bias the diode D1. The collector current of the transistor Q1, which constitutes the input current IREF of the current mirror 12, increases, thereby causing the output currents IOUT1 and IOUT2 to increase. The increased output current IOUT2 charges the capacitor C1 until VOUT1 becomes equal to VIN.
When the input signal VIN decreases, the diode D1 becomes forward biased and the capacitor C1 discharges through the diode D1 and the transistor Q3 into the source IS1 until VOUT1 becomes equal to VIN.
When the TRACK1/HOLD2 switching signal applied to the base of the transistor Q3 is low and the TRACK2/HOLD1 switching signal applied to the base of the transistor Q4 is high, the capacitor C1 operates in holding mode and the capacitor C2 operates in sampling mode. The operation is essentially similar to that described above, except that the transistors Q2 and Q4 and diodes D3 and D4 are operative rather than the transistors Q1 and Q3 and diodes D3 and D4.
The circuit 10 improves over the basic diode bridge circuit disclosed in the Metz patent in that the transistors Q1 and Q2 provide input buffering, and the current mirror increases the dynamic slew current by a factor of two. However, the circuit 10 suffers from the same limitation of the basic bridge circuit in that the maximum slew current is limited to the bias current provided by the source IS1.
Assuming that the capacitor C1 is operating in sampling mode and the capacitor C2 is operating in holding mode, the maximum current available for charging or discharging the capacitor C1 is equal to IBIAS. Since the reference current IREF of the current mirror 12 must be supplied by the current source IS1, its maximum value is limited to IBIAS. Since IOUT2 is equal to IREF, the maximum current available for charging the capacitor Cl is also equal to IBIAS.
For a value of VIN which is low enough to turn off the transistor Q1, the capacitor C1 discharges through the diode D1 and transistor Q3 into the source IS1. Since the maximum current the source IS1 can sink is IBIAS, the maximum discharge current is equal to IBIAS.
In summary, the maximum dynamic slew current which is available in the circuit 10 in sampling mode is limited to the standing or bias current IBIAS. This limits the slew rate and signal acquisition rate of the circuit to relatively low values. The circuit 10 also suffers from the drawback of the basic bridge circuit in that, due to the mismatch between the diodes D1 to D4, any attempt to increase the slew rate by increasing the bias current will cause a corresponding detrimental increase in the sampled pedestal and D.C. offset.

Sample-and-hold circuit including push-pull transconductance amplifier and current mirrors for parallel feed-forward slew enhancement and error correction


A canister for holding a solid phase support for use in a biospecific binding assay is disclosed. The canister consists of a receptacle and cap, both shaped to mate with each other in a snug fit, the cap having a central opening spanned by the solid phase in the form of a thin porous disk. The central opening is surrounded by a raised surface which forms a protective wall avoiding inadvertent contact of the disk by the user or surrounding objects. The cap and receptacle are constructed so as to provide a vent when the parts are joined, providing gravitational flow of a test sample across the porous disk into the interior of the receptacle.

Many types of immunoassays involve the interaction of a liquid sample with a solid material, and a determination of whether or not a reaction has taken place between species in the sample and species immobilized on the solid surface. The immobilization may be achieved either by covalent chemical bond or nonspecific binding such as electrostatic attraction, hydrophobic interaction or hydrogen bonding.
Handling of the solid phase by the operator is frequently a delicate procedure. In some cases, the membrane is thin and fragile. The membrane can be contaminated by inadvertent touching to the extent that its accuracy and reproducibility may be impaired. In addition, the species immobilized on the membrane may contain infectious material raising a safety hazard to those handling the membrane.
Drawing liquid through the solid phase is also problematic in some cases. Absorbent pads have been used on the downstream side of the membrane, but this requires very close contact between the membrane and the absorbent pad. Otherwise, bubbles form which obstruct the flow.
The present invention provides a canister for the support of a flow-through solid phase, which protects the solid phase and any species immobilized on it from inadvertent contact by the operator or other equipment, and permits flow across the solid phase solely by the force of gravity, retaining all liquids for proper disposal. The canister is comprised of two parts, an open-top receptacle and a cap for the receptacle, the cap designed to support the solid phase material. The cap has a central opening surrounded by a raised surface. The solid phase material spans the opening, and the raised surface serves as a protective wall encircling the material. The cap and receptacle are shaped to fit snugly and securely together and yet leave a gap to vent the interior of the receptacle to the atmosphere.


Embodiments include methods, and computer system, and computer program products for testing directly and indirectly anchored interfaces for vulnerabilities regarding storage protection keys. Aspects include: defining a test template for each parameter area interface for a given system service's interface for vulnerabilities regarding storage protection keys by replacing each parameter area interface with unauthorized parameters to generate expected failures, defining a test template for each parameter area interface having variable-length fields for vulnerabilities regarding buffer overflows in an attempt to access a protected storage area beyond an unprotected storage area with a larger length field to generate expected failures, defining a test template for each control block to replicate copies that will generate expected failures from the system service's validation, executing at least one test for each test template generated, summarizing results of the tests executed, and returning an overall return code based on summarized results.

The present disclosure relates generally to mainframe computing, and more particularly to methods, systems and computer program products of testing interfaces for storage vulnerabilities including storage protection keys and buffer overflows.
Storage protection keys in various forms are utilized on many computing platforms to provide an added security mechanism. Storage protection keys have the following elements: (a) each virtual memory page is assigned a small integer key value, (b) an indication whether that key applies to fetch protection or merely protects write access, and (c) a corresponding execution key for the unit of work. Generally the execution key must match the corresponding memory. There may be a specially designated execution key value that can access any storage key, and similarly there may be a specially designated virtual memory key that can be accessed by any execution key.
An exemplary vulnerability of computer storage protected by storage protection keys may include an unauthorized user passing bad addresses to a system service. The system service could be running with an authorized key, and if it trusts the user supplied address, could indirectly provide that user read or even write access to storage to which that user should not have access. Another vulnerability of computer storage may include buffer overflows. When parameter areas include variable-length fields, transfers of data can overflow when the boundaries of those length fields are not checked. A third exemplary vulnerability of computer storage may include system-owned control blocks. When an unauthorized user passes an address to a system-owned control block, the system service must verify that block through an independently anchored chain. Otherwise an unauthorized user could spoof the control block in order to cause that system service to take various actions that it would otherwise not take.
In order to ensure system integrity, system services should be tested in their use of untrusted parameters, including parameters that are directly anchored and those that are indirectly anchored by virtual addresses within a base parameter list. Additionally system services should be tested when variable-length fields are used to prevent buffer overflows. Addresses to control block need to be independently verified from system-controlled anchors.
Therefore, heretofore unaddressed needs still exist in the art to address the aforementioned deficiencies and inadequacies.

Methods and systems of testing interfaces of computer storage for storage vulnerabilities

INTERNATIONAL BUSINESS MACHINES CORPORATION


Examples herein generally relate to sinter blend compositions for use in a sintering process that do not contain coke breeze (0.0% coke breeze), or contain only very small amounts of coke breeze. In particular, these sinter blend compositions are capable of repurposing mixture of iron-making reverts, having high total and metallic iron levels that re-oxidize so as to become a replacement fuel source for the coke breeze typically used in sinter blend compositions for use in a sintering process, while still managing to produce a sinter with sufficient ISO tumble strengths.

Production processes in the iron and steel industry involve the formation of large amounts of by-products that create waste streams governed by costly legal disposal requirements designed to prevent environmental pollution.
In an integrated iron and steel plant, one of the most important thermal operations is the sintering of raw iron ore. In a conventional sintering process, waste products from the iron making process (a mixture of iron bearing residues, such as blast furnace dust and filter cake, commonly referred to as "reverts"), are mixed with iron ores, coke breeze, and limestone to create a sinter blend composition. The sinter blend composition is then heated at high temperatures until it is sintered into a porous irregular shaped iron oxide—commonly known as a "sinter"—that is feedstock for a blast furnace used in the production of pig iron, and eventually the production of steel.
Conventional sinter blend compositions have some disadvantages. For example, the energy source for conventional sintering processes is the carbon contained in the sinter blend composition's coke breeze (dust and fines of coke). However, as a result of the rapid growth of the steel industry worldwide, coke breeze is becoming increasingly expensive and difficult to procure. Another issue with sinter blend compositions is that after the sintering process they generally must produce a sinter with an ISO 3271 tumble strength rating ("ISO tumble strength") typically, greater than 72, that is capable of withstanding the rigors of the blast furnace iron-making process, which involves movement of the sinter on conveyor belts, and into shaft furnaces, under significant weight compression. Accordingly, not all iron making reverts are easily repurposed by incorporation into a sinter blend composition, in evaluating a typical sinter blend it may be necessary to estimate the total energy content of the sinter blend composition. Depending on the blend, any of the following energy sources may be present: coke breeze, component metallics and component carbon. If the combined energy content of the sinter blend composition is too high, excessive temperatures and slagging may develop during the sintering process.
Direct reduced iron (DRI), sometimes called sponge iron, is a commercial product widely used as a source material for making steel. The conventional techniques for making steel involve the use of an electric arc furnace (EAF) or a basic oxygen furnace (BOF). DRI is typically higher in iron units than taconite pellets and other sources of iron, and can be used as a partial substitute for scrap in the production of steel by EAF.
DRI is formed from beneficiated iron ore, such as taconite pellets. For example, taconite has been mined and crushed, and the iron containing portions magnetically separated from the non-iron containing portions to form a beneficiated product higher in iron content than mined taconite. The beneficiated iron ore portion may be formed into pellets by pelletizing, and heated in a linear hearth furnace in the presence of reducing agent (e.g., carbonaceous material) to a temperature below the melting point of iron using natural gas or coal, to promote the reduction of iron ore to metallic iron. DRI is typically above 90% metallic iron with the remainder gangue.
In the process to make DRI, the beneficiated and pelletized iron oxide containing material is moved through a furnace mixed with a reducing agent, such as coal, coke, or another for of carbonaceous material. A desulfurizing agent, such as limestone or dolomite, is also typically added. The carbon of the reducing agent and the oxygen of the iron oxide material react chemically in the reducing zone of the furnace, thereby partially reducing the iron oxide to form metallic iron. This, and other traditional reducing processes, are used to create the DRI.
DRI is difficult to transport because DRI and DRI fines are highly reactive with oxygen in air and moisture. Moisture, in particular, reacts with the iron forming FeO and H2. The DRI being sponge iron his many voids making it porous in nature. The porous nature of DRI also means that it has low compressive strength, and handling of DRI generates surface fines and dust. Additionally, when the DRI is stored, for example in the hold of a ship during transportation, some of the pellets have been prone to disintegrate under the weight of pellets above them further generating fines and small particles. The DRI lines and small particles increased the ability for reaction with moisture and oxygen around it. Additionally, the rough surface characteristics of the DRI pellets produce particulate matter and other fines having a high surface area, which also promoted the likelihood of the DRI reacting with oxygen. Such particulate matter and fines typically are produced throughout the storage and transportation of the DRI, making it difficult to transport DRI over long distances and to store DRI for long periods.
The porous, low internal strength, and flakey nature of DRI all increase the surface area of the nodule that is exposed to an oxidizing atmosphere and/or moisture, resulting in substantial and rapid oxidation and rusting. The reactions that occur during DRI oxidation produce heat and hydrogen making DRI susceptible to overheating and combustion. Increases in temperature in containers storing DRI, in which air is free to circulate, can reach 1200° F. Such combustion causes fires in the holds of ships during transportation of DRI and in the clam buckets of cranes when unloading DRI. These risks have substantially increased the cost of DRI delivered to a steel plant because of the losses during transportation and storage. Due to the difficulties and risks associated with transporting DRI, production of DRI has with a few exceptions been generally located near the steelmaking facilities and near the time of use in steelmaking, rather than in more economical locations and times. For these same reasons, the disposal of DRI fines and dusts is expensive and difficult.
While disposing of DRI reverts is expensive and environmentally challenging, it has now been determined that DRI fines and dust (DF blend) can be successfully repurposed by being incorporated and used as a replacement energy source to replace coke breeze in sinter blends. Accordingly, in cokeless sinter blends disclosed herein, the DRI reverts are used as a replacement fuel source for the coke breeze in the sintering process, while still producing sinter with an ISO tumble strength of at least 72. The cokeless sinter blends are inert, safe to transport, inexpensive to produce and provide sinter with the ISO tumble strength ratings necessary for use in conventional blast furnace iron-making processes.
As used herein, "cokeless" or "free of coke breeze" means no intentional addition of coke or coke breeze.


A method is disclosed for transferring a received media object to remote devices in accordance to attributes in a user profile. The profile information additionally determinates the versions of the media object that are available to such remote devices and whether the media object may be stored in such remote devices.

When a customer subscribes to a variety of media services such as cable television, satellite television, music providers, and the like, the customer typically accesses such services at a home location. When the customer travels to a new location for a temporary basis, such as a business trip or a vacation the customer is restricted from or has difficulty accessing these services.
One reason why a customer has difficulty accessing services they subscribe to that most locations offer media service providers that are restrictive or proprietary. For example, if a customer subscribes to a cable system with a specific package of services, it is highly unlikely that the customer would be able to use these services if a hotel the customer was staying at only offered satellite television.

Customer associated profile for accessing audio and video media objects


An integrated circuit device includes a first memory unit and a conversion part for converting the parallel data read from the first memory unit into serial data. The integrated circuit device also includes a second memory unit that can write and read the data indicating the order of reading the parallel data from the first memory unit and the order of converting the parallel data into the serial data.

1. Field of the Invention
The present invention relates to an integrated circuit device for driving a flat display board or the like.
2. Description of the Related Art
A fluorescent display module is built in a dot character type fluorescent display device which is a flat display unit. FIG. 1 is a schematic diagram showing a conventional fluorescent display module. FIG. 2 is a schematic illustration showing one divided display part 110 in FIG. 1. FIG. 3 is a schematic illustration showing anode lines 102 in FIG. 1.
As shown in FIG. 1, a conventional fluorescent display module is provided with a fluorescent character display tube 100 which is a flat display board, and an integrated circuit device 300 for driving the fluorescent character display tube 100. The fluorescent character display tube 100 has a capability of displaying, for example, 15-digit alphanumeric characters and katakanas (angular Japanese phonetic syllabary). Such a fluorescent character display tube 100 includes fifteen divided display parts 110. One divided display part 110 is composed of 5(crosswise)xc3x978(lengthwise) dots of minimum light emission display. Each of 5(crosswise)xc3x978(lengthwise) anodes 101 (A1-A40) is composed of one dot of minimum light emission unit, as shown in FIG. 2.
The fluorescent character display tube 100 includes, as shown in FIG. 1, input terminals 103 (AI1-AI40), and forty anode lines 102 are connected to the input terminals AI1-AI40, respectively. The anodes 101, which are disposed at the same position at each digit, are commonly connected to respective input terminal 103 (AI1-AI40) by the anode lines 102, as shown in FIG. 3. For example, fifteen anodes A5 are connected to the input terminal AI5 by one anode line 102.
Furthermore, the fluorescent character display tube 100 includes, as shown in FIG. 1, input terminals 106 (GI1-GI15), and fifteen grid lines 105 are connected to the input terminals GI1-GI15, respectively. Each digit has one grid 104 (GI1-GI15) as a digit electrode, which is connected to the input terminals 106 (GI1-GI15), respectively.
The integrated circuit device 300 has output terminals 311 (ao1-ao40) and 312 (go1-go15). From the output terminals 311 (ao1-ao40), outputted are anode voltages that drive the anodes 101 corresponding to a display pattern. From the output terminals 312 (go1-go15), outputted is a grid voltage that drives each grid 104 by time-sharing.
The fluorescent character display tube 100 and the integrated circuit device 300 are mounted on a printed circuit board (not shown). On the printed circuit board, there are provided wirings 325 for connecting the input terminals 103 of fluorescent character display tube 100 and the output terminals 311 of integrated circuit device 300. There are provided with, on the printed circuit board, wirings 326 for connecting the input terminals 106 of fluorescent character display tube 100 and the output terminals 312 of integrated circuit device 300.
FIG. 4 is a block diagram showing the integrated circuit device 300 in FIG. 1.
The integrated circuit device 300 includes a control part 301 that inputs and outputs various signals including display data for the fluorescent character display tube 100. The integrated circuit device 300 also includes a memory part 302 that consists of RAM for writing and reading display data and the like and ROM for reading only according to output signals from the control part 301. Furthermore, the integrated circuit device 300 includes an anode drive part 303 for outputting anode voltages according to the display data read from the memory part 302 and obtained via the control part 301, and a grid drive part 304 for outputting grid voltages sequentially to each grid 104 by time sharing, based on timing signals from the control part 301.
The control part 301 has a counting part 305 for reading display data from the memory part 302 as parallel data according to a count signal, and a parallel/serial conversion part 306 for outputting parallel data converted into serial data. To the output side of anode drive part 303, connected is the output terminals 311 (ao1-ao40) for anode voltage, and to the output side of grid drive part 304, the output terminals 312 (go1-go15) for grid voltage is connected.
FIG. 5 is an illustration showing data stored in the memory part 302 in a conventional integrated circuit device 300.
As shown in FIG. 5, in the memory part 302, stored are 5(crosswise)xc3x978(lengthwise) bits of display data to be displayed at each digit of the fluorescent character display tube 100. The address of display data at each bit is designated by the row address R0-R7 and the column address C0-C4 corresponding to the anode A1-A40.
Now, operations of the conventional fluorescent display module configured as mentioned above will be described.
When a count signal from the counting part 305 is supplied for the memory part 302, the display data of the digits to be displayed are read sequentially from the memory part 302 as parallel data for each 5 bits of column addresses C0-C4, from the row addresses R0 through the row addresses R7. The read parallel data are outputted after their 5-bit data have been serialized by the parallel/serial conversion part 306, from the C0 side toward the C4 side of column address. The serial data are inputted sequentially into a shift register included in the anode drive part 303. Once all of the 5(crosswise) xc3x978(lengthwise) bits of display data have been inputted into the shift register, anode voltages for anodes A1-A40 are outputted simultaneously from the output terminals 311 (ao1-ao40). At the same time, a timing signal is supplied from the control part 301 to the grid drive part 304, and grid voltages from the output terminals 312 (go1-go15) are applied to the digits that are driven in response with the timing signal.
Successively in the same fashion, an anode voltage and a grid voltage are sequentially supplied to respective anode 101 and grid 104 of each digit by a dynamic grid drive by time-sharing, and thus predetermined characters or the like are displayed.
Next, description is given of a printed circuit board on which the integrated circuit device 300 is mounted. FIG. 6 is a schematic diagram showing the relationship between the printed circuit board and the integrated circuit device 300 in a conventional fluorescent display module.
The integrated circuit device 300 is disposed on the underside of the printed circuit board 320. On the periphery of integrated circuit device 300, the output terminals 311 (ao1-ao40) corresponding to the anodes 101 (A1-A40) of fluorescent character display tube 100 are disposed in the counterclockwise order. The output terminals 312 (go1-go15) corresponding to the grids 104 for fifteen digits are disposed in the clockwise order on the periphery of integrated circuit device 300. These positions are determined at the designing stage. Besides, other input terminals and power supply terminals (not shown) are also disposed on other regions of the periphery of integrated circuit device 300. Within the integrated circuit device 300, the above-mentioned circuits are electrically connected to the terminals.
The printed circuit board 320 includes forty input terminals 321 to which the output terminals 311 of integrated circuit device 300 are connected, and fifteen input terminals 322 to which the output terminals 312 of integrated circuit device 300 are connected. The printed circuit board 320 further includes forty output terminals 323 to which the input terminals 103 of fluorescent character display tube 100 are connected, and fifteen output terminals 324 to which the input terminals 106 of fluorescent character display tube 100 are connected. The printed circuit board 320 includes forty wirings 325 which connect each input terminal 321 to each output terminal 323, and fifteen wirings 326 that connects each input terminal 322 with each output terminal 324.
The forty wirings 325, which are connected to the output terminals ao1-ao40 of integrated circuit device 300 via the input terminals 321, are connected to the output terminal 323 corresponding to the input terminals AI1-AI40 of fluorescent character display tube 100, respectively. Likewise, the fifteen wirings 326, which are connected to the output terminals go1-go15 of integrated circuit device 300 via the input terminals 322, are connected to the output terminals 324 corresponding to the input terminals GI1-GI15 of the fluorescent character display tube 100, respectively. In FIG. 6, the solid lines representative of wiring 325 and 326 indicate that the wiring is disposed on the surface side of printed circuit board 320, and the broken lines representative of wiring 325 and 326 indicate that the wiring is disposed on the underside of printed circuit board 320.
In general, the positions where the input terminals of fluorescent character display tube are disposed, are designed by makers of fluorescent character display tubes allowing for the shape and size. On the other hand, the positions where the output terminals of integrated circuit device are disposed, are designed by makers of integrated circuit device. This creates a problem as follows. When a fluorescent character display tube and an integrated circuit device are mounted on a printed circuit board by a maker of fluorescent display module, the interconnection between the input terminals of printed circuit board corresponding to the positions of output terminals determined at the designing stage by the maker of integrated circuit device, and the output terminals of printed circuit board corresponding to the positions of input terminals determined at the designing stage by the maker of fluorescent character display tube, must be executed by multiple wiring.
For this reason, except when a maker of fluorescent display module designates the positions of output terminals of integrated circuit device to a maker of integrated circuit device maker so that the wiring to the positions of input terminals can be handled in a simple manner, the wirings on the printed circuit board must be routed so as to meet the positioning of output terminals determined by the maker of integrated circuit device, as long as an integrated circuit device for general purpose use is used.
For example, when the input terminals 321 and 322 as well as output terminals 323 and 324 are disposed on the printed circuit board 320 as shown in FIG. 6, the input terminals 322 and the output terminals 324 are, as to grids, positioned opposed in a one-to-one correspondence; this enables the wiring 326 to be simpler and shorter. As to anodes, however, the input terminals 321 and the output terminals 323 are not always positioned opposed in a one-to-one correspondence, and hence a complicated routing of the wiring 325 is required. Specifically, in order to prevent the wiring from intersecting each other, part of the wiring is located on both the surface side and underside of the printed circuit board 320. Most of the wiring is routed on the underside of integrated circuit device 300, but some of the wiring is routed on the periphery of integrated circuit device 300. This results in the increase in wiring region on the printed circuit board 320.
Accordingly, it is an object of the present invention to provide an integrated circuit device that allows a user to arbitrarily select the position of the input terminal of printed circuit board to be connected to each output terminal for an anode, and that allows the wiring on the printed circuit board to be simpler and reduced in wiring region.
According to one aspect of the present invention, an integrated circuit device comprises a first memory unit, a conversion part which converts parallel data read from the first memory unit into serial data, and a second memory unit. The second memory unit can write and read data indicating an order of reading the parallel data from the first memory unit and an order of converting the parallel data into the serial data.
In the present invention, the second memory unit is disposed between the counting part and the first memory unit and the reading order and the serial direction thereof are designated. Therefore, the correspondence between the address of dots and output terminals can be arbitrarily set up, when outputting display data that drive dots of minimum light emission unit in matrix configuration on the flat display board, from the display data output terminals of integrated circuit board. Consequently, when assembling a fluorescent display module, the display data input terminals of the flat display board and the display data output terminals of integrated circuit device can be positioned opposed in a one-to-one correspondence. Furthermore, the electrical interconnection between the display data input terminals of flat display board and the display data output terminals of integrated circuit device can be executed in a simpler wiring. Moreover, the decreased wiring area can reduce the manufacturing cost of printed circuit board.

Integrated circuit device and display device with the same


An oxidizable hydrocarbon is oxidized in a reaction zone at elevated temperature in the presence of a liquid reaction medium by introducing the hydrocarbon and a feed stream containing molecular oxygen to the reaction zone under conditions sufficient to oxidize at least a portion of the hydrocarbon; withdrawing at least a portion of the liquid reaction medium from the reaction zone; passing at least a portion of the withdrawn liquid reaction medium to an oxygen injection zone located external to the reaction zone; contacting the liquid in said oxygen-injection zone with a gas stream containing molecular oxygen under conditions sufficient to form a two-phase gas/liquid mixture; and passing said two-phase gas/liquid mixture to the reaction zone as the feed of molecular oxygen thereto.

1. Field of the Invention
This invention relates to the oxidation of hydrocarbons and is more particularly concerned with hydrocarbon oxidation employing an improved oxygen-injection method.
2. Description of the Prior Art
Glycol esters, and especially glycol carboxylic acid esters, are particularly useful organic chemical intermediates and extractive solvents. The glycol esters produced from ethylene are useful in the production of ethylene glycol an important commercial chemical. Catalytic processes for the preparation of the glycol esters have been disclosed, for example, in U.S. Pat. No. 3,689,535 and in Belgian Pat. No. 738,463. Ethylene glycol may be prepared by the hydrolysis of the ethylene glycol carboxylic acid esters, as disclosed in U.S. pat. No. 3,647,892, and vinyl acetate may be prepared by pyrolysis of the ethylene glycol ester, as disclosed in U.S. Pat. No. 3,689,535. Similarly, propylene glycol may be prepared by the hydrolysis of propylene glycol carboxylic acid esters, and other glycol esters yield the corresponding glycols upon suitable hydrolysis. (Belgian Pat. No. 862,054 (issued 1978) relates to an improved process for preparing glycol esters in which olefin, molecular oxygen, and a carboxylic acid are contacted in the presence of a catalyst system comprising a variable valent cation in association with bromine, chlorine, a bromine-containing compound or a chlorine-containing compound in a vertically-elongated reaction zone provided with a branch vertical circulation zone for continuously transferring liquid from the upper portion of the vertical reaction zone to the bottom of the reaction zone, to provide predetermined vertical superficial liquid velocities, which disclosure is herein incorporated by reference.
While the known processes for oxidizing hydrocarbons, such as those disclosed in the above-mentioned patents and patent applications, are effective for the indicated purposes, they are susceptible to improvement from the standpoint of optimum operation with continuous oxygen feeds to the reactor, generally by use of gas spargers. However, such devices which sparge gas into a liquid phase reaction medium containing the hydrocarbon reactants are quite vulnerable to loss of oxygen flow caused, for example, by a discontinuity in the feed pressure of the oxygen gas to the system. In such a case, the danger exists of back flow of part of the liquid reaction medium into the gas sparger. In start-up of the reactor following this discontinuity of oxygen feed, the spargers must be flushed to insure that the flammable hydrocarbons are removed from the spargers prior to passage of oxygen gas therethrough for safety's sake. This results in added equipment and process time expenses. In the event the flammable hydrocarbons are flushed using an inert gas, such as nitrogen, the large volumes of gas employed must be removed from the reactor's effluent gases and offer a potential environmental pollution source which must be carefully treated before discharging to the atmosphere. Use of a nonflammable flushing liquid which is inert to the components in the reactor can introduce impurities to the system, and, again, the volumes of flushing liquid can be expensive to recover from the reactor's product streams. The dilution of the reaction media resulting from use of such flushing liquids can also adversely affect reactor efficiency during startup, decreasing product yields, selectivity and quality. To avoid introduction of impurities in the system, the non-flammable liquid which would ordinarily be used to flush the spargers would be one which would be indigenous to the process. However, such liquids are themselves not entirely satisfactory. For example, in the case of the preparation of vicinal glycol esters by the above-described olefin-oxidation process, the only non-flammable liquid indigenous to the process is water, and it has been found that significant quantities of water, when passed through the gas spargers to flush them free of the hydrocarbon reactants, results in the deposit on the gas spargers and other process equipment of a resin-like material which is believed to result from the reaction of water with components of the liquid medium. Since this deposited resin-like material can readily plug the spargers and is organic in nature, the flushing of the gas spargers with water is unacceptable.


A method and system for generating a video production of an event that can be implemented automatically in real-time and with minimal operator intervention. The method includes receiving a plurality of video signals of an event. Each video signal includes a plurality of image frames. Each image frame corresponds to a view of the event. In addition, the method includes receiving at least one predefined condition associated with the event. Further, the method includes selecting a section of at least one of the plurality of image frames based on the at least one predefined condition to generate at least one output image frame. The method also includes generating a video production from the at least one output image frame.

The present invention relates to a method and a system for generating a video production.
In embodiments, the present invention relates in particular to a method and a system for generating a panoramic video for use to generate a video production of an event of public interest with minimal or no operator intervention and/or in real-time as an event occurs
Television coverage of many events of public interest, including sporting events such as football (soccer) matches, typically requires many video cameras and many camera operators. In the example of a football (soccer) match, each cameraman operating a camera would follow the action on and off the playing field, either by panning or zooming the video camera to track the ball, players, or spectators as they move around on and off the playing field. The video signals of the captured images would then be transmitted to a control centre, where a director is able to view the images of each video signal. The director is also able to communicate with the cameramen to provide instruction for how a particular camera is to be operated and is able to select or combine the video signals to produce a presentation for broadcasting. Such a broadcast operation necessarily requires a large amount of manpower, equipment, and technical support; all of which adds to the financial costs of producing the broadcast. In particular, equipment such as wide-angle optics used to capture a wide field-of-view of an event can be prohibitively expensive.
For large scale events with sufficient financial backing, the large amount of resources required to produce a video broadcast is not a major concern. However, for small scale events or events with limited financial backing, the prohibitively high costs of broadcast production typically means that the event is not covered, and thus not televised.
For organisers of small scale events or events that do not enjoy wide spread popularity, being able to televise an event would in many cases increase the exposure of the event or organisers. In turn, the increase exposure attracts public interest, which can serve to raise the profile of the event and subsequently can be utilised to attract sponsors and funding.
There is therefore a need for an improved method and system for reducing the costs and resources need to produce a video production of an event that would be fit for broadcasting.
According to another aspect of the present invention, there is provided a method for generating a video production of an event, the method comprising: receiving a plurality of component video signals of an event, each component video signal comprising a plurality of component image frames, wherein each component image frame corresponds to a section of a panoramic view of the event; stitching the temporally corresponding component image frames of each video signal together to generate a plurality of panoramic image frames; selecting a section of each panoramic image frame based on at least one predefined condition associated with the event to generate a plurality of output image frames; generating a video production from the plurality of output image frames.
The present invention therefore provides a method that generates wide field-of view image frames without the need for expensive wide-angle optics. The method also enables a video production to be produced with minimal or no operator intervention and can be implemented automatically in real-time to capture video images of a wide variety of events.
In embodiments, one of the predefined conditions is to select a section of each panoramic image frame containing an area of interest associated with the event.
Alternatively or in addition, the step of selecting further includes identifying at least one image object in at least one image frame, and wherein one of the predefined conditions is to select a section of the at least one panoramic image frame containing the at least one image object. In particular, for more than one identified image objects in at least one panoramic image frame, the step of selecting further includes: determining the positions of the image objects in the at least one panoramic image frame; identifying the distribution of the positions over the at least one panoramic image frame; and determining a deviation of the identified distribution from an expected distribution associated with the event; wherein one of the predefined conditions is to select a section of the at least one panoramic image frame having a minimum deviation. By selecting a section that includes the image object, the method of these embodiments is able to simulate the effect of panning a video camera. Additionally, or alternatively, the method further comprises extracting background data from at least one of the panoramic image frames, wherein the step of identifying is based at least on the extracted background data. The method may also further comprise determining a density map of at least one of the panoramic image frames to indicate an area of the panoramic image frame where a large number of image objects are in close proximity to each other, wherein the step of identifying is based at least on the density map. The provisions of extracting background data and density mapping facilitates the step of identifying image objects against background features.
Preferably, the size of the selected section varies from one panoramic image frame to another. Alternatively or in addition, the position of the selected section relative to the corresponding panoramic image frame varies from one panoramic image frame to another. Varying the size and the position of the selected section further facilitate the simulation of the effect of zooming and panning of a video camera.
In other embodiments, the step of stitching further comprises correcting colour information of the component image frames of at least one component video signal relative to the component image frames of at least one other component video signal. The step of stitching may further comprise calibrating brightness levels of the component image frames of at least one component video signal relative to the component image frames of at least one other component video signal. These provisions enable the image frames to be stitched together seamlessly.
In some other embodiments, the method further comprises: generating metadata associated with the event; producing a visual element corresponding to the metadata; and incorporating the visual element into the video production. Alternatively or in addition, the method further comprises: receiving at least one audio signal; combining the at least one audio signal with the video production; and generating an audio-video production. These provisions enhance the video production by providing the viewer with additional information associated with the event.
According to another aspect of the present invention, there is provided a system for generating a video production of an event, the system comprising: a capture module operable to receive a plurality of component video signals of an event, each component video signal comprising a plurality of component image frames, wherein each component image frame corresponds to a section of a panoramic view of an event; a stitch module operable to stitch the temporally corresponding image frames of each video signal together to generate a plurality of panoramic image frames; a select module operable to select a section of each panoramic image frame based on at least one predefined condition associated with the event to generate a plurality of output image frames; a production module operable to generate a video production from the plurality of output image frames.
In embodiments, one of the predefined conditions is to select a section of each panoramic image frame containing an area of interest associated with the event.
Alternatively or in addition, the select module is operable to identify at least one image object in at least one panoramic image frame, and wherein one of the predefined conditions is to select the whole or a section of an image frame containing the at least one image object. In particular, for more than one identified image objects in at least one panoramic image frame, the select module is operable: to determine the positions of the image objects in the at least one panoramic image frame; to identify the distribution of the positions within the at least one panoramic image frame; and to determine a deviation of the identified distribution from an expected distribution; wherein one of the predefined conditions is to select a section of the at least one panoramic image frame having a minimum deviation. Additionally, or alternatively, the system further comprises an extraction module operable to extract background data from at least one of the panoramic image frames, wherein the select module is operable to evaluate the background data to identify the at least one image object. The system may also further comprise a mapping module operable to determine a density map of at least one of the panoramic image frames to indicate an area of the panoramic image frame where a large number of image objects are in close proximity to each other, wherein the select module is operable to evaluate the density map to identify the at least one image object
Preferably, the size of the selected section varies from one panoramic image frame to another. Alternatively or in addition, the position of the selected section with respect to the corresponding panoramic image frame varies from one panoramic image frame to another.
In other embodiments, the stitch module is operable to correct colour information of the component image frames of at least one component video signal relative to the component image frames of at least one other component video signal. The stitch module may also be operable to calibrate brightness levels of the component image frames of at least one component video signal relative to at least one other component video signal.
In some other embodiments, the capture module is operable to generate metadata associated with the event; and the production module is operable to produce a visual element based on the metadata and to incorporate the visual element into the video production. Alternative or in addition, the production module is operable to: receive at least one audio signal; combine the at least one audio signal with the presentation; and generate an audio-video production.
According to another aspect of the present invention, there is provided a method for generating a video production of an event, the method comprising: receiving a plurality of video signals of an event, each video signal comprising a plurality of image frames, wherein each image frame corresponds to a view of the event; automatically identifying at least one image object in at least one image frame; automatically selecting the at least one image frame containing the at least one image object to generate a plurality of output image frames; and automatically generating a video production from the plurality of output image frames.
According to another aspect of the present invention, there is provided a system for generating a video production of an event, the system comprising: a capture module operable to receive a plurality of video signals of an event, each video signal comprising a plurality of image frames, wherein each image frame corresponds to a view of the event; a select module operable to automatically identify at least one image object in at least one image frame and to automatically select the at least one image frame containing the at least one image object to generate a plurality of output image frames; a production module operable to automatically generate a video production from the plurality of output image frames.
A system for generating a video production of an event in accordance with an embodiment of the present invention is shown in FIG. 2. In general, embodiments of the system of the present invention comprise a number of modules that are in communication with one another and can be implemented in computer hardware or software. The modules can also be implemented as individual modules or as sub-modules of a larger module. The system is arranged to receive video signal streams captured by a number of video cameras located at the geographic location where an event such as a football (soccer) match occurs.
The video cameras may be operated remotely or locally with minimal human intervention so as to enable the system to produce a desired video production automatically in real-time. Indeed, once the system has been set up, it can operate as will be described below with no further operator intervention. In some embodiments, the video signal streams may be pre-recorded and received by the system subsequent to the occurrence of the event. In particular, as illustrated in FIG. 1, two video cameras may be placed in close proximity to each other, either side-by-side such as cameras C1 and C2 or in tandem such as cameras C3 and C4, so that the field-of-view of one camera C1 (C3) overlaps in part with the field-of-view of the other camera C2 (C4). The individual video streams may then be combined to generate a single video stream with a wide field-of view. More generally, a number of cameras may be deployed in a similar manner such that the wide field-of-view video stream generated covers the entire field of interest, such as the field of play of a football (soccer) match.
Subsequently, the wide field-of-view video stream may be manipulated. For example, for a certain portion of the video stream, the video stream may be manipulated by selecting a section of the field-of-view and further manipulated to shift the selected section from one image frame to another to simulate the effect of panning a video camera with the same field-of-view of that portion. Alternatively, or for another portion, the video stream may be manipulated by selecting a section, the size of which varies from image frame to image frame, to simulate the effect of zooming. The selected sections may then be cut and joined together to generate a video production for storage and/or broadcast.
It will therefore be appreciated that the wide field-of-view video stream can provide great flexibility and enables a variety of video productions to be produced from that video stream. The production of the video production occurs automatically once the system has been set up such that the significant cost and complexities of conventional systems, described above, can be avoided.
Referring now to FIG. 2, the system 10 of an embodiment of the present invention comprises a capture module 100, a stitch module 200, a select module 300, and a production module 400. As shown in this figure, each module is depicted as individual entities. However, it will be appreciated that some modules may be sub-modules of a larger module. For example, in some embodiments, the stitch module 200 and the select module 300 may be sub-modules of a virtual camera module 202. It will also be appreciated that the modules and sub-modules may be implemented in hardware or in software.
When an event such as a football (soccer) match takes place, a number of video cameras may be deployed in the manner described above to capture the event. In the embodiment shown in FIG. 2, the capture module 100 is configured to receive one or more video signals 120 captured by the video cameras, either in real-time directly from video cameras communicatively coupled to the capture module 100 or by means of pre-recording and storing the captured video signals. The capture module 100 is, in some embodiments, also configured to convert the received video signals 120 into an appropriate format suitable for use by the system 10.
As will be appreciated by a skilled person, a video signal can be analogue or digital, and comprises a series of image frames. It will also be appreciated by a skilled person that the image frames of a video signal each has an angle/field-of-view that depends on the characteristics of the optical components of the video camera, such as the focal length of the lens or the size of the imaging sensor.
In general, the video signals 120 received by the capture module 100 each comprises a number of image frames, where each image from corresponds to a view of the event that is being captured. Some of the video signals 120 received by the capture module 100, such as the component video signals 122-1 . . . 122-n shown in FIG. 2, may be associated with a panoramic field-of-view. That is to say, the image frames of a video signal received by the capture module 100 can be joined or stitched to the temporally corresponding image frames of another video signal to generate a panoramic video signal, where the image frames of the panoramic video signal have a field-of-view that is wider than the field-of-view of the image frames of each of the individual video signals. The component video signals 122-1 . . . 122-n may be obtained from a number of video cameras, placed side-by-side adjacent each other or in tandem one above the other, and aligned such that an edge of the field-of-view of one camera corresponds to an edge of the field-of-view of the adjacent camera or such that the field-of-view of one camera partially overlaps with the field-of-view of the adjacent camera.
As shown in FIG. 2, the capture module 100 is arranged to be operable to receive one or more component video signals 122-1 . . . 122-n, each of which is associated with a panoramic field-of-view. Once received, the component video signals 122-1 . . . 122-n may, in some embodiments, undergo one or more pre-processing steps such as colour correction and calibration to equalize the colour hue and brightness levels of each video signal. Thereafter, the component video signals 122-1 . . . 122-n are passed to the stitch module 200, which is arranged to be operable to combine the corresponding image frames of the component video signals 122-1 . . . 122-n to generate a panoramic video signal. For example, in some embodiments, the stitch module 200 receives the component video signals 122-1 . . . 122-n and is operable to stitch together the image frames of one component video signal with the temporally corresponding image frames of the other component video signals by any suitable method, such as using homography or the zero-parallax technique, to generate panoramic image frames for the panoramic video signal 220. FIG. 3 illustrates schematically the stitching together of two temporally corresponding image frames.
In FIG. 3, an example of two component video signals, component video signal 122-1 made up of component image frames 122-11 . . . 122-1n and component video signal 122-2 made up of component image frames 122-21 . . . 122-2n, are shown schematically. In these examples, component image frames 122-1a . . . 122-1n cover a particular field-of-view and component image frames 122-21 . . . 122-n cover a field-of-view that overlaps with the field-of-view of image frames 122-11 . . . 122-1n by a small portion. In the stitching process, the component image frames of component video signal 122-1 are joined with the temporally corresponding component image frames of component video signal 122-2 at the overlapping portion to generate panoramic image frames 220-1 . . . 220-n for a panoramic video signal 220. As an illustration, FIG. 3 shows component image frame 122-11 depicting a scene at a particular time and component image frame 122-21 depicting another scene at the same moment in time as component image frame 122-21, overlapping at portion 122′. In the stitching process, component image frame 122-11 and component image frame 122-21 are stitched together at the overlapping portion 122′ to generate a panoramic image frame 220-1 of the panoramic video signal 220. The other panoramic image frames 220-2 . . . 220-n of panoramic video signal 220 are then generated in a similar manner.
In some embodiments, component video signal 122-1 and component video signal 122-2 may undergo one or more pre-process steps. For example, the exposure settings of the camera used to capture component video signal 122-1 may differ by a small amount from that of the video camera used to capture component video signal 122-2. In such a case, it will be desirable to adjust the images depicted in the respective video signals relative to each other so as to enable image frames to be seamlessly joined together. Accordingly, in these embodiments, the stitch module 200 is arranged to be operable to correct the colour information of the component image frames of the component video signals that are to be stitched together. In addition, or alternatively, the stitch module 200 is also arranged to be operable to calibrate the brightness levels of the component image frames of the video signals that are to be stitched together. Correcting the colour information and calibrating the brightness levels prior to stitching the image frames together then ensures that the colours and brightness levels on one side of the panoramic image frame matches those on the other side of the panoramic image frame so that the seam at which the image frames are joined is as imperceptible as possible.
It will be appreciated that, although only two component video signals 122-1, 122-2 are shown in FIG. 3, any number of suitably aligned component video signals 122-1 . . . 122-n may be stitched together to generate the panoramic video signal 220. It will also be appreciated that more than one panoramic video signal may be generated in the same manner.
Referring back to FIG. 2, once the panoramic video signal 220 has been generated, it is passed to the select module 300. The select module 300 is arranged to manipulate the video signals it receives according to predefined rules and conditions that are associated with an event. For example, the panoramic image frames 220-1 . . . 220-n may depict the actions of a football (soccer) match, and the predefined rules and conditions may be a requirement to simulate the effect of tracking the movement of a football depicted in the panoramic image frames 220-1 . . . 220-n for a certain period of time.
As an illustration, FIG. 4 shows panoramic image frames 220-1 . . . 220n, depicting a scene having a football that changes position from frame to frame. The select module 300 is operable to analyse the panoramic image frames 220-1 . . . 220-n using any suitable image analysis and tracking methods to identify the football as a moving object and determines its position within each image frame. Based on the position, the select module 300 is then able to determine the trajectory of the football. Then, by setting one of the predefined conditions as to select a section of the image frame to include the football, the select module 300 is able to simulate the effect of tracking the football by selecting a section that includes the football located at a particular relative position in each section. Generally, based on at least one predefined condition associated with the event that is being captured, the select module 300 is operable to select the whole or a section of any number of image frames of any number of video signals it receives to generate a corresponding number of output image frames. As an illustration shown in FIG. 4, the select module 300 in some embodiments is operable to identify the football in panoramic image frame 220-1, to select section 222-1 to include the football, and to extract section 222-1 to generate a separate output image frame 320-1. Similarly, the same procedure can be applied to the other panoramic image frames to generate output image frames 320-2 . . . 320-n to form an output video signal 320.
Although only one image object is shown in FIG. 4, it will be appreciated that the predefined rules and conditions are not limited to tracking one moving image object and the select module 300 may be operable to track more than one image object. It will also be appreciated that the select module 300 may be operable to track any number of image objects or area of interest. In addition, the select module 300 of some embodiments may also be operable to determine the positions of the image objects in the panoramic image frames and to identify how these image objects are distributed over the panoramic image frame. Then, for events where the image objects have an expected distribution, the select module is operable to determine the deviation of the distribution of the positions of the image objects from the expected distribution. One of the predefined conditions can then be set as to select a section where the deviation is at a minimum. For example, the select module 300 may be able to identify the movement of spectators in a football stadium as moving objects and to identify that the distribution of the movement of spectators to match that of a Mexican wave travelling around the stadium. In such an example, the select 300 module is operable to select sections of the panoramic image frames to track the movement of the Mexican wave.
It will be appreciated that by selecting a section 221-1 . . . 222-n of the panoramic image frames 220-1 . . . 220-n to include a moving object, the effect that would be observed in the output image frames 320-1 . . . 320-n would be equivalent to video images captured by panning a video camera that has the same field-of-view as the output image frames 320-1 . . . 320-n. In some embodiments, the select module 300 may be further arranged to vary the size of the selected section so as to simulate the effect of zooming. For example, the select module 300 may be arranged to select a progressively smaller section to create the effect of zooming in or progressively larger sections to create the effect of zooming out.
Referring back to FIG. 2, to facilitate the task of identifying objects or area of interest in the panoramic image frames 220-1 . . . 220-n received by the select module 300, the system 10 of some embodiments further includes an extraction module 500 and a mapping module 600.
The extraction module 500 is arranged to be operable to identify features either in the image frames of the panoramic image signal 220 or in the component video signals 122-1 . . . 122-n that are associated with the background and to extract image data 520 that represent these features. The background image data 520 are then communicated to the select module 300 for evaluation so as to facilitate the select module 300 to distinguish between image objects in the foreground and the background features.
The mapping module 600 is arranged to be operable to analyse either the image frames of the panoramic image signal 220 or in the component video signals 122-1 . . . 122-n to identify one or more image objects that are of interest. Once the image objects are identified, the mapping module 600 determines the positions of the image objects, generates a density map 620, and assigns an indicator in the density map 620 such as a colour to indicate an area of the image frame where a large number of image objects are in close proximity to each other. Similarly, the mapping module 600 may also assign an indicator in the density map 620 to indicate an area of the image frame where there are few or no image objects. The completed density map 620 is then communicated to the select module 300 for evaluation so as to facilitate the select module 300 to distinguish between image objects in the foreground and the background features and to facilitate the select module 300 to determine how the image objects are distributed over the image frames.
It will be appreciated that the extraction module 500 may be implemented in conjunction with the mapping module 600. It will also be appreciated that the extraction module 500 may be implemented as an alternative to the mapping module and vice versa.
Referring still to FIG. 2, once the output video signal 320 is generated, it is passed to the production module 400 for editing. For example, it may be undesirable to include the whole length of the output video signal 320 for broadcast. In such an example, it may be desirable to include only a portion, or some portions of the output video signal 320. Accordingly, the production module 400 is arranged to be operable to select some or all of the output image frames 320-1 . . . 320-n to generate a video production 420. In embodiments, as illustrated in FIG. 5, the production module 400 is operable to select the output image frames from different segments of the output video signal 320 and to combine the segments to produce the video production 420. As shown in FIG. 5, the output video signal 320 includes desirable segments 322, 324, 326, 328 separated by undesirable segments. The production module 400 is operable to extract the output image frames of these segments and to combine them to produce the video production 420 as shown in FIG. 6a.
In some embodiments, it may be desirable to have one or more segments repeated either immediately or at a subsequent time. It may also be desirable to repeat a segment in slow motion. Accordingly, in some embodiments, illustrated in FIG. 6b and FIG. 6c, the production module is operable to generate a video production with one or more segments 322 repeated as a slow motion segment 322-SloMo, or a segment 322 repeated subsequent to one or more different segment.
More generally, the production module 400 is operable to generate a video production from output image frames it receives.
Referring back to FIG. 2, once the video production 420 is generated, it may be sent directly to broadcast or it may be sent to storage or further processing before broadcast.
In some cases, the event that is to be covered may have secondary data associated with the captured video signals, and it may be desirable to incorporate these into the video production 420 to enhance the viewing experience. For instance, it may be desirable to incorporate the running time and score line of a football (soccer) match into the video production so that a viewer can follow the action with the knowledge of the scores. Accordingly, as shown in FIG. 2, the capture module 100 of some embodiments is further arranged to be operable to receive secondary information 140 associated the event. Secondary information 140 may, for example, be gathered from external sensors, timing devices, score keeping devices, or any other suitable means. The capture module 140 then generates metadata 142 associated with the secondary information 140 and communicates the metadata 142 to the production module 400. The production module 400 is operable to produce a visual element, such as an element that displays the scores and running time of a football (soccer) match at the corner of an image frame, and to incorporate the visual element into the video production.
In other cases, it may also be desirable to incorporate audio information into the video production 420. Accordingly, in some embodiments of the system 10 described above, the production module 400 is arranged to be operable to receive one or more audio signals 160 and is operable to incorporate the audio signals 160 into the video production 420.
In some alternative embodiments, the capture module 100 is also operable to receive video signals from individual video cameras that are not associated with a panoramic field-of-view, such as video signals 124, 126 shown in FIG. 2. In these embodiments, these video signals 124, 126 are passed to the select module 200, bypassing the stitch module 300. Once received by the select module 300, it will be appreciated these video signals 124, 126 would be handled in a similar manner to that described above for the panoramic video signal 220.
By utilizing panoramic video image frames generated as described above, and simulating the effect of panning and zooming, embodiments of the present invention is able to generate a video present from fixed cameras that require little to no operator intervention. The utilization of panoramic video image frames as herein described also provides videos with a wide field-of-view without the need to use expensive wide-angle optics. The method and system may be pre-configured to operate automatically and in real-time so as to minimize the requirement on resources.
In other different embodiments of the system 10, the select module 300 is further operable to receive and store the predefined rules and conditions that are used to generate the video production. In particular, the select module 300 receives and stores predefined conditions that are associated with the event that is to be captured. The predefined conditions can be implemented in hardware or software, and can be loaded to the system 10 during or after assembly. Once video signals are received from the stitch module 200 or from the capture module 100, the select module 300 selects the whole or a section of an image frame from any suitable number of the image frames of the received video signals based on the predefined conditions. When making the selection, the select module 300 is optionally operable to track the movement, colour, brightness, and contrast of any number of objects depicted in the image frame. The selected image frames and/or section of image frames are communicated to the production module 400 as output image frames of an output video signal 320. The production module 400 then uses the output video signal 320 to generate a video production 420.
Optionally, video signals from the stitch module 200 or the capture module 100 are communicated to the extraction module 500 and to the mapping module 600, as well as to the select module 300.
The extraction module 500 is operable to analyse the image frames of the received video signals and to identify features in the image frames that are associated with the background of the event that is being captured. Image data 520 representing these background features are extracted from the received video signals and are communicated to the select module 300. The select module 300 evaluates the image data 520 alongside the video signals it receives when making the selection. The image data 520 enables the select module 300 to identify any object that is moving relative to the background more readily, thus facilitates the generation of the video production 420 in real-time.
The mapping module 600 is operable to analyse the image frames of the received signals and to identify one or more image objects that are of interest. Once the image objects are identified, the mapping module 600 determines the positions of the image objects, generates a density map 620, and assigns an indicator in the density map 620 such as a colour to indicate an area of the image frame where a large number of image objects are in close proximity to each other. Similarly, the mapping module 600 may also assign an indicator in the density map 620 to indicate an area of the image frame where there are few or no image objects. The completed density map 620 is then communicated to the select module 300 for evaluation so as to facilitate the select module 300 to distinguish between image objects in the foreground and the background features and to facilitate the select module 300 to determine how the image objects are distributed over the image frames.
In these different embodiments, the predefined rules and conditions generally relate to physical attributes and aspects of the event that is to be captured. For example, where the event to be captured is a football (soccer) match, it is inherent that the event comprises two teams of eleven players each, a referee, and a ball. In this example, the select module 300 is operable to identify the players, referee, and the football based on their shapes and colours. Additionally, the action of a football match typically occurs within a certain distance of the football. Accordingly, an example of a predefined condition is to select a section of the image frame that includes the football and the area within a predetermined distance surrounding the football. The action may also occur where there is a certain number of players of one of the teams (i.e. objects that are all of a certain colour) within a certain distance of the football, such as during a counter-attack. Accordingly, another example of a predefined condition is to select a section of the image frame that contains a certain number of players of one team within a predetermined distance of the football as compared to the number of players of the other team. Other examples of a predefined condition include, but are not limited to, selecting a section of the image frame that contains one or more specific players, selecting a section of the image frame within which the football is at the same position, and selecting a section of the image frame that includes the referee. More generally, and as it will be appreciated by the skilled person, these examples of predefined conditions can be adapted for other sporting events such as, but not limited to, rugby, golf, tennis, basketball, hockey, cricket, volleyball, American football, and baseball.
It is also inherent to some events that the action occurs in a field or area with known dimensions and markings. For example, where the event to be captured is a race, it is inherent that the image objects, i.e. competitors such as athletes, race horses, racing cars, racing motorbikes, racing bicycles, or any other racing vehicles, move and follow a predetermined path, such as the track of a racing course or circuit. Accordingly, another example of a predefined condition is to select a section of the image frame that includes at least one image object whilst following a predetermined path. It may also be that the most interesting action of the race is characterised by a large proportion of the competitors being in a small section of the track of the racing circuit. Accordingly, another example of a predefined condition is to select a section of the image frame that has the highest density of image objects. Optionally, the select module 300 is operable to distinguish different image objects, such as moving vehicles, based on their colours and contrast, and another example of a predefined condition is to select a section of the image frame that includes any one or group of image objects out a plurality of image objects.
In other examples of these different embodiments, the event to be captured is characterised by variations in brightness over the area of the image frame. For example, for events such as plays, operas, or any other stage performances, the action is generally characterised by regions of relatively high brightness, such as spotlights directed towards an area of a theatre stage. Accordingly, another example of a predefined condition is to select a section of the image frame that includes bright regions that correspond to spotlighting. In these examples, the image objects in the image frames may be anatomic features of the actors/singers on the theatre stage and the action is characterised by facial movements of the actors/singers, such as lip movements. Accordingly, the select module 300 is operable to identify these facial movements by analysing the colour and/or contrast of the received image frames, and another example of a predefine condition is to select a section of the image frame that includes at least one of the identified facial movements.
In these different embodiments, it may be that more than one predefined conditions are met in a given image frame. Accordingly, the predefined conditions of these embodiments are optionally ranked. If the image frames received by the select module 300 satisfy more than one predefined conditions, the select module 300 generates the video production 420 based on the highest ranked predefined condition. It will also be appreciated that the above-described predefined conditions may be implemented individually or collectively in any suitable combination. Further, it will be appreciated that some of the above-described predefined conditions are more suitable than others depending on the intended end-user of the video production 420. Accordingly, these more suitable predefined conditions are implemented for the particular intended end-user. For example, where the intended end-user of the video production 420 is a coach of a football team, it is more desirable for the video production 420 to include image frames that include the whole area of a football field to enable to coach to analyse all aspects of a football match. In such an example, a preferred predefine condition is to select a section of the image frames that contain the whole area of a football field. In another example, where the intended end-user is a football scout interested in one particular player, it is more desirable for the video production 420 to include image frames that contain that particular player. In such an example, a preferred predefined condition is to select a section of the image frames that contain a particular image object.
In these different embodiments, the system 10 of the present invention is able to produce video productions of events that include the effects of panning and zooming automatically with minimal human intervention. By generating the video production 420 based on the above-described predefined conditions, the system 10 is able to determine the section of an image frame of a received video signal that is to be included in the video production 420 without the further human input.
In the foregoing embodiments of the present invention, the method and system for generating a video production have been described as suitable for events of public interest, such as football matches. It will be appreciated by the skilled person that the present invention is not limited to events of public interest and is also suitable for other events. It will also be appreciated that the purpose of the video production is not limited to broadcast and may be for other purposes, including streaming and private viewing.
Embodiments of the present invention have been described with particular reference to the examples illustrated. However, it will be appreciated that variations and modifications may be made to the examples described within the scope of the appending claims.

Method and system for producing a video production


An input/output device has a processor which processes data strings received by the device. When a data string is received, it is passed to a serial interface and a timing means. The serial interface generates a signal which interrupts the existing processing by the processor and causes the process to start processing of the newly received data string. At the same time the timing means measures the length of the data string and compares it with a predetermined length set by user-controllable data setting means. If the data string length reaches the predetermined length, the processor is triggered to stop processing the new data string and to recommence the processing it was performing prior to interruption. The unprocessed part of the new data string is stored in a memory.. In this way, urgent data strings, which are generally short, are processed rapidly and longer data strings are processed after the urgent data strings. It is not necessary for the data string to contain any information to identify its length.

1. Field of the Invention
The present invention relates to an input/output device. It also relates to a method of operating such a device, and to a control system incorporating such a device.
2. Summary of the Prior Art
It is well known to control an object, such as an industrial system or plant, using a programmable controller. That programmable controller has a processing module and one or more input/output devices, which input/output devices link the processing module to the object to be controlled. Data from the object are transmitted via one or more of the input/output devices to the processing module, and the processing module may also transmit data to the object to be controlled via one or more other input/output devices.
An example of such a known controller is the H-2000 Programmable Controller from Hitachi, Ltd.
When originally developed, such input/output devices were controlled entirely from the processing module of the programmable controller. However, it has been proposed that at least some of the control of the input/output device be achieved via a processing means within the input/output device itself. Such an input/output device is then called an "intelligent" input/output device. The processor of an intelligent input/output device is arranged to carry out at least some processing functions on the data that the input/output device receives.
In existing arrangements, the data from an object is passed to the input/output device in a series of frames, with each frame corresponding to a string of data, and the string of data must then be processed by the processor of the input/output device. One example of the type of frame which can be used is disclosed in e.g. the article entitled The Hierarchy of Communication Networks in the Programmable Assembly Cell: and Experimental Framework" by L. Sintonen and T. Virvalo in IEEE Network of May 1988, Volume 2, No. 3, pages 48 to 52.

Input/output device and a control system incorporating such a device