Geometric operations implemented by conformal geometric algebra neural nodes
Eckhard HITZER
University of Fukui
Abstract: Geometric algebra is an optimal frame work for calculating with vectors. The geometric algebra
of a space includes elements that represent all the its subspaces (lines, planes, volumes, ...). Conformal geometric algebra expands this approach to elementary representations of arbitrary points, point pairs, lines,
circles, planes and spheres. Apart from including curved objects, conformal geometric algebra has an elegant unified quaternion like representation for all proper and improper Euclidean transformations, including
reflections at spheres, general screw transformations and scaling. Expanding the concepts of real and complex neurons we arrive at the new powerful concept of conformal geometric algebra neurons. These neurons
can easily take the above mentioned geometric objects or sets of these objects as inputs and apply a wide
range of geometric transformations via the geometric algebra valued weights.

arXiv:1306.1358v1 [cs.CV] 6 Jun 2013

1.

Introduction

The co-creator of calculus W. Leibniz dreamed of a new
type of mathematics in which every number, every operation
and every relation would have a clear geometric counterpart.
Subsequently the inventor of the concept of vector space and
our modern notion of algebra H. Grassmann was officially
credited to fulfill Leibniz’s vision. Contemporary to Grassmann was W. Hamilton, who took great pride in establishing the algebra of rotation generators in 3D, which he himself called quaternion algebra. About 30 years later W. Clifford successfully fused Grassmann’s and Hamilton’s work
together in what he called geometric algebra. Geometric algebra can be understood as an algebra of a vector space and
all its subspaces equipped with an associative and invertible
geometric product of vectors.
It is classic knowledge that adding an extra dimension for
the origin point to a vector space leads to the projective geometry of rays, where Euclidean points correspond to rays.
Adding one more dimension for the point of infinity allows
to treat lines as circles through infinity, and planes as spheres
through infinity and unifies their treatment. This socalled
conformal geometric algebra represents geometric points,
spheres and planes by 5D vectors. The inner product of two
conformal points yields their Euclidean distance. Orthogonal
transformations preserve inner products and in the 5D model
Euclidean distances, provided that they also keep the point at
infinity invariant. According to Cartan and Dieudonné all orthogonal transformations are products of reflections. Proper
and improper Euclidean transformations can therefore be expressed nowadays in conformal geometric algebra as elegant
as complex numbers express rotations in 2D. And the language is not limited to 3+2D, n+2D follows the very same
principles.
Transformation groups generated by products of reflections in geometric algebra are known as Clifford (or Lipschitz or versor) groups [7, 10]. Versors (Clifford group or
Lipschitz elements) are simply the geometric products of the
normal vectors to the (hyper) planes of reflection. These
versors assume the role of geometric weights in concept of
conformal geometric algebra neural nodes. Precursors for
these nodes are complex [1], quaternion [3], and Clifford
spinor [2, 6] neurons. They have also been named versor
Clifford neurons [13], but regarding their fundamental geometric nature even the term geometric neurons seems fully
justified.

2.

Geometric algebra

Definition 1 (Clifford geometric algebra). A Clifford geometric algebra Gp,q is defined by the associative geometric
product of elements of a quadratic vector space Rp,q , their
linear combination and closure. Gp,q includes the field of
real numbers R and the vector space Rp,q as subspaces. The
geometric product of two vectors is defined as
ab = a · b + a ∧ b,

(1)

where a · b indicates the standard inner product and the
bivector a ∧ b indicates Grassmann’s antisymmetric outer
product. a ∧ b can be geometrically interpreted as the oriented parallelogram area spanned by the vectors a and b.
Geometric algebras are graded, with grades (subspace dimensions) ranging from zero (scalars) to n = p + q (pseudoscalars, n-volumes).
For example geometric algebra G3 = G3,0 of threedimensional Euclidean space R3 = R3,0 has an eightdimensional basis of scalars (grade 0), vectors (grade 1),
bivectors (grade 2) and trivectors (grade 3). Trivectors in
G3 are also referred to as oriented volumes or pseudoscalars.
Using an orthonormal basis {e1 , e2 , e3 } for R3 we can write
the basis of G3 as
{1, e1 , e2 , e3 , e2 e3 , e3 e1 , e1 e2 , i = e1 e2 e3 }.

(2)

In (2) i is the unit trivector, i.e. the oriented volume of a unit
cube. The even subalgebra G3+ of G3 is isomorphic to the
quaternions H of Hamilton. We therefore call elements of
G3+ rotors, because they rotate all elements of G3 . The role
of complex (and quaternion) conjugation is naturally taken
by reversion (a1 , a2 , . . . , as ∈ Rp,q , s ∈ N)
(a1 a2 . . . as )∼ = as . . . a2 a1 .

(3)

The inverse of a non-null vector a ∈ Rp,q is
a−1 =

a
.
a2

(4)

A reflection at a hyperplane normal a is
x0 = −a−1 xa.

(5)

A rotation by the angle θ in the plane of a unit bivector i
can thus be given as the product R = ab of two vectors a,

b from the i-plane (i.e. geometrically as a sequence of two
reflections) with angle θ/2,
Rp,q 3 x → R−1 xR ∈ Rp,q ,

e0 · e∞ = −1,

(7)

e0 E = −e0 , Ee0 = e0 , e∞ E = e∞ ,
Ee∞ = −e∞ , E 2 = 1.

Extracting a certain grade part from the geometric product of
two blades Ak and Bl has a deep geometric meaning.
One example is the grade l − k part (contraction [8]) of
the geometric product Ak Bl , that represents the orthogonal
complement of a k-blade Ak in an l-blade Bl , provided that
Ak is contained in Bl
(9)

Another important grade part of the geometric product of Ak
and Bl is the maximum grade l + k part, also called the outer
product part
Ak ∧ Bl = hAk Bl il+k .

(10)

If Ak ∧ Bl is non-zero it represents the union of the disjoint
(except for the zero vector) subspaces represented by Ak and
Bl .
The dual of a multivector A is defined by geometric division with the pseudoscalar I = A∗ = A I − 1, which maps
k-blades into (n − k)-blades, where n = p + q. Duality transforms inner products (contractions) to outer products
and vice versa. The outer product null space representation
(OPNS) of (8) is therefore transformed by duality into the
socalled inner product null space (IPNS) representation
x ∧ A = 0 ⇐⇒ x · A∗ = 0.

(11)

2.1 Conformal geometric algebra
Conformal geometric algebra embeds the geometric algebra
G3 of R3 in the geometric algebra of R4,1 = R3+1,0+1 Given
an orthonormal basis for R4,1
{e1 , e2 , e3 , e+ , e− }

b=
A

n
X

(−1)k hAik .

A Clifford (or Lipschitz) group is a subgroup in Gp,q generated by non-null vectors x ∈ Rp,q
Γp,q = {m ∈ Gp,q | ∀x ∈ Rp,q , m
b −1 x m ∈ Rp,q } (19)
For every m ∈ Γp,q we have mm
e ∈ R. Examples are m = a
and m = R = ab for reflections and rotations, respectively.
Clifford groups include Pin(p, q), Spin(p, q), and
Spin+ (p, q) groups as covering groups of orthogonal
O(p, q), special orthogonal SO(p, q) and SO+ (p, q) groups,
respectively. Conformal transformation groups C(p, q)
preserve inner products (angles) of vectors in Rp,q up to a
change of scale. C(p, q) is isomorphic to O(p + 1, q + 1).
The metric affine group (orthogonal transformations and
translations) of Rp,q is a subgroup of O(p + 1, q + 1), and
can be implemented as a Clifford group in Gp+1,q+1 .
2.2 Geometric objects
The conformal geometric algebra G4,1 provides us with a superb model [7–9] of Euclidean geometry. The basic geometric objects in conformal geometric algebra are homogeneous
conformal points
1
P = p + p2 e∞ + e0 ,
(20)
2
p
where p ∈ R3 , p =
p2 . The +e0 term shows that we
include projective geometry. The second term + 12 p2 e∞ ensures, that conformal points are isotropic vectors
P 2 = P P = P · P = 0.

e21 = e22 = e23 = e2+ = −e2− = 1,

(13)

we introduce a change of basis for the two additional dimensions {e+ , e− } by
1
(e− − e+ ),
2

e∞ = e− + e+ .

(14)

The vectors e0 and e∞ are isotropic vectors, i.e.
e20 = e2∞ = 0,

(18)

k=0

(12)

with

e0 =

(17)

As we will now see, conformal geometric algebra is advantageous for the unified representation of many types of
geometric transformations. In the next section we will further
consider the unified representation of eight different types of
Euclidean geometric objects possible in conformal geometric
algebra.
Combining reflections (5) leads to an overall sign (parity)
for odd and even numbers of (reflection plane) vectors a, b,
etc. Therefore we define the grade involution

x ∈ V = span[a1 , . . . ak ] ⇔ x∧a1 ∧a2 ∧. . .∧ak = 0. (8)

Bl = hAk Bl il−k .

(16)

We further have the following useful relationships

where |a|, and |b| are the lengths of a, b. This description
corresponds exactly to using quaternions.
Blades of grade k, 0 ≤ k ≤ n = p + q are the outer
products of k vectors al (1 ≤ l ≤ k) and directly represent
the k-dimensional vector subspaces V spanned by the set of
vectors al (1 ≤ l ≤ k). This is also called the outer product
null space (OPNS) representation.

Ak

E = e∞ ∧ e0 = e+ ∧ e− .

(6)

where the vectors a, b are in the plane of the unit bivector
i ∈ Gp,q if and only if a ∧ i = b ∧ i = 0. The rotor R can
also be expanded as
R = ab = |a||b|exp(θi/2),

and have inner and outer products of

(15)

(21)

In general the inner product of two conformal points P1 and
P2 gives their Euclidean distance
1
P1 · P2 = − (p1 − p2 )2 .
2

(22)

Orthogonal transformations preserve this distance. The outer
product of two conformal points spans a conformal point pair
(in OPNS) as in Fig. 1
P p = P1 ∧ P2 .

(23)

Fig. 1 Conformal point pair P1 ∧ P2 with center C.
This and the following illustrations were produced with the
OpenSource visual software CLUCalc [14], which is also
based on conformal geometric algebra.
The outer product three conformal points gives a circle (cf.
Fig. 2)
Circle = P1 ∧ P2 ∧ P3 .

(24)

Fig. 4 Conformal line P1 ∧P2 ∧e∞ with 3D direction vector
d.
also called bivector moment of the line. Conformal planes
(spheres through infinity, cf. Fig. 5) are represented by
P lane = P1 ∧ P2 ∧ P3 ∧ e∞ = Circle ∧ e∞ .

(27)

Further flattened objects are

Fig. 2 Conformal circle P1 ∧ P2 ∧ P3 with center C.
The conformal outer product of four conformal points
gives a sphere (cf. Fig. 3)
Sphere

= P1 ∧ P2 ∧ P3 ∧ P4 .

(25)

Fig. 5 Conformal plane P1 ∧ P2 ∧ P3 ∧ e∞ .
P ∧ e∞ ,

(28)

a (flat) finite–infinite point pair, and
−is E = Sphere ∧ e∞ ∼ I5 = iE,

(29)

the in 5D embedded (flat) 3D Euclidean space R3 .
2.3 General reflection and motion operators (motors)
As in G3 , 3D rotations around the origin in the conformal
model G4,1 are still represented by rotors (6). The standard
IPNS representation of a conformal plane, i.e. the dual of
the direct OPNS representation (27) results in a vector, that
both describes the unit normal direction n = c⊥ /|c⊥ | and
the position (signed distance d = c⊥ · n from the origin) of
a plane by
µ = P lane∗ = n + de∞ .
Fig. 3 Conformal sphere P1 ∧ P2 ∧ P3 ∧ P4 with center C.
If one of the points is at infinity, we get conformal lines
(circles through infinity, cf. Fig. 4)
Line = P1 ∧ P2 ∧ e∞ = P p ∧ e∞
= 2r(d ∧ ce∞ − dE) ∝ m e∞ − dE,

(26)

where d is the direction vector of the line and c the 3D midpoint between P1 and P2 , 2r = |p2 − p2 |. c can be replaced by any point p on the line. m = d ∧ c = d ∧ p is

(30)

We can reflect the conformal point X at the general plane
(30) similar to (5) with
X 0 = −µ−1 Xµ.

(31)

A reflection of a general conformal object O (point, point
pair, line, ..., sphere) at the general plane (30) similar to (31)
with
b
O0 = µ−1 Oµ,

(32)

where the grade involution takes care of the sign changes.
Just as we obtained rotations (6) by double reflections we

now obtain rotations around arbitrary axis (lines of intersection of two planes) by double reflections at planes µ1 and µ2
X 0 = R−1 XR,

R = µ1 µ2 .

(33)

And if the two planes µ1 and µ2 happen to be parallel, i.e.
n1 = ±n2 , we instead get a translation by twice the Euclidean distance t/2 between the planes
X 0 = T −1 XT,
1
1
T (t) = µ1 µ2 = 1 + te∞ = exp( te∞ ).
2
2

Table 2 Summary of motions and scaling O → W −1 OW in
conformal GA. O is a general conformal object (point, point
pair, circle, sphere, flat point, line, plane, 3D space). The
conformal versor W represents the motion operator.
Motion operator Versor W
Rotor
exp(θi/2)
Translator
exp( 12 te∞ )
Motor
TR
Scale operator
T −1 (c) exp (E 21 log s) T (c)

(34)

A general motion operator (motor) results from combining
rotations (33) and translations (34) to
M = T R.

(35)

The standard IPNS representation of a sphere results in the
vector
1
σ = S ∗ = C − r2 e∞ ,
2

(36)

which is exactly the dual S ∗ = S i−1
3 E of (25). The expression (36) shows that in conformal GA a point can be regarded
as a sphere with zero radius. We can reflect (invert) the conformal point X at the sphere (36) [or at a conformal point]
similar to (5) and (31) simply by
X 0 = −σ −1 Xσ.

(37)

The double reflection at two concentric spheres σ1 and σ2
(centered at c) results in a rescaling operation [8] with factor
s and center c
X 0 = Z −1 XZ,
Z = σ1 σ2 = T −1 (c) exp (E

Fig. 6 Examples of combinations of geometric transformations: rotor R, translator T , scaling operator Z, motor and
scaling op. Ms .

1
log s) T (c).
2

(38)

The following illustrations have been produced with the
socalled Space Group Visualizer [15], a symmetry visualization program for crystallographic space group, which is also
based on conformal geometric algebra software.
Figure 7 shows a glide reflection, i.e. a reflection combined with a translation parallel to the plane of reflection.
Figure 8 shows a point inversion. Figure 9 shows a screw

Table 1 summarizes the various reflections possible in conformal GA. Table 2 summarizes the motions and scaling posb in conforTable 1 Summary of reflections O → −W −1 OW
mal GA. O is a general conformal object (point, point pair,
circle, sphere, flat point, line, plane, 3D space). The conformal versor W represents the mirror.
Mirror Versor W
plane
n + de∞
point
p + 12 p2 e∞ + e0
sphere C − 12 r2 e∞
line
m e∞ − dE

Fig. 7 Examples of glide reflection, which is a reflection
combined with a translation parallel to the plane of reflection.

sible in conformal GA.
2.4 Combining elementary transformations
All operations in Tables 1 and 2 can be combined to give further geometric transformations, like rotoinversions, glide reflections, etc.! Algebraically the combination is represented
by simply computing the product of the multivector versors
of the elementary transformations explained above. Figure
6 shows some examples of combinations of geometric transformations applied to a point pair P1 ∧ P2 . The overbars
abbreviate the inverse of an operator.

transformation, which is a rotation followed by a translation
along the axis of the rotation. Figure 10 shows a rotoinversion, which is a combination of point inversion and rotation.
A rotoinversion is also equivalent to a rotation followed by a
reflection at a plane perpendicular to the axis of rotation.

3.

Geometric neurons

Conformal versors V describe in conformal Clifford group
[10] representations the above mentioned transformations

Fig. 8 Examples of point inversion.

Fig. 10 Examples of a 90 degree rotoinversion, which is a
combination of point inversion and a 90 degree rotation.

4.

Fig. 9 Examples of a screw transformation.

of arbitrary conformal geometric object multivectors X ∈
G(R3+1,1 ) of section 2.2
X 0 = (−1)v V −1 XV,

(39)

where the versor is a geometric product of v invertible vectors ∈ R3+1,1 .
The geometric neuron (GN) is characterized by a twosided multiplication of a single multivector weight versor
W ∈ G(R3+1,1 ), input multivectors X ∈ G(R3+1,1 ), and
multivector thresholds Θ ∈ G(R3+1,1 )
Y = (−1)w W −1 XW + Θ,

Conclusions

We have introduced the concept of geometric algebra as the
algebra of a vector space and all its subspaces. We have
shown how conformal geometric algebra embeds and models
Euclidean geometry. Outer products of points (including the
point at infinity) model the elementary geometric objects of
points, point pairs, flat points, circles, lines, spheres, planes
and the embedded 3D space itself.
The unified representation of affine Euclidean transformations (including translations) by orthogonal transformations
in the conformal model allows the construction of a geometric neuron, whose versor weights can learn these transformations precisely. The transformations were illustrated in
detail.

(40)

where w represents the number of vector factors (parity) in
W . The theory, optimization and example simulation of such
geometric neurons has been studied in [13]. It was shown
that e.g. the inversion at a sphere can be learned exactly by a
geometric neuron, outperforming linear networks and multilayer perceptrons with the same or higher number of degrees
of freedom.

Acknowledgments
The author would like to thank K. Tachibana (COE FCS,
Nagoya) and S. Buchholz (Kiel). He further wishes to thank
God, the creator: Soli Deo Gloria, and his very supportive
family.

References
[1] A. Hirose, Complex-Val. NNs, Springer, Berlin, 2006.
[2] S. Buchholz, G. Sommer, Quat. Spin. MLP, Proc.
ESANN 2000, d-side pub., pp. 377–382, 2000
[3] N. Matsui, et al, Quat. NN with geome. ops., J. of Intel.
& Fuzzy Sys. 15 pp. 149-1164 (2004).
[4] E. Hitzer, Multivector Diff. Calc., Adv. Appl. Cliff. Alg.
12(2) pp. 135-182 (2002).
[5] D. Hestenes, G. Sobczyk, Cliff. Alg. to Geom. Calc.,
Kluwer, Dordrecht, 1999.
[6] S. Buchholz, A Theory of Neur. Comp. with Cliff. Alg.,
TR No. 0504, Univ. of Kiel, May 2005.
[7] D. Hestenes, H. Li, A. Rockwood, New Alg. Tools for
Class. Geom., in G. Sommer (ed.), Geom. Comp. with
Cliff. Alg., Springer, Berlin, 2001.

[8] L. Dorst, D. Fontijne, S. Mann, Geom. Alg. for Comp.
Sc., Morgan Kaufmann Ser. in Comp. Graph., San Francisco, 2007.
[9] P. Angles, Conf. Groups in Geom. and Spin Struct.,
PMP, Birkhauser, Boston, 2007.
[10] P. Lounesto, Cliff. Alg. and Spinors, 2nd ed., CUP,
Cambridge, 2006.
[11] S. Buchholz, K. Tachibana, E. Hitzer, Optimal Learning Rates for Cliff. Neurons, in LNCS 4668, Springer,
Berlin, 2007, pp. 864–873.
[12] E. Hitzer, et al. Carrier method f. gen. eval. & control of
pose, molec. conform., tracking, and the like acc. Adv.
in Appl. Cliff. Algs., 26 pp. (2008).
[13] S. Buchholz, E. Hitzer, K. Tachibana, Coordinate independent update formulas for versor Clifford neurons
Proceedings of Joint Conference SCIS & ISIS 2008,
Nagoya, Japan, pp. 814–819, (2008).
[14] C.
Perwass,
Visual
Calculator
CLUCalc,
http://www.clucalc.info
[15] C. Perwass, E. Hitzer, Space Group Visualizer,
http://www.spacegroup.info

