Introduction
What is Symbolic Computation?
Symbolic computation deals with the computation of mathematical objects symbolically. This means that the mathematical objects are represented exactly, not approximately, and mathematical expressions with unevaluated variables are left in symbolic form.
Let's take an example. Say we wanted to use the built-in Python functions to compute square roots. We might do something like this
Julis has sqrt
in base
julia> sqrt(9)
3.0
Expand for Python example
>>> import math
>>> math.sqrt(9)
3.0
9 is a perfect square, so we got the exact answer, 3. But suppose we computed the square root of a number that isn't a perfect square
julia> sqrt(8)
2.8284271247461903
Expand for Python example
>>> math.sqrt(8)
2.82842712475
Here we got an approximate result. 2.82842712475 is not the exact square root of 8 (indeed, the actual square root of 8 cannot be represented by a finite decimal, since it is an irrational number). If all we cared about was the decimal form of the square root of 8, we would be done.
But suppose we want to go further. Recall that \sqrt{8} = \sqrt{4\cdot 2} = 2\sqrt{2}
. We would have a hard time deducing this from the above result. This is where symbolic computation comes in. With a symbolic computation system like SymPy, square roots of numbers that are not perfect squares are left unevaluated by default
We see two ways to do this, call the sqrt
function from sympy
or use the overloaded sqrt
function for symbolic objects. The latter is more idiomatic.
julia> sympy.sqrt(3), sqrt(Sym(3))
(sqrt(3), sqrt(3))
Expand for Python example
>>> import sympy
>>> sympy.sqrt(3)
sqrt(3)
Furthermore–-and this is where we start to see the real power of symbolic computation–-symbolic results can be symbolically simplified.
julia> sqrt(Sym(8))
2⋅√2
Expand for Python example
>>> sympy.sqrt(8)
2*sqrt(2)
A More Interesting Example
The above example starts to show how we can manipulate irrational numbers exactly using SymPy. But it is much more powerful than that. Symbolic computation systems (which by the way, are also often called computer algebra systems, or just CASs) such as SymPy are capable of computing symbolic expressions with variables.
As we will see later, in SymPy, variables are defined using symbols
. Unlike many symbolic manipulation systems, variables in SymPy must be defined before they are used (the reason for this will be discussed in the next section]).
Let us define a symbolic expression, representing the mathematical expression x + 2y
.
While symbols
may be used in the same manner as the Python
code, the use of the @syms
macro is used in this translation of the tutorial to Julia
.
julia> @syms x, y
(x, y)
julia> expr = x + 2y
x + 2⋅y
Expand for Python example
>>> from sympy import symbols
>>> x, y = symbols('x y')
>>> expr = x + 2*y
>>> expr
x + 2*y
Note that we wrote x + 2*y
just as we would if x
and y
were ordinary Python variables. But in this case, instead of evaluating to something, the expression remains as just x + 2*y
. Now let us play around with it:
julia> expr + 1
x + 2⋅y + 1
julia> expr - x
2⋅y
Expand for Python example
>>> expr + 1
x + 2*y + 1
>>> expr - x
2*y
Notice something in the above example. When we typed expr - x
, we did not get x + 2*y - x
, but rather just 2*y
. The x
and the -x
automatically canceled one another. This is similar to how sqrt(8)
automatically turned into 2*sqrt(2)
above. This isn't always the case in SymPy, however:
julia> x * expr
x⋅(x + 2⋅y)
Expand for Python example
>>> x*expr
x*(x + 2*y)
Here, we might have expected x(x + 2y)
to transform into x^2 + 2xy
, but instead we see that the expression was left alone. This is a common theme in SymPy. Aside from obvious simplifications like x - x = 0
and \sqrt{8} = 2\sqrt{2}
, most simplifications are not performed automatically. This is because we might prefer the factored form x(x + 2y)
, or we might prefer the expanded form x^2 + 2xy
. Both forms are useful in different circumstances. In SymPy, there are functions to go from one form to the other
The expand
and factor
functions of SymPy are wrapped and exported. For non-exported functions from SymPy, the sympy
module can be utilized.
julia> expanded_expr = expand(x * expr)
2 x + 2⋅x⋅y
julia> factor(expanded_expr)
x⋅(x + 2⋅y)
Expand for Python example
>>> from sympy import expand, factor
>>> expanded_expr = expand(x*expr)
>>> expanded_expr
x**2 + 2*x*y
>>> factor(expanded_expr)
x*(x + 2*y)
The Power of Symbolic Computation
The real power of a symbolic computation system such as SymPy is the ability to do all sorts of computations symbolically. SymPy can simplify expressions, compute derivatives, integrals, and limits, solve equations, work with matrices, and much, much more, and do it all symbolically. It includes modules for plotting, printing (like 2D pretty printed output of math formulas, or $\mathrm{\LaTeX}$), code generation, physics, statistics, combinatorics, number theory, geometry, logic, and more. Here is a small sampling of the sort of symbolic power SymPy is capable of, to whet your appetite.
julia> @syms x, t, z, nu
(x, t, z, nu)
Expand for Python example
>>> from sympy import *
>>> x, t, z, nu = symbols('x t z nu')
This will make all further examples pretty print with unicode characters.
The ASCII pretty printing is used by show
by default
julia> nothing
Expand for Python example
>>> init_printing(use_unicode=True)
Take the derivative of \sin{(x)}e^x
.
julia> diff(sin(x) * exp(x), x)
x x ℯ ⋅sin(x) + ℯ ⋅cos(x)
Expand for Python example
>>> diff(sin(x)*exp(x), x)
x x
ℯ ⋅sin(x) + ℯ ⋅cos(x)
Compute \int(e^x\sin{(x)} + e^x\cos{(x)})\,dx
.
julia> integrate(exp(x)*sin(x) + exp(x)*cos(x), x)
x ℯ ⋅sin(x)
Expand for Python example
>>> integrate(exp(x)*sin(x) + exp(x)*cos(x), x)
x
ℯ ⋅sin(x)
Compute $\int_{-\infty}^\infty \sin{(x^2)}\,dx$.
The oo
variable is exposed (along with PI
, E
, IM
, zoo
)
julia> integrate(sin(x^2), (x, -oo, oo))
√2⋅√π ───── 2
Expand for Python example
>>> integrate(sin(x**2), (x, -oo, oo))
√2⋅√π
─────
2
Find $\lim_{x\to 0}\frac{\sin{(x)}}{x}$.
The limit
function is wrapped and exported. The wrapping is given an interface which accepts a pair
julia> limit(sin(x)/x, x => 0)
1
Expand for Python example
>>> limit(sin(x)/x, x, 0)
1
Solve $x^2 - 2 = 0$.
The solve
function is wrapped and exported, as it and solveset
are workhorses.
julia> solve(x^2 - x, x)
2-element Vector{SymPyCore.Sym{PythonCall.Core.Py}}: 0 1
Expand for Python example
>>> solve(x**2 - 2, x)
[-√2, √2]
Solve the differential equation $y'' - y = e^t$.
In Julia
, following the Symbolics.jl
interface, We provide a the Differential
function. It cleans up the calls to diff
a bit, though using diff
is an option.
julia> @syms t, y()
(t, y)
julia> D = Differential(t)
SymPyCore.Differential(t, 1)
julia> D² = D∘D
SymPyCore.Differential(t, 1) ∘ SymPyCore.Differential(t, 1)
julia> dsolve(D²(y(t)) - y(t) ~ exp(t), y(t))
-t ⎛ t⎞ t y(t) = C₂⋅ℯ + ⎜C₁ + ─⎟⋅ℯ ⎝ 2⎠
Expand for Python example
>>> y = Function('y')
>>> dsolve(Eq(y(t).diff(t, t) - y(t), exp(t)), y(t))
-t ⎛ t⎞ t
y(t) = C₂⋅ℯ + ⎜C₁ + ─⎟⋅ℯ
⎝ 2⎠
Find the eigenvalues of $\left[\begin{smallmatrix}1 & 2\\2 &2\end{smallmatrix}\right]$.
The package extends some generic function from the LinearAlgebra
package
julia> using LinearAlgebra
julia> M = Sym[1 2; 2 2]
2×2 Matrix{SymPyCore.Sym}: 1 2 2 2
julia> eigvals(M)
2-element Vector{SymPyCore.Sym{PythonCall.Core.Py}}: 3/2 - sqrt(17)/2 3/2 + sqrt(17)/2
Expand for Python example
>>> Matrix([[1, 2], [2, 2]]).eigenvals()
⎧3 √17 3 √17 ⎫
⎨─ - ───: 1, ─ + ───: 1⎬
⎩2 2 2 2 ⎭
Rewrite the Bessel function $J_{\nu}\left(z\right)$ in terms of the spherical Bessel function $j_\nu(z)$.
The package extends some generic function from the SpecialFunctions
package. Special functions defined in sympy
but not SpecialFunctions
, such as several orthogonal polynomial related function can be qualified using the sympy
module.
julia> using SpecialFunctions
julia> besselj(nu, z).rewrite("jn")
√2⋅√z⋅jn(ν - 1/2, z) ──────────────────── √π
Expand for Python example
>>> besselj(nu, z).rewrite(jn)
√2⋅√z⋅jn(ν - 1/2, z)
────────────────────
√π
Print $\int_{0}^{\pi} \cos^{2}{\left (x \right )}\, dx$ using $\mathrm{\LaTeX}$.
The Latexify
package has a recipe for producing $\LaTeX$ output. The Integral
function below constructs an integral, but does not evaluate it. Either use integrate
or the method doit
to evaluate the integral.
julia> using Latexify
ERROR: ArgumentError: Package Latexify not found in current path. - Run `import Pkg; Pkg.add("Latexify")` to install the Latexify package.
julia> out = sympy.Integral(cos(x)^2, (x, 0, PI))
π ⌠ ⎮ 2 ⎮ cos (x) dx ⌡ 0
julia> latexify(out)
ERROR: UndefVarError: `latexify` not defined
Expand for Python example
>>> latex(Integral(cos(x)**2, (x, 0, pi)))
\int\limits_{0}^{\pi} \cos^{2}{\left(x \right)}\, dx
Why SymPy?
There are many computer algebra systems out there. This Wikipedia article lists many of them. What makes SymPy a better choice than the alternatives?
First off, SymPy is completely free. It is open source, and licensed under the liberal BSD license, so you can modify the source code and even sell it if you want to. This contrasts with popular commercial systems like Maple or Mathematica that cost hundreds of dollars in licenses.
Second, SymPy uses Python. Most computer algebra systems invent their own language. Not SymPy. SymPy is written entirely in Python, and is executed entirely in Python. This means that if you already know Python, it is much easier to get started with SymPy, because you already know the syntax (and if you don't know Python, it is really easy to learn). We already know that Python is a well-designed, battle-tested language. The SymPy developers are confident in their abilities in writing mathematical software, but programming language design is a completely different thing. By reusing an existing language, we are able to focus on those things that matter: the mathematics.
Another computer algebra system, Sage also uses Python as its language. But Sage is large, with a download of over a gigabyte. An advantage of SymPy is that it is lightweight. In addition to being relatively small, it has no dependencies other than Python, so it can be used almost anywhere easily. Furthermore, the goals of Sage and the goals of SymPy are different. Sage aims to be a full featured system for mathematics, and aims to do so by compiling all the major open source mathematical systems together into one. When you call some function in Sage, such as integrate
, it calls out to one of the open source packages that it includes. In fact, SymPy is included in Sage. SymPy on the other hand aims to be an independent system, with all the features implemented in SymPy itself.
A final important feature of SymPy is that it can be used as a library. Many computer algebra systems focus on being usable in interactive environments, but if you wish to automate or extend them, it is difficult to do. With SymPy, you can just as easily use it in an interactive Python environment or import it in your own Python application. SymPy also provides APIs to make it easy to extend it with your own custom functions.
In Juila
there are a few other choices for symbolic math, primarily Symbolics.jl
, SymEngine.jl
. Symbolics.jl
is a Julia
only solution. It is performant and widely used within the suite of SciML
packages. The SymEngine
package is much more limited in features, but extremely fast. Using SymPy may be slower, but the library has many more features available.