Category Archives: Mathematics

What is Information?

Information is a difference that makes a difference.

— Gregory Bateson

Information is a distinction that makes a difference.

— Donald M. Mackay

Draw a distinction.

— G. Spencer-Brown

To Luciano Floridi, information can have one (or more?) of the following four properties:

    • As something
    • About something
    • In something
    • For something

To Charles S. Peirce, information is about semiosis, integrating the four aspects of:

    • Denotation
    • Connotation
    • Extension
    • Comprehension

 

Further Reading:

https://en.wikipedia.org/wiki/Philosophy_of_information#Definitions_of_%22information%22

https://en.wikipedia.org/wiki/Philosophy_of_information

https://en.wikipedia.org/wiki/Logic_of_information

https://en.wikipedia.org/wiki/Semiotics

https://en.wikipedia.org/wiki/Denotation

https://en.wikipedia.org/wiki/Connotation

https://en.wikipedia.org/wiki/Extension_(semantics)

https://en.wikipedia.org/wiki/Comprehension_(logic)

Aaron Sloman on Bateson and Information:

https://www.cs.bham.ac.uk/research/projects/cogaff/misc/information-difference.html

https://www.cs.bham.ac.uk//research/projects/cogaff/misc/austen-info.html

https://www.cs.bham.ac.uk//research/projects/cogaff/sloman-inf-chap.html

Various links:

https://www.stephanie-burns.com/blog/2017/3/25/the-difference-that-makes-the-difference

https://www.edge.org/conversation/daniel_c_dennett-a-difference-that-makes-a-difference

Dynamics of Information as Natural Computation (2 links to same paper):

https://www.mdpi.com/2078-2489/2/3/460

https://www.researchgate.net/publication/220121522_Dynamics_of_Information_as_Natural_Computation

[*13.192, *13.194]

<>

Linear Process Algebra

One of computer scientist and Professor Emeritus Vaughan Pratt’s most recent conference papers is on “linear process algebra,” which relates several of his previous interests on linear logic, Chu spaces, concurrent processes, events and states, etc.

The paper opens with a nice overview of computer science research primarily concerned with concurrent processes. Computation itself divides into the aspects of logical and algorithmic, formal methods into the logical and algebraic, concurrent computation into operational and denotational, and then the author gives a brief list of models of processes by a variety of mathematical structures until he comes to his theme of using Chu spaces.

As an example, he presents processes as Chu spaces over the set K, where K = { 0, T, 1, X}, with names and meanings :

  • 0: Ready
  • T: Transition
  • 1: Done
  • X: Cancelled

and then details four binary operations as working in Chu spaces over K:

  • P ; Q: Sequence
  • P + Q: Choice
  • P || Q: Concurrence
  • P ⊗ Q: Orthocurrence

Further Reading:

Vaughan Pratt / Linear Process Algebra

Click to access bhub.pdf

Click to access lpa.pdf

Click to access bud.pdf

https://www.researchgate.net/publication/2663060_Chu_Spaces_A_Model_Of_Concurrency

https://www.researchgate.net/publication/222310260_Types_as_Processes_via_Chu_spaces

https://en.wikipedia.org/wiki/Vaughan_Pratt

https://dblp.org/pid/p/VRPratt.html

[*12.122]

<>

How to Solve It

“How to Solve It” (first published in 1945) is a small volume by mathematician George Pólya describing methods of problem solving.  The book suggests the following steps when solving a mathematical problem:

1. Understand the problem.
2. Devise a plan to solve it.
3. Carry out the plan.
4. Revise and extend: look back on your work.

Further Reading:

https://en.wikipedia.org/wiki/How_to_Solve_It

https://en.wikipedia.org/wiki/Heuristic

<>

 

The Golden Ratio

Here are shown various ways to write the Golden Ratio, a favorite theme of mathematical recreation and investigation:

  • The equality of two ratios of simple algebraic quantities in two unknowns
  • The infinite limit of the ratio of successive Fibonacci numbers
  • In an infinite continued fraction representation
  • As a specific irrational number involving the square root of five (but cross multiply and 4 = 4 is explicit)

These instances remind me a bit of the Four Causes in their representations:

  • Relative and relational, but indefinite (Efficient)
  • Idealized as an infinite sequence and infinite completion (Formal)
  • Infinitely nested and recursively reductive (Material)
  • Definite but with embedded irrationality (Final)

Further Reading:

https://en.wikipedia.org/wiki/Golden_ratio

https://en.wikipedia.org/wiki/Fibonacci_number

https://en.wikipedia.org/wiki/Irrational_number

[*12.92]

<>

Classes of Automata

Here is one way to carve up abstract (mathematical) automata into different classes of complexity (from low to high).

There is a somewhat different and older one that is based on the Chomsky Hierarchy (where ND stands for non-deterministic), and the associated language or grammar that they recognize:

Further Reading:

https://en.wikipedia.org/wiki/Automata_theory

https://en.wikipedia.org/wiki/Chomsky_hierarchy

[*11.138]

<>

The Pi Calculus

My previous post on Wolfram’s physics mentioned the Pi calculus, but I liked this little diagram so much I decided to let it have its own mention. The rules aren’t really four in number, but oh well.

  • (νx)P: create a channel named x, then do P
  • x(y).P: receive y over channel x, then do P
  • x‾<y>.P: send y over channel x, then do P
  • P|Q: do P and Q at the same time
  • !P: do P over and over until stopped
  • 0: stop

Further Reading:

https://en.wikipedia.org/wiki/%CE%A0-calculus

https://en.wikipedia.org/wiki/Process_calculus

https://en.wikipedia.org/wiki/Game_semantics

https://golem.ph.utexas.edu/category/2009/08/the_pi_calculus.html

[*12.34]

<>

 

The Wolfram Physics Project

When I first started looking at Stephen Wolfram’s latest proposal to solve physics, I was somewhat disappointed. I was rather fond of his previous “New Kind of Science” based on the structural rigidity of cellular automata. However, I am now intrigued by his latest ideas, based on the looser but more flexible basis of networks.

And once you have pithy statements with space, time, energy, and matter (as momenta), you catch my attention:

  • Energy is flux of causal edges
  • through Spacelike hypersurfaces
  • Momentum is flux of causal edges
  • through Timelike hypersurfaces

I confess I haven’t read much about the project yet, but it seems to be using rewriting rules, perhaps similar to the notion of rewriting in Wolfram’s previous framework, cellular automata. Of course, cellular automata and also rewriting rule systems can be computationally universal or Turing complete.

Another idea might be to try some sort of computational metaphysics between nodes like the pi-calculus (or some other process calculus). After all, you have to support quantum entanglement! However if you can encode everything with simpler structures then do it!

Further Reading:

https://www.wolframphysics.org/

https://www.wired.com/story/stephen-wolfram-invites-you-to-solve-physics/

How We Got Here: The Backstory of the Wolfram Physics Project

https://en.wikipedia.org/wiki/Digital_physics

https://www.scientificamerican.com/article/physicists-criticize-stephen-wolframs-theory-of-everything/

https://turingchurch.net/computational-irreducibility-in-wolframs-digital-physics-and-free-will-e413e496eb0a

View at Medium.com

Cellular automata:

https://en.wikipedia.org/wiki/Cellular_automaton

Note this quote for future reference:

The primary classifications of cellular automata, as outlined by Wolfram, are numbered one to four. They are, in order, automata in which patterns generally stabilize into homogeneity, automata in which patterns evolve into mostly stable or oscillating structures, automata in which patterns evolve in a seemingly chaotic fashion, and automata in which patterns become extremely complex and may last for a long time, with stable local structures. This last class are thought to be computationally universal, or capable of simulating a Turing machine.

Rewriting:

https://en.wikipedia.org/wiki/Rewriting

https://en.wikipedia.org/wiki/Semi-Thue_system

[*12.32]

<>

What is Turbulence?

In his science-fictional “Foundation Trilogy”, Isaac Asimov famously hypothesized a future science called “psychohistory”, a mathematically grounded theory of generalized and predictive human action, based on an amalgamation of psychology, history, and sociology. The future galactic empire was managed by this theory and practice (look out – almost seventy year old spoilers!) except for an exceptional character that was not anticipated and essentially unpredicable.

Asimov had in mind well validated continuous and statistical theories of physics, for example for idealized gases and their laws. I was stuck by an image for an explanation of turbulence that highlighted key elements of velocity, density, pressure, and viscosity, and how it was (in my mind) analogical to antagonistic individuals, dominating leaders, submissive society, and affiliated coteries. Of course, an article below states that turbulence is still too complicated to provably model correctly at this point in time.

I had no idea that psychohistory was claimed to be an actual field of study these days, albeit being somewhat controversial in its authenticity. And it doesn’t seem to have any mathematical basis yet, as far as I know. Mathematician Dan Crisan gave an inaugural talk a few years ago that was hypothesizing using heat equations instead of fluid dynamics as a basis. Even so, we can’t seem to properly model any sort of social action so how could psychohistory be within our grasp?

In these turbulent times perhaps we should make an effort to understand ourselves a bit better, as we hope to navigate between the Charybdisian whirlpool of civil discord and environmental collapse and the Scyllaian rocks of fascism, authoritarianism, and / or totalitarianism. But hey, isn’t Apple doing an Apple TV+ series based on Asimov’s books? Let’s all tune in!

Further Reading:

https://en.wikipedia.org/wiki/Psychohistory_(fictional)

https://en.wikipedia.org/wiki/Psychohistory

https://en.wikipedia.org/wiki/Foundation_(TV_series)

https://www.quantamagazine.org/why-turbulence-is-a-hard-physics-problem-20190128/

https://www.quantamagazine.org/videos/what-is-turbulence/

https://en.wikipedia.org/wiki/Navier–Stokes_equations

Philip Ball / Critical Mass : How One Thing Leads to Another (2004)

Concerning Professor Dan Crisan:

Click to access talkinaugural230113.pdf

And also this quite long but interesting essay:

Prolegomena to Any Dark-Age Psychohistory

[*11.166]

<>

Category Theory

I’ve been interested in Category Theory for a substantial number of years, but have never dedicated the time necessary to learn it properly. But it seems to me that these are great days (salad days?) for learning at least the rudiments of the subject. There are now wealths of copious materials available on-line for free for one’s self-study and enrichment, as well as new and classic treatises on Categories and their theory.

Category Theory has been called “abstract nonsense”, but while it is very abstract, it is hardly nonsense. Like set theory, it can be used to study the foundations of mathematics. Like algebra, it can be used to study generalized structure and relationships in math. Like the assortment of tools that is computer science, it can be used to study the essence of logic and computation. And like calculus, it can be used for all sorts of applied and scientific purposes.

Like all good math, Category Theory (CT) generalizes concepts that lie at the heart of many branches of mathematics. These concepts allow the mathematician to see similarities between these different branches, and carry them over into others as well. You might think “maths” is all one thing, and it is, roughly, but like science, it has evolved into a myriad of subjects and specialities. Ontologically (or perhaps even categorically), CT is listed as a topic under algebra, and it in turn has its own distinct branches.

And like all good math, CT benefits from a judicious choice of definitions and properties, that balance generality with precision to great expressive advantage. This balance between abstraction and concreteness gives it the power and utility that it has enjoyed for the better part of seventy-five years. This makes CT rather a new-comer to mathematics, but please don’t mistake youth for lack of expertise.

If I wanted to represent CT emblematically, I might suggest the diagram above. At root, a category merely consists of a collection of objects and the pairwise morphisms (or arrows) between them. But additionally, the arrows must also obey a small set of conditions, so the objects usually have a similar nature. This nature can be quite abstract though, and one of the most familiar “concrete” categories is that of sets and the functions between them.

If arrows are the mappings between objects, then “functors” are mappings between categories, that once again have to obey some rules to maintain structure. So you can think analogically that arrows are to objects as functors are to categories and you wouldn’t be too wrong. Next, you can imagine generalizing to a higher level that there are mappings between functors, and “natural transformations” are indeed defined to be so.

There are many types of entities and characters that inhabit the theory that serve to propel the plot threads along. Some turn out more important than others, but most are essential to the overarching tale. Mathematics as storytelling? What an interesting and novel concept!

Further Reading:

https://www.math3ma.com/blog/what-is-category-theory-anyway

http://rs.io/why-category-theory-matters/

https://inference-review.com/article/categories-from-zero-to-infinity

https://en.wikipedia.org/wiki/Lists_of_mathematics_topics

https://en.wikipedia.org/wiki/Outline_of_category_theory

https://en.wikipedia.org/wiki/Category_(mathematics)

https://en.wikipedia.org/wiki/Category_theory

https://plato.stanford.edu/entries/category-theory/

https://ncatlab.org/nlab/show/category+theory

https://bartoszmilewski.com/

https://www.youtube.com/user/DrBartosz/videos

Rina Zazkis, Peter Liljedahl / Teaching Mathematics as Storytelling

Why Is Category Theory a Trending Topic?

Also, these courses on applied and computational category theory:

https://ocw.mit.edu/courses/mathematics/18-s097-applied-category-theory-january-iap-2019/

http://brendanfong.com/programmingcats.html

[*6.180, *11.104]

<>

The Lambda Cube

More or less from Wikipedia:

In mathematical logic and type theory, the λ-cube is a framework introduced by Henk Barendregt to investigate the different dimensions in which the calculus of constructions is a generalization of the simply typed λ-calculus. Each dimension of the cube corresponds to a new way of making objects depend on other objects, namely

    1. terms allowed to depend on types, corresponding to polymorphism.
    2. types depending on terms, corresponding to dependent types.
    3. types depending on types, corresponding to type operators.

The different ways to combine these three dimensions yield the 8 vertices of the cube, each corresponding to a different kind of typed system.

So in the diagram above, we have emblazoned the names of these type systems ordered from lower left to upper right:

  • λ→: the simply typed lambda calculus, our base system
  • λ2: add 1. above to λ→, giving what is also known as System F or the Girard–Reynolds polymorphic lambda calculus
  • λP: add 2. above to λ→
  • λ_ω_: add 3. above to λ→
  • λP2: combine 1. and 2., λ2 and λP
  • λω: combine 1. and 3., λ2 and λ_ω_
  • λP_ω_: combine 2. and 3., λP and λ_ω_
  • λC: combine 1., 2., and 3., giving the calculus of constructions

Further Reading:

https://en.wikipedia.org/wiki/Lambda_cube

http://www.rbjones.com/rbjpub/logic/cl/tlc001.htm

https://en.wikipedia.org/wiki/Calculus_of_constructions

https://en.wikipedia.org/wiki/System_F

[* 11.86, *11.87]

<>