Skip to content

Commit

Permalink
summer school
Browse files Browse the repository at this point in the history
  • Loading branch information
awxuelong committed Nov 2, 2023
1 parent 11b75c7 commit 7334a04
Show file tree
Hide file tree
Showing 9 changed files with 55 additions and 17 deletions.
2 changes: 1 addition & 1 deletion _bibliography/papers.bib
Original file line number Diff line number Diff line change
Expand Up @@ -3,5 +3,5 @@ @article{anantonio2023
title={Charting the Landscape of Neurosymbolic Reasoners},
author={An, Xuelong and Vergari, Antonio},
year={2023},

poster={sassy-clevr-poster-beta.pdf}
}
2 changes: 1 addition & 1 deletion _data/cv.yml
Original file line number Diff line number Diff line change
Expand Up @@ -59,7 +59,7 @@
- title: Master Algorithm for Computational Biology
items:
- Neurosymbolic AI and Reinforcement Learning
- Cell science, systems biology, pharmacogenomics, predictive medicine
- Cell science, systems biology, pharmacogenomics, precision medicine
- title: Consilience of knowledge
items:
- Artificial intelligence, artificial general intelligence and the pursuit of meaning in life.
Expand Down
4 changes: 1 addition & 3 deletions _posts/2023-11-1-many-faces-ML.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,9 +8,7 @@ categories: blog-post
disqus_comments: true
related_posts: true
toc:
sidebar: left

# related_publications: einstein1950meaning, einstein1905movement
sidebar: left
---

I bumped into this paper on [X (formerly Twitter)](https://twitter.com/ChristophMolnar)
Expand Down
56 changes: 48 additions & 8 deletions _posts/2023-11-2-creativity.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,48 @@
Math is really a beautiful system (framework?) from which we can derive ideas of beauty through symmetry and geometry, study of complex systems through calculus, and also of creativity.
- How would I define creativity?
o Imagine you’re an enthusiastic pursuer of truth. In front of you are a some numbers and two operators: + (ordinary addition) and * (ordinary multiplication). Science, or the discovery of knowledge, is analogous to discovering new numbers. You randomly add two numbers, 1 and -1 and discover 0. Then you add 1 to 1 and obtain 2. Repeating this process you discover all the integers. From God’s point of view, addition and multiplication over integers is closed in this set, therefore you can’t discover anything beyond the horizon of integers, even though you can discover a lot. You can find patterns, such as properties of commutativity, transitivity and distributivity.
o Creativity, in this scenario, would be proposing another operator such as division. Having this new operator in your arsenal of tools to perceive reality, you can now compute a new class of numbers, the rationals and thus discover the set of all real numbers.
o The infiniteness of numbers is analogous to the infinity of knowledge.
 Further creativity would be introducing the square root, and this tool extends our perceptual horizon to encompass the realm of complex/imaginary numbers.
 A different civilization, using a different set of symbols to encode numbers, may make similar discoveries, i.e., numbers obtained following the same principles of computation using + and *, discovering commutativity, transitivity and distributivity. This underlies/represents the universality of knowledge.
o I’ve ignored letters, phonemes, words to simplify this overly-idealized world to get my ideas on what is creativity across.
---
layout: post
title: A mathematical analogy for understanding creativity #a post with bibliography
date: 2023-11-02 09:42:00-0400
description: Using numbers to illustrate an intuitive definition of what creativity is #an example of a blog post with bibliography
tags: food-for-thought
categories: blog-post
disqus_comments: true
related_posts: true
thumbnail: /assets/img/creativity.jpg
toc:
sidebar: left
---

Math is really a beautiful framework with which we can analyze several ideas. For instance, beauty can be seen through the lenses of math using symmetry and geometry, and the study of complex systems can be cast through calculus and probability theory.

Given this premise, can we use math to understand what creativity is. Here is my attempt:

# How can creativity be defined?

Let us run the following thought experiment. Imagine you’re an enthusiastic pursuer of truth. The whole universe is simply an empty space. In this void, in front of you are a some numbers and two operators: + (ordinary addition) and * (ordinary multiplication)[^1].

Science, or the discovery of knowledge, is analogous to discovering new numbers. You randomly add two numbers, 1 and -1 and discover 0. Then you add 1 to 1 and obtain 2. Repeating this process, you end up discovering all the integers. Furthermore, you can find patterns that lead to theorems among the integers, such as properties of commutativity, transitivity and distributivity.

However, from a metaphysical point of view, addition and multiplication over integers is closed in this set, therefore you can’t discover anything beyond the horizon of integers.

# Can you discover anything else?

Creativity, in this scenario, would be proposing another operator such as division. Having this new operator in your mind's eye to perceive reality, you can now compute a new class of numbers, the rationals and thus discover the set of all real numbers.

In either case, prior and after the discovery of the division operator, the infiniteness of numbers is analogous to the infinity of knowledge.

Creativity can also materialize by introducing the square root, and this new operator extends our perceptual horizon to encompass the realm of complex/imaginary numbers.

# More analogies

A different civilization from another point in space, using a different set of symbols to encode numbers, may make similar discoveries, i.e., numbers obtained following the same principles of computation using + and *. Moreover, they may also discover commutativity, transitivity and distributivity. This analogy represents the universality of knowledge.

In the above thought experiment, I’ve ignored letters, phonemes, and words to simplify this overly-idealized world to get my ideas on what is creativity across.

<figure>
<img src="/assets/img/creativity.jpg" alt="Sorry, an unanticipated error occured and the image can't load." width="100%" height="auto">
<figcaption id="creativity"> The thumbnail is generate by Dall-E powered MS Bing Image Generator given the prompt "your interpretation of what creativity is". </figcaption>
</figure>

PS: Demis Hassabis, Deepmind CEO, also comments on another definition of [creativity, or AGI](https://www.youtube.com/watch?v=Gfr50f6ZBvo). This is going beyond statistical interpolation and extrapolation of training data. An AGI model that is creative should be able to give an output to an instruction such as "design a game that has simple rules, but is extremely hard to master, and can be played for hours".

[^1]: Perhaps these numbers and operators existed there a priori, maybe they emerged from a Creator, or perhaps they emerged from a singularity.
6 changes: 3 additions & 3 deletions _posts/thoughts-deepmind-cell.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,9 +8,9 @@ Cite Guy's paper on the paradox to learn to reason, and ObjectNet, and Stammer e

We have no control on what artifacts of the dataset a deep learning model is looking at. If you only want to get the job done, such as car plate recognition for a reserved parking spot, or sentimen analysis on restaurant reviews, it'd suffice to either output feature maps

Prof. Xavier Trepat offers a very good [account](https://www.nature.com/articles/d41586-018-07246-8) on the complementarity of top-down and bottom-up processes. Top-down allows us to explain traffic jams, while bottom-up processes at most help us know how cars work.
Prof. Xavier Trepat offers a very good [account](https://www.nature.com/articles/d41586-018-07246-8) on the complementarity of top-down and bottom-up processes. Consider the following thought experiment: Top-down allows us to explain traffic jams, while bottom-up processes at most help us know how cars work.

In biomedicine, however, if we want to validate scientific discovery, mechanistic insight is imprescindible. In that regard, AI can't further scientific discovery, only aid.
In biomedicine, however, if we want to validate scientific discovery, mechanistic insight is indispensable. In that regard, AI can't further scientific discovery, only aid.

It is still the human scientists deciding what sequence of genes to decode.

Expand All @@ -28,4 +28,4 @@ The above statement is supported by anecdotal evidence where scientific research
- Prof. Noam Chomsky's work on a universal grammar underlying Human thought for understanding human language, which helped inspire work like the design of the [FORTRAN programming language](https://en.wikipedia.org/wiki/Noam_Chomsky#Reception_and_influence)
- And many more examples, where who knows how research on intelligence can help with simulating a biological cell.

If the above anecdotes remind you of the book [Why Greatness Cannot Be Planned](https://link.springer.com/book/10.1007/978-3-319-15524-1) by Prof. Kenneth O. Stanley and Joel Lehman, then there is another perspective from which to support the idea that basic science can fuel technological progress.
If the above anecdotes remind you of the book [Why Greatness Cannot Be Planned](https://link.springer.com/book/10.1007/978-3-319-15524-1) by Prof. Kenneth O. Stanley and Joel Lehman, then there is another perspective from which to support the idea that basic science can fuel technological progress. We don't know what are the stepping stones for achieving technological progress. Therefore, to achieve progress, we may have to be creative in the questions we ask and formulate novel ideas hoping and rely to some extent serendipity, that some of them will translate into groundbreaking innovations.
2 changes: 1 addition & 1 deletion _projects/ai-latam.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,6 @@ El [repositorio](https://github.com/awxlong/ai-latam) y el [canal de YouTube](ht

# Inteligencia artificial

- Artículos incluyen
- Artículos incluyen una breve [introducción a modelos generativos](https://awxlong.github.io/blog/2023/ritmo-ia/)

- Di una [conversatoria](https://www.instagram.com/stories/ciap_espol/3218560237714625995/) organizada por el [Club de Inteligencia Artificial Politénica](https://www.instagram.com/ciap_espol/) sobre la introducción a la IA neurosimbólica con diapositivas en mi [repositorio](https://github.com/awxlong/awxlong.github.io/blob/master/assets/pdf/charla%20de%20ia%20nesim.pdf)
Binary file added assets/img/creativity.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified assets/pdf/cv_xuelong.pdf
Binary file not shown.
Binary file added assets/pdf/sassy-clevr-poster-beta.pdf
Binary file not shown.

0 comments on commit 7334a04

Please sign in to comment.