What Beautiful Artificial Intelligence Art teaches us about Financial Services

Lex Sokolin
8 min readJul 22, 2019

The Expert Craftsman

One of the key takeaways that keeps spilling out of the conversation around Artificial Intelligence is whether humans will be augmented or replaced by software. Most of the time, these transhumanist discussions are science fiction hand-waving. But let me walk you through some tangible examples, so you can see and feel the distance traveled.

Let’s say it is the 1500s, and you’d love a portrait of your family, or an image from your favorite allegory to behold once in a while. Since it is the Middle Ages, not everyone can just fire up Blade Runner (my favorite allegory) or take DSLR photos of their cats. If you are a locally powerful sovereign in the local feudal community, you might be able to hire a craftsman like Michelangelo to paint the ceiling once every twenty years. For your trouble, you will get the following masterpiece!

Of course, you are not really hiring Michelangelo alone to do all this work. He comes with a guild of apprentices and professionals that scale up the capabilities of his practice, deploying Michelangelo’s style and leveraging his reputation to do illustrations all over Europe. You are welcome to analogize this to a successful investment banker doing deals all over Silicon Valley — a craftsman with years of experience and a strong reputation using teams of underpaid interns to immortalize people in power.

However, mastery is not immune to automation. As a profession, portraiture melted away with the invention of the Camera, which in turn became commoditized and eventually digitized. The value-add from painting had to shift to things the camera did *not* do. As a result, many artists shifted from chasing realism to capturing emotion (e.g., Impressionism), or to the fantastical (e.g., Surrealism), or to non-representative abstraction (e.g., Expressionism) of the 20th century. The use of the replacement technology, the camera, also became artistic — take for example the emotional range of Fashion or Celebrity photography (e.g., Madonna as the Mona Lisa). The skill of manipulating the camera into making art, rather than mere illustration, became a rare craft as well — see the great work of Annie Leibovitz.

Democratizing and Devaluing

But nothing is sacred. As we moved into the Machine Age, photography was democratized through the shift to digital cameras and smart phones. This meant that the populace at large could generate endless visual imagery, and perfect their selfi skill-sets. Home photo albums grew from a few dozen mundane, poorly composed pictures, to millions of images immaculately designed and filtered for social media. Today, every single person on Tinder and Instagram is a fashion photographer. They are also their own self-immolating Madonna. It is a heavy burden.

Let’s analogize back to Finance. It used to be that complex financial products, like derivatives, real estate investing, global tactical asset allocations, and foreign exchange arbitrage were built for institutions and wealthy people. Today, it is pretty much trivial to access all of these products in any corner of the world. Roboadvisors in 2019 will give you Goldman’s 2006 asset allocation for pretty much free. Neobanks will provide institional-level intererest rates (almost the Fed rate!) to the smallest accounts. Crowdfunding sites have introduced real estate and high yield bond markets to regular people. And if you want to see FX arbitrage or high frequency trading at play levered up 100x, just go to Bitmex. Today, you are empowered to have the misfortune of figuring out your own investment and retirement strategy. For most people, this is as much fun as trying to make it as a YouTube influencer.

Teaching the Machines

So now we come to Data. As web apps filled up with our millions of selfies, cat photos, and selfies with cats, humanity’s engineers figured out one more trick. We could run thousands of simultaneous regressions across all these images to create self-managing algorithms that identified the subject matter of the content. And as the math classified what was already in the images, it also learned how to hallucinate the underlying structure of the world. By scanning through the history of human visual arts, the machine learned the styles of different artists — and how to project them as filters on any image you decided to choose. An artist in your pocket from any moment in history!

This is roughly where we are with financial services Artificial Intelligence today. Take for example a digital lender that uses AI to maintain an underwriting model for personal loans. European core-banking company Temenos just bought a startup called Logical Glue to build exactly this feature inside its broader platform. By studying past human judgment in lending, literally teaching the machine through supervised learning on existing data sets, the software is replicating the “style” of a prior underwriter. Perhaps the underlying picture will change — but the overall vibe, and hopefully the associated default rate, will stay a masterpiece. Lending Club charge-offs below illustrate the point by analogy.

But the story does not end here. New media art has been thriving over the last several decades, as programmers learned to write code that visualized beautiful and complex algorithms, which in turn could be rendered by increasingly more powerful hardware and websites. Artists like Holger Lippmann created generative systems that would yield infinitely variable patterns, fractals, and other gorgeous designs that take your breath away. Still, these are highly engineered, mathematical outcomes. Like the case of Michelangelo earlier, they are shaped by an expert craftsman using modern tools. You can compare Lippmann to the billionaire mathematician financiers behind Two Sigma, or D.E. Shaw, who code the quantiative fractal investment strategies to beat markets.

Today’s innovations of Artificial Intelligence and Blockchain are opening up a new frontier for the machines, and their implications for our creativity. Neural networks — the math that powers the style transfer I referenced earlier — can now create their own generative outcomes based on the millions of images of photos and visual artifacts that the Web has fed them. Take for example a project called Ganbreeder, which allows users to traverse mathematically between different types of objects in a visual space (e.g., an image could be half fish, a quarter truck, and a quarter castle). The network can be used to hallucinate forward music covers, landscapes, or human portraits. The below illustrations were not done by a human hand, other than the coding of course.

Curating the Infinite

These infinite realistic, abstract, or Surrealist images are not all equally valuable. Some are gorgeous and should be saved, while others are redundant and uninteresting. This is where blockchain networks add their magic. Check out this great article on Artnome about the attempts to make scarce and commercial digital art by tokenizing its ownership. If the machine authors a beautiful thing — or perhaps if you discover it during your travels through its alien landscapes — how do we record provenance and property rights? How do we value, exchange, gift, create reproductions, or destroy the thing itself?

Here are a few projects working on the issue: SuperRare, KnownOrigin, Portion, RareArtLabs, DigitalObjects, Crypto Punks, Dada.NYC, CurioCards, Pixura, and Freeport. By tieing each piece of digital art to a blockchain collectible, scarcity allows for economic activity between human beings.

Determining what is valuable can be human work, as in the case of Ganbreeder. Or perhaps it is the work of mathematical algorithms as well! One such example is a social media experiment called Archillect, which scrapes the social web for highly unusual images with strong user engagement. This has earned its Twitter account over 1 million followers, and I recommend you check out the results here. Perhaps in Finance, this would be a highly successful momentum trading bot, targeted at the most discussed companies on social websites. Or perhaps it is the trade-copy Fintechs like Covestor or Gimmer.

Decentralized Autonomus AI Artists

We are getting a bit long in the tooth with this entry, so let me land us in the natural conclusion of these developments. Gene Kogan, one of the pioneers in creative AI, has just started work on a generative neural network that makes digital art, and bundles it with a blockchain-based marketplace. Another similar project is Artonomous from Simon de la Rouviere (using a simpler procedural engine), yet to launch. Participants in the training of the AI artist get economic rewards, the artist’s outputs are saved as crypto collectibles, and there is potential to leverage all the decentralized financial services that exist on the Ethereum blockchain.

You could, for example, try to use generated art objects as collateral to get margin loans from MakerDAO. Or, perhaps, you would exchange the works using decentralized exchanges. When the economic value of such artwork is trivial, the concept is not particularly compelling. But once you realize that traditional paintings (with a record of a sale of about $450 million) will follow a similar route, things become interesting.

In the financial services world, Numerai is the main comparable that comes to mind. That team runs machine learning competitions on a common data set, using the winning algorithms to generate alpha in the stock market, and pays out participants in a proprietary cryptocurrency. But I think such an approach is too greedy — why should one hedge fund get to monopolize the benefits of all that math? Far more interesting would be a Decentralized Autonomous Organization that has a participatory rewards model, such as 20% of carry, for high quality AI-based trading algorithms that pass a certain threshold of quality. If such an open source projects does appear, it may be possible for it to accrue massive returns to scale. That is, if it isn’t stomped into the ground by regulators first.

Looking for more?

--

--

Lex Sokolin

Entrepreneur building next-gen financial services @Consensys @Autonofintech @Advisorengine, JD/MBA @columbia_biz, editor and artist @inkbrick