lukajk / blog / AI Art

jan 13 25 10:18pm

In mid 2022 generative AI took off in visibility. However, it has failed to get anywhere particularly substantive. Ethicality or otherwise aside, it's just not a viable alternative as it stands. A skilled artist attempting to prompt something specific will find there isn't enough control built into these tools to feasibly do so. This is just by natural consequence - the easier it is to use to use a tool to its full potential, the lower that potential is. For mainstream generative AI the whole point is to offer tooling for people that don't already have strong artistic skills. A word prompt also contains far less information than a picture, so iterations are inevitable to better align it to the vision. However, steering it in any particular direction is very difficult. To be able to consistently improve AI images by iteration you would need to be able to describe what needs to change down to very small changes - on the order of individual brushstrokes. Obviously at that point you're just manually painting with extra steps. There is a case for AI as a base for manual refinement though its usefulness seems highly situational, as a flawed starting point often creates more problems than it solves. Ted Chiang wrote that art is "something that results from making a lot of choices." This is necessarily the case since a result that is neither particularly creative or particularly difficult to come about by definition is not very interesting. Distinction in art then comes about by those different, difficult choices. Claim spin art virtuosity all you want but no one who knows how they're made finds the results particularly awe-inspiring or even meaningfully distinct (I apologize to any parents and/or young children). Further Notes That summarizes why AI art in its current form is fairly unhelpful. However there are some other aspects under the umbrella of AI art that bear interesting thoughts at the least. Art is not a monolith - traits of some niches will not translate to others. One example is that some styles are much more convincingly generated than others. This survey by Scott Alexander tested whether people could distinguish between AI and human art fielded 11,000 responses, with a median score of 60% - not significantly better than pure guessing at 50%. Something that stood out was that the generated naturalistic landscapes were virtually indistinguishable from real ones: "Your instincts were worst for Impressionism; you identified every single Impressionist painting as human except the sole actually-human Impressionist work in the dataset (Paul Gauguin’s Entrance To The Village Of Osny)" (presumably he meant overwhelmingly people were wrong). I believe the amount of inherent noise in physical paintings and variance in landscapes (no specific scenes that need to make sense, hands, text, etc) cover up AI's weaknesses. Much in this vein, this AI artwork caused quite a bit of discussion on Twitter recently. Certainly as far as AI images go I think this one is pretty appealing, but again the style here is very suited to AI. Theft? By far the most common criticism of AI art I've seen is that it is "theft" - trained on artists' works without their consent. However artists are also drawing on their visual experiences (which certainly include plenty of other artists' work without express permission) to produce art. I have yet to see a legitimate rebuttal to that...