We have kind of slacked off on the monthly art challenges here recently. So i thought i'd set a new one up.

It's our desire to make this whole thing a little more interesting by turning it into an official contest with official rules and perhaps some official prizes. Those official rules associated with an official contest will hopefully be posted soon.

Until that happens, any discussion here refers to the intellectual challenge associated with this new Studio Artist Challenge. As opposed to any 'official contest' with 'official rules'.

Here's the challenge image.

The challenge solution will be able to start with some arbitrary image of a person with head and upper body visible in the source image. And end up with something that resembles the artistic style of the image above.

I'd prefer a Paint Action Sequence preset that pulls it off automatically.

If no one can successfully rise to that fully automatic solution to the challenge, i'll settle for a comprehensive tutorial on how to manually pull it off as a series of documented steps described in detail to the point where someone can follow them one by one to get to the end result. This would include the various presets you would use for each of the documented steps to get from the source image to the final stylized finished result.

There are a few different things going on in this particular challenge image. There's a bit of caricature going on. And of course the very distinctive cartoon style drawing for the sketch of the person. And a limited use of color fill to accent certain areas of the image.

Some hints to think about:

1: We've been experimenting recently with caricature here by using interactive warp on a source image, then loaded the warped image into the source area and doing painting or other processing off of that. the warp builds the caricature. then you derive your painting off of the warped caricature image.

There have been discussions here for using a folder of images to derive a generic face. Automatic caricature would then involve magnifying variations seen in your original source image to the standardized head image. So that's one approach to generating it automatically. If you are taking the manual description option to the solution, you need to describe how to use interactive warp to do it.

2: By clever use of Smooth followed by thresholding, you could possibly generate masked areas for the limited color fills seen in the challenge.

3: Thin vector pen paint is going to be key to the sketching part of it. You can use ip ops to generate vector paths that the paint synth can then paint in if you wish. Or you could use one of more ip ops if you are clever and do it that way.

4: Manual selection of the eye areas is allowed if you are building a PASeq. Or building your script for how to build it up with manual paint steps. V5 does automatic eye detection, but you don't have access to that, so we'll let you fake it by doing the eye selection manually.

5: I jut gave some hints for possible solutions, but don't let those limit your imagination. The best way to pull it off might be something totally different than my suggestions. I'm always surprised by the different approaches people come up with when working with Studio Artist.

SO, get to it people. It's doable, but it is going to stretch your brain to pull it off i believe.

We hope to have some exciting prizes associated with this intellectual challenge once it turns into an 'official contest'. More on that as it develops.

Views: 734

Replies to This Discussion

Interesting and different approach then what has been discussed before, and an interesting end result as well. Including an appropriate hand drawn quote too. Very well done.

Of course your use of Photoshop in what was essentially a pre-processing step for modifying a source image into something different that was then used as a source to make automatic bezier paths from totally disqualifies your result as a full solution of the challenge.

A successful solution only uses Studio Artist for all of the different components of the solution. 

Would you mind trying that part again only using Studio Artist?

And then describing how you did it in Studio Artist.

You could use the vectorizer as you mentioned, or something like Color Simplify ip op. Other options might include Color Quantize or Watershed Regionize ip ops.

Simplify or Smooth ip ops can be used to significantly smooth a source image while maintaining it's edge structure, but they don't generate flat color region output.

And maybe you need to use manual selection afterwards to get rid of some of the flat colored regions generated by whatever color-flattening approach(s) you use?  

Generating a raster flat color regions output (as opposed to an anti-aliased vector output) from either the Vectorizer or Color Simplify is going to make the selection process for getting rid of some flat colored regions in the result much easier. And probably makes more sense for your intended use, which is to have some flat colored regions that have very hard edges to use as input into the automatic bezier path generation algorithms available in the Path menu of Studio Artist.

I'm happy to provide other hints or tips on color flattening techniques in Studio Artist if you (or anyone else) needs them.

Thanks for that John,

This is just an interesting challenge. I am teetotal, so free beer is not a motivator : )

I used photshop because it is far simpler and quicker for what I had in mind- only a fool or someone out to prove something uses only a screwdriver to build a fence. SA is indispensable in my workflow but I would never use it exclusively, some features are just too clunky and awkward.

I posted merely to see if anyone else could take the bezier route any further. Every little helps right?

Let me make very clear that officially this is still just an 'intellectual challenge' only. As i mentioned previously, in the short term future, we hope to change that into an 'official contest' with 'official rules' and 'official prizes'. When that does happen, local micro brew beer will not be one of those official prizes. Sorry for any confusion about that.

I totally agree with you that when working, if you are familiar with tools for given tasks, it makes sense to just use them.

That said, the whole point of the Studio Artist intellectual challenge is really about us all learning more about Studio Artist features we maybe unfamiliar with, in addition to learning more about the analysis and interpretation of components of artistic style, and how to then recreate that using Studio Artist features.

That's why we want people to try to only use Studio Artist to pull off the entire challenge from start to finish.

My personal feeling is that generating flat colored regions from a source image is particularly easy to do in Studio Artist in many different ways.

So part of my goals for a challenge like this would be to get someone like yourself to learn enough about new Studio Artist features to also consider this part of the process an appropriate and easy to use tool for the job.

Or if you feel that is not the case, to understand why, and to work towards fixing that in the future.

Hope that made sense.

And i agree that your approach to generating the bezier paths automatically is a very insightful one. So thanks for sharing that with everyone.

Paul Perlow and i were discussing this most recent Studio Artist Challenge via email. He also brought up how he thought the art of caricature was a very important part of what the original challenge illustration is all about, and what you need to figure out how to do well to successfully solve it.

He mentioned the work of another famous illustrator, David Levine, as another example of this kind of caricature illustration style. David's work is very interesting, but it does seem to have a different feel to me than Joseph Ciardiellos's work. David's line work is way more busy. While Joseph seems to get the point across with a remarkably small number of well placed pen strokes.

I think this gets at something else going on in this particular challenge image other than caricature i feel is really important, a very important and fascinating component of the overall artistic style it represents.

In addition to the caricature part, there is something going on in the really amazingly good pen illustration work where the artist is able to encode 3D perceptual information in how the 2D lines are arranged. Any artist who is really good at generating a successful sketch of a 3 dimensional face or scene with a few carefully drawn pen strokes on a flat 2 dimensional piece of paper is doing something quite remarkable. Because a viewer of that 2 dimensional artwork perceives it as being a 3 dimensional representation of that 3D face or object.

Why is that the case?

Obviously it has something to do with human visual perception. There is something associated with the human perception of 3 dimensional imagery that can be encoded in a few carefully drawn pen strokes on a flat piece of paper.

i find this fascinating, as do some other people like me, that try to straddle the boundaries of science, technology, and art.

There have actually been several technical papers published on this topic, that try to analyze specifically what a really good artist is doing to make this happen.

Part of it has to do with the neuroscience of visual perception. Because we can look at a flat 2D photo and perceive it's contents as having 3D structure.
We do that based on certain characteristics of that image. And how we interpret them visually in our brains. Specifically in the parts of our brain that process visual imagery.

A really good artist may not understand the neuroscience of how this works, but they have developed intuitive knowledge of it, because they have developed tricks or techniques that enable them to reproduce that key information inside of their 2 dimensional drawings. Using only a few very carefully drawn thin pen strokes.

And a successful solution to this particular Studio Artist Challenge requires solving this 'encoding' problem as well.

In fact, someone technically inclined might actually view this approach to drawing as a successful technical solution to compressing the original 3D image.

It's actually a hard problem for someone manually painting to solve really successfully.

And even more challenging to try and solve with some kind of fully automatic approach to generating a drawing or painting.

The discussion going on associated with this particular challenge (some of it off line in emails to me rather than directly posted here), may actually lead to a few small steps towards solving the automatic solution, or at least improving it. Some interesting things have already come up in these discussions, both online and off line.

And i really look forward to other attempts at solving this particular challenge by other Studio Artist users. Taking advantage of all of the features that Studio Artist has to offer. 

Or any feedback from them on new features Studio Artist needs to provide to really pull it off successfully  or easier, or whatever.

 

On the original lighter line/contour drawing technique...

When I was a young learning artist I encountered several related ideas about how things can be represented (and I assume - interpreted) as having volume. Volume would be the word for three dimensional.

In Physiological psych classes - and basic biology for that matter - I was exposed to a lot of ideas about the mechanical structure of sight.

In art related classes i was exposed to Kimon Nicolaides techniques for learning to view things and represent aspects of them.

And

While I was staying with a sculptor friend of my family (many, many
years ago) - who was also very involved with techniques for helping the blind navigate their environment - we would occasionally have discussions about areas of the brain/eye that (while in the blind might seem dormant) are used to represent information. One of those areas was edge perception. Particularly the way the (working) eye processed edges. Deepening contrast at edges to "enhance" the "edginess". The edge of dark surfaces will have a slight halo of bright next to them - enhancing the edge. An effect that is viewer based rather than (perhaps) actually there. Artists use a similar edge enhancement technic when they paint border edges with a lighter color - a highlight stroke to pop out the edge line.

The sculptor I stayed with felt that even the blind must have wiring established to interpret edges - and might be utilizing that pathway to (mentally) construct things in a room from aural depth cues (echo ranging) as well as recollections of touching. They could be (essentially) eidetically creating a caricature of a room and things in it. With edges (front and back - volumes) integrated into the image.

They could describe things as "in front" and "behind" - why wouldn't they be seeing them (imaging) in a way similar to sighted people.

A technique like contour drawing (line drawing of edges) uses something of a similar trick - to enhance edge clarity. Its actually a double trick. The edge line (super enhanced in a line drawing - black on white) and overlap (front and back - volume). The simplest form of overlap can be illustrated with two circles. But can also be seen clearly in a quick ear study.

Wether a tool could be used to find edges and isolate overlap… Thats a big unknown. That overlaping edge question was one of the first things I noted in the original challenge art.

I would be fascinated with a tool that could treat fields of depth as if they were something like layers. Drawing a "background" image (clutter) onto one layer… Perhaps filling into unseen areas. Drawing foreground masses in to subsequent layers (on top)

Right now SA takes all information that is on the same level and treats it about equally. There is no front and back so to speak. Finding a way to layer information and automate the layering would be a fascinating trick.

Craig, you brought up 2 really important (and fascinating) points.

The first has to do with 3D perception of a thin line sketch being tied to where individual lines overlap, or alternatively where they meet, and then one of them vanishes.

This information provides valuable clues to someone looking at a 2D sketch about the 3D surfaces the sketch is trying to represent.

And they are also directly associated with similar 3D features that someone sees in a 3D object when they view it, which their brain then detects and uses to build the perception of depth in the view of the 3D image they experience.

Now the other fascinating thing you brought up is the concept of perceiving an image as a series of individual layers. Like a foreground object in front of a background. So the foreground object and the background it is in front of could be thought of in some sense as 2 different perceptual layers that your brain pulls apart and perceives as being different. This happens even when stereo vision is not directly occurring, which is the case when looking at a 2D photograph.

You are also right that naive use of Studio Artist to paint a given source image really makes no distinction between what could be perceived by a human viewer of that source photo as separate individual foreground and background layers.

There are however approaches one could use within Studio Artist today, to try and make distinctions between what the viewer might be perceiving as 2 very separate visual layers in the source image. Both with manual drawing, or when building PASeqs for fully automatic effects.

I do think it's important to distinguish what we are referring to here as a perceptual layer from the concept of individual canvas layers stacked on top of each other and composted together somehow. You could for example build up the perceptual layering effect we are referring to within a single canvas layer.

Clever use of selection is one approach. Keep in mind that how one can use selection in Studio Artist is way richer than in other more conventional graphics or paint programs. You can select an area of the canvas, and then fully mask painting or any other visual effects with that selection.

But you can also select an area of the canvas, and then use it as a part of your paint synthesizer programing, for example to force path start locations to only occur within the selected area, but to otherwise not mask any painting or drawing that takes place at all. This leads to a much more natural effect, than a hard mask of a paint stroke, which can look very contrived and artificial. Not the approach someone would use if they were actually drawing something, unless they were actually using a physical stencil to restrict their painting.

Representing positive and negative space is also an important stylistic technique for building the perception of multiple visual layers in a painted canvas. As well as helping to convey a sense of depth, or to distinguish foreground from background. So this is a 3rd new factor i'm introducing into the discussion here.

One could also speculate on additional neural processes that take place in the brain associated with the perception of positive and negative space in visual imagery, both real world, and in drawn simulations of that real world imagery. There are interesting scientific papers on this as well, in addition to edge perception, or perception of occlusion of intersecting lines.

The Smart Contrast ip op available within Studio Artist can be configured to derive very intelligent and fully automatic representations of positive and negative space in a source image it is processing. The fully automatic output of the Smart Contrast ip op could then be routed to the selection buffer for example, where it could be used to mask painting, either like a stencil, or in much more subtle ways, like i discussed above.

…….

Another whole take on this is that you could use 2 or more different source images at different times in an overall process to build up a final finished piece of artwork. There is actually a special feature in a PASeq called a Source Context you could use to build a PASeq that worked with multiple source images within the context of a single automatic processes run by that PASeq if you want to do so.

David Levines style is a combination of crazy blobby forms and a heavy coat of "modeling" with lines… Interesting and very "beefy" - not as light as the original challenge style (by any means)

The attached Paint Synth Presets were used to make the unplanned sketch here. All hand applied (drawn)… just winging a Lincoln-like profile. No reference image.

To really get the style - I would have to do a lot more preparing of a reference image and a lot more practicing with the line like tools I used.

The lines here were made with cd_ink_ballpoint01_alt02 for single lines hand applied

The hatch lines: cd_ink_ballpoint01_alt01_auto-tilthatch02

This preset responds to tilt and pressure. Tilt to direct the line angle and pressure to get the long and short lines.

I used both presets with the source color white to knock back some of the lines as well. Basically using the presets as erasers.

To do this look justice I would have to practice enough to lay down as few clean hatch lines as possible.

To make the job easier - I would make the drawing in two layers. One for the outlines. A second layer for the hatch lines. I would split it up like this to allow for some freer drawing of the hatch lines… That I could then cut (erase) to fit into (inside of) the outlines...

This image was all one layer - cleaning it up would be a pretty tedious task… with the lines intermixed as they are.

Attachments:

Here is another shot at the original look and a combination of surface techniques from both the caricaturists discussed so far. This is again entirely hand drawn. I am happy with the way SA can be used to do an organic hand drawn style like this. It is worth presenting just as a counterpoint to automated possibilities. The fact that I can get this lively a look and enjoy the process has always been a selling point for me with SA.

(I will post some odd offshoots of trying to make a more automated set of Presets somewhere else or further along in this thread.)

The image was built from a fast sketch. This was done in in the close to defunct application TabletDraw - which is designed entirely for line type drawing and particularly good for sketching… So I am off the reservation with that part of the process.

However - for several reasons speed of drawing (faster the better for me) is a big factor in the very first stage of developing an idea. Often it is the action and sweep of the hand that expresses the line and form I want a thing to take. I am drawing as if passing my hands along the contours of the thing (an idea)… The speedier I can pass over the contours the more "organic" the results.

The two line and color samples show an approach that uses the multiple lines for shading:

lin01.jpg

and just contour lines and color.

lin02.jpg

The art was made with variations on previous Preset postings - attached with this post (zip file)

The images were built using three layers.

A color layer

A line layer (contour) 

And a Multi line layer

The sketch was loaded in as a source image and I used the onion skin feature to view it in the canvas.

Attachments:

RSS

Latest Activity

David Buckle posted photos
8 hours ago
David Buckle posted photos
Saturday
David Buckle posted photos
Thursday
Jean Detheux posted a discussion

“Prélude” will be at the Punto y Raya Festival in Wrocla, Poland

Prélude”, the third movie done in collaboration with Xavier Díaz-Latorre, will screen during the Punto y Raya Festival held in Wroclaw, Poland (Oct. 25 - 28).That festival has been kind to my…See More
Thursday
David Buckle posted photos
Wednesday
David Buckle posted photos
Oct 16
Jean Detheux commented on Jean Detheux's video
Thumbnail

Pavana glosada (v. 2)

"People willing to contribute to the fundraiser can go here More info is available on that donation page, both in English and en français. No donation is too small or too big, any help is welcome. Thank you / merci"
Oct 15
Jean Detheux posted a video

Pavana glosada (v. 2) from Jean Detheux on Vimeo.

Pavana glosada (v. 2)

This is the second version of this piece, with music magnificently interpreted by Paola Erdas (http://www.paolaerdas.it/). First version is here: https://vimeo.com/22810432 Here’s an album of movies done in collaboration with Paola:…
Oct 15

© 2018   Created by Synthetik Software.   Powered by

Badges  |  Report an Issue  |  Terms of Service