User Experiments

My attempt at an egg tempera paint look generated in Studio Artist V5.5.  Seems to work well for both still images as well as video processing.  Like all good ideas, i was trying to do something else when i stumbled upon it yesterday.  So i went with the flow rather than being pissed off that my original idea was not quite panning out as i had hoped.

I built this with 2 different layers, but there is no stacked layer compositing involved.  I have a recursive processing loop going on in each layer.  It's a very small amount of recursive mixing of the previous output of the layer with the current output of the layer.  Enough to subtly blend, but not so much that you see ghosting. 

I used the Sketch Mass IpOp in the first layer to build the sketch hatching.  Along with the Threshold IpOp to punch through a little bit of the low end of the mass rendition.

I used the output of the first layer for the luminance of the Colorize IpOp effect, colorized by the source.  This is happening in the second layer.  Smart Blu IpOp is used in both layers.  Several passes of MultiOctave Gradient Lighting IpOp with different settings is used in the second layer, along with some low Mix Smart Contrast, to build the shading.

Prototyping a new transition effect in Studio Artist V5.5.5 using Warp Contexts in conjunction with a factory movie processing preset for the stylized paint look of the output.  The transition rolls into chaos, then rolls back into form over and over again.  The movement could be different each time, i kept it simple for prototyping purposes.

Working with some simple but effective vector paint effects in Studio Artist V5.5 to build a paint animation. I'm using the paint synthesizer's vector paint shadowing options to build something that works visually like a gradient lighting effect, but is all just built using vector paint. You flip the orientation of the vector diffuse shadowing by 180 degrees (some slop in this is good sometimes), and darken the shadow on one side, and then lighten the shadow on the other side (think about what gradient lighting does to the image). The nice thing about building your lighting effects as a direct part of the vector paint is that they then avoid introducing any resonance energy over time that a normal raster gradient lighting effect adds to a recursive paint animation process.

Watercolor paint animation experiment created in Studio Artist V5.5.  I've been trying some experiments recently where i just go into the factory manual paint presets, grab one at random that looks interesting, and try working with it in a Paint Action Sequence (PASeq) to build an animation.  I'm working with a Transition Context to build a virtual source based on multiple source movies that are transitioning between one another (algorithm 4) as the animation progresses.  

Simple bezier path embedded keyframe paint animation created in Studio Artist V5.5.5. I started with a single vector shadow paint synthesizer preset that painted bezier vector paths generated by an embedded Ip Op effect. I had 4 different source images key-framed into a Transition Context that feeds the source area with its output. They were key-framed 100 frames apart over a 300 frame timeline. I then ran a menu command that embedded the paint synthesizers draw paths directly into a second paint action step where every bezier path was directly stored in the embedded auto paint keyframes (as opposed to the original paint preset that auto-generates the bezier paths using an Ip Op effect every time it is run).

Automatically generated keyframed embedded bezier path vector paint animation.  Everything is derived off of vector bezier paths, so you can rescale any frame to any output size you want.

This particular movie is interesting because it is an example of proto-typing a V6 effect using V5.5.5 features.  I actually do this a lot, try out a potential new feature for the next version using existing Studio Artist features cobbled together in a Paint Action Sequence (PASeq) to implement what we ultimately end up turning into a single action step new visual effect.  In this simple example we basically re-conceptualizing 'old school raster effects' color gradient and color palette mapping effects as integral vector effects.

Once i had a mechanism for generating the bezier paths and painting them using the paint synthesizer, i then used a Transition Context with virtual sub-nest keyframes set to 15 and a Path menu command to auto convert each Transition Context virtual keyframe into an embedded bezier atuo paint action step in a PASeq.

Then i used two Embedded Bezier Frame menu commands to auto-normalize the number of bezier paths in each keyframe and then re-order their index positions to lead to a smoother animation effect.

So 3 menu commands generate the entire keyframe paint animation automatically after you build the initial PASeq for processing a frame and setup the timing of the Transition Context virtual keyframing.

This is a simple example of generating moving paint animation from a series of hand drawn paint sketches. 

You can use an arbitrary number of paint strokes for each sketch. After drawing one, you then convert it into a single embedded bezier auto paint preset.  I then option click recorded those at the appropriate keyframe times in a single AutoPaint action step in a Paint Action Sequence to build the animation in the PASeq Timeline.

I then used some timeline menu commands to auto-normalize the number of paint strokes recorded in each keyframe, and then sort them based on distance to get a smoother keyframe animation.

I used the mouse and the Onion Skin feature to do the drawing based off of a loaded source movie.  The mouse sucks for drawing, so i'm trying to use that as a stylistic feature in this example.

All of the Roto Promo videos i posted recently were done totally automatically. But you can also build hand painted animation in Studio Artist if you so desire.  I get the sense that people are mostly unaware that you can do it, so we'll be educating people more on the features as time goes on.  We're also trying to make it even easier in the next version.

Ghosting and Temporal Promo Movie from Synthetik - Studio Artist on Vimeo.

Another Studio Artist V5.5 promo video that showcases some of the factory Paint Action Sequence presets that were optimized for video processing effects.

55 Roto Video Promo USE from Synthetik - Studio Artist on Vimeo.

New promo video for Studio Artist V5.5 that shows off some of the factory Paint Action Sequence presets designed for video processing.

Free running Studio Artist V5.5 paint synthesizer time particle animation. Time particles are a feature of the paint synthesizer that let your paint strokes have continuity over time in an animation.

I used a Transition Context to create an ever evolving source for painting derived off of 5 different Transition Context key-framed still images. So the source being painted is virtual.  It is always changing and evolving over time. 

This animation shows of the dynamic interaction of the 2 main components of digital painting, the laying down of colored 'stuff' on the canvas, and the application of dissipative forces that smear and manipulate it in some way. I'm using 2 different applications of the Smart Blur IpOp effect to do the dissipation.  One is adaptive smoothing based on the virtual source orientation.  The other is adaptively smoothing based on the orientation of what is already in the canvas. So the first introduces visual components of the virtual source into the painted canvas. The second adaptively smooths detail already in the canvas, essentially reinforcing it as a visual component of the overall canvas image as it adaptively. smooths it.  So there are 2 different dissipative forces battling it out as the animation progresses.

This approach to working with time particles is one way to build procedural paint animation.  By procedural we mean that the movement in the animation is computationally derived from algorithms that work based off of the individual parameter settings in the 2 Time Particle control panels in the paint synthesizer.  The computational model used by the paint synthesizer time particles is very similar to how it generates paint paths for normal painting.  The difference is that the movement plays out over time rather than just being associated with the drawing of an individual paint path on the canvas in a static image.

An alternative approach to building animation movement would be to use key-framing in the PASeq Timeline. Or to build a set of bezier paths and then configure the paint synthesizer to move path start locations derived off of the shape and positioning of the individual bezier paths.

If you are not interested in animation and only work with static 2D art image output in your work you can still view this whole approach as a way to build a single static 2D painted image through a recursive process that plays out over time.  I believe this approach to 2D painting can be very effective, and is worth exploring in depth.  very subtle changes in how you apply dissipative or contrast 'expansive' forces to the canvas in a recursive process like this can dramatically influence the overall appearance of the end result.

Fun super simple Studio Artist animation experiment. I drew 3 bezier shapes and then recorded them in the paint synthesizer's internal bezier path memory. I turned on a path shape option that cycle interpolates through them as the animation progresses, and had them drawn as vector regions with a small drop shadow effect. I then auto-generated a bezier path built from the human pose points detected in the source video, and used to it to auto-draw a second canvas smear paint effect. A small amount of source modulated translation warp was added for the falling dissipative effect. And i used 6 repetitions of a 5% Mix Image Compeller IpOp (with random banding turned on) to push the local canvas statistics towards the source a little bit (the effect of this builds over time).

Generative paint animation experiment created in Studio Artist V5.5.5. I started by building a folder of source images tied to a sunrise dawn theme. I then configured a totally generative paint strategy (no presets used) in Gallery Show, then let it run to automatically generated 96 output images into an image stream. I then auto-loaded all 96 streamed Gallery Show cycle output images into a Transition Context, time expanded the Paint Action Sequence timeline by 10X, added some additional multi-octave gradient lighting and adaptive contrast boost to my PASeq, loaded a source movie i used for some interactive warp manipulation of the Transition Context output, then ran Action : Animate menu to output to the final movie file.