Foundation of re-normalized

synergetics:

issues of computability and

complexity

Milan Jovovic
 Analysis of signal distortion
by multi-scale decomposition
 Modeling approach based on free energy and
distortion energy
 Near linear model - aims for the simplest
explanations
 Estimation of dynamical parameters of
clustering by statistical inference
 Multi-spectral decomposition, in hierarchy of
scales

 Application: scale analysis of complex systems

Introduction (1 of 2)

 Cluster parameters:
• Selected spatial window: Wr
• Computed cluster vector c within Wr
 Statistical inference defines PDF, with the associated
distortion energies, F and V
 Energy functions are generally multi-dimensional and
non-convex
 Non-linear map defines dynamical scale-space
clustering
 Clustering is important optimization problem
Introduction (2 of 2)
 Model of signal distortion:
- definitions
 Distortion measure:
1. d = z2 = (Cx-X)2 + (Cy-Y)2 eg. in TSP

2. d = z2 = [ I t  I  v ]2 eg. in 3D video communication

 z2
r
 PDF: P  ,
Z

Z  r
 Partition functions:  z2
,
Wr
 Distortion energies -
free energy, and variance:

  
F v ,     log r Z , V   d x , v P
1
 Wr
Scale-space computing
 Series of convex min/max of free energy F
 brings in eq. up-scale melting & down-scale cooling:
F
  
c     W 2 c  I P ,
c r
 
F (1)
   .

 Evolution scheme – path integrals:

  V   d

F     V  d , Z    r
1 0

 0
 Way to move through the scale-space ?
Motion through the scale-space:
- wave equation

F v ,  
 V
v    (2)
v
F
   (3)

2F
  2
V
 2
(1)

F  V
 dU   dv   d  0
  
2 1

(2) S S
 v

v  grad V

 The same potential level difference the equilibrium point moves by (2)
and (3)
Cluster Bindings
 Criteria of splitting a cluster at the “wave collapse”:       0

V
2

 Spatial coherency of information: G  , v  
 2V

 Information content wrt the uncertanty relation: 2 Covv ,    1

 Coupled domains of computation:


 0 v  Wr1 V
2
   
Ov    G , v  dv    where G , v  
 0 v  Wr2  2V
S

 F F
v1   1   2
 Motion binding: v1 v2
 F F
v2   2   1
v2 v1
 Determinant of the map:

  2 F1  2 F2  2  F1  F2
 
2 2
D  λ    2   2 λ  1  
2
2  2 .
 v1 v2  v1 v2
Scalable coding
 c0(v0, W0)

 c1(v1, W1)  c2(v2, W2)

 c3(v3, W3)
(v0, W0) (v1, W1) (v2, W2)

(v3, W3) (v4, W4)

 Coupled data structure of the hierarchy of

binary images
 Efficient coding, control, data transfer
 Parallelization: computing and control by
parallel computing architectures
 Focus on computability and complexity –
relationship to statistical physics

o Computing paradigm assumes:

o Motion via scale-space wave information propagation, and
o Uncertainty relation wrt the information content of a cluster

o What makes it, therefore, polynomial in complexity (ref. 2)?

o Unique statistical description, although chaotic motion possible
o No strange attractors due to the conservative motion

 Within this description: multi-scale decomposition of the information

content into clusters
 Coupling of the energy exchange – synergetics
 Coupled manifolds spanning the content of the information clusters
 Counting dimensions
 Bringing in resonance system of 2 clusters
 F1   F2 
F  1  2   (ref. 2)
 F2   F1 
o System of 3 clusters at the “wave resonance”:       0
 3D spectral components
 3D cluster covariance
 3D coupled cluster covariance
 results in 3 coupled clusters 3D manifolds
 dynamical scale parameter β
 = 10
 operators div and rot
 System of 3 clusters is much more complex !
Summary presentation of current work

 Images: multi-spectral decomposition and clusters

coupling, spectral signature recognition
 Movements: trajectory analysis, learning, coding and
control by scale-space computing
 Bio/chemical informatics: data-mining and knowledge
discovery
 Scalable data decomposition: coding, control, and
transmission
 Synchronous computing scheme: upscale melting &
downscale cooling
 Parallel computing implementation
 Still images decomposition

 Scale singularity of data sets is used in detecting rain

patterns
 Sequence of 2 images: 2 clusters
decomposition

 2D ball expansion expansion and diagonal

 Sequences – different intervals: 2 clusters decompos.

 Vortex sequence 2. images

 sequence 4. images sequence 7. images

Perspective and future directions

 Artificial intelligence, computational genomics

 Scale-space approach to computing, analysis, and
signal control
 Model of signal distortion analogous to that of
networked physical systems
 Dynamical Data Modeling: efficient analysis,
coding, and data transmission
 Segmented control
 Parallel computer implementation
 BIBLIOGRAPHY
 Jovovic, M., A. Salden, Foundation of Renormalized Synergetics
applied to Robotics, Marie Curie Fellowship Application, 2009.
 Jovovic, M., G. Fox, [2007], Multi-dimensional data scaling – dynamical
cascade approach, Technical Report - Indiana University, USA.
http://grids.ucs.indiana.edu/ptliupages/publications/Milan_report.pdf
 Jovovic, M., H. Yahia, I. Herlin [2003], Hierarchical scale decomposition
of images – singular features analysis, Technical report, INRIA, AIR
Lab, France.
 Jovovic, M., S. Jonic, D. Popovic [1999], Automatic synthesis of
synergies for control of reaching – hierarchical clustering. Medical
Engineering and Physics.
 Jovovic, M. [2001], Space-Color Quantization of Multispectral Images
in Hierarchy of Scales. ICIP,Thessaloniki, Greece.
 Jovovic, M. [1996], Image segmentation for feature selection from
motion and photometric information by clustering. SPIE Proc. on Visual
Information Processing V, Orlando, USA.
 Jovovic, M. [1994], A Markov random fields model for describing
unhomogeneous textures: generalized random stereograms, IEEE
Proc. on Visualization and Machine Vision, and on Biomedical Image
Analysis, Seattle, USA.