Tuesday, June 11, 2024

Why Journal?

 One of the things I did at Parke-Davis as their imaging guru led to my US Patent on assembling fragments of an image into a larger mosaic that had both depth and wide field of view.

(Patents. US Patent 5613013 - R. Wade Schuette, 18-March-1997 "Glass Patterns in Image Alignment and Analysis". Keywords: image registration, image alignment )

This work has, in my mind, some profound implications that are not instantly obvious, but that are directly relevant to the question "Why Journal?"  and "What do you mean, 'Journal'?".

I realize using the word "profound" sounds arrogant but by it I really do mean that they are both broadly applicable in many different circumstances and contexts, and deep, in a sort of pixel-depth way, where each pixel is itself an entire image, of which each pixel in turn is an entire image, etc. in a fractal multi-level tree shape,  ie,mathematically, a 'tensor'.      Einstein once said that everything important in physics can be ( and perhaps must be ) represented as a tensor.  More on that below.

In any case, one of the departments needed images of cross sections of blood vessels and important biological processes required both a wide field of view and a very high resolution ( depth ) of detail, and no single image contained both as you had to pick one or the other for the microscope lens setting, so what they needed to see was a montage, a mosaic, an assembled collection of images,which meant they had to be "registered", ie,  overlapped, and the overlapping was not obvious because each separate image might be distorted slightly,  from a different angle, with a slightly different rotation, etc.  You couldn't just lay them side by side and voila, a larger image. 

And the biology did not have built in reference points,so that, aha,  this point in this image clearly corresponds to that point in that image, so slide them over a little more, and tip this one 2 degrees clockwise,  etc.

 So keep that conceptual problem in mind and consider this picture of the "Very Large Array",  famous from Sagan's story "Contact".

Very Large Array - Wikipedia

What is going on here?  Why all the different telescopes?  That's a long story about the law that say the resolution of any lens or dish on any direction in the resolved image ( map ) of the sky is exactly the wavelength you are using divided by the diameter of the dish in that direction.  Turns out you don't need the middle, mostly.   So what you have above is "aperture synthesis" where a number of smaller sensors are used to make a number of smaller "images" which are centrally assembled into a much better larger image.

Sound like a familiar problem?

It is not obvious from the picture of the dishes that all the signals need to be transported to a central site which has a supercomputer that does this "assembly" which is a very complex operation, and like my cross-section of a blood vessel,  needs to "align and register" the different smaller images which are taken from critically slightly different angles.     

That's especially important if the dishes are located on opposite sides of the Earth to get an 8000 mile baseline, and the signals are recorded on tape and shipped to a central site for "processing".   The exact relative location, angle of view, field of view, and absolute time of the observations all need to be preserved and used for this "assembly" into a synthetic aperture the size of the Earth.

Or, observations taken at opposite sides of the Earth's orbit, with a diameter of 1 earth orbit, taken at different times.  Etc.

So, in your head now two different situations where smaller fragments of a larger synthetic "image" need to be aligned and registered and assembled. 

Radio astronomy was held back for years in its early development by thinking that if one telescope ( itself an array of smaller antennas often ) looked long enough that the signals could be combined to remove noise and get arbitrary depth and resolution ( separation of two nearby features into two features not one blurry feature. )     Finally Ron Bracewell realized, ( what we knew as "Bracewell's Law" ) that this time combining ( assembling over time ) process didn't work, in fact couldn't work.  You needed that diameter which meant you needed to assemble fragments taken from what I will provocatively call the most diverse viewpoints possible.   You need many fragments from many diverse viewpoints in space and time and focal depth, and then you need a super-complicated algorithm to "assemble" them,  not just lay out on a table and side them until the edges matched.   

Each "image" or observations was inseparably linked to a "context" ,   location in space,location in time, pointing angle, rotation around the central point of view, depth of field selected, f-stop or width of view,  filters in place to enhance or suppress some frequencies,  etc. And you need to adjust  ("correct" ?) each image for that context in order to assemble them properly.   You cannot just lay them out on a table and "average" them.   

But the assembling of the fragments is critical to getting the most information possible and synthesizing a super-scale observing telescope.

So -- now consider you as an observer, as a sensing element,  making observations on different days at different times, in often very different moods and contexts.   Like the microscope or telescope or any camera, you have many different "settings" --  f-stop, field of view,  depth of view, rotation angle, viewpoint, color sensitivity, filters, etc.     You are free to pick any of those, but the physical fact is like,  (unlike the 3-lens cell phone cameras ) you must PICK.   You have to pick SOME depth of field, is it all in focus or is something highlighted and the background out of focus.  Etc.

You therefore make "an observation" of the world. 

But have you considered the mathematical process of how you,, how anyone, how society,  now combines or assembles those fragments of "observation plus context" into a larger, more valid, better scientific synthetic observation of the world?

Is the best you can do to just observe the world, like throwiing spaghetti on the wall,and see what images are vivid and stick with you over time, and let the others decay away?

Or is there value in the concept of "scrap-booking",   preserving the snapshot fragments and going back and looking at them again, later,  possibly WITH another person, and remembering when that was taken, both sliding back in time from your current context to a historical perspective of what life was like then?

One of my most memorable Charles Schulz "Snoopy" cartoons, Snoopy is laying atop his doghouse and says: "Have you ever noticed  / that if you think about something at 2 AM / and then again at noon the next day / you get two different answers?"

 Talk about profound.  Humans are subject to the same laws as telescopes -- what we see often is critically affected by our context, let alone our settings ( ie, "mood",  "framing",  who we are with, etc. )

What we snapshot and record is just one a a billion possible observations we could have made at that second, we could have focused on, as our brain can slide silently from considering our shoelace is untied to considering global thermonuclear war each occupying a single field-of-view. 

Are we doing a good job of "assembling" what we observe into a larger, better, bigger picture that removes the noise and artifacts and reveals what is actually going on larger than our own tiny context-dependent senses perceives at that time?

Thus "journaling"or "scrap-booking" what is "obvious" to us at any time, despite it being "obvious", realizing that tomorrow with different settings something else will be "obvious" what what is "clear" to us right now will no longer be clear from that viewpoint in space and time.    In fact, before we "realize" stuff it is not obvious,  then when we get an aha moment it is obvious, and then, most often, a week later it is no longer obvious.   

In fact, most of life is "volatile" --  the obviousness of what is true will be gone tomorrow. We will have the memory, but the memory is somewhat dehydrated, not nearly as vivid and actionable as it was yesterday.

When an article is published, a thought, in the New York Times,  it generates often thousands of "responses".  Sometimes responses to the responses.    But the thoughts are laid out end to end in a string of text.   We could do better.

In fact, like after a plane crash,  we could conceptually have a space frame and as each piece is collected we could rotate, translate, unbend, and try to position that fragment on the larger space frame so that when we are done we have an entire airplane and it is now "obvious" that there was an outward going explosion right here by seat #42 B.    Etc. Whatever the assembled "synthetic aperture" reveals that would never have been obvious walking through a warehouse of unassembled pieces.

We walk through life like walking through that warehouse,  and Journaling  / scrapbooking is akin to a way we can, over time,  mix, match, rotate, mesh, merge each day's intense experience and what is "obvious"  over time, into actual "wisdom" and "understanding" of what is "really" going on over your lifetime, over the lifetimes of all of us.

Laying our memories out in a long string over time is only step one of the process of "journaling". That may capture a fragment of our Life.

It's the reassembling over days, weeks, years, a lifetime of such fragments into a larger valid "obviousness" that is important.

https://www.youtube.com/watch?v=TTA2buWlNyM

Alan Jackson, Remember When

 We, as a society, conceptually, can do way way more with fragments of experience than manage to rotate and transform ourselves at brief instances into each other's moccasins and lives and "Oh, I see what you mean and what you are going through."  I "see your viewpoint" ( context ).


 



 








0 Comments:

Post a Comment

Note: Only a member of this blog may post a comment.

Subscribe to Post Comments [Atom]

<< Home