Friday, May 19, 2017

Deep Learning part 1

Back in the ol' days of the late 90s, starting around '96 I started a small software company named with a couple of high school buddies. You can find the last few years of our fading website in the internet archive wayback machine starting around 2001 but by then we had drifted far from our original purpose.

My original business plan had been built around neural nets and training them on distributed networked machines kinda like Folding@Home or Seti@Home etc. We would hornswaggle our friends and family into running a small screen-saver type app which would train neural nets and upload the resulting weight sets to a central server where they would compete in a genetic algorithm arrangement. Worked great but never earned us a penny or drew in any funding. The AI winter was in full force and no one would talk to an egghead with a big idea.

Now with the advent of GPUs and the new TPUs the sort of deep learning we were just starting to play with when we folded up in 2003 is beyond the "Hot New Thing" so I can't help but appreciate the subtle irony.

Saturday, February 21, 2015

A day at the spa

[ From the Glassman anthologies. These aren't really numbered or in any order so &etc. ]

A day at the Spa

    I swapped my ultrasilk suit for one of the medicinal bathrobes in the dressing room. The escalator swept me downstairs to one of the private vat rooms. I could still afford a little aloneness. Before getting into the gel I set the walls on four sweeping panoramas from around the globe. Gobi desert, Florida Keys underwater, Australian reefs, Oregon rainforest mountain view from 6500 feet. Flicked on a randomize routine to slowly drift the views. So glad they never privatized the global reserves.

    Sometimes I run the process as part of a sensory deprivation trip. Not even being in space can produce a better zero G than the med tanks.

    Climb into the tank slowly, allowing the dendrites to scan my skin first. Feet always need the extra work anyhow. I still walk almost everywhere I go. When the medgel finally reaches my neck,  pause for a second to steel my mental discipline. Many people still get sedated for this part. Gradually dunk my head, swallowing a couple pints first as my mouth goes under. The paroxysm of coughing and choking that comes with inhaling the goo is mostly mental the techs tell me. Yet I’ve seen many of them go under sedated. I endure it anyways, finally falling back into my natural breathing rhythm as the pseudo-fluid establishes itself in my lungs and extrudes a tiny bit of analgesic to numb my autonomic response to its presence.

    Here’s another reason many people don’t like to remain awake during the process. The faintly pink gel around me begins to grow cloudy. Strange tugging sensations become noticeable in my extremities, the gel grows thicker, almost stiff in places of contact. Nanothreads are penetrating my skin in places, stripping off dead skin cells here and there, tugging other cells into newer, better overlapping regions.

    The threads running into my muscles are checking for strain damage, pumping out any toxic metals I might have picked up, sorting cell arrangements for maximum shear resistance.

    Disturbing gray streamers are emerging from my mouth. All that dust and smoke I picked up while working on the apple trees. I’m glad my hash-patch works well enough I don’t need to smoke anymore. Even with nano, cancer surgery is still expensive.

    My teeth and digestive system tingle and twitch. “Three microcavities sealed” the readout dumps into one of my headscreens. I won’t bother describing the readout on my other internal organs. All shipshape, except for a tiny bit of liver repair; always gotta watch my self when I go to one of Steve’s parties.

    I only get my bones done once a year. Some things I feel are best left to nature.

    I haven’t requested any installations or modifications this time, so when the medthreads have finished healing what they can and pumping my blood and tissue full of Optimum, they drain the fluid away at last. At the very end a fogger comes on (that's new!) as I puke and cough up the last bits of gel. Almost no sensation with that by the way, medgel is very efficient at diminishing discomfort. The fog lays down a seal coating to cut down on UV for a couple of days, I datagaze.

    Climbing back into my robe, I feel it fluff up and throb with warm, comforting vibes. It is no doubt checking with my implants and the medical database to make sure that everything went fine. Triple, triple, triple redundancy. My refreshed nerves are minutely sensitive to the vibrations of the terry cloth tendrils as they scrape over my skin, looking for any possible stray threads or tissue damage left by the gel.

    I feel a faint affirmation ding! in the back of my mind as I return to my dressing room. My coverall has also freshly cleaned itself and done a long diagnostic. Swap out the robe for the strong sense of purpose running in the old smudged tan jampsuit. I flick the colorswirl and pick out a late summer scene to match my return to work.

    All is right with the world, or at least my part of it.

Wednesday, February 11, 2015

Glassman anthology installation #7: DawnGazer on the slope.

I can feel the sun warming my fronds and tendrils. The slope is coming alive around me as an eye opens. A few seconds of bewilderment as a sensory stream aligns with categorizers. A few seconds later 3 more eyes pop open as my mics pick up the first chirping of slope quail and the mournful hoot of doves.

"Time to get up" one my minds thinks as another gazes restlessly at a column of ghosts-in-memory. A few  hundred tiny processes scatter as I put my foot down from the hammock. A gentle breeze sways and pulls a few dozen of my threads up into the slowly warming air.

The body moves easily in the cool shade of morning. Fibrils and tendrils wrap this frail form supplying much of the locomotion but I'm still proud of the pulse that pushes fluid. No need to replace that yet my scanners tell me.

A sparkle of gigs swarm through my neighborhood, bipping and booping into some of the processes I shed earlier. I love how the sand, twigs and pebbles of my vicinity have been arranged to tile Escher and McGregor. So funny what just a few hundred pounds of process can do overnight with a full days solar siesta.

I think it'll be a good day for flight, thermals are pulling up fast and I've got that extra little spring in my step already. Good ol' adrenal glands once more into the breach.

A flashing red diamond sparkles and screams hanging from the branch of a scraggly oak. Dang! storm warnings later. Checking the radar, a mind fragment says I've got hours yet so I send a jolt up the thread lines, energizing my entire bloom. Minutes later my feet leave the ground.

(Zeep-zeep-zeep-zeep) the call coming in slows my ascent as I check its mood and origin. {IRL://Thunderstump_wanderlamp} Ok, I'll read it: Goingup?Stormwarn?Backdownearly?Short-hop?StayAlert.

Each thought glyph highlights a nicely colored graph expanse of possibilities. Always interesting to see what a complex_transform will make of casual actions. Two of me split off and reshape the vector to more closely match my intention. A spiraling affirmation of delight is returned when they are done.

Tuesday, March 04, 2014

A Fresh batch of nootropics

Just brought home my order of nootropics from Health Supplement Wholesalers! 

 Took a few minutes to whip up a cup of strawberry milk with a couple grams of creatine added before writing this. Delish. Was never too excited about supplementing with this amino acid since it is found in meats and can be made by our own bodies but then I came across this interactive article at data is beautiful. Clearly showing creatine above the "worth a try" line. Did a little more research and saw that it might have potential in regards to the heavy physical work load I've got coming up on the farm. Don't want to get my hopes up but I have good reason to believe this will really help.

 I'm holding off on the sulbutiamine for another day while I analyze the influence of creatine and ashwaganda extract today. So far so great on both of those. Sulbutiamine is an old stand-by with me and I know that it gives me a nice boost when it comes to having the drive to get things done.

What I'm really interested in is the sunifiram which I will be holding back for those occasions when I really need to concentrate on writing software or web code. I've had great responses to all the racetams so this could be real winner. Will be updating with more about experiences with this later.

Thanks again for quick shipping and great packaging, HSW! You always have everything I need and more!

Saturday, May 19, 2012

A salient analysis, from Reddit of all places

Found this brilliant analysis/refutation on Reddit of all places. from Thloughts
 Nobody tell Noam Chomsky ok?
This is wrong and long disproven. For even the most rudimentary of perceptual mechanisms, like the first layers in the visual cortex, neurons can act as feature detectors by learning which neurons in lower levels are likely to fire together or which will not fire if others are firing. Further layers find out when those feature detectors neurons are firing together or not, and so on up. Go a few layers up and now the brain is effectively aggregating all those first neuron reponses into much more abstract things, like regions of rapidly varying light intensity or hue (edges of objects in the visual field) or regions of similar or slowly varying color (like surfaces). Later on this information gets glommed together with information from different senses, like our kinesthetic sense, so that at higher and higher levels of abstraction we can do more interesting simulations, like mental rotations of figures.
Every step in that process is "symbology", a little piece of machinery that compactly represents lower level sensory data. People do not have stored up memories of sensory experience at the level of photons impinging on the retina. We are not cameras that can be forced to replay a scene. Rather, the states of feature detector neurons, which can represent the gist of a scene, are remembered, and this information can be used in reverse, with the feature detectors now acting as feature controllers which re-activate lower levels of features, in order to approximately reconstruct scenes. Language is built on thoughts, which are made of concepts, which are abstracted from perception. And every one of those layers is supported by more math and science than found in that book.
There are no "signs" floating around in our minds. To develop a real understanding, you need to know what the neural machinery is doing and how that behavior implements relevant algorithms. And we do know a lot of that. And no, when the results came in, the answer was not that "language is actually the structure that the human mind is made of". Language comes from the human mind; saying, of absolutely any cognitive phenomenon or process that "language did it" can not be an explanation. It's like saying lightning is responsible for electromagnetism.

Sunday, April 22, 2012

A surfeit of labor

A computer used to be a person who sat at a desk with slide rules, trigonometry charts, maybe an abacus and performed calculations. 

I get to wondering about this definition and what it means in terms of man-hours (pardon the sexism) spent doing work. Let's do a simple thought experiment.

Let's say that you have a well trained computer and she can perform any mathematical function including something complex like an algebraic equation with trigonometric function in 1 second. That's 21,600 calculations per hour. Times a 40 hour work week, 864000 calculations per week. Times 50 weeks, 43.2 million calculations a year. Times an optimum 80 year work life,  a little under 34.6 billion calculation in a human computer life.

Without pursuing the whole geometric progression of accelerating innovation, just thinking about the number of CPUs being made in the years 2011-2012, how many millions or billions of human lifetimes of labor are present in the earth's current stockpile of processors by this standard?

According to wikipedia as of 2010, the fastest six-core PC processor reached 109 GFLOPS. That's 18 GFLOPS or so per processor. Let's stretch the above figures and say 36 billion calculations in a human lifetime. So that is 1 human lifetime's worth of calculations every 2 seconds if we equate flops to a single human calculation.

What is the financial value of this calculating resource at minimum wage?

Update  [interrupted by work in the greenhouse] :
I don't mean for just 1 processor, but as I mentioned above, for all the earth's processors? Unlike humans, processors run regardless of sleep cycles, granted most of them are shut off by their human users so let's stick with the 7.2 million seconds per year as a duty cycle. 7.2 times divided by 2 makes 3.6 million human life-labors per processor per year. I'm still trying to run down the figures on annual CPU production.

Update 2: Ok, well, this will do. A ball park figure from this ZDNet article places last year's production of PCs at around 353 million possibly climbing to 500 million in 2012. So obviously there are way more CPUs than that. But let's take it easy and round it down to 250 million for both of the last 2 years. That brings us to 500 million processors arguably extent and running on the planet. 3.6 times 500 makes 1,800 trillion human lifetimes worth of calculating available for our use on the planet.

Hopefully I've fudged enough on the downside to cover any errors in my figuring.

Labels: , , , ,

Thursday, March 22, 2012

The promise of broadband haptics and sensory mapping.

while nokia focuses on the simple use of this technique as a substitute for ring tones it occurs to me that with a little tweaking quite a bit more information could be routed to our attention through the wasted biological bandwidth of human skin nerves. With some practice I think you could "listen" through such a patch. Just start out simultaneously feeding the audio stream to skin and ear then gradually lower the ear amplitude as the skin nerves are adapted to carry the audio path.