Monday, August 13, 2012

Recognize Everything Always

In the world of wire and wireless things, information is being shoveled around in astounding amounts. This also includes devices which interface "beneath" the web, using IP but not HTTP, so that transactions between machines can be optimal for that pair or set of machines involved, and can be composed of data like video streams, audio streams, telemetry, meta-programs and so on. 

But the state of all things on all wired and wireless signal networks is from such an enormous quantity of data that the usefulness of it is very low. You cannot recognize everything at once, all the time. A human mind is good at making a story from the random puffs of data that enter via the eyes and ears and all other senses. The story cannot be the simultaneous stories of all possible paths of analysis. Some smaller set is always used for the useful stories about the world of information.

Big Data is a phrase that means a lot of different things; it depends on the point of view used to refer to the Big Data. Storing it is a whole complicated pack of dogs. Correlating it is the job of a pack of genies who can create other genies to help them. Reaction to it requires accumulation of experiences regarding what happens when certain patterns in the combinations of correlations occur. Delegating each sub-combination to a another reactor might go for very deep levels because of the huge number of states each sub-combination may itself consist of.

In concrete terms, use Laptops with 8 processors as a unit. An entire laptop is sometimes loaded with enormous amounts of data, although it has only 8 processors. Each of the 8 processors may also subdivide certain data into sub-processes that are either emulated by the 8 processor system as a whole in a multitasking manner, or are hardware like graphics cells that can process hundreds of data nodes in parallel, perhaps 128.

In another construction of machinery, such as a forest of server nodes, the actual number of unique processors can be in the millions. This can take some problems and solve them in seconds instead of years or centuries. Such machines are not without cost, since there is a tremendous complexity in assuring all states in all the processors is synchronized as well as parallel executed. If there are trillions of nodes, it may take weeks to load all the states of each node just to get ready to start solving the original problem.

So, if the number of humans on the planet is in the billions, and there are billions of cameras in cell phones, millions of CCTV nodes and web cameras. Each has a huge amount of data, perhaps mostly useless. There are huge numbers of comparisons made amongst the mountains of data by the billions of computer operations it takes. There are trillions of unique comparisons necessary to process just the nodes, and each node has gigabytes of data. Assuming intelligent compression of all that data is made (not so far) then it might take far fewer nodes to process it all later.

I imagine there may actually be agencies that collect and sift this Big Data, using a myriad of tools to help harvest and gain whatever advantage it gives them to catch crooks or keep us less than free, whichever is closer to infinity.

Friday, August 10, 2012

Finite Sadness


I observe the world with decreasing numbers of seconds before me. The world will go on for a very long time after my last second, which is good for those who remain and at least a small comfort when considering the fate of my descendants. I know the world will not end because of humans, even if we used all our nuclear weapons at once and spread every toxin we have created to every crack and crevice of Earth's surface and to every drop of water in the oceans.

Yet merely because bacteria are tough enough to survive the most obscene destruction our demented minds can conceive it is not a permanent comfort. It does not excuse us from the horrors that humans are capable of. Sharks may be ruthless and unrepentant killers, but that is their method of survival. Only a few animals besides humans kill for the fun of it or for ritualistic purposes. 

Wild dogs will kill each other and their pups, like many other animals, and it seems to be merely for spite. Yet, looking more closely at their lives, however, it is much more related to the cruelty of their environment and the genetic warfare that goes on endlessly. Humans are conscious of their actions in ways that other animals cannot be, and we can choose whether to be needlessly cruel or not. 

It is a terrible thing, but most of us are cruel in at least some ways, such as vaporizing ants with magnifying glasses and certainly by our crass methods of harvesting fish and other meat sources. We might pick out a few edible fish from trawler nets and throw away tons of "inedible" stuff that dies because of pressure changes or other trauma suffered thereby. Cruelty is our way of life, even if all we do is torture plants. I cannot tell you how a plant feels or if a forest suffers the loss of friends.

Nature will get us in the end, of course, since all previous species have all gone extinct. There may be a few leftover species that are unchanged from prehistoric times, like tube worms, horseshoe crabs, nautiluses and other primitive lifeforms. If humans are able to survive all future catastrophes as well as sharks (which have nearly met their match as we drive them to ever-shrinking numbers) then perhaps we might be around a hundred million years from now. Yet, we might escape the Earth and travel to the stars, but whoever remains behind will eventually succumb to the unavoidable calamities befalling all planets -- heat death. Heat either overwhelms us or leaves us utterly frozen, one or the other.

We blame the Sun for our current climate problems, but we really know it is our own fault. It doesn't matter, really, because after any person is dead their problems disappear with them. Eventually, when all of us are dead, those problems will belong to someone or something else. If one believes in magical things, and that there is an afterlife, then perhaps we are supposed to be punished for the terrible things we do. Yet, like hanging a man who tortures and murders children, it may rid the world of one monster but does not return the innocent children to their mourning parents. Just because we burn in Hell because we burned down our home planet does not fix the planet.

I am not convinced of the reality of the afterlife, at least not in such a black and white way. I almost feel completely devoid of religion, but that does not mean I feel free to commit terrible acts with no fear of retribution. I just don't have such desires. I don't want to murder people or steal things,  regardless of whether some God exists or not. Yet, despite their supposed belief in God, some people have no empathy whatsoever, no regard for the vast pain and suffering they might cause.

So religion is not the issue. It is just a reaction in my own mind, a sadness that visits me whenever it wishes. The sadness comes and goes whenever it likes, but someday it will have no one left to visit, or no one left that cares. I can try to ignore it, to just don't worry, be happy. That is OK for me, but it is not enough when I think of my grandchildren. I worry for them, and I am not happy about the world I will leave them.