Basic data visualizaton

Simple data viz

Internet users by country in 2010

This is the first of five graphics in a series, State of the Internet 2010. All are hand-made graphics by Jose Duarte. He is exploring new and simple ways to represent information. With his handmade visualization tool-kit, he provides the technology to rapidly create any kind of graphics including

abstracts maps and diagrams, area graphs and charts, arrow diagrams, bar graphs, Venn diagrams, time line charts, bubble graphs, circle diagrams, proportional charts, organization charts, and really, whatever you want.

Do you want your own kit? Follow the link embedded above, and follow the instructions. It can be yours, free of charge, no-strings-attached. Just send an email to Jose Duarte as instructed in the text accompanying the “handmade visualization tool-kit” link.

Published in: on August 8, 2011 at 9:42 am  Leave a Comment  
Tags: , , ,

Economic Models for Turbulent Times Part I

Consider Crust

The Stata Center houses CSAIL, LIDS, and more.

Strange topology at MIT

Crust is an algorithm for reconstructing surfaces of any topology. In other words, it is a method for digitally rendering any 3-D shape, using data in three-dimensional space as input. Such methods garner a lot of attention now a-days. Graphical simulation models are increasingly prominent for visualization and testing purposes in the field of particle physics. World of Warcraft and Second Life rely heavily on computationally intensive computer graphics, and scalable distributed systems in general. Perhaps the most complex system of all is the U.S. economy, whose governance is partly guided by the results of mathematical models as part of monetary policy and fiscal planning.

Crust was developed as a collaborative effort between two staff scientists at Xerox PARC, now known as Palo Alto Research Center, and a doctoral candidate at MIT. None of this happened recently. In fact, Crust hasn’t been semantically linked with the word “new” since its debut at the 1998 ACM SIGGRAPH Conference.

What is so special about Crust? How is it relevant to global central banks and economic policy officials? What about the Federal Reserve Bank? Patience, please. Tarry a bit longer with me. All will be revealed.

The Crust algorithm is special because it has certain features uncommon in most quantitative models, yet highly sought after. First, the Crust algorithm offers results with “provable” guarantees. Given a “good sample” from a smooth surface, Crust’s results are guaranteed. That is, Crust guarantees that its output is topologically correct, converging to the original surface with increasing faithfulness depending on the input data’s sampling density.

MIT Pigtacular

Graphical Computation using the Crust Algorithm: An MIT PIG-tacular!

Crust has another interesting feature. The Crust research team was aware of how difficult it was to accurately model real world phenomena. They express such sentiments in their peer-reviewed academic publications. At least one was unusually receptive to the shortcomings of  mathematical models,  due to random events and interactions in the wild, e.g. unexpected co-linearity. Manolis Kamvysellis did much of the implementation and testing work on the Crust project. He was the third member of the team, studying for his Ph.D. at MIT. Happily, he had the good sense to demonstrate the algorithm via this fine pink pig! Let’s do the same.

Recall that Crust’s criteria for acceptable sample density is dynamic. Sample size is surprisingly intuitive! It depends on how dense the available data points are. A single topological surface, such as Piggy, may have very detailed surfaces. Observe this near Piggy’s ears and snout. Other areas like the hindquarters are quite featureless. Yet Crust dynamically adjusts its smallest acceptable sample size accordingly. Even minimally detailed surfaces such as Piggy’s lower hind legs above the hooves can be reconstructed accurately.

Manolis wrote a short-form version of the original ACM journal publication: A New Voroni Based Reconstruction Algorithm, click to download as a pdf file.  Google Chrome browser users may save directly to Google Docs, an option built into yesterday’s Chrome version 8.xxxx update.

To Be Continued….

Check back for Part 2 of Economic Models for Turbulent Times

Learn how and why crusty old Crust is relevant to the 2007 – 2010 economic and global financial crisis, and how it might be helpful going forward in 2011.

Geological Time Spiral

Geological Time Spiral

A Spiraling, Slightly Squiggly Path to the Past

The series of geological epochs are like pages in a long and complicated book, recording events of the past

The Earth is 4.5 billion years of age. Evidence of our planet’s antiquity is

primarily contained in the rocks that form the Earth’s crust. These once-molten rocks contain radioactive elements whose isotopes decay at known rates. Thus, the results of studies of rock layers (stratigraphy), and of fossils (paleontology), coupled with the ages of certain rocks as measured by atomic clocks (geo-chronology) offer the means for determining the age of the Earth.

UPDATE: As a result of my enthusiasm for the CiteULike electronic citation and somewhat social bookmarking service for academic, research and peer-reviewed publications, I realized that this calculation of the Earth’s age was not quite correct. I was taking CiteULike’s beta release through its paces, testing the service for Geological Survey citation functionality, particularly images. I returned to the U.S.G.S. site. After some very cursory digging about, I found another U.S.G.S. geological time page. It featured the same spiralling image as the one above. Except that the accompanying textual content was different. Let us refer to it as “Page 2″:

So far scientists have not found a way to determine the exact age of the Earth directly from Earth rocks because Earth’s oldest rocks have been recycled and destroyed by the process of plate tectonics. If there are any of Earth’s primordial rocks left in their original state, they have not yet been found.

Please be aware: I am NOT implying a massive deception about the Earth’s age perpetrated by the U.S.G.S. on an unsuspecting public. Nor will I surmise that our planet is actually only 6000 years old. The creationists were right all along! No. Not about this.

The geophysical method, based on radiometric dating of Uranium-235 and 238 isotope decay was identical on both U.S.G.S. pages. Page 2 cited the many elderly rocks strewn about our planet, in Swaziland, Greenland, Michigan and Australia. Most were 3.4 -3.7 billion years of age. Let’s use this as the boundary value for the youngest possible Earth.

The oldest rocks discovered to-date are zircon crystals hailing from Western Australia, at 4.3 billion years of age. However, these too have sedimentary origins. Plate tectonics is the villain, making it extremely unlikely to find rocks that were part of the “primordial crust” associated with Earth’s formation. Thus even these rock samples do not actually tell us the Earth’s age. They can only offer a data point of 4.3 billion years or older. This would be our estimate for the Earth’s age based on the approach described by the first U.S.G.S. source (“Page 1″). Page 1′s estimate was 4.5 billion years. That’s a mere 0.2 billion year discrepancy.

Well, “merely” isn’t the best word choice, as 0.2 billion years seems longer in different units.  There is a 200 million year difference between the estimate from Page 1 versus Page 2. In relative terms, that’s a 4.5 percent difference.

The moon is actually more useful for determining the Earth’s age. The moon wasn’t subject to plate tectonic activity. Unfortunately, we have a limited supply of moon rocks available for study. Our ability to gather new samples for testing is also limited! Yet many of our moon rocks are 4.4 – 4.5 billion years old. This further extends the probable age of the Earth. According to Page 2,

the best age for the Earth comes not from dating individual rocks but by considering the Earth and meteorites as part of the same evolving system…. determining an age for the Earth and meteorites, and hence the Solar System, of 4.54 billion years with an uncertainty of less than 1 percent.

I see no need to alert the authorities. Consider this as a take-away: The first answer one finds, even from an official site, is not necessarily the most accurate. Context is everything, though. I suspect that expedience would make Page 1 adequate for most readers’ purposes.

My next post will not involve ad hoc auditing of the U.S. Geological Survey website. Instead, I prepared a Security Update. I’ll include a new, free magazine from Y-Combinator (sort of), a few doo-dads, maybe even a video. I’m hoping it will be fun for everyone!

Published in: on October 9, 2010 at 6:41 pm  Comments (3)  
Tags: , , , ,

Innovative Visualization Delivery

Visualisation Magazine collated particularly creative information visualizations in each of its three publications to-date including:

  • Volume 2- Circles,
  • Volume 3- Isometrics
  • soon to be released Volume 4- Handmade.

Visualisation Magazine is produced by Visual Think Map. It offers a resource and reference site with a dizzyingly comprehensive array of applications, images and methodology references encompassing every data type I could conceive of. This is a screen shot of the site,

Visualisation Magazine's Applications Resource Site

only a fraction of the many screen length landing page! The magazine is published via digital publishing platform Issuu.

Issuu is interesting in its own right. Issuu’s viewer application, seen above Isometrics, can be customized with IML, Issuu Markup Language, using Flash, Photoshop or any other imaging software. It is effective for delivery of data visualization material, and much more. The developer section includes the usual search API as well as a separate JavaScript API for the viewer.

Note that WordPress offers an Issuu plug-in for WordPress.org sites.

Follow

Get every new post delivered to your Inbox.

Join 31 other followers