Cluster Works
A Sampling of Research Using an
NYU High Performance Computing Resource
Joseph Hargitai
NYU is home to several high performance computing (HPC) clusters and high-speed networks supporting NYU researchers with significant computational requirements. Among these resources is the NYU General Cluster, which started full production in April 2008. Over the past year, researchers have run more than one million computational analyses using this cluster. Their works include studies of arctic ice formations, brain electrical activity, stock market participation and risk aversion, as well as the evolution of galaxies and dark matter.
Along with this new research, some intriguing computational tools have been added to the cluster's "toolbox" (see A Toolbox Supporting a Range of Research Applications). This has also been a year of intense collaboration between departments and ITS high performance computational services. NYU researchers from the Center for Neural Science and the Department of Economics have emerged as significant cluster and data users.
More than the provisioning of compute cycles for these departments, the management of general data growth has proved to be a compelling challenge for researchers and ITS technical staff alike. NYU is not unique in trying to find answers to this national trend. ITS has been working closely with departments and researchers to resolve hosting, networking and storage issues related to the movement of significant amounts of data to computational resources and archives. (See related article, Big Data) To date, for example, researchers have accumulated 59 terabytes (TB) of data on the NYU General Cluster, out of a total of 74TB available.
The following is just a sampler of projects for which this HPC resource is being used, with descriptions provided by the researchers. Additional projects will be featured in the next issue of Connect.
Galaxies & Dark Matter Evolution![]() A dark matter halo distribution in the LasDamas simulations, showing the computational volumes to scale. Smaller boxes allow much higher spatial resolution, to understand faint galaxies, whereas larger boxes are designed to study luminous galaxies and cover a large fraction of the observable universe. LasDamas (lss.phy.vanderbilt.edu/lasdamas) is an international collaboration among researchers from Vanderbilt University, the University of Washington, the Max Planck Institute of Astronomy, Stanford University — and Roman Scoccimarro of NYU's Center for Cosmology and Particle Physics (FAS). Professor Scoccimarro's interest is in theoretical cosmology, large scale structure of the universe, gravitational clustering, and primordial fluctuations. Professor Scoccimarro writes, "Large Suite of Dark Matter Simulations (LasDamas) is a project to run a large suite of cosmological N-body simulations that follow the evolution of dark matter in the universe. The project's focus is to obtain adequate resolution in many large boxes, rather than a single realization at high resolution. "This will result in an enormous volume of data appropriate for statistical studies of galaxies and dark matter halos. We plan to study the clustering of halos as a function of mass and other properties, the internal density and velocity profiles of halos, their three-dimensional shapes, and their mass-accretion and merger histories. Quantifying these properties and their correlations with each other at high signal-to-noise will help improve halo models and will be invaluable for helping to understand the physics of galaxy formation." |
Arctic Shelf Systems' BehaviorsTasha Reddy, Ph.D., is a postdoctoral fellow at NYU's Center for Atmospheric and Ocean Science (CIMS). Her research involves studying Antarctic and Arctic open water ecosystems and sea ice using a combination of numerical modeling, satellite remote sensing, and field studies. "The multi-year ice pack that covers the central Arctic Ocean has thinned from 3.1 m in the 1960's to 1.8 m in the 1990's. Over this time period, the long-term areal extent of sea ice has decreased by 14%. Although these changes could represent a component in a natural cycle, this trend could also harbinger the "meltdown' of the Arctic in response to anthropogenic climate warming. "In recent years, two major observational programs have been launched and have garnished significant physical, geochemical, and biological data over specific Arctic shelves. The successful Shelf-Basin Interaction (SBI) project over the Alaskan Shelf and Canadian Arctic Shelf Exchange Study (CASES) over the Mackenzie shelf represent a major step forward in quality and quantity of observational data upon which a model of the present and future behavior of the Arctic shelf systems can be constructed. "The purpose of this project is to construct a robust, coupled physical and biological model of the Alaskan and Mackenzie shelf ecosystems and their interaction with the Arctic basin, based on the observational data sets of the SBI and CASES programs."
|
Comparing Entrepreneurs' & Wage Workers' Earnings
"If we focus on the earnings of the median entrepreneur and compare it with the earnings of the median wageworker, data show that the median entrepreneur fares less well than his wageworker counterpart. This is true for any level of tenure, and the difference in their earnings increases with time. In other words, if we take an individual who has been an entrepreneur for 10 years say, and compare his earnings with the earnings of a worker who has worked for 10 years, the entrepreneur makes less money. After 10 years of tenure, this difference can reach 30%. This raises a significant puzzle: if the returns to entrepreneurship are so low, why are there so many entrepreneurs? "The mathematical problems involved are all non-linear constrained optimizations with no closed form solutions. Further, because I chose to endogenize all the "economic variables,' I needed to write code that could easily handle symbolic calculations. Mathematica (www.wolfram.com) was perfectly suited. I am currently expanding my model to a multi-sector economy (with different goods being produced by different entrepreneurs), thus expanding my computing needs." |
Predicting Ice Sheet InstabilityDaniel Goldberg, a Ph.D. student at NYU's Center for Atmosphere Ocean Science (CAOS, CIMS), is studying the dynamics of Antarctic ice shelves and fast-moving ice streams, using mathematical and numerical modeling, under the supervison of his advisor, CAOS Director David Holland (Department of Mathematics, CIMS). He writes: "The West Antarctic Ice Sheet is a marine ice sheet, meaning that its base is below sea level. As such, there are strong interactions between the ice sheet's streams and their floating ice shelves. This implies that factors affecting ice shelves, such as ocean melting and the breaking off of large pieces of shelves, can feed back on the ice sheet's dynamics. The boundary between grounded and floating ice, also referred to as the grounding line, can change due to mass flux imbalances, which in turn can modify the flow of the streams. "Using the deal.II software library (dealii.org), I have developed a model that makes use of the finite element and finite volume methods to solve the time-dependent Shelfy-Stream approximation to the governing glaciological equations [1]. Running this model on the cluster and using up to 16 CPUs simultaneously, I have carried out experiments to determine how both ice shelf buttressing and ice rises affect the instability to collapse predicted for an ice sheet on a foredeepened bed — that is, a bed that deepens moving inland."
|
FOOTNOTES
[1] MacAyeal, D.R. Large-scale flow over a viscous basal sediment: Theory and application to Ice Stream B, Antarctica. Journal of Geophysical Research, 1989, 94, 4071-4088.
Author Biography
Joseph Hargitai is a Faculty Technology Specialist who works within ITS’ High Performance Computing group.









Chloe Tergiman is a graduate of MIT and a current student at NYU's Department of Economics (FAS). Her research interest is entrepreneurship and political economics, and her academic advisors are Professors Guillaume Frechette and Boyan Jovanovic.
