Cloud-to-Cloud Connectivity Becomes Elastic

Editor’s note: This article is by Douglas Freimuth, Senior Technical Staff Member and Master Inventor at IBM Research.

The true power of cloud computing is in its ability to connect between clouds and share resources and compute power. Clouds make large cloud-to-cloud data transfers for critical administrative functions like data center backups and workload balancing. But a typical private cloud can also connect to a public cloud to access a specific service or type of data to create a “hybrid” cloud. All of that data sharing takes networks – and bandwidth. My team, along with AT&T and Applied Communication Sciences, funded by the DARPA CORONET program, created the technology to make cloud-to-cloud connectivity “elastic” in order to make using the cloud (and paying for that usage) more flexible. Not every service, at every moment of the day, needs peak network availability, so why have the volume turned up all the time? 

Part of the reason for today’s “always on” approach is to always have a secure, reliable network for clouds to connect and operate. Making the bandwidth flexible means being able to adjust the bandwidth on existing connections, which in turn requires making extremely fast decisions, using data center software, about adjustments between cloud-to-cloud connections. With network carriers moving their hardware to software on the cloud, elastic scaling will become commercially available. For example, moving the network infrastructure that manages our smartphone data from a physical box to virtualized software in the cloud can help make elastic connectivity possible – and less expensive for the carrier.

What this partnership has shown in a proof of concept, and now wants to deliver commercially, is a cloud system that monitors and automatically scales the network up or down as applications need. It works by the cloud data center sending a signal to a network controller that describes the bandwidth needs, and which cloud data centers need to connect. The key technology in the cloud IBM will provide is the intelligent orchestration capability that knows when and how much bandwidth to request and between which clouds. The cloud data center orchestrator will continue to get more intelligent in its utilization of the network. Longer term an application on your smart phone might be smart enough to request bandwidth from the network controller.

Today, a truck drives out to install new network components and administrators set up the Wide Area Network connectivity. Physical equipment has to be installed and configured if you want to turn up a WAN signal. We could do all that virtually by using intelligence in the cloud to request bandwidth from pools of network connectivity when needed by an application. When the peak requirement has been met, the cloud can signal the network carrier to release available bandwidth back to the pool.

The difference in set up time between today’s cloud-to-cloud networks, to what we have demonstrated, is days or months versus seconds.

Going from always on to always elastic

To make this all work, we demonstrated a cloud platform running in the cloud data center that manages connections and has the intelligence to make fast decisions to signal a controller in the core network for connectivity at the right time (to make the cloud-to-cloud connection elastic). Then, our partners’ controller orchestrates the requests from our cloud to ensure the requests get to the correct layer in the network. The carriers will provide a multi-layer network with different bandwidth capabilities to service different request from the cloud, such as a request to synchronize a critical application database so that a smartphone user gets up-to-the-moment information, or a full data center backup in the event of a catastrophic event.

The connection request might be set up on an IP network, sub-wavelength or possibly a full wavelength layer for demanding applications depending on the bandwidth requested. Wavelength in this context means optical carrier signals multiplexed over an optical fiber. Each wavelength represents a high bandwidth connection to carry our application data. Those wavelengths can be sub-divided to carry lower bandwidth traffic like a video stream to a mobile device. In the instances of full wavelength requests, all parties involved might utilize a specialized protocol to dynamically set up a high bandwidth service in order to set up the proper routing.

Making cloud-to-cloud computing elastic over WAN augments everything that’s already great about the cloud. Businesses spend less because of more effective sharing of network resources, enabled by virtualized hardware. Operating costs drop because of automated processes controlled by cloud - and network-level orchestrators. Businesses that move to set up cloud-to-cloud connections via WAN will notice further cost savings and faster service setup and delivery.

For you and me, as individuals, more dynamic cloud computing means new applications we never dreamed could be delivered over a network – or applications we haven’t even dreamed of yet.

Douglas M. Freimuth is a Senior Technical Staff Member and Master Inventor in the Cloud Based Networking group at the IBM Thomas J. Watson Research Center where he has focused on the research, design and development of server networking technologies. He is a co-author of the IO Virtualization (IOV) specifications in the PCI SIG. He has also participated in the Distributed Management Task Force (DMTF) for activities related to deployment of Virtual Machines and cloud networks. Doug has 60+ disclosures and patents in the domain of cloud networking, and has also published related papers, developed products and contributed to open source.


Smaller chip with bigger bandwidth, thanks to E-Band and SiGe

Dr. Danny Elad
Editor’s note: This article is by Danny Elad, Manager of Analog and Mixed Signal Technologies at IBM Research – Haifa.

Backhaul, bottlenecks, integrated circuits, and high-speed streaming are all concepts that refer to traffic – mobile device data traffic, to be precise.

As the number of smartphones and tablets increases alongside a host of new cloud services, bandwidth traffic is becoming a big problem, causing the data transmission to slow down. With massive amounts of multimedia content and growing demands for 4G and soon 5G streaming, the current infrastructure just isn’t set up to meet the demands. By the end of this year, the number of mobile-connected devices will exceed the number of people on earth.

IBM researchers in Haifa have developed the first low-cost Silicon Germanium (SiGe) complete transceiver chipset solution to support the coming high bandwidth requirements for wireless backhaul data transfer. In other words, these chips can move data over the network faster than today’s infrastructure, and keep up with mobile device growth for years to come. 


Several years ago, when the radio frequencies used to channel data from handheld devices to wireless radio base stations, things started to get overcrowded. At that time, a new range of frequencies, known as E-Band, were defined to support larger bandwidths.   

The goal of E-band for wireless communication was to find a lower cost alternative to optical fiber, but one which did not require large investments in infrastructure, like laying new fiber cable. However, E-Band is based on still-expensive Galium Arsenide (GaAs) technology, and until now there has not been a highly integrated low cost solution that telcos can use for cell to cell communication. 

Silicon - A Single Chip Solution 

IBM’s new SiGe chips could soon replace more expensive off-the-shelf components used today, like GaAs. Silicon offers a lower cost solution that incorporates a high level of integration to support more advanced transceiver functionality. The new chipset offers broadband wireless communications in the 71-76 GHz and 81-86 GHz E-Band millimeter-wave frequency range supporting a high modulation scheme of 64QAM.

E-band is used inside the cellular network and allows improved bandwidth between cells. In this way, our mobile devices, which communicate with those cells, can benefit from  higher speed performance
Tiny E-Band chip shown near an Israeli Shekel
(about the size of a dime)
SiGe offers a single chip platform with the functionality normally provided by several chips, including mixed signal, digital, and analog circuits and is therefore a very competitive solution for mobile service providers to enable ultra-high-speed information streaming.

Wireless networking companies like BridgeWave and GigOptix have already turned to IBM Research to license these E-Band solutions.


Profile of an IBM Scientist: Giorgio Signorello

Who: Giorgio Signorello
Location: IBM Research - Zurich
Nationality: Italian

Focus: Materials Integration and Nanoscale Devices

“Some kids grow up and want to be a fireman or police officer - When I was kid, I wanted to be a scientist. Later on I wanted to become an architect or a designer - I loved the creative side of both - but my parents suggested that I should be a chemist or physicist. They thought it wasn't normal for someone so young to be so strong in these areas. Years later I started working in a clean room in Sweden and for the first time I felt that I made the right choice. It may sound crazy, but I feel at home in a laboratory.”

“What fascinates me the most about science is that it is not based on any one individual — it’s a collective contribution. What I discovered in my most recent Nature Communications paper will hopefully lead to another discovery years from now. In that sense, science is a giant puzzle without fixed borders and each time we publish we add one piece to the picture. 150 years ago James Clerk Maxwell described for the first time the physics of light and today we are manipulating light to send data at the nanoscale. Thousands of publications had to happen to reach this point. It’s inspiring, crazy and not far from being magical.”

Insider Tip:

“I applied to the IBM Research lab in Zurich five times over two years. Finally, my persistence paid off after emailing Heike Riel, who is now an IBM Fellow. But this taught me a lesson, which is applicable to any aspiring scientist — be persistent. Whether you are having challenges with a difficult experiment or dealing with a referee who keeps refusing your paper, don’t give up and push yourself.”

Last week Giorgio was awarded a 5000 CHF ($5600 USD) prize from the Swiss Physical Society for his his outstanding scientific achievements investigating the effect of strain on semiconducting nanowires, which can make it possible to transfer data between chips at the speed of light.

Giorgio's publications and connect with him on LinkedIn.


40+ Year Old Challenge Solved for Phase Change Materials

Phase change materials, were first considered for storing data in the 1970s, where the two metastable states or phases of these materials, are used to store data in the form of millions of lines of binary code made of up billions of 0s and 1s. 

The concept eventually reached the consumer market, and today the most common use of these materials is in optical storage, where the phase transition is induced by heating the material with a laser beam - this is how a Blue-ray disk stores a video.

The cross-sectional tunneling
electron microscopy (TEM) image of
a mushroom-type PCM cell
is shown in this photo.
In addition to a laser, it is also possible to heat the phase change material through electrical means by placing it between two electrically conducting electrodes. This forms the basis for a novel concept called phase-change memory (PCM), a nonvolatile memory technology that promises to bridge the performance gap between the main memory and storage electronics, spaning from mobile phones to cloud data centers.

The nanometric volume of phase change material in the PCM cell can be reversible switched from the amorphous phase (logic “0”) and the crystalline phase (logic “1”) by the application of suitable voltage pulses. The resulting data can be read out by applying a much lower read voltage.

But for more than 40 years scientists have never measured the temperature dependence of crystal growth, due to the difficulties associated with the measurements which are taken at both a nanometer length and a nanosecond time scale. That was until earlier this year when, for the first time, IBM scientists in Zurich were able to take the measurements, which is today being reported in the peer-review journal Nature Communications.

On the eve of the publication of this important result, the authors answered a few questions from their lab in the Binnig and Rohrer Nanotechnology Center at IBM.

IBM scientists Abu Sebastian, Manuel Le Gallo and Daniel Krebs

Let’s start with the obvious decades old question, what is the temperature corresponding to maximum crystal growth?

Daniel Krebs: The optimum crystal growth temperature is 477 degrees Celcius (750 Kelvin), but that it really just one point on the chart (figure B) – holistically it gets much more interesting. 

What is more useful to scientists studying phase change materials is that we were able to model the entire growth velocity curve in addition to this maximum. Prior to this paper, scientists knew some of the points, but not across such a wide temperature and time scale.

It is also worth noting that we took these measurements within the cell. Typically, experiments took place outside the cell, which then had to be extrapolated. Now scientists have an excellent reference point.

Can you describe the eureka moment?

Abu Sebastian: Let me start by saying that these phase change materials are very fascinating and possess unconventional crystallization kinetics. Just by changing the temperature by a few hundred degrees, you change the crystal growth rate by 17 orders of magnitude (that is beyond a trillion). This is why it  has been so difficult to probe experimentally.

Only in the last 18-24 months have scientists begun to probe the crystallization rate within a reasonable temperature range, until this point the measurements were at very low temperatures (close to room temperature).

Our key insight was in exploiting the nanoscale dimensions and the fast thermal dynamics of the phase change memory cell to expand the temperature range all the way up to the point at which the material melts – more than 600 degrees Celsius.

Daniel: It’s called the time-temperature dilemma. At room temperature you want stability of the material to retain the data for at least 10 years, but when you want to write to the material it needs to crystallize in nanoseconds. And that is what makes this material so interesting, but it’s also what makes it challenging – particularly in how it can be accurately measured.

Manuel Le Gallo: I came to IBM to do my Masters thesis work on electrical transport in phase change materials. One of the requirements was to achieve the same amorphous volume at all temperatures. This involved a deeper understanding of melting and crystallization in the PCM cells. As we delved more into the subject, the focus of the thesis gradually shifted, culminating in the fascinating results we present in the paper.

What inherent challenges in phase change memory does this achievement address and what are the potential applications?

Daniel: If we break down the challenges of PCM into read and write operations, in this work, we are addressing the write operation. Our measurements will help devise ways to write data faster and with better retention.  

Abu: In the context of PCM, this research will help us in estimating how fast we can write, how much power is required and what the real retention time is. Going beyond memory, yet another emerging application of phase change materials is in neuromorphic engineering,  creating chips based on the biological architectures of the nervous system. So understanding the phase change mechanism is critically important for a number of applications.

Manuel: Crystal growth and subsequent change in electrical conductance has the potential to emulate the biophysics of neurons and synapses. This will also form part of my doctoral thesis work which I am currently pursuing jointly with the Institute of Neuroinformatics at ETH Zurich.

What will you study next?

Abu: It will be interesting to look at different materials and compare the temperature dependence of crystal growth. We also discovered that the crystal growth rate reduces over time, which we want to expand on further.

Daniel: The reduction in growth over time is actually very interesting for me. In the amorphous phase the materials are a glass. Like a glass window becomes thicker when it is at rest over a long period of time, like 100 years, also our amorphous material will change. In fact, it changes in such a way that it becomes more viscous. This viscosity is one of the characteristics which determines how fast the material can crystalize. Therefore it effects the write operation. It cannot crystallize as fast anymore, which is a good thing for data retention. On the other hand the glassy nature also causes the inherent problem of resistance drift in phase change memory.

Creating secure test data to test systems

Tamer Salman
Editor’s note: This article is authored by Tamer Salman, senior researcher of Security & Quality Technologies at IBM Research – Haifa.

How does an insurance company, financial institution, healthcare organization, or government body get personal and confidential data to develop and test the performance of new software? The challenges associated with managing personal and confidential data are huge, especially with the increasingly stringent data privacy regulations. Some data is private and confidential, other data may have been redesigned and transformed, and some may not exist at all. Typically, project leaders or database administrators will set up an additional environment for development and testing. The big challenge is how to populate it with data.

With expertise in constraint satisfaction and automatic test generation, IBM researchers in Haifa developed the Data Fabrication Platform (DFP). It’s a solution that efficiently creates high quality test data, while eliminating any potential data security or privacy concerns. The platform is already helping a large insurance company revamp their current processes around test data.

Generating masses of personal (but fabricated) data

For most situations, generating the mass of data needed involves in-house scripting, simple data generation techniques, manual insertions and updates, and a lot of masking and data scrubbing. Even after the test data is ready, the requirements can change during development, rendering the current data useless and necessitating a repeat of some processes. The result is a tedious, costly, and time consuming process that doesn’t necessarily deliver results.

In order to accommodate distributed and outsourced development and testing, our client needed test data that would not be susceptible to leaks or breaches in security and privacy. They also need the ability to transform and evolve the data as the business needs changed or were updated. DFP does this by allowing for rule sharing and migration. It also minimizes test-data generation efforts by eliminating security and privacy concerns, and offering support for early development and regression tests. 

Data rules

The logic of what’s needed in these secure, confidential instances can be described using various rules that define the relationships between different columns in your databases, resources for populating new data columns, or transformations from archived data. DFP lets companies put these rules into the system, and get the data needed as output. The platform consumes the provided rules and generates the requested data, which can be automatically inserted into the target databases, or any of a variety of formats, such as XML, CSV, and DML files.

At the heart of the DFP lies a powerful Constraint Satisfaction Problem (CSP) solver, also developed in Haifa. A CSP typically involves numerous possibilities that can’t be solved automatically by straightforward algorithms within an acceptable amount of time. A form of artificial intelligence, the CSP solver from IBM solves these unique complex problems using it's ability to arrive at many more buildable solutions than traditional optimization approaches. The CSP solver provides accelerated solutions and helps eliminate errors by generating only data that is valid for the specific requirements.

In summary , the IBM Data Fabrication Platform is an easy to use technology that allows for rule sharing and migration, minimizes test-data generation efforts, eliminates security and privacy concerns, and makes it easier for companies to outsource development and testing. 


SERI Predicts Improved Utilities of the Future

Data and analytics hold the key for many global industries facing a future with difficult obstacles and new opportunities. Few industries are facing challenges as significant as those in the energy and utilities field.

Today’s aging energy infrastructure isn’t just being battered by dramatic weather events. Increases in cyber attacks on the grid have skyrocketed – from 2012 to 2013, more than 53 percent of cyber attacks have been on energy installations.

Dr. Jonathan Pershing
“Energy demand is rising, but supply is dropping … and our aging infrastructure is vulnerable,” said Dr. Jonathon Pershing, the principal deputy director for the Office of Energy Policy and Systems Analysis at the US Department of Energy, who keynoted the second annual Smarter Energy Research Institute Conference at IBM Research, before more than 125 energy and utility experts from companies around the world

SERI was formed in 2012 with the goal of bringing together the world’s top energy and utility companies to build the energy utility of the future using data analytics. It pairs IBM’s open analytics toolkit platform of application-specific code with energy and utility companies’ ideas, needs and expertise to develop new software applications that solve their operational problems. At this year’s conference, Institute partners Alliander, Hydro-Québec, DTE Energy and IBM spent two days with representatives from 18 companies from around the world to learn how the big data analytics applications demonstrated at the conference can address these challenges.

In 2013, the US averaged 140 minutes per electrical outage, its highest rate in history.

In his keynote Pershing also pointed out that “50 percent of natural gas transmission infrastructure in the US was built between the 1940s-60s … and by 2030 the US will need to invest between $1.5 and $2 trillion in utility improvements.”

He said this comes at a time when more than 60 percent of those working in this industry are likely to retire in the next decade. As part of Pershing’s role with the DOE, he is leading their Quadrennial Energy Review Project, a four year effort to improve the country’s energy production, generation, supply and demand, and entire value chain. And he’ll count on the innovation of groups such as SERI to deliver solutions to these needs.

Predictive Analytics: Energy solutions through smart software

Every country faces similar energy challenges. DTE Energy, Alliander, and Hydro-Québec are using software – big data analytics – to better understand and solve these challenges.

Take weather prediction. Data, and lots of it, is behind the collaborative project Outage Prediction Response Optimization (OPRO) application, led by SERI partner DTE Energy. It is designed to predict weather and potential damage to the grid in order to help the utility optimize resources and prepare its response proactively. OPRO can predict where the storm will hit, down to one kilometer; who it will affect; and even utility service response times.

OPRO screenshot
The weather isn’t the only thing utilities need to predict. Grid maintenance costs in the US increased 42 percent between 2011 and 2012. Another DTE Energy-SERI project, Asset Risk Management and Optimized repair-rehab-replace (Armor^3), applies predictive and prescriptive analytics to grid data to quantify and optimize infrastructure maintenances planning for all electrical assets, including transformers, cables, poles, circuits, and more.

SERI partners are working on a handful of other applications that, among other things, use data to optimize the management and preservation of energy we depend on from all sources. Energy and utility companies interested in joining SERI can read more about how it’s building the utility of the future, and about some of the partners’ projects already underway.

This article is by Cody Frankel, a senior at the University of Rhode Island's Harrington School and intern with IBM Research Marketing and Communications.


IBM and RWTH Aachen University Collaborate on Phase Change Materials with Support from European Commission

Kaes and Krebs working in the
Binnig and Rohrer Nanotech Center
at IBM Research (left to right)
Several years ago the European Commission created the Marie Skłodowska-Curie Actions (MSCA). It set aside €6.16 billion to last through 2020 to support the research training and career development of 25,000 European researchers whether they are early PhD candidates or seasoned scientists. The goal is to encourage trans-national and interdisciplinary mobility across member and partner countries, and for scientists to exchange ideas which lead to innovation.

One of these candidates is Matthias Kaes, a pre-doctorial student from RWTH Aachen University in Western Germany. For the past eight months, Matthias has been working side-by-side with scientists at IBM Research-Zurich on the cleverly titled project called DIASPORA or Drift In Amorphous Semiconductors – A Partnership of Rüschlikon and Aachen (Rüschlikon is the Zurich suburb where IBM is located). The collaborative project is focused on the emerging field of phase change materials, a promising class of materials which are expected to be the basis for new generation of fast and durable memory to handle Big Data and cloud computing workflows.

As Matthias’ time at IBM winds down to make room for other students joining from Aachen, we had a chance to ask him, and the lead scientist on the project Dr. Daniel Krebs about the experience.

What motivated you to apply for MSCA?

Daniel: As an alumnus of Aachen, we have very good connections to the phase change materials team who are doing some impressive and complementary work to our research. But we didn’t collaborate on a concrete project, so the MSCA call gave us the chance to formalize a project, with dedicated resources, to investigate some critical basic science which has been vexing phase change materials scientists since the 1970s. I was personally also motivated by the opportunity to interact with young minds and to exchange ideas, which is the goal of the MSCA.

What did you know about IBM Research prior to joining the team here? Any surprises?

Matthias: Of course I knew about the Nobel Prize research and the invention of the scanning tunneling microscope, which led to the atomic force microscope. But I was very surprised about the other research conducted here, including computer security. I was also surprised to learn about the large number of PhD students, I didn’t think this was possible at an industrial lab.

Tell us more about your experience so far?

Matthias: A typical day is spent in the lab where I am setting up a variety of experiments, testing, calibrating and characterizing the phase change materials under different conditions. I also participate in weekly team meetings with our co-workers in Aachen.

One of the goals of the MSCA is your personal development. Do you have any examples?

Matthias: It may come across as strange, but I have noticed that compared to my time at the university I am taking a lot more notes. We have weekly cadence calls with the other students, both here and in Aachen, and for these calls I need to update the team on my progress. Therefore, since I am presenting more than before, I obviously need to prepare with shorter deadlines. I find this a good "best practice" for my career. 

In addition, the research here is more focused. For example, I am working with one experimental set-up, compared to several in Aachen. This is enabling me to find a niche to focus on in more detail.

Based on your experience, how do you think about a career in academic or industrial research?

Matthias: I had the feeling before I arrived that I didn’t want to stay in academia, so this experience has reinforced my initial thinking. My experience has also opened my eyes to the level of pressure for results at an industrial lab. It’s too early to know where I will go, but I would like to at least initially start at an industrial lab once I finish my PhD.

Since you are the first of several students from Aachen joining IBM what tips can you offer?

Matthias: Well, you should be prepared to have patience finding a flat demand far exceeds supply! But one thing that has really helped me to meet people and to feel comfortable in my temporary home was to join the IBM football team, which is sponsored by the lab’s Hobby Club. It was good to meet colleagues outside of work and to meet scientists from the other IBM departments. So my best advice would be to take advantage of this.