Google’s Green Computing: Efficiency at Scale

Introduction
Introduction Powering an Email System
Provisioning Email Servers Redundancy and Reliability Computer Housing and Cooling

Cloud Advantages Carbon Costs Conclusions

It’s common to hear about new data centers being built, and it may seem as if the energy used by “the cloud” is a growing problem. However, services provided by the cloud can be remarkably efficient. In many cases, data centers hosting cloud services are more efficient than the in-house office servers they replace. These efficiency gains come from maximizing server utilization, using high-efficiency facilities and making power usage efficiency a priority for hardware and software developers. This case study compares the energy savings and carbon footprint of using Gmail via Google Apps—Google’s cloud-based messaging and collaboration suite, versus housing local servers to manage the same email. Google’s cloud services are all carbon neutral—dating back to 2007. However, for the purposes of this case study, we will be modeling Google’s per-user carbon footprint before offsets are applied.

Powering an Email System
When a user checks their email, energy is consumed in three places: 1. The client: The PC, laptop, phone or other device directly accessing email is called the client. It’s using electricity as it fetches and displays email. 2. The network: Wireless routers, network switches and all the intervening networking equipment between the client and the email server use electricity. In a small office, a wireless router may be the only network device involved. In a larger enterprise, networking equipment could involve dozens of devices spanning continents. 3. The server: The computer or group of computers receiving, sending and storing email is called the email server. This machine or group of machines is constantly on and consuming electricity. Although switching from a locally hosted email system to a cloud-based email system can affect the energy usage of all three, it primarily affects the server level energy usage.1 This paper examines server energy only. Servers in locally hosted email systems are often underutilized and installed in facilities that aren’t optimized for energy efficiency. Servers in cloud-based email systems are located in large, efficient data centers which can provision more servers as needed. A cloud-based email system saves considerable amounts of per-user energy costs once provisioning email servers, providing redundancy, and cooling costs are taken into account.

Provisioning Email Servers An email server is a computer that sends outgoing messages to the external network and stores incoming messages until a user downloads or deletes them. Servers can be very large, powerful machines for handling many simultaneous users or smaller machines for handling only a few. Consider three typical businesses that choose to host their mail locally and their hypothetical server requirements2:
Business Size Small Medium Email Users 50 500 Server Requirements A single, mid-range multi-core server with local disk that can serve 3003 users and draws 2004 Watts. A single, large, many core server with combinations of local and network storage, which can host 1,000 users and which draws 450 Watts. 5 Several, large, many-core servers with combinations of local and network storage which can host 1,000 users and draws 450 Watts.

Large

10,000

The small organization is at a distinct disadvantage, having to purchase a server that can host 300 users when it only needs capacity for 50. An organization can’t purchase and power half a server if that’s all they need. Moreover, the energy consumption of a fully-utilized server is not much higher than a partly-utilized one. Redundancy and Reliability A modern day business relies on email servers 24 hours a day, 7 days a week, 365 days a year and endeavors to make them as reliable as possible. Depending on the size and type of the organization, this could mean: • Additional backup email servers • Redundant email storage, like networked hard drives or other storage technology • Backup networking links • Co-locating email servers in multiple separate physical locations “N” shorthand is sometimes used to describe the number of redundant servers needed for an organization’s email. If “N” number of servers are need to handle an organization’s users, “N+1” redundancy means there is one spare server on hand. If a company requires two servers to host all of their email, then they have a third on hand in case one fails. “2N” redundancy would mean having one spare for every required server. Redundancy means more reliability and more energy use. Modeling modest redundancy requirements for a small, medium and large business provides an estimated number of servers each business will need for their email system.
Business type Minimum servers required without redundancy 1 1 10 Redundancy plan Total servers required 2 2 12

Small Medium Large

N+1 N+1 N+0.2N

2

From the number of servers, the annual energy usage can be roughly calculated as such:
Business type Individual server power 200 W 450 W 450 W Total server power 400 W 900 W 5400 W Server power per user 8W 1.8 W 0.54 W Annual server energy required per user 70 kWh 16 kWh 4.7 kWh

Small Medium Large

The disadvantages faced by small and medium businesses are magnified once redundancy requirements are added. The larger the organization, the more efficiently servers can be provisioned. When comparing server power per user, the large organization uses 1/15th as much energy per user as the small organization. Computer Housing and Cooling The energy email servers consume directly is only one component of the energy used to store and deliver email. Additional energy is required to house and cool the servers. A server located under a desk or in an office networking closet makes use of the same air conditioning system as people in the office. This can be very inefficient, since the room temperature and ventilation are set up for personal comfort, not for server efficiency. It is not uncommon for such a system to use an additional 1.5 W of extra energy overhead for every 1 W of computer load. The data center industry uses the measurement “PUE,” or power usage effectiveness, to calculate the energy costs of housing and cooling servers. PUE measures how much overhead energy is required to house and cool the computers inside a building relative to the amount the computers consume themselves6. For the example above, the email server in the networking closet has a PUE of 2.5. That’s 2.5 watts of power total for each watt of computing power. Medium and large data centers are typically a bit better—and can be much better. This is because they are designed with powering and cooling IT equipment in mind rather than keeping humans comfortable. The average PUE of a typical data center today is about 1.87, but for a larger organization with time to make significant measurements and improvements, it can be lower. For our example, we estimated 1.6.
Business Type Small Medium Large IT power per user 8W 1.8 W 0.54 W PUE 2.5 1.8 1.6 Total power per user 20 W 3.2 W 0.9 W Annual energy per user 175 kWh 28.4 kWh 7.6 kWh

Once again, small setups underperform, with both larger per-user energy costs and carbon footprints. When cooling and housing costs are taken into account, the total power per user for a large organization can be 1/20th that of a small business.

3

Cloud Advantages
So far, our model shows that large organizations hold an advantage over smaller organizations: they can provision resources more efficiently and they can operate those computers in more efficient facilities. Cloud providers take advantage of this efficiency in scale by providing servers for millions of users—maximizing the utilization of machines while cutting down on the total number of servers required. The result is fewer machines and less energy over all.
Locally Hosted Email: Inefficient use of servers by individual businesses.

BUSINESS A

BUSINESS B

BUSINESS C

BUSINESS D

BUSINESS E

BUSINESS F

Cloud-Based Email: Efficient use of servers by collective use in the cloud.

BUSINESS A

BUSINESS B

BUSINESS C

BUSINESS D

BUSINESS E

BUSINESS F

For example, Google has developed Gmail for Google Apps, a cloud-based email service used by over 4 million organizations, small and large. Gmail is constantly improving as we integrate new efficiency improvements, develop ways of streamlining our operations, and, of course, increase capabilities. Software developers, hardware designers and data center technicians have a unified goal of optimizing Google services to use as few resources as possible. This is quite distinct from the usual software and server model, where software developers from one company have to develop an email server that will work on wide range of hardware developed by other companies. At Google, we can optimize across boundaries that are not accessible in a traditional software or hardware development environment.

4

Our size, focus, and ability to optimize across barriers translates into a series of distinct advantages for our servers hosting cloud-based email, including: • Custom, high-efficiency servers: Our servers are specifically designed to host cloud-based services with only the components that are necessary for them to perform—nothing more or less. • Custom, high-efficiency power supplies: Many servers today use power supplies that have efficiencies in the mid-80% range. That means for every 100 Watts the computer needs, almost 20 Watts are converted directly to heat. Google’s are more than 90% efficient, wasting less energy. • Custom-built software: From top to bottom, Google infrastructure is designed to deliver our innovative web services. Our software is designed to perform with maximum efficiency on the servers we develop without bloated additional features. Optimizing the entire process of storing, hosting and serving email means that Gmail requires less than 250 mW per user8. Over the course of a year, that’s just a bit more than 2 kWh of energy, or about $0.22 per user per year,9 representing significant savings over the locally hosted alternatives modeled in the previous example.
Business Type Small Medium Large Gmail IT power per user 8W 1.8 W 0.54 W < 0.22 W PUE 2.5 1.8 1.6 1.16 Total power per user 20 W 3.2 W 0.9 W < 0.25 W Annual energy per user 175 kWh 28.4 kWh 7.6 kWh < 2.2 kWh

Carbon Costs
Since 2007, Google has been a carbon neutral company, utilizing energy efficient improvements, green power and carbon offsets to bring our footprint down to zero. Users of Gmail also enjoy this benefit of zero carbon emission email. However, to form an accurate comparison of cloud-based versus locally hosted services, we calculated our per-user carbon emissions before offsets. Using the EPA US average emissions intensity for locally hosted email servers10, and using Google’s own calculated emissions intensity for its operations, the annual carbon footprint of a Gmail user is about 1/80th that of a small business with locally hosted email servers.

5

Locally Hosted Server vs. Gmail: A comparison of annual CO2 per user

Annual CO2 per user (kg)
125

103 kg
100

75

50

25

16.7 kg 4.1 kg…...