{"id":1000017773,"date":"2025-04-15T11:07:08","date_gmt":"2025-04-15T09:07:08","guid":{"rendered":"https:\/\/forum-engagement.org\/2024\/?p=1000017773"},"modified":"2025-04-15T11:07:09","modified_gmt":"2025-04-15T09:07:09","slug":"unveiling-salesforces-blueprint-for-sustainable-ai-where-responsibility-meets-innovation","status":"publish","type":"post","link":"https:\/\/forum-engagement.org\/2024\/unveiling-salesforces-blueprint-for-sustainable-ai-where-responsibility-meets-innovation\/","title":{"rendered":"Unveiling Salesforce\u2019s Blueprint for Sustainable AI: Where Responsibility Meets Innovation"},"content":{"rendered":"
\n
\"\"<\/figure><\/div>\n\n\n

Salesforce is guided by its core values<\/a> of trust, customer success, innovation, equality, and sustainability. These values are reflected in its commitment to responsibly develop<\/a> and deploy new technologies like generative AI on behalf of stakeholders<\/a> \u2014 from shareholders to customers to the planet.<\/p>\n\n\n\n

The Large Language Models (LLMs) that power generative AI require enormous compute resources<\/a> to function, resulting in negative environmental impacts like carbon emissions, water depletion, and resource extraction within the supply chain. As the world sets \u201cemissions and temperature records, which intensify extreme weather events and other climate impacts<\/a> across the globe,\u201d the need to reduce planet warming emissions has never been more dire. At a time when every additional ton of carbon emitted matters, the development of AI technologies should not exceed planetary boundaries<\/a>.<\/p>\n\n\n\n

While the hypothetical long-term sustainability benefits of AI are significant, with the potential to reduce global emissions\u00a05 to 10% by 2030<\/a>, Salesforce also remains focused on minimizing environmental impacts in the short term.<\/p>\n\n\n\n

Read on to learn about Salesforce\u2019s strategies for creating sustainable AI, developed as a collaboration between the AI Research, Sustainability, and Office of Ethical and Humane Use teams.<\/p>\n\n\n\n

Optimizing models<\/h4>\n\n\n\n

The energy needed to train a model depends on the number of its parameters and the size of the training data. For the last few years, the trend has been to significantly increase both factors, resulting in exponential growth (750x growth every 2 years) in energy requirements for transformers, the leading LLM architecture. In fact, this trend seems to be dwarfing\u00a0Moore\u2019s Law<\/a>, suggesting that hardware efficiency improvements alone won\u2019t keep up with increased computational demand.<\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

The amount of compute needed to train various models as compared to Moore\u2019s Law. <\/em>Source: Amir Gholami<\/u><\/em><\/a><\/p>\n\n\n\n

Though there has been a trend toward large, general-purpose models, is it really necessary to write code with the same model that can create Shakespearean sonnets? Salesforce AI Research<\/a> remains focused on developing domain-specific models, customized to their intended applications.<\/p>\n\n\n\n

For example, the team\u2019s CodeGen<\/a> model, initially released in 2022, was one of the first LLMs to allow users to \u201ctranslate\u201d natural language, such as English, into programming languages, such as Python. The latest version \u2013 CodeGen 2.5<\/a> \u2013 has been optimized for efficiency through multi-epoch training<\/a> and flash attention<\/a>. The result is a model that performs as well as<\/a> larger models at less than half the size<\/strong>. Besides being more sustainable, the team learned that smaller models are more cost effective, easier to fine-tune, and operate faster, improving the user experience.<\/p>\n\n\n\n

Utilizing efficient hardware<\/h4>\n\n\n\n

Once the model has been optimized, it\u2019s important to choose efficient hardware to train and deploy AI. AI hardware manufacturers frequently unveil new versions with substantial efficiency enhancements. Google\u2019s AI hardware, the\u00a0Tensor Processor Unit (TPU)<\/a>, has become more efficient with each new generation, and Salesforce AI Research has leveraged these advancements for sustainability. The team\u2019s more recent models are trained on TPU v4, while some older models were trained on TPU v3. Google estimates that the newer TPU v4 is\u00a02.7x more efficient<\/a>\u00a0and the team\u2019s calculations have confirmed this claim, noting a\u00a02.8x efficiency increase<\/strong>\u00a0(measured by averaging the model parameters per training energy consumed). Furthermore, our initial tests have found that the brand new \u201cTPU v5p outperforms the previous generation TPU v4 by as much as 2x<\/a>\u201d.<\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

These efficiency increases are expected to continue. For example, Nvidia claims<\/a> that their forthcoming H200 GPUs will achieve 18x the performance of the A100 GPUs that are widely used today.<\/p>\n\n\n\n

Beyond the GPU\/TPU hardware specialized for AI, there is also progress in deploying AI on more traditional CPUs, found on consumer-grade computers. CodeGen 2.5 can be locally deployed<\/a> today, leading to decreased energy use, increased speed, enhanced security, and personalization.<\/p>\n\n\n\n

Prioritizing low-carbon data centers<\/h4>\n\n\n\n

Data centers\u2019 emissions vary widely as they are powered by local electric grids. Depending on the grids\u2019 reliance on fossil fuels, their carbon intensity can vary dramatically region by region (see graphic below).<\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

The varying carbon intensity of the world\u2019s electric grids (source: <\/em>electricitymaps.com<\/u><\/em><\/a>)<\/em><\/p>\n\n\n\n

With this in mind, it\u2019s important to be cognizant of what data centers are used to train and deploy AI. To reduce our AI model emissions, Salesforce trained its models in lower-carbon data centers, powered by electricity that emits 68.8% less carbon<\/strong> than global average electricity. This resulted in 105 fewer tons of carbon dioxide<\/strong> equivalents (tCO2e) than if data centers with global average carbon intensity were used for training.1<\/sup><\/strong><\/p>\n\n\n\n

Beyond AI model development: Sustainable AI techniques<\/h4>\n\n\n\n

The team\u2019s AI sustainability approach doesn\u2019t end with the development and deployment of models. As with all Salesforce products, they work to ensure that its products are designed with sustainability<\/a> at their core, from the architecture to the UX. For instance, when multiple AI models are available, we default to the most efficient and appropriate option for each use case.1<\/sup><\/strong><\/p>\n\n\n\n

Additionally, prompt engineering techniques built into Prompt Builder<\/a> optimize customer satisfaction, cost, and environmental sustainability, ensuring our AI systems deliver top results with minimal resource usage. By caching both prompts and outputs to store and reuse responses for common queries, the team significantly cuts down on repetitive computations, speeding up response times and energy consumption. The team also incorporates mechanisms like usage tracking and rate limits into its Einstein 1 Platform<\/a> built on Hyperforce<\/a>, promoting mindful, responsible, and secure use of our AI systems.<\/p>\n\n\n\n

Measuring impact<\/h4>\n\n\n\n

Incorporating these strategies into the AI Research team\u2019s development approach has resulted in significantly lower-carbon AI models. To understand these impacts, the team calculated the energy and carbon emissions of model pre-training, by the far the most impactful AI model lifecycle stage:<\/p>\n\n\n\n

Salesforce AI Model Pre-Training Environmental Impacts<\/strong><\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

In aggregate, pre-training these models resulted in 48 tCO<\/strong>2<\/sub><\/strong>e<\/strong>: 11 times less than the emissions of GPT-3<\/a>. Beyond the training phase, the ongoing usage impact of our models has been disclosed in the Hugging Face<\/a> and ML.Energy<\/a> leaderboards.<\/p>\n\n\n\n

The team believes that transparency is key to Trusted AI<\/a> and remains dedicated to sharing its environmental impacts and lessons learned, hoping to see other actors in the AI ecosystem follow suit. To follow along as we progress on this journey, check out AI Research updates<\/a> and explore the models on Hugging Face<\/a> and GitHub<\/a>.<\/p>\n\n\n\n

A holistic approach to sustainability<\/h4>\n\n\n\n

Salesforce\u2019s commitment to sustainability is not just about reducing impact; it\u2019s about leveraging AI to create tangible environmental benefits. Innovations in AI are enhancing ESG reporting<\/a> within our Net Zero Cloud<\/a>, illustrating the growing intersection between technology and corporate sustainability. CodeGen, which powers Einstein for Developers<\/a> and Einstein for Flow<\/a>, enhances code efficiency, with third-party research indicating a 2.5x improvement<\/a>. This enhanced efficiency extends to Salesforce\u2019s customers as well, with AI-powered tools enabling them to analyze and automatically reduce the carbon emissions of their Apex code.<\/p>\n\n\n\n

Additionally, environment is a\u00a0key focus area<\/a>\u00a0for the AI Research team. They are pioneering\u00a0AI for Global Climate Cooperation<\/a>, using AI to craft negotiation protocols and climate agreements that could shape future environmental policies. Also, its\u00a0ProGen<\/a>\u00a0AI language model, designed to generate new artificial proteins, is making strides in the development of compostable materials from carrot starches. Another notable project is\u00a0SharkEye<\/a>, which employs AI to detect great white sharks, contributing to a vital database for scientists, conservationists, and local communities.<\/p>\n\n\n\n

Learn more<\/h3>\n\n\n\n