Advancing Climate Research and Understanding at Georgetown with ClimateGPT

ClimateGPT, built by Erasmus.AI is an AI-powered platform designed to assist users in understanding climate change and its impacts. In a data science class at Georgetown University, under the guidance of Prof Dan Loehr students had the opportunity to evaluate ClimateGPT‘s performance against real task-driven questions.

Overall, ClimateGPT scored 82.1% on real world evaluation of the answers, across a taxonomy of 20 Climate Issues

-Prof Dan Loehr

The study of climate change is a complex and ever-evolving field, and researchers are constantly seeking new and innovative ways to understand and address its impacts. One tool that has emerged as a powerful aid in this endeavor is ClimateGPT, a natural language processing model developed by Erasmus.AI. In a series of tests conducted across diverse climate-related domains by Georgetown University students, ClimateGPT demonstrated its ability to provide accurate and insightful answers to a wide range of questions.

The students were able to interact with ClimateGPT and assess its capabilities in answering general questions; specific factual questions; summarizing, classifying the sentiment & analysing third-party text; providing references on the topic; and even writing a blog on climate-related topics.  ClimateGPT’s ability to provide quick and accurate responses to climate-related questions can be a valuable resource for researchers, policymakers, and the general public. It can help in understanding the causes and effects of climate change, potential mitigation and adaptation strategies, and the impact of climate change on various sectors such as agriculture, water resources, and health.

The challenge of evaluating AI models, is beyond simple classification benchmarks to open ended questions which test the robustness of models through real world interaction.

Working together with team at Georgetown University we could see that models with High Quality Climate RAG significantly outperformed our original benchmarks.

-Daniel Erasmus, CEO

In the context of the data science class at Georgetown University, ClimateGPT provided students with a hands-on learning experience in interacting with AI technology. It allowed them to see how AI can be used to address real-world problems and provided them with an opportunity to evaluate the strengths and limitations of AI models. 

Overall, ClimateGPT scored 82.1% on evaluation of the answers with the best performance in the category examining the Impact of Rising Sea Levels and Ethics of Stratospheric Aerosol Injection for Climate with 94% correct and valuable answers and weakest on Impact of Climate Change on Farmers in Rwanda with 58% of the answers deemed as valuable, pointing the areas to improve the model- which will be addressed in future versions.  This interaction shows how ClimateGPT is a promising tool that can help in understanding climate change and its impact across the world. Its application in a data science class at Georgetown University demonstrates the potential of AI in enhancing education and research in climate science. As AI technology continues to evolve, it is expected to play an increasingly important role in addressing the complex challenges posed by climate change.

Here is the list of categories the students tested ClimateGPT on, along with a category description:

• Albedo enhancement: Albedo enhancement, often referred to as “albedo management,” is a set of proposed geoengineering techniques aimed at increasing the reflectivity, or albedo, of various surfaces, such as rooftops, buildings, and pavements. The goal is to reduce the absorption of solar radiation by these surfaces and mitigate the urban heat island effect, thereby lowering temperatures in urban areas. However, the implementation of albedo enhancement techniques on a large scale raises ethical concerns.
• Impact of wildfires on ecosystems: Wildfires can have significant impacts on ecosystems, including loss of biodiversity, destruction of habitats, and release of carbon stored in forests, contributing to climate change. The ethical implications of wildfires include questions about the value of natural ecosystems, the impact on wildlife and the role of humans in causing and managing wildfires.
• Tornado formation and natural hazards: Tornadoes are violent storms that can cause significant damage to communities and infrastructure. The ethical considerations related to tornado formation and natural hazards include the value of human life, the importance of disaster preparedness and response, and the role of government and communities in managing risks associated with natural hazards.
• Analysing the Impact of Weather Patterns on Renewable Energy Production: Weather patterns have a significant impact on the production of renewable energy, including solar and wind energy. The ethical considerations in analysing this impact include the value of renewable energy in mitigating climate change, the importance of energy security and the role of government and industry in promoting renewable energy development.
• Forecasting deforestation in the Amazonian Rainforest: The Amazonian Rainforest is a critical ecosystem that plays a vital role in global climate regulation. Deforestation is a significant threat to the rainforest and has ethical implications related to the value of biodiversity, the rights of indigenous communities and the role of government and industry in protecting this critical ecosystem.
• Ethics of Stratospheric Aerosol Injection for Climate: Stratospheric aerosol injection is a proposed geoengineering technique that aims to mitigate climate change by injecting aerosols into the stratosphere to reflect sunlight back into space. The ethical considerations of this technique include concerns about unintended consequences, the value of natural systems, and the role of humans in altering the climate.
• Ethical Value of Ecosystem Services: Ecosystems provide a wide range of services, including clean water, pollination and climate regulation, which are essential for human well-being. The ethical value of these services includes questions about the value of nature, the rights of ecosystems and the responsibility of humans to protect and preserve ecosystems that provide these services.
• Climate change: Climate change is one of the most pressing ethical issues of our time, with impacts that affect vulnerable communities, ecosystems and future generations. The ethical implications of climate change include questions about intergenerational justice, the value of natural systems and the role of humans in causing and mitigating climate change.
• Solar Radiation on Agricultural Soil Conditions: Solar radiation plays a critical role in agricultural productivity, and changes in solar radiation can impact soil conditions and crop yields. The ethical implications of solar radiation on agricultural soil conditions include the value of food security, the importance of sustainable agricultural practices and the role of government and industry in promoting sustainable agriculture.
• Petrochemical feedstock for the chemical industry: One of the critical applications of ClimateGPT is in assessing the environmental impact of the petrochemical industry. The model can be used to analyze how the production of petrochemicals contributes to greenhouse gas emissions and climate change. This information can be invaluable in guiding policy decisions and industry practices to reduce the carbon footprint of this sector.
• Oceans and rising sea levels: Climate change is profoundly affecting our oceans, leading to phenomena like rising sea levels that pose significant threats to coastal communities. ClimateGPT has been applied to assess the pace of sea-level rise, helping researchers understand the factors contributing to this phenomenon and predicting its future impacts.
• Carbon Footprint and Corporate Financial Performance: Another important use case for ClimateGPT is analysing the relationship between corporate financial performance and carbon footprint. This application helps investors and stakeholders understand how environmental impacts can affect a company’s financial health and provides insights for making informed decisions.
• Tracking deforestation: Deforestation is a major driver of climate change, and monitoring and understanding its patterns are crucial for mitigating its effects. ClimateGPT has been employed to track deforestation rates and identify trends, enabling policymakers and conservationists to target interventions more effectively.
• Misinformation on climate change: The spread of misinformation about climate change is a significant obstacle to addressing the issue effectively. ClimateGPT has been used to detect and correct misinformation, ensuring that public discourse is based on accurate and reliable information.
• Effects of Industrial Noise and Coastal Development on Marine Mammal Ecosystems: Understanding the impacts of human activities on marine ecosystems is essential for conservation efforts. ClimateGPT has been applied to study how industrial noise and coastal development affect marine mammal populations, providing valuable insights for protecting these vital ecosystems.
• Sea level rise and flooding: Rising sea levels pose a significant threat to low-lying coastal regions, leading to increased flooding events. ClimateGPT has been utilized to predict the likelihood of flooding in these areas, enabling communities to prepare and adapt to these challenges.
• The Impact of Climate Change on Farmers in Rwanda: Climate change has profound effects on agriculture, particularly in vulnerable regions like Rwanda. ClimateGPT has been employed to study how shifting weather patterns impact crop yields and farmer livelihoods, informing policies to support these communities.
• Desertification: Desertification is a pressing issue in many parts of the world, resulting from a combination of climate change and land use practices. ClimateGPT has been used to detect and monitor desertification, aiding efforts to combat this phenomenon and preserve arable land.
• Microplastic Migration: Microplastics are a growing environmental concern, and understanding their migration patterns is crucial for addressing their impact. ClimateGPT has been utilized to study how microplastics move through ecosystems, providing valuable insights for mitigating their effects.
• Ozone air pollution: Air pollution, including ozone, is a significant environmental and health issue. ClimateGPT has been applied to analyze ozone levels and understand the factors contributing to air pollution, guiding strategies for improvement.