green-software-foundation / hack Goto Github PK
View Code? Open in Web Editor NEWCarbon Hack 24 - The annual hackathon from the Green Software Foundation
Home Page: https://grnsft.org/hack/github
Carbon Hack 24 - The annual hackathon from the Green Software Foundation
Home Page: https://grnsft.org/hack/github
beyond carbon
We are developing an innovative software solution that focuses on reducing waste in software development. Our tool analyzes any existing code base, using Static and Dynamic Analysis methods, to evaluate and report on the waste produced by the software. The ultimate goal is to encourage more waste-aware decisions in software development, leading to more efficient, less wasteful software applications. This project aligns perfectly with the hackathon's challenge of showcasing the Impact Framework's prowess in reducing the ecological footprint of software. Through this project, we aim to revolutionize the way software's environmental impact is measured and reduced, making a tangible contribution to waste reduction in the digital world.
None
Yes but accepting others
No response
Building a plug-in for Impact Framework
The primary objective of this plugin is to seamlessly integrate data from Microsoft's Sustainability API for Azure into the Impact Framework. Microsoft's API provides detailed metrics on carbon emissions and resource usage specific to Azure cloud services. By incorporating this data into the IF, users can gain a more comprehensive understanding of the environmental impact of their software applications on Azure.
Can I write the plugin in C#.Net? Does the build need to be a DLL, executable, or something else? What does the interface between IF and a plugin look like? What kind of data would be most beneficial to IF?
No, but we will find people ourself
No response
Best Content
Microsoft Azure Data Studio (https://github.com/microsoft/azuredatastudio) is a database administration tool that is written as an Electron application. It supports a wide range of database systems and runs on Windows, Linux and IOS. It provides SQL Query performance metrics.
The goal of the Hack is to build an Azure Data Studio Extension (https://github.com/microsoft/azuredatastudio/wiki/List-of-Extensions) and an SQL Query Impact Framework extension that can hack into these performance metrics and produce impact estimates.
Azure Data Studio also supports (Jupyter) Notebooks. As part of the GSF Extension for Azure Data Studio I would like to deliver a Notebook that introduces the Green Software Foundation and basics of the Impact Framework, besides demonstrating how to use the extension with SQL Query payloads.
No response
No, but we will find people ourself
No response
Writing content about Impact Framework
Tem or Project Name: Prefrontal Cortex from Capgemini
Type of project: Writing content about the Impact Framework, which is key for any initiative, products, and services to be successful, purposeful and impactful.
No response
Yes and we are still open to extras members
Team Mates: @kumarchinnakali
Building a plug-in for Impact Framework
Interested in Continuous integration and helping bring sustainability into the conversation? Help us bring sustainability to every developer by integrating our CI pipeline tooling into the most popular CI platforms, while using the Impact Framework data!
https://github.com/Green-Software-Foundation/carbon-ci
What CI pipelines can we target?
GitHub Actions
GitLab CI
Travis CI
Circle CI
SourceHut Builds
Where is the best value for developers? And how can we bring the greatest value to developers to help them reduce their carbon intensity in both cloud deployments, but also local code.
No, we would like your help to find team-mates
No response
Best Plugin
Basically it is a one implementation for the problem statement
#33
I am thinking to implement this using https://mlco2.github.io/impact/. We can get the inputs Hardware type, Hours Used, Provider, Region of Compute and return the raw carbon emissions produced and the approximate offset carbon emissions. I know the data is outdated, but in future if we get a updated source we can use it.
If we need more accurate results then we can also integrate with paid services like https://www.climatiq.io/
No response
I am working on this project alone
No response
Building a plug-in for Impact Framework
Creating an organisation's carbon footprint as a data product by involves collecting, analyzing, and presenting data related to the organisation's environmental impact with the help of Visualization & Dashboard
Gather data from various application sources within the organisation, such as energy consumption records, fuel usage, waste production, employee commuting habits, business travel, and supply chain activities.
Aggregate data from third-party sources, such as utility bills, transportation databases, and environmental databases from different cloud provider to supplement internal data.
Clean and preprocess the collected data to ensure consistency and accuracy.
Calculate carbon emissions for each data source using established methodologies and emission factors.
Normalize data to account for factors such as business size, industry type, and geographic location.
Perform exploratory data analysis to identify trends, patterns, and areas for improvement.
Conduct scenario analysis and sensitivity analysis to assess the impact of different variables on the organisation's carbon footprint.
Develop interactive dashboards and visualizations to present key metrics and insights related to the organization's carbon footprint.
Use charts, graphs, maps, and other visual elements to communicate complex data in a clear and intuitive manner.
Create customized reports and presentations for different stakeholders, such as executives, sustainability teams, investors, and regulators.
Incorporate storytelling techniques to highlight successes, challenges, and opportunities for reducing carbon emissions.
Continuous Monitoring and Improvement:
Implement systems for ongoing monitoring of environmental performance metrics and carbon emissions.
Set targets and goals for reducing carbon emissions and track progress over time.
Use feedback loops to gather input from stakeholders and incorporate suggestions for improvement.
Regularly update and refine the data product based on new data sources, methodologies, and best practices in carbon accounting.
Integrate the organization's carbon footprint data into strategic decision-making processes, such as budgeting, resource allocation, and risk management.
Use insights from the data product to identify opportunities for cost savings, operational efficiencies, and sustainability initiatives.
Align environmental goals with business objectives and incorporate carbon reduction strategies into the organization's overall strategy.
Impact :
By treating the organization's carbon footprint as a data product, we can provide stakeholders with valuable insights into environmental performance, drive positive change, and demonstrate a commitment to sustainability and corporate responsibility.
No response
Yes and we are still open to extras members
Building a plug-in for Impact Framework
As an IF user, I want to be able to create and use custom CPU power curves in IF so that I could calculate carbon emissions of my system based on it's specific power consumption model
Based on our work on the Intel model (aka IEE = "Intel Energy Estimator") we know that many clients (private, OEMs and others) use customized systems where the power consumption characteristics (aka power curves) may differ from the generic ones provided by manufacturers (if any). The idea here is to provide a model where users will only need to plug in their custom power curve (as a data file) and have the model carry the burden of energy calculations, among others, at runtime.
Such a model would be backed by a script that will generate a power curve on given system.
Successfully implementing this idea will:
Significantly simplify getting started with IF, for those wanting to have a pipeline that accurately reflects their specific system modifications and customizations. Acknowledging the importance of CPU modeling in the manifest file, we can see how this will improve onboarding of such users, as they will be able to create their own power curves and then only provide the resulting data to the model, without writing any code.
Increase transparency under a unified standard: once all CPU-modeling users use the same Generic CPU Power Curve generation script and model, we know that while the data naturally differs between each, the process of creating the power curves and calculations done based on those curves are the same across all users. Even if users can't share their data (power curves), we at least have transparency over their computations.
This project idea originated from this discussion:
#37
No response
Yes and we are still open to extras members
Enhancing the Impact Framework
Introduction
Our Green Hightech Innovators team is excited to apply for the hackathon, proposing a project that advances package delivery systems through environmental sustainability. By integrating real-world simulation and the Impact Framework (IF), we aim to extend its application to include comprehensive environmental metrics. Our proposal is further enriched by adopting Agile principles, ensuring iterative development and internal user feedback guide our innovation process.
Beyond Carbon Initiative
Central to our ambition is expanding IF's scope to cover carbon, with environmental waste (and possibly more) usage, both upstream and downstream, among other vital metrics. This expansion reflects our commitment to a holistic approach to sustainability. Inspired by Agile methodologies, we plan to iterate our project through incremental advancements, allowing for continuous refinement based on feedback and simulated environmental impact assessments.
Data-Driven Model Development
The foundation of our project is the simulation of real-world logistics scenarios, generating YAML data to inform our new model plugin. This plugin aims to enhance the IF ecosystem, embodying Agile's incremental delivery philosophy. Each iteration will bring us closer to a robust solution, incorporating user feedback to ensure our developments align with real needs and environmental sustainability goals.
Visualization and Accessibility
Instead of traditional content creation, we focus on developing an intuitive dashboard. This approach, inspired by Agile's emphasis on tangible products at each iteration, will visualize output YAML data in an accessible manner, making sustainability performance metrics understandable and actionable for a broad audience. This dashboard represents our "skateboard" - a minimal viable product that provides immediate value while laying the groundwork for more sophisticated future enhancements.
Incorporating Agile Lessons
Our approach learns from Agile's cautionary tales against 'Big Bang' delivery models, where projects are only revealed at completion. Instead, we aim to deliver functional increments that invite user feedback and enable continuous improvement. This strategy ensures that each phase of our project, much like evolving from a skateboard to a more complex vehicle, is driven by user needs and sustainability objectives, avoiding the pitfalls of delivering a solution that misses the mark.
Adaptive Development and Internal User Engagement
Our iterative development process is designed to adapt to discoveries and feedback. By engaging users from the outset with a functional, albeit simple, version of our solution, we initiate a valuable feedback loop. This process not only aligns with Agile principles but also ensures our project remains flexible and responsive to the evolving landscape of environmental sustainability and user needs.
Conclusion
Our hackathon project proposal represents a thoughtful integration of sustainable logistics enhancements, driven by both environmental considerations and the principles of Agile development. This approach, which transitions from detailed logistics simulations to leveraging YAML data through the Impact Framework, and ultimately to intuitive dashboard visualizations, is our response to the complex challenges of sustainability. Our aim is to demonstrate a model of product development that emphasizes adaptability, engages users, and facilitates continuous improvement. Through this commitment, we anticipate contributing a project that not only addresses immediate environmental concerns but is also prepared for ongoing refinement and broader impact, aligning with future ESG objectives.
Some members of our team are ready and willing to delve into the details of our application via a live stream next Monday. Could you advise on the steps to set this up?
Yes and we aren't recruiting
Other team member Giithub tags will follow for now @WBurggraaf.
Writing content about Impact Framework
The idea comes from this discussion.
Large Language Model(LLM) has evolved rapidly over the past year and has shown great potential in many areas. At the same time, we cannot ignore its impact on the environment.
Therefore, we would like to conduct a survey on the existing LLMs to generate a manifest file that could be used to calculate the energy and carbon consumed by LLM training. The actual models/calculations are not requirements here - it is enough to create a manifest file that could run as this will expose gaps in the current stack.
.yaml
fileAt the moment we have no questions.
If there are relevant suggestions or resources, feel free to leave a message.
Yes and we aren't recruiting
Team members: @Xiaoliang1122, @Irenia111, @Jjing-Liang
Enhancing the Impact Framework
Groundbreaking project that aims to transition our society from climate indifference to active environmental stewardship. The project's core intention is to cultivate a culture of climate consciousness and responsibility, empowering individuals, communities, and corporations to make informed, environmentally-friendly decisions.
Central is the use of technology as a catalyst for this transformation. Recognizing the influential role of technology in shaping behaviors and perspectives, Focusing on developing innovative tech solutions that raise awareness about climate change, encourage sustainable practices, and drive policy changes. From educational apps to data-driven decision-making tools, Harnessing the power of technology to tackle the pressing issue of climate change.
Movement towards a more sustainable future. It's about creating a global community that is informed, proactive, and committed to the environment. We envision a world where every decision, whether by an individual, a community, or a corporation, takes into account its impact on the environment. Ultimately, dedicated to making climate consciousness a universal way of life.
None
Yes and we are still open to extras members
No response
Best Content
Green IT is an integral part of ESG and in the tertiary sector, a major component. Integrating the recommendations of the GREEN GRID for the data center and the SCI index for the software part, allowing to model the impact of a software tuning and giving basic capacity planning capacities.
No response
I am working on this project alone
Building a plug-in for Impact Framework
A simple-as-possible plugin that gets startups an 80/20 view of the carbon impact of their software without writing any code.
How it could work:
impl
fileompl
fileHow this could be extended:
a) Graphical displays of information
b) Benchmarking versus other startups
c) Analyses sensitivity to inputs
c) Suggests & prioritises options to reduce emissions
d) Suggests options for offsetting
Key questions:
No, we would like your help to find team-mates
No response
Best Plugin
To capture the carbon emission of Xbox games we will develop the tool, based on the Green Software Foundation methodology called SCI (Software Carbon Intensity) and IF (Impact Framework), will capture carbon emissions across the Xbox game lifecycle: measuring power consumption during gameplay, estimating server and download emissions, raising awareness of development impact, utilizing "carbon-aware" features, and promoting responsible recycling.
No response
Yes and we are still open to extras members
No response
Building a plug-in for Impact Framework
Kepler is a CNCF project for measuring energy consumption of bare metal Kubernetes clusters using RAPL. A Kepler model for Impact Framework would query Prometheus for Kepler metrics and allow calculating the SCI score for applications deployed to Kubernetes clusters when Kepler is deployed.
We are thinking of building a pipeline which has following steps
For hackathon, it would be limited to
Yes and we are still open to extras members
@greenscale-nandesh @rossf7 @SFulpius
Building a plug-in for Impact Framework
The energy consumption of blockchain is a growing concern. Currently, according to some researches, Bitcoin alone accounts for 0.38 % of the whole global electricity consumption (https://www.jbs.cam.ac.uk/2023/bitcoin-electricity-consumption). Bitcoin mining process also consumes a lot of fresh water in their cooling process, some researchers estimate that US Bitcoin miners uses around 93 - 120 gigalitres (GL), equivalent to the average annual water consumption of around 300,000 U.S. households.
With the growing popularity of blockchain technology, more blockchains will be created in the future and more users will take part in the ecosystem. That means more nodes, more transactions and more resources like electricity or fresh water are used.
There have been some efforts by blockchain organizations to reduce the energy consumption by their nodes. For example, Ethereum switching from PoW (proof-of-work) consensus mechanism to Pos (proof-of-stake) reduces 99.99% energy consumption, a fantastic result.
I think the Impact Framework can contribute to the process of raising blockchain users awareness about the impact their actions/software/systems can have over the environment.
Here is what I have in mind for this plugin right now.
The plugin would calculate how much resources consumed for these types of users:
These are some issues I would like to discuss with Carbon hack team:
The most important thing is data and researches concerning the energy consumption of blockchains. The Crypto Carbon Rating Institute (https://carbon-ratings.com/) provides an API service where we can get some of the data like energy consumption annually of a blockchain. Are you aware of any other data sources or researches that we can use to do calculation ourselves?
The calculation for energy consumed by smart contracts is the hardest question here I think, I've done some researches and haven't found any solid researches, also found no data sources.
Yes and we are still open to extras members
No response
Enhancing the Impact Framework
The Impact Framework from the GSF is working hard and making strides to measure the real carbon intensity of compute resources, to give us developers a chance at understanding the impacts of our software and cloud architecture. Wouldn't it be great if we could contribute to the framework's roadmap by unlocking GitHub actions or other CI technologies. This could allow every developer to have the IF at their fingertips when writing code and deploying cloud resources, and could significantly increase the number of developers who are aware of the carbon impact of their software.
Since the IF measures, simulates and models the environmental aspects of software, it could be a great addition to allow you to assess the SCI of software during your own CI process.
We believe this would be a highly beneficial addition to the roadmap of the IF in terms of driving usage, but also increasing awareness of SCI, and allowing developers to take action to reduce their environmental impact.
We need to consider popular tools and approaches to, to get the most use from developers, and also consider what data is most useful for developers to be able to take action to reduce their SCI.
IF: https://github.com/Green-Software-Foundation/if
Can we improve the IF by considering CI pipelines? What data can we extract and use? Is the integration of the IF and a CI pipeline a sustainable approach in itself, or does it drive up the SCI of a solution with limited impact? How should this information be displayed to a user as part of a CI process?
What CI pipeline tools can we use? What popular platforms could be investigated:
GitHub Actions
GitLab CI
Travis CI
Circle CI
SourceHut Builds
No, we would like your help to find team-mates
No response
Building a plug-in for Impact Framework
The Azure Importer is a plugin that aims to provide a capability to calculate the Software Carbon Intensity (SCI) of workloads deployed on Azure services, using the Impact Framework. The project plans to extend the existing proof of concept (POC) of the Impact Framework for Azure VMs, which can be found here: https://if.greensoftware.foundation/tutorials/how-to-use-azure-vm
Based on our analysis we have observed that the workloads running on any compute, storage or network platforms draw energy from the underlying host. This energy can be measured through metrics like CPU utilization, memory utilization etc. By measuring these metrices over fixed time period and passing them through the IF computational pipeline we will be able to calculate the SCI score for these workloads on Azure.
The plugin will use the Azure Monitor API to collect observations from Azure resources and feed them into the Impact Framework computation pipeline. The project will also support batch API and multiple metrics for the SCI calculation.
The importer will take the subscriptionID and resource group name as input and run through all the azure services deployed in that specific resource group. For the hackathon, we aim to consider Azure Virtual machines, Virtual machine scale set, Azure SQL and Azure Kubernetes Services (as a stretch goal).
From an impact framework perspective, this is a plugin but the plugin itself can be considered as a framework for extending it to more Azure services in future.
No response
Yes and we aren't recruiting
@yelghali @vineeth123-png @harinibaddam99 @gaurimadhok @srini1978
[identity] @todo: trace paper towel drawing
Writing content about Impact Framework
We are introducing "Impact", an innovative apparel line that visually embodies the principles of the Impact Framework. Collaborating with various artists, each design reflects the Framework's role in evaluating the environmental impact of software. Through our online store, the "Impact" line aims to create a tangible connection between consumers and the concept of sustainable software. Our goal is to illustrate the synergy between the Impact Framework's objectives and our "Impact" apparel line, showcasing how creativity can be harnessed to enhance understanding and visibility of sustainability in software.
none
Yes and we are still open to extras members
No response
Building a plug-in for Impact Framework
It is known for sometime now that darker colours require less energy to illuminate LED/OLED displays, black being the lowest energy colour and white being the most energy intensive colour. Red, green and blue lie in the middle with blue being more energy inefficient than red and green.
Having said that, almost all websites load images. It would be fascinating to see how each image contributes towards energy consumption eventually leading to carbon emissions.
I am thinking of building a pipeline which has following steps
For hackathon, it would be limited to
There are hundreds of websites that host stock photos and images for download and use e.g. Shutterstock, Unsplash, Getty images etc.
If these images were to display SCI as part of their metadata then the user can become 'Carbon Aware' and will know the impact of including an image in their webpage.
Leaning toward Python but not given up on TypeScript yet.
I am working on this project alone
Just wanted to raise that the url redirecting from Carbon Aware SDK repo and IEF repo lead to: https://github.com/Green-Software-Foundation/hack/blob/main/FAQ.md which does not exist in this repo. Is this going to be added later on? or are the URLs safe to remove from both repos?
For reference, its the last url on the screnshot in the README files:
https://github.com/Green-Software-Foundation/carbon-aware-sdk/blob/dev/README.md
https://github.com/Green-Software-Foundation/if/blob/dev/README.md
Building a plug-in for Impact Framework
The idea comes from this discussion.
Large Language Model(LLM) has evolved rapidly over the past year and has shown great potential in many areas. At the same time, we cannot ignore its impact on the environment.
Therefore, we would like to conduct a survey on the existing LLMs to generate a manifest file that could be used to calculate the energy and carbon consumed by LLM training. The actual models/calculations are not requirements here - it is enough to create a manifest file that could run as this will expose gaps in the current stack.
.yaml
fileAt the moment we have no questions.
If there are relevant suggestions or resources, feel free to leave a message.
Yes and we aren't recruiting
Team members: @Xiaoliang1122, @Irenia111
Enhancing the Impact Framework
I plan to build an intuitive interface, either a GUI or TUI, aimed at simplifying the process of generating manifest files for software projects. This tool will lower the entry barrier, making green software practices more accessible and appealing to new users, thereby encouraging widespread adoption and contributing to a more sustainable software development ecosystem.
Is this project idea viable considering the current stability of the manifest file specifications?
Would a TUI, as an addition to the current CLI offering more integrated process support, or a GUI, capable of displaying more details such as graph, be more suitable?
How should the configuration of plugins be handled? Should it include plugin-specific questions (at least for the standard library) or simply provide an input field with a reference to the plugin documentation for configuration details?
Yes and we aren't recruiting
Best Plugin
Prometheus is an open-source systems monitoring and alerting toolkit originally built at SoundCloud. Since its inception in 2012, many companies and organizations have adopted Prometheus, and the project has a very active developer and user community. It is now a standalone open source project and maintained independently of any company. To emphasize this, and to clarify the project's governance structure, Prometheus joined the Cloud Native Computing Foundation in 2016 as the second hosted project, after Kubernetes.
Prometheus collects and stores its metrics as time series data, i.e. metrics information is stored with the timestamp at which it was recorded, alongside optional key-value pairs called labels.
We propose to build an Prometheus Importer which will facilitate the consumption and processing of metrics through Impact Framework, especially in a Kubernetes environment.
We plan to allow PROM queries to be used as input for our model, with a specified aggregation window. The resulting array of measurements would be further processed by other models in the pipeline.
This would be especially useful if and when the Impact Framework is deployed within a Kubernetes environment, significantly reducing the overhead of preparing the measurements to be used in the manifest file.
Yes and we aren't recruiting
@ParvanAndrei @MXG99 @laurandrei994 @AmeliaCrizbasan @AlexHusleag @angelcataron @hyper11011
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.